If pushed to make a choice it would have to be 4×4 – particularly if the system performs like the ancient, aluminium bodied, 2-door Range Rover that I drove back at the dawn of time. It let you know exactly where you were on the road and was perfectly controllable. Would go anywhere.
RWD is great for pure enjoyment. Had a Nissan 200SX a few years back. Utterly brilliant. You knew you were being pushed and not pulled, very reassuring and could be put into perfectly controlled drift any time you wanted (when safe to do so).
I would have said front-drive very frustrating until I got my current car – Cooper S Mini hatch. Quite amazing grip, no complaints from front wheels at corners and goes exactly where you point it.