I don't like being rushed in a game, but I don't mind limits like in FO, mostly because it barely WAS a time limit. Well... it was, but despite taking my time, I never even came close to losing due to time.
What I really hate are false time limits, like "OMG THE SHIP IS GONNA BLOW!!!" and everything shakes and alarms go off, but despite everything, the ship isn't going to blow, nor are the orcs really going to invade if you don't hurry up. That's just lame. Don't do it!
I believe the problem is that every quest needs to be epic and often times the easiest way to make something feel epic is by claiming time is limited.