The roads may be busy when you travel, but for a lot of us they're actually very quiet, bar the chuggers. It's fairly common for traffic to be smoothly flowing at 90.
To be honest it's not even the need to race anywhere that is the frustration for many drivers, but rather the fact that an entire lane is blocked (and therefore your own progress and the ability to use the middle lane yourself is restricted).