I owned an Acura Integra Type R (sound deadening removed from the factory) for about 2 years, drove it on some really long trips, and it wasn't that big of a deal. I thought I wanted something more "civilized" and "mature" and sold the thing for a Lexus. I've missed it ever since.
No biggie for me, as I love the sound of the mechanical marvels we drive.
Now I won't do an aftermarket (read: loud) exhaust with no sound deadening. That's my breaking point for a daily ride. So we all have limits
