I don't notice it. I do get home from work around 5-6 so most of the traffic has come through. If you are doing normal things (cooking a dinner, watching TV, showering, etc.) you wont notice it. At least I never do.
I would worry more about having good neighbors (for noise purposes) being...