Once you got used to drive regularly you don't get stressed out anymore. That only happens if drive somewhere that you have never been before and it is difficult to navigate.
City traffic is only annoying right in the center of a city and there is rarely a need to drive there.