You are being left out because you are a Bernd. That's how we are. Accept it and thrive on it and don't find other excuses.
If you absolutely want to go with them to slack off you can always start to vape with nicotine-free liquids. It is probably still unhealthy though because you will have to breath in their smoke.