Yes, depends on how much air pressure there is. The downside to too much air pressure out is that you also suck out valuable cold air (in summer) or hot air (winter.)
If the air pressure isnt sufficient, you get some smoke coming thru, esp if the pipes are horizontal. Also depends on how much people spoke and depends on how many units the exhaust travels past before being sucked up into the building-top exhaust.
I used to live in a high rise which had a common pipe for extraction, I never had any odor coming in, and I know my neighbors were smoking since I would get smoke if the windows were open.