Yes, but only after taking damage, and their retreat is because they have too high supression. So they are usually rendered ineffective at this point, unless you can rally what's left of them.
I'd like some units to Withdraw from fire, to avoid casualties and maintain low supression.