Just as losing your ships bridge means your crew has a hell of a time piloting their ship, thus reducing movement to one.
When you lose your crew quarters, all your staff are stuck (presumably) with sleeping on the bridge, and with all the snoring and so on, they have a hard time getting anything done. So be glad they can move at all
