[thejeff]

You understand correctly.

Communion slaves will not cast if a master has already cast that turn. Any slaves who acted first still get the benefit of buffs and absorbs the master's fatigue.
So if you can arrange your master to be last on the list, there is no need for him to retreat.