Having a few low-level priests on hand can wipe out huge numbers of dispossessed spirits.
They're undead, and their lonely hit point means that if they even catch a whiff of banishment they burn up in a hurry. You can still bring the elephants along if you have the right counter-counters
