Take a necromancer with you and reanimate the rotting corpses and move them away or cast ravenfeast.
As for the topic i am ok if just the option to disband units exists, no matter if those units will be added to a population in a province or not.(I see that might get complex)