I always try to manually rally units that are in the thick of it, but I also don't want to forget about a formation at the end of the turn (happens to me a lot with 100+ units in my force). So leaving it ON makes more sense to me and allows same control as OFF if I wanted to.