Yeah, I tried that. I actually put all the TRUE/FALSE toggles to FALSE. Doesn't make any difference at all O_O
I think the setting you are refering to is the Retreat When All Weapons Damaged thing, but it only seem to matter if the ships had weapons in the first place.