Personally i would strengthen my forces at the openings of enemy space. I would wait at maximum 5-10 turns for a replacement player to join, only attacking fleets if they attacked me. After that i guess it is only fair to either wipe them out or take them over. Of course if they do any irreplacable damage it is only fair to capture some planets/ships for compensation!
