If it were me, I'd make it so when you click on a sector with more than one planet but only one colony, the colony is auto-selected. You can also click the little back arrow in the corner to go back and look at the unpopulated worlds if'n you have a need to. Same thing for the Next/Previous Colony selection buttons.
But that's just me.
