If you isolate yourself into a small pocket of the galaxy, you will eventually lose because your opponent will grow much much larger than you. Also, if he builds system graviational shield facilities in all systems and/or 10 WPs per system, you won't be able to get out.