The carbon nano-tubes in their final form will not affect the armor if a few are broken after the machining process.I also always wear that armor

It's low profile

Also, machining errors would not be as noticable on personel armor, but rather on ship armor, where the nano-tubes redirect the energy into redirection chambers which slowly bleed off the energy into the shields and weapons systems.