AFAIK the only time assassins don't assassinate is when there is no (more) commanders in the province. But Prov Def commanders aren't killable this way.
I think that I've had a scout attack an independent province and seen that there were two commanders. Then I assassinated two commanders, attacked, and had an enemy commander present. That ever happen to anyone else?