Local militia can be awfully weak. As an example, Mictlan gets some slaves, and Pythium unarmoured militia. Jotunheim's and Ulm's pd can often be worthwhile, but I still prefer real troops in borders. However, when playing Ulm, I only have to bring infantry, and with Jotunheim, archers. The pd is the other half.
When you plan to have a strong army in a province for a while, not having a fort may be the better choice. In a no-fort province, everyone who isn't hidden will fight against an invasion. In a province with a fort, only patrolling units and PD defend against an initial invasion.
In the late game, you have to be careful that your patrolling forces are strong enough to deal with multiple castings of ghost riders (or strong forces teleporting / astral traveling in).
__________________
Wormwood and wine, and the bitter taste of ashes.