I got confused by the wording in the manual on this too.
It actually says, "Units which retreat are eliminated instead of being able to return to the fortress."
What that means is, they cannot break siege, then retreat to the fortress. The manual does not say they cannot retreat to a neighboring province.
I like it the way it works now (if you hadn't guessed that already
).