I've had my own spots of bad luck. In my first move of expansion I lost my prophet to some side-swiping infantry.
Then my capitol was hit with an unrest event.
Followed by a barbarian attack. The attackers were routed but the event caused even more unrest.
That however didn't stop me from commanding my units to construct my second castle on turn 3, or from my judges from putting to rest the insolence of my populace.