Hmm, my cavalry and priests seem able to go across rivers and woods at full speed of 2 or 3. The mountainous provinces slow them down, though. It doesn't seem like lack of survival skills impedes movement to me. They're described as simply reducing the chance of starvation.