Yes, as Graeme stated, you have to kill the caster of the spell or dispel it. Though in SP, I personally have found that killing the pretender/prophet is usually the one who casts the spell. Though on the off chance you arn't able to kill them and kill a pretender via Preaching, you will be up the Gangi's without a paddle if you can't dispel.