Normally independent castles are due to magic sites of the non-magic variety. Inside you usually find whatever independent units that the province can make, there's usually nothing special in there.
Although, in one of my games recently I attacked a province with 60ish Lion Tribe guys and when the turn came back Bogus and his merry band of heroes was there defending it. So you never really know, right?
