@Kaarme: About that with the wild beasts wandering in. In most cases strong beings hold their territory. If you slaughter them chances are, weaker will try to take it. And until a really strong one emerges and lucks out, by not being constantly challenged and getting gut and exhausted, there will be infighting for some time. On the downside those new inhabitants don't know where the borders are, but overall the situation becomes better. And you have no guaranty, that the new boss is really stronger or more aggressive, than the old one. So cheer up, things look better in the fight against beasts.
About the dangers by man, I can't say too much as I don't know the setting too well.