We don't know if the landlord is a youkai, but keep in mind that she freaked out a bit when she found out the kappa was a real kappa. The youkai are kept somewhat hidden from the world. So she could have met youkai before, but have just been completely unaware that they were youkai.