tl;dr Not sure if there's a language barrier here or if the concept is somehow unique to the U.S., but your "hometown" isn't necessarily where you live right now, it's where you grew up. Haruka was living in Tokyo in Kazuma's place, so it makes sense to be "exiled" back to her hometown i.e...