It can technically mean both at once, the reason it's considered an insult is it's basically calling someone plain or unremarkable.
(From dictionary.cambridge.org)
"UK. (US homey) plain or ordinary, but pleasant: The hotel was homely and comfortable."
UK is seems to apply more so to...