Words that can't easily be translated (e.g. honorifics and words like "itadakimasu") should, I think, stay in Japanese.
When it comes to common Japanese words that can be translated and that most readers will probably know (e.g. "kawaii"), it's up to you. Personally, I'm okay with leaving them...