It does seem a rather odd mix.
The modern in appearance ship does seem most incongruous when combined with a quasi-medieval society. The presumption is that it's motive power is magic, such that it has no need for sails, but even so, the appearance being so close to one of our bulk transports, is the development that efficient that no other appearance would be made? It does appear to actually be of wood construction, yet resembles a metal constructed vessel to that degree?
And there's the whole, "I'm just a lowly villager" combined with, "everyone is relying on me to solve their problems" along with, "It's actually safe for everyone to trust me with their problems" thing.
I understand about the idea of not being in a prominent position, of desiring to stay in the background, but he has clearly failed in that, big time. He's a big wheel in his area, although he somehow deludes himself into believing otherwise.
The whole "if we all work together, we can find an equitable solution" shtick is nice in theory, but the larger the group of people involved, the harder it is to accomplish in real life. And, it's being accomplished here by their all deferring to him. Which is very much not working together, but rather acceding to him as the de facto ruler of the local polity!
My, and such an impressive residence he has. That one presumes he built on his own, out in the sticks, and which has luxuries that no one in town has. At the same time as his only known source of income is his farming and foraging? During good weather, which is when one would do such construction, his every effort would be focused on the work of his farm; Yes, once the outer shell is up, the rest could be constructed during the rainy periods, but when would he have had the time to put up the outer shell in good weather?
Yes, Chapter 1 has not been posted. I'm curious as to what explanation Chapter 1 provides for how things got to this point.
The other Isekai currently posting with similar concepts (kinda) all have an OP attribute/skill/tool involved to explain how he pulls it off. Nothing like that is being indicated here, other than general knowledge retained from his previous life.
All that said, final judgement will be withheld until more is posted, as this could be too small a sample for proper evaluation.