To be fair, all he said on screen for us so far is that he's going to maintain peace. Obviously, there's about a 99% chance he's a cheesy villain noble because isekai tropes, but he could also have become misguided (it never said who actually made the accusation) by someone else and will end up being the MC's supporter after the misunderstanding has been cleared up.
But yes, odds are he's the one making the accusation and he did so because he wants to turn the MC into his little inventor bitch boy or something.
So, according to the noble, Jin used his own golems to attack himself and destroy his own property, then he in turn destroyed his own golems, only to rebuild them later? Sounds like a typical, super intelligent isekai noble alright.