I'm sorry. But with his ability, I would be killing EVERYTHING, no matter how weak. Everything stacks on, so even goblins would strengthen you.
If you compare the stats, that incredibly difficult golem fight only gave him 10 goblins worth of attack and health, and 20 goblins worth of defense.