According to the chapter he said he has no intent of actually fighting cause of what he went through in the other world and just wanted to see the level that his summons are. His actual presence in the "real fight" as you put it had zero impact, which is doubled down on when his summon went buck...