@elemenopeee I think you've over estimated his position a bit, but he doesn't actually possess any power as of this moment. He might be a good, or even exceptional, fighter - but he is one person. The reason I think he excelled so much in the empire regarding the nights and the sorcerer was because of the enclosed space and the lack of any preparation.
Put simply, he is in no position to actually do anything about it, and he recognises this. The only "forces" he has is his friendship to the mercenaries, his achievement in the civil war was due to the military of the queen, and he merely directed it.
Basically he's only strong physically, but in terms of actual power he's severely lacking in that matchup. Just wait for the future - Ryouma hasn't forgiven the queen.