Looking back, that explains why Ryuji was acting so jaded and prejudiced although he knew who he is, he was very cautious what others will see when he hang out while dating Makoto especially when they went out ice skating together.
Shame Ryuji issues weren't resolved in the main story, think he suffered the most even compared to Makoto, it was his internal battle with who he is and what society would react to if he step out of the line.
Thanks for the scanlation!