Nope, he does not care.
He is perfectly capable of expressing himself, as shown with Bridey's younger siblings.
Try not to forget that dress the father gave her in the early chapters, it was clearly to mock her.
Bastard is probably only acting like this to try and make her a pawn easier since he only started when Bridey talked down to him on how much her mother loved this fool.
And Blondina likely only had that feeling because she was surprised and perplex on why he showed up.