I have a feeling that without Nobu's influence the higher class patrons wouldn't have interacted with the more mid class to lower class patrons, while there is the possibility that they would eventually, Nobu just accelerated it and lessened/removed any notion of prejudice