Didn't all of this already happen like a couple of chapters ago? End even those two girls were there, so they must know they shouldn't bother him.
PS: the girl he stole the stone from was lesbian in the (if I got it right), so why she seemed so happy when she was leaving with him? this doesn't...