Seriously, I think the doctor can legally give him a sort of license or badge showing that he's the administered assistant for these patients and should be the one and only person responsible of them, in case of emergencies. Of course, there will be scumbags who might ignore it, but at least it'd easily explain this, and he still always has the watch the girls can use to call for help.