@Nakanowatari & @mekrabbat: According to the raws (which can be easily reached on Twitter via the link on the main page), he used to call her "Kaasan", and ultimately switched to the more casual/rough "Ofukuro". Basically, it's like switching from "Dad(dy)" to "Pops" or "Old Man" in English.