I think the "release all magic" didn't just remove the mask, it removed whatever curse he had on him that was making him ugly. That or her idea of beautiful is different than this worlds beauty standard because of her past life memories. Like how in lots of reincarnation/isekai stories, Asian features of black hair and black eyes are considered cursed...