@AryaWolfgar I think he's referring to all the times that he meant "I love you" platonically. Lily would always not misunderstand it, basically, understand that he meant it as friends. Now he says she should misunderstand, meaning she should assume he meant it romantically