Nah! Just own it!
Go all in, dress up like an old-timey ice-cream seller or something; white shirt, pinstriped vest, the whole shebang.
With an outfit like that, folks'll just think it's natural for you to be eating cake.
... you just need to take care to mind your manners, no slouching or hunching.