So, luckily she did us all a favour by bringing him along a pair to the 'Britain's Got Talent' press launch on Thursday.
The judge turned up at the show's official press launch on Thursday brandishing a pair of specially themed Union Jack boxers.
She's probably also keen to get her own back on her boss after he mocked her marriage to Les Dennis.
Simon joked that her marriage to the former 'Family Fortunes' host was the reason she found fame.
When Amanda was asked on the first episode of 'Britain’s Got More Talent' when she first realised she was famous, Simon siad: “Marrying Les?”
Amanda replied: “Oh bog off! I forgot about that – but probably!”
The pair were married for five years before splitting in 2000 following her affair with Neil Morrissey.
Back on the red carpet, Amanda played in simple in a skinny black trouser suit, while fellow judge Alesha Dixon went for the much louder option in a statement print dress with killer heels.
The pair played down any sort of fashion war though by puckering up for a kiss under the watchful eye of Simon.
Along with David Walliams and hosts Ant & Dec and Stephen Mulhern, they all were at the ICA in London to preview the first episode of the show, which hits screens on Saturday.
We can't wait.