Things looked tense last night as the X Factor judges and producers gathered for crisis talks over the controversy on Sunday night's show.
The Irish judge was at the centre of Sunday night's storm when, after originally choosing to save Carolynne Poole he sent the vote to deadlock, amid accusations he had been told to do so by a producer in order to save controversial contestant Rylan Clark.
However, in stark contrast to Gary and Tulisa, who both looked ready to drop as they left the meeting at the Arts Club in London, 60-year-old Louis looked to be the life and soul of the party as he laughed and joked with a female pal.
During the chat - which host Dermot O'Leary and the executive producer who was spotted talking to Louis during the sing-off on Sunday were also present - Gary is said to have threatened to quit the show if a similar scandal happens again.
So with X Factor and controversy more inextricably linked than Ant and Dec, could this series be Gary's last?