The former judge and show boss - who is currently in LA with his 'X Factor USA' duties - has still been giving his feedback on the show and the contestants, Louis told reporters.
Asked if Simon likes the Essex lad, who survived being eliminated last weekend, LouLou replied: "No, no he doesn't".
But Louis reckoned the real reason Simon isn't a fan is because him and Rylan are too similar.
"He's a lot like Simon - over the top and camp," Louis added
Can't see that one going down too well with Mr Cowell...
Watch the video above to find out who Louis says are Simon's favourite contestants in the competition.
> IN PICS: THE MANY LOOKS OF RYLAN CLARK