The Tory MP sacked from his government job for attending a Nazi-themed stag party now faces a criminal investigation by the French police.
Aidan Burley had said he was extremely sorry after he was caught taking part in a Nazi themed stag-do that involved Hitler salutes and SS officer uniforms.
Speaking on Thursday he said he was "not the focus" of the investigation. "They are launching a preliminary investigation and I understand I am not the focus of it.
"I do not believe I have broken any French law and have distanced myself from the behaviour of other people on the stag."
Within a week David Cameron had sacked him as a PPS to transport secretary Justine Greening after it emerged he may have hired the SS costume.
Now the French authorities will investigate Burley and the 12 friends who accompanied him on the stag party after receiving a complaint about "inciting racial hatred and glorifying crimes against humanity". If found guilt, he could face six months in jail.
Politicalscrapbook reported that there had been "official complaints from anti-racism organisation SOS Racisme and the owners of the restaurant" the do was held in.
A party spokesman said on Saturday, before news of the investigation emerged, that David Cameron was investigating Burley: "Aidan Burley has behaved in a manner which is offensive and foolish.
"That is why he is being removed from his post as Parliamentary Private Secretary at the Department for Transport. In light of information received the Prime Minister has asked for a fuller investigation into the matter to be set up and to report to him."
Labour MP Ian Austin said the Conservative whip should be withdrawn from Burley on Thursday, adding: "David Cameron and the Tories tried to brush this under the carpet, but the scandal surrounding Aidan Burley's disgraceful conduct is not going away.
"Surely the Prime Minister must take the whip off Mr Burley while this investigation is taking place."
The leader of Cannock Chase Council, Labour's George Adamson, said Mr Burley should resign.
"I think he's brought shame on Cannock. His behaviour was appalling, there's no excuse for what happened," he told Sky News.
"This was pre-planned, that uniform didn't appear as if by magic, this was all planned in advance.
"It's disgusting, it's illegal in France, and the authorities, quite rightly, are investigating the matter."