Female MPs are put off contributing to Prime Minister's Questions by its "histrionics and cacophony of noise", according to John Bercow.
The Commons Speaker said Parliament was "spray painting its own shop window" by appearing to generate higher decibel levels than Deep Purple, regarded as the loudest band in the world in some quarters.
He also claimed there are "down-market parts of the media" who would "positively relish" it if there was a fight on the floor of the Commons chamber.
Mr Bercow told BBC Radio 4's PM programme that "seasoned parliamentarians" boycotted PMQs out of embarrassment while some female MPs did not want to take part in the session.
Mr Bercow said: "Not just people standing down but people with a lot to contribute, reluctant to engage in the chamber because they think that the histrionics and cacophony of noise are so damaging as to cause them to look elsewhere.
"But I'm sorry if some of those people are lost to the chamber because they think, 'I'm not going to take part in that atmosphere'."
Mr Bercow was asked if he had heard back from the party leaders after he sent them a letter about the conduct of MPs in the Commons.
He replied: "I have heard back from the party leaders.
"There is a general sense, 'Yes Mr Speaker you make a good point and of course we must behave well and try to impress the public and give serious consideration to what people think', but there's not yet much by way of a specific commitment."
Mr Bercow went on: "I know there are people in the Westminster beltway, including in the press gallery, who think, 'Well, what's the Speaker moaning about? Why is he so neurotic? This is the way people like it'.
"To which my answer is no, that's the way you like it.
"There are people in the media, I don't say people necessarily representatives of the PM programme on BBC Radio 4, but there are people in some of the more down-market parts of the media who would positively relish it if there were a physical fight on the floor of the chamber."
TOP STORIES TODAY
In a wide-ranging interview, Mr Bercow was asked about expenses, in the wake of former Culture Secretary Maria Miller's case, and MPs' behaviour, following the not guilty verdicts in the trial of former deputy speaker Nigel Evans.
Mr Bercow said: "If we've changed we have to find ways of explaining how things are different now from what they were.
"And if parliamentarians where they do still have a say over their own colleagues' conduct, reach a different view from say some independent observer or judge, well then we've got a duty to explain perhaps rather better, perhaps more simply, perhaps earlier in the media reporting of a row why we've taken a different view.
"I think in recent weeks we neglected that duty and a story against Parliament was out there before we'd even begun to fight back."