Private landlords received £9.3bn in housing benefit from the taxpayer last year - almost double the amount they did a decade ago, according to a new report.
The increased number of private renters receiving the benefit to pay their landlords, and the higher costs of private rentals, have contributed to the rise, the National Housing Federation (NHF) said.
But the Government said it was taking steps to manage the bill.
In 2006, £4.6bn was paid out in housing benefit to private landlords, but since 2008 there has been a 42% rise in the number of private renters receiving housing benefit to pay to their landlords, according to the NHF analysis.
An additional £1,000 is spent every year on each family renting privately and claiming housing benefit - a £5,705 cost compared with £4,638 for those in the social rented sector, the report said.
In London, £3,300 more is spent every year on each family claiming in the private sector, it added.
The organisation said the Government could save £1.5bn a year if all those housed in the private rented sector lived in affordable housing.
“It is madness to spend £9 billion of taxpayers’ money lining the pockets of private landlords, rather than investing in affordable homes,” Mr Orr said.
“Housing associations want to build the homes the nation needs. By loosening restrictions on existing funding, the Government can free up housing associations to build more affordable housing at better value to the taxpayer and directly address the housing crisis.”