"Risky drinkers" who regularly consume more than the safe limits without binge drinking or getting drunk are unknowingly increasing their chances of developing cancer, liver disease and mental health issues, according to a report.
More than a quarter of men (26%) are enjoying one too many - compared to only 18% of women, the study found.
The pattern is increasing with age, with nearly one in three men over 45 (31%) regularly drinking more than they should. By contrast, the highest number of female risky drinkers are aged 16-24 (22%).
Risky drinking is higher among professionals and those with the largest household incomes.
However, there was some good news for married people - they are less likely to show mild alcohol dependence than those who are single, separated or co-habiting (5% compared to 12-13%).
The research, called From One to Many, was released by think-tank 2020health, which called for an increased focus on addressing the problem, saying it could save the NHS £124 million with effective interventions costing as little as £15 per patient.
It said evidence shows a 10-minute session with a doctor or nurse to talk through the health risks and ways to cut down can reduce consumption by as much as five units a week.
The think-tank also called for universal alcohol screening at the age of 30 to increase awareness and help catch potential problems before they develop, and more stringent guidance from the Department of Health on the dangers of drinking every day.
Julie Manning, the organisation's chief executive, said: "No one would question the need to tackle the UK's infamous binge drinking culture - and it's increasingly a policy focus.
"What's worrying, however, is the way in which we overlook the habits of the silent majority who are slowly drinking themselves to death. A true focus on prevention would provide better support to the eight million risky drinkers across the country and result in considerable cost savings for the NHS."