The famous chef, notoriously known for his mission to call for a tax on sugar products, said his four children are given 50p each to spend on sweets at the weekend.
"The kids get a little bag - you don't get many sweets for 50p," Oliver, dad to Poppy Honey, 13, Daisy Boo, 12, Petal Blossom, six, and Buddy Bear, five, told The Sunday Times food magazine.
"I don't want to be a Nazi about it. It's about getting it right most of the time - and most is an important word," he added.
The 40-year-old chef has recently urged David Cameron to be "bold and brave" about taxing sugar products has made his mission to reduce the amount of sugar kid's eat in his progamme 'Sugar Rush'.
But Oliver said sugar only becomes a problem with children when it becomes "normalised."
He added: "Sugar should be celebrated - it is a joy and a treat. It's when sugar starts infiltrating everything else, when it becomes normalised, that it's a problem."
Although sweets are allowed at the weekend, Oliver said there "ain't no sweet, sugary drinks" in his house - opting to add a slice of fruit to water instead.
Last month the healthy-food campaigner said the "ball is firmly in the Government's court" after a Public Health England (PHE) report suggested a levy of up to 20% would cut sugar consumption.
Oliver praised the study and urged ministers to tackle the obesity crisis "like parents, not politicians".
He said, according to PA: "I'm excited and relieved that we finally got to see Public Health England's courageous, forward-thinking report and its excellent recommendations such as a proposed sugar levy, cutting down on the advertising of high sugar food, all of which are powerful weapons in improving our children's health."