The 83-year-old former prime minister said: "My inappropriate comments caused a big trouble. I am sorry."
The Tokyo games have been postponed because over the coronavirus pandemic.
Japan is currently due to host the sporting event from July 24, but it could be pushed to the end of the year.
Six million people have been advised to evacuate.
Heading off to the Rugby World Cup or 2020 Olympics? This guide will give you travel inspiration.
A man wielding a knife has attacked a group of schoolchildren at a bus stop in south Tokyo. Sixteen people were injured and two died, including a 12-year-old girl and a 39-year-old man. The attacker later died in hospital from self-inflicted wounds.
16 people including 15 young schoolgirls were injured.
Emperor Akihito is the first Japanese monarch to step down from the throne in more than 200 years. The 85-year-old is abdicating due to age and declining health.
A self-driving car service could be on Tokyo’s public roads in time for the 2020 Olympics as Japan looks to drive investment in new technology to drive economic growth.
Because of course they needed a new one.