Lily said she loved being a mum to Ethel, three, and Marnie, one, but didn't 'have the concentration span for that kind of thing'.
So the girls' dad – down-to-earth builder and decorator Sam Cooper – said she should start writing and performing again. And she hasn't looked back.
Lily, 29, told Australia's Channel 9 host Richard Wilkins that she doesn't feel she deserves Sam, saying: "I still don't feel worthy of my husband. He's an amazing person. I am very lucky to even have contact with someone like that never mind be married to them and have children."
The star, who is in Australia for a five-day tour, told Wilkins about her short-lived retirement from the pop industry.
She explained: "I had no intention of coming back when I did take the time out.
"I just thought I'm going to be such a great mum. I'm going to be pureeing vegetables all of the time and being really patient and building Lego.
"As much as I love spending time with my children I haven't got the concentration span for that kind of thing."
But it was Sam who convinced her to go back to music.
She said: "I was yearning for something and I didn't know what it was that I wanted. It was when my husband suggested, 'maybe you need to start writing again'. It made feel better."
Lily met Sam five years ago at Glastonbury and said that was the reason she shot her latest video for As Long As I've Got You at the festival.
She said: "It's a song about my contentment about my relationship with my husband and the fact that I've got children.
"It's saying that as long as he's there then everything will be fine."
More on Parentdish: How to plan a mumback like Lily Allen
Suggested For You
Get top stories and blog posts emailed to me each day. Newsletters may offer personalized content or advertisements. Learn more