Speaking to the Sun, Peter said Princess and Junior either love the songs on his new album, or totally hate them.
"The kids are quick to tell me when they don't like something," he said, "There are a couple of songs on the album they won't even listen to. They're my critics. I love it that they have their own ideas."
Peter also claimed that although seven-year-old Junior might not be his biggest fan, he does want to follow in his father's footsteps and have a musical career.
"Little J is an entertainer. I sometimes hear him singing in private. It's every parent's dream that their child is a doctor or an architect. But kids decide early what they want to do."
Peter won't be letting Junior or his sister Princess, four, make their professional debut in the very near future though, adding that he wants his kids to be older before starting work:
"I want them to be quite a bit older. I got offered a recording contract live on TV at 16 in Australia - and my dad wouldn't let me sign it until I'd left school. When they start really young they don't get a chance to do the normal things."
Do you agree with Peter about kids not entering showbiz until they are older, and having the chance to be 'normal'?