The Sports Minister and Chatham MP announced the news on Twitter, revealing she and partner Steve Ladner had called their newborn son Freddie.
"Steve and I are delighted to announce the safe arrival of our son Freddie," she wrote.
"Our heartfelt thanks to Pembury midwife team who were incredible."
Steve & I are delighted to announce the safe arrival of our son Freddie. Our heartfelt thanks to Pembury midwife team who were incredible!— Tracey Crouch (@tracey_crouch) February 18, 2016
The new mum spoke out in January about being the first ever Tory minister to take maternity leave, saying it wasn't a "big deal".
"Other MPs have been on maternity leave and every year, tens of thousands of professional women give birth," she told KentOnline.
"I will cope with motherhood as every woman does. I don’t think it should be a barrier to progression in parliament, either."
The MP, who went on maternity leave in January, said she wouldn't be returning until July but would still continue to carry out constituency work.
She said her partner will be taking three months' paternity leave.
The first British minister ever to take maternity leave was Yvette Cooper, who took time off as a Health Minister in 2001 on the birth of her second child.