Gould gave birth to Oliver in March, and returned to work with baby in tow last month.
"As we join so many other Canadian parents who juggle the responsibilities of career and family, Alberto and I want to thank everyone for their kind words and support," Gould said in a statement announcing the birth of her son.
On Tuesday, several reporters noted that she had brought Oliver to question period.
"I'm glad I live in a country where this is normal and accepted (as it should be)," Canadian Press reporter Teresa Wright tweeted in reaction to seeing Gould breastfeed.
In 2016, politician Unnur Brá Konráðsdóttir breastfed her baby while addressing Iceland's Parliament about an immigration bill she had put forward.
"She was hungry, and I wasn't expecting to speak, so I started feeding her," the MP for Iceland's Independence Party explained. "Then a representative asked a question about a proposal I had put forward, which I had to answer. I could choose to yank her off and leave her crying with another representative, or I could bring her with me and I thought that would be less disruptive."
The world's top health experts recommend exclusive breastfeeding until a child is six months old with continued breastfeeding to age two and beyond. But breastfeeding in public is often a challenge for new moms, with many shamed for it.
A recent study found that 17 per cent of Canadian moms admitted to feeling embarrassed while breastfeeding in public. And breastfeeding can be especially difficult to navigate for working moms, who have to balance feeding, pumping, and work.
More from HuffPost Canada: