You can do that.

However, you need to convince the immigration officer when you land that your intention is indeed to be resident of Canada. It's unthinkable to have a small child separated from parents.

Once landed, you can re-apply immigration visa for your child at whatever time convenient to you. It just takes a while and costs application fee.