I dont think the problem comes from doing it with a baby, it comes from not stopping it after theyre old enough to talk themselves. Speaking in an infantilized way to a growing kid is a terrible idea.

At one of my jobs there is a customer with a 10 year old daughter that she talks to like a small child. Despite the kid being 10, she acts/talks like shes is still 6 or something. Its sad to see