Newborns and infants have developing immune systems that are more vulnerable to infections than those of older children and adults. Feeding bottles frequently come into contact with milk, which can leave behind residue that encourages bacterial growth.