Babies are vulnerable to infections caused by bacteria, viruses, and germs that often lurk on feeding bottles, breast pump parts, pacifiers, teething toys, and milk storage containers. Even a small trace of milk residue can lead to harmful bacteria growth.