Babies have delicate immune systems, which makes them more vulnerable to bacteria, germs, and infections. Everything that comes in contact with their mouth—bottles, nipples, pacifiers, breast pump parts—needs to be 100% sterilized.