Babies’ immune systems are still developing during the first year of life. Any exposure to germs through feeding bottles, nipples, or breast pump parts can lead to stomach infections, diarrhea, or even more serious illnesses. Washing bottles with soap and water alone may not remove all harmful bacteria.