Baby feeding bottles, nipples, and breast pump parts come in direct contact with milk, which can become a breeding ground for harmful bacteria if not cleaned properly. Even thorough washing may not eliminate all germs.