Babies have developing immune systems, so maintaining good hygiene around feeding equipment is particularly important. Even when bottles look clean after washing, microorganisms can remain in small areas such as nipples, bottle caps, valves, and other components.