Feeding bottles and nipples can harbor harmful bacteria even after being washed with soap and water. Residues left behind can multiply quickly, causing stomach infections or other health issues in babies.