Yes, sterilizing your breast pump after each use is crucial to prevent bacteria buildup and ensure your baby’s safety. How to sanitize baby bottles by hand? Start by washing your hands well with soap for 20 seconds then take apart all of the bottle parts (bottles, nipples, caps, etc).