A pacifier is not 100% water- and airtight. When a pacifier is boiled or sterilised, a vacuum may form in the silicone sucking section. This is caused by the big jump in temperature during cooling. After a while, once the pacifier is sufficiently cooled, the silicone section will fill with air again on its own.