Troubleshooting Milk is getting inside the diaphragm and does not go down to the bottle. Why is that? Make sure you hold the pump upright; as if you bend it milk cannot go through and gets trapped inside the diaphragm.