This is a unique feature in parliamentary system. The cabinet is collectively responsible to the parliament. Every minister has to support the decisions of the cabinet. They will remain in office as long as they enjoy the confidence and majority support in the legislature. Otherwise, the entire ministry will have to resign if it is voted out by the legislature through the no-confidence motion.
