Not all animal products are non veg. For eg -milk don't have embryo so it didn't contains any life. Therefore we consider it as a veg material