Ministers say work can carry on if people are two metres apart, but critics say public health comes first.