Critics have not faced up to the “tough choices” required to reach agreement, cabinet minister says.