He was one of 21 MPs who lost the Tory whip after rebelling in a bid to stop a no-deal Brexit.