The former prime minister says the 2016 EU referendum turned into a “terrible Tory psychodrama”.