It comes days after the surprise departure of Boris Johnson’s chief adviser on the union.