The home secretary said he had questioned Downing Street’s decision not to invite him.