Ex-party officials told BBC Panorama the accusations should set “alarm bells ringing across the party”.