Labour will “haemorrhage” votes in the EU election unless the party backs a second vote, says a senior party figure.