A 66-year-old man has been arrested over the theft of the toilet, which was part of an exhibition.