Physical restraint is part of the culture in some specialist hospitals, a care regulator finds.