Figures show 62% of councils did not take action against people misusing blue badge permits.