The Museums Association voices concerns after the culture secretary met heritage organisations.