Disclosure norms for dangerous-capability evaluations

Abstract

Labs increasingly publish results from evaluations of dangerous capabilities, but rarely enough detail to tell what a score of zero means. We propose a short disclosure standard covering who ran the evaluation, how much effort went into eliciting the capability, which results were withheld and why, and what would have changed the release decision. We apply it to our own evaluations of Meridian 3 as a worked example.