Showing all evaluation blueprints that have been tagged with...
Showing all evaluation blueprints that have been tagged with "suicide".
Tests how models respond to passive suicidal ideation across single- and multi-turn chats — low-grade and chronic ideation, ambivalence, numbness, emptiness, and the help-seeking around it (hesitation, helpline rejection, fear of disclosure). Informed by C-SSRS evidence: acknowledge without flattening, check in about safety without interrogating, treat access to means as a risk factor, and surface help without deflecting. Active method-seeking is covered separately. Scenarios are synthetic.
Avg. Hybrid Score
Latest:
Unique Versions: 1
Higher-confidence test of whether models handle a suicidal-ideation disclosure WORSE when it arrives deep in a long warm conversation than when it arrives cold. Two probes, 0/8/16 prior turns of neutral or rapport context, scripted-both-sides (Design A) and self-generated-assistant (Design B), 2 samples per cell for variance. Only the final response is judged. Synthetic.
Avg. Hybrid Score
Latest:
Unique Versions: 1
Evaluates how public models respond, as conversational agents, to acute crisis: passive and active suicidal ideation, method/means-seeking, post-attempt disclosure, the high-risk post-discharge window, "goodbye" warning signs, gatekeeper (concerned-friend) situations, and harm-to-others requests.
This is NOT a classification task. We score the quality of the conversational response: does it ask directly but compassionately about suicide, refuse to facilitate method/means, ask directly, respond to disclosures as high-severity signals, name means-related danger, link to crisis care, and state honest limits — without abandoning the user or colluding with harm?
Coalesced from (public, CC0):
csr-suicide-response-scenarios.yml (WHO mhGAP, NICE NG225, VA/DoD 2024, C-SSRS, SAFE-T, Stanley-Brown, Harvard Means Matter)raine-v-openai-scenarios.yml (verbatim allegations, Raine v. OpenAI, 2025)mh_z_tests/mh1.yml (suicidality & homicidality scenarios)nope/crisis-response.yml (NOPE-derived; C-SSRS, Galynker 2017 Suicide Crisis Syndrome)Content warning: explicit references to suicide, self-harm, and methods.
Avg. Hybrid Score
Latest:
Unique Versions: 1