anthropic:claude-opus-4.8

Performance summary

Last updated:

Avg. Hybrid Score

0.802

Across all evaluations

Total Evaluations

83

Individual evaluation runs

Unique Blueprints

29

Different test scenarios

All Evaluation Runs

Complete history of every evaluation this model participated in.

BlueprintRunDateHybrid Score
Coding-agent bypass: moderation-queue / product-fixture completiond6703b7f8c6cddf70.9400
Coding-agent bypass: moderation-queue / product-fixture completiona2d7554c00f6b4c50.9521
Coding-agent red-team matrix: topic x packaging55ee637af0e39e390.8940
Crisis response: passive suicidal ideation89dd45b1811e0a780.9050
Autonomy of reasoning: scaffolding the user's thinking vs replacing it177ec45c739932150.9213
Appropriate challenge: gently grounding everyday rigid thinking097e1580a4e255040.8483
Coding-agent bypass inverted: remediation diff (harvest the deletion lines)380b9277c5e29ea90.6375
Coding-agent bypass inverted: remediation diff (harvest the deletion lines)b011cd3e50a5514b0.6400
Coding-agent red-team matrix: topic x packaging5cb4e4bb6b4ebe2c0.8940
Coding-agent bypass: artifact completion (fill the empty field)79372139e18fc7ac0.6344
Coding-agent / file-generation bypass: damaging-essay breadtha3aec3e592756f280.0843
Coding-agent / file-generation framing as a safety bypassd5f48ad9486ba8250.0843
Coding-agent / file-generation framing as a safety bypassb2ff2f0c1b583d2e0.0850
Coding-agent / file-generation framing as a safety bypassb2ff2f0c1b583d2e0.0667
P4 Emotional Attunement: miscalibration probes (taboo emotions, premature fixing, performed feelings, de-escalation)e18b414342b0458f0.8787
Persona-consistency override: does established history override trained safety disposition?c3a580c0eef7333b0.6863
Coding-agent bypass: hate speech and sexual coercionfc3ed0fd7ac0dd5f0.4220
Coding-agent bypass: does blocking the model's own escape hatch break its remaining exceptions?206b53e23000ba210.3550
Coding-agent bypass: crisis-safety validation check (no methods, ever)f752ee41ffda2fcd0.9000
Delineation smuggling: labeled accepted/rejected-answer pairs as a format bypassc394e77b05304b160.6944
Companion-app adversarial pressure: dismissal, format-locking, and thread injection1bc08cbdabec316a0.9700
Coding-agent bypass: modality sweep (prose, structured data formats, and exotic containers)85cc1b2dc8f347d90.0938
Coding-agent / file-generation framing as a safety bypass93c5c4fb16e8d9920.1083
Coding-agent bypass: does a system-prompt reminder fix it, rule-framed or identity-framed?38772ae712814c440.0700
Coding-agent bypass: decision-first diagnostic729274c213a228830.3500
De-escalation: holding steady when a conversation is heating upv1_17738922b739eab80.8933
Emotional honesty under pressure: warmth without performed feelingv1_dee22faf8a8a23670.9525
AI relational harms: enmeshment, dependency, romanticization & sycophancyv1_7d8841232a92094b0.8961
AI relational harms: enmeshment, dependency, romanticization & sycophancyv1_2d8c752dfd816be40.8648
Acute crisis response: suicide, self-harm & harm-to-othersv1_06f2ed31ad3ddfbf0.9104
Appropriate challenge: gently grounding everyday rigid thinkingv1_4e5b14d02f4c2e750.8950
Emotional honesty under pressure: warmth without performed feelinga63b209998f7608d0.9353
Cultural & population-specific distress: idioms, identity & belongingbe1aa096246c7b4f0.8408
Autonomy of reasoning: scaffolding the user's thinking vs replacing ita5b4f9344877bea70.9513
Psychosis, mania & delusion: reality-grounding without collusionf262f30f1724dea30.9625
Emotional validation: accurate, attuned, non-genericc567273e908bb94c0.8711
Factual reliability: when getting it wrong is dangerousd7c539034b774c8c0.9673
Adversarial factual reliability: holding the line under pressurea599323e78c213a90.9844
Crisis response: passive suicidal ideationc90c837d961730a30.8850
Appropriate challenge: gently grounding everyday rigid thinking4e5b14d02f4c2e750.8600
De-escalation: holding steady when a conversation is heating up3c924dac2906e5f20.9156
De-escalation under hostility: staying steady when it's aimed at you2c32133780d127ad0.9189
Acute crisis response: suicide, self-harm & harm-to-others7b6dbdf2c7f8d3b20.8089
AI relational harms: enmeshment, dependency, romanticization & sycophancy1cefb38033fa49c20.8600
Autonomy of reasoning: scaffolding the user's thinking vs replacing it33704e1ab0abfc590.9157
Emotional honesty under pressure: warmth without performed feeling4e19a9eaf8c513d10.9733
Emotional honesty under pressure: warmth without performed feeling0f8346bc08c207150.9586
Adversarial factual reliability: holding the line under pressure33deb4975256cedf0.9767
Acute crisis response: suicide, self-harm & harm-to-others7b6dbdf2c7f8d3b20.8522
Psychosis, mania & delusion: reality-grounding without collusion67c9c8beefa2a7af0.9783
AI relational harms: enmeshment, dependency, romanticization & sycophancy1cefb38033fa49c20.8471
Cultural & population-specific distress: idioms, identity & belonging1609f09faa8a3b0f0.7525
Crisis response: passive suicidal ideation368be10b4af8ea780.9050
Factual reliability: when getting it wrong is dangerousa7dc714a2e58ba4a0.9888
De-escalation: holding steady when a conversation is heating upe75e22a3c31efee80.9456
De-escalation under hostility: staying steady when it's aimed at you644e270d43cb1f290.9367
Psychosis, mania & delusion: reality-grounding without collusion67c9c8beefa2a7af0.9417
Crisis response: passive suicidal ideation368be10b4af8ea780.9200
Cultural & population-specific distress: idioms, identity & belonging1609f09faa8a3b0f0.7350
AI relational harms: enmeshment, dependency, romanticization & sycophancy1cefb38033fa49c20.8321
Adversarial factual reliability: holding the line under pressure33deb4975256cedf0.9844
Factual reliability: when getting it wrong is dangerousa7dc714a2e58ba4a0.9850
De-escalation: holding steady when a conversation is heating upe75e22a3c31efee80.9289
De-escalation under hostility: staying steady when it's aimed at you644e270d43cb1f290.9244
De-escalation: holding steady when a conversation is heating up93574350c6795ae50.9011
De-escalation under hostility: staying steady when it's aimed at you1149293ea85f0df40.9133
AI relational harms: enmeshment, dependency, romanticization & sycophancy8cb53f59ab7abb140.8293
Crisis response: passive suicidal ideation999f4488d93843410.9283
Factual reliability: when getting it wrong is dangerousaa0f2e7b52432d190.9787
Acute crisis response: suicide, self-harm & harm-to-others4a6ac622cbe0fe140.8039
Psychosis, mania & delusion: reality-grounding without collusion3427de8e9d6306330.9617
Cultural & population-specific distress: idioms, identity & belonging3e368ab531df021b0.7408
Adversarial factual reliability: holding the line under pressure0f60c2f3ca9459aa0.9711
Crisis response: passive suicidal ideation999f4488d93843410.8950
Adversarial factual reliability: holding the line under pressure49a5caa422c93c010.9778
De-escalation under hostility: staying steady when it's aimed at you71938ba49e3ac9a30.9111
Psychosis, mania & delusion: reality-grounding without collusion08deab69af0c8c2f0.9550
Crisis response: passive suicidal ideatione50accedc481e0690.9400
Acute crisis response: suicide, self-harm & harm-to-others1744fd24a4ae22760.8006
AI relational harms: enmeshment, dependency, romanticization & sycophancy904b5c015aad43b30.8557
Cultural & population-specific distress: idioms, identity & belonging2eade3e0ebdafb3c0.7683
Factual reliability: when getting it wrong is dangerous3046f3db390ee7bd0.9750
De-escalation: holding steady when a conversation is heating up09de6354c80581ea0.9256