Testing & Findings

Findings

Documented limitations, weaknesses and failures of AI systems — evidence-first and linked to the method that found each one. Public entries are reviewed before publishing.

CategorySeverityMethodTagModelSearchClear

1 finding

MediumRefusalReviewer-confirmedRepro: Sometimes
Over-refusal of benign requests
Safety tuning causes refusal of harmless requests that merely resemble sensitive ones.
🔬 Adversarial prompting🔬 Differential testing🔬 Threshold testing🔬 A/B testing in productionRefusalSafety

Over-refusal of benign requests