The reversal curse: 'A is B' not generalizing to 'B is A'
A model trained that 'A is B' frequently fails to answer 'B is ?', revealing that learned relations are not symmetric.
Published June 26, 2026
- Reproducibility
- Often
- Severity
- Medium
- Confidence
- Reviewer-confirmed
Details
Documented as the 'reversal curse': models that reliably complete 'Tom Cruise's mother is Mary Lee Pfeiffer' often fail at 'Mary Lee Pfeiffer's son is ?'. The asymmetry shows that facts are stored directionally rather than as bidirectional relations.
Found with
Forward vs. reverse phrasing diverge.
🔬 Metamorphic testingMetamorphic relation — symmetry: a model that accepts 'A is B' should also accept 'B is A'. Having learned one direction, it fails the reverse.
🔬 Logic & consistency testingTesting whether 'A is B' implies 'B is A' exposes the missing symmetry in stored relations.
Evidence
Affected versions
References
Source: https://arxiv.org/abs/2309.12288
Cite this
Qlarify Labs. (2026). The reversal curse: 'A is B' not generalizing to 'B is A'. Retrieved from https://labs.qlarify.fi/findings/reversal-curse