Qlarify Labs
Catalog
How to find the limits of AI systems. Each entry is a repeatable testing technique — the durable knowledge, independent of any one model or version.
3 methods
Other
Integration testing (MCP handshakes & tool contracts)
Exercise the seams where the model meets the rest of the system — tool and function contracts, MCP handshakes, retrieval calls, API auth — to catch connectivity and contract failures end to end.
EstablishedTool useAgentsReliability
Property-basedProperty-based testing
Specify invariants the output must always satisfy, then generate many inputs automatically and check the invariant on each.
EstablishedTool useEvals
OtherUnit testing the deterministic scaffold
Test the deterministic code around the model — prompt builders, output parsers, schema validators, tool wrappers — in isolation, with exact assertions, the way you'd test any software.
EstablishedTool useReliability