testing
Property-based testing: test the rule, not just the examples Lesson
Property-based testing generates many inputs automatically and checks general rules that software should always obey, such as round trips, invariants, and equivalence under harmless transformations; it finds edge cases that example-by-example unit tests often miss.
SC25 LLM reliability assessment Tool
Fault-injection harness that flips individual bits during language model inference through PyTorch hooks, then restores them, so you can measure how your own model degrades under simulated soft errors instead of assuming it is resilient.
FpSan (Floating-Point Sanitizer) Tool
Open-source correctness checker for Triton GPU kernels, and the tool OpenAI says it used to validate the production kernels GPT-5.6 Sol rewrote. It compares symbolic computation under its own payload algebra rather than simulating IEEE floating point, so results should be compared only against other FpSan runs. Useful for anyone writing or generating custom kernels who needs to catch numerical breakage before it reaches production.