testing
Mutation testing: checking whether your tests notice a deliberately introduced bug Lesson
Mutation testing makes small changes to working code and checks whether the test suite rejects them, exposing blind spots that code coverage alone misses.
Property-based testing: test the rule, not just the examples Lesson
Property-based testing generates many inputs automatically and checks general rules that software should always obey, such as round trips, invariants, and equivalence under harmless transformations; it finds edge cases that example-by-example unit tests often miss.
Simantic Tool
CLI and API for running firmware binaries against simulated microcontrollers and peripherals in repeatable virtual-clock scenarios.
SC25 LLM reliability assessment Tool
Fault-injection harness that flips individual bits during language model inference through PyTorch hooks, then restores them, so you can measure how your own model degrades under simulated soft errors instead of assuming it is resilient.
FpSan (Floating-Point Sanitizer) Tool
Open-source correctness checker for Triton GPU kernels, and the tool OpenAI says it used to validate the production kernels GPT-5.6 Sol rewrote. It compares symbolic computation under its own payload algebra rather than simulating IEEE floating point, so results should be compared only against other FpSan runs. Useful for anyone writing or generating custom kernels who needs to catch numerical breakage before it reaches production.