Install
Testing & Quality
Unit/integration tests, fuzzing, reliability, and observability for apps.
- 23 Tracked terms
- Last 30 days Feed window
What this topic collects on
An article joins this feed when it matches these terms. Each one is also a search of its own.
Related topics
Latest in Testing & Quality
A stale hash failed 29 of 59 tests. The tool that refreshes hashes had never seen that copy.
51+ min ago (634+ words) The project keeps derived claims from rotting with freshness pins. A pin is a row that cites another file and records the hash of the bytes it was derived from. A small device recomputes those hashes and re-keys the rows....
Learn Eval Ownership by Building a Tiny Lab Witness
1+ hour, 18+ min ago (854+ words) Last Tuesday in Halifax my laptop sounded like it wanted to leave the room. I had a 40-line name-normalization lab, a messy CSV, and a due time that was closer than my pride wanted to admit. The function was supposed…...
Show Reversibility Proof Before Pasting Agent Undo Copy
1+ hour, 19+ min ago (1157+ words) The agent already sent the client email. I am staring at a recovery screen. A free model drafted the undo label. It sounds calm and finished. It wrote, You can undo this send. Can I actually reverse it? The send…...
My progress was 0.5% or 7.3%, depending on which denominator the report used
1+ hour, 57+ min ago (426+ words) A classification pass over a large corpus prints its progress. Here are two numbers from the same run, in the same line: Eight of sixteen hundred. Four and a half thousand of sixty-two thousand. Both are "how much have we…...
Your eval set is probably in your training set — here's how to check in ten minutes
1+ hour, 48+ min ago (688+ words) You fine-tune a model, run your benchmark, and the score jumps six points. Before you write that up, there's one question worth ten minutes: how many of those benchmark examples were in the training data? If the answer is "some…...
My verifier accepted "13 of 13" by finding the number 13 once
2+ hour, 24+ min ago (417+ words) Claims in my project are written as a pair: some count out of some total, each side backed by a cell in a generated table. A checker resolves the claim by finding the evidence for both numbers. It resolved each…...
I labelled a dependency cycle "unknown" and called it rigour
2+ hour, 25+ min ago (525+ words) I have spent a while arguing that checks need a third value: not every result is pass or fail, and folding "I could not determine this" into either one is how a suite starts lying. Then I applied it to…...
Each pull request was tested against a main that no longer existed
2+ hour, 54+ min ago (786+ words) A payment call started timing out in production about an hour after a Thursday merge. The change that broke it had been reviewed, approved and green. So had the change it collided with. Neither of them was wrong on its…...
My registry accepted a duplicate ID, and the wrong thing failed three steps later
2+ hour, 55+ min ago (482+ words) A register of in-flight work assigns each unit an ID. One writer mints them, they are unique, and everything downstream keys off that. The rule is written down. Two rows ended up with the same ID, a day apart. Nothing complained…...
How Bug Hunter Evolved From a Test Runner Into a Self-Hosted Quality Intelligence Platform
3+ hour, 16+ min ago (1638+ words) A few months ago, I wrote about Bug Hunter as a self-hosted testing tool for web applications and APIs. At that point, the project could already: Since then, the project has changed significantly. The biggest change is not one individual…...