From 07ac70e83515f2fb6e1afab6eb06391522acabd4 Mon Sep 17 00:00:00 2001 From: Kai Chappell Date: Tue, 3 Feb 2026 18:10:19 +0000 Subject: [PATCH] docs(changelog): add benchmark entries Document benchmark module features in changelog. --- changelog.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/changelog.md b/changelog.md index 9ad82b2..7b82df6 100644 --- a/changelog.md +++ b/changelog.md @@ -36,3 +36,12 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0 - `text_validation` marker for filtering validation tests - Pytest fixtures: `text_validator` factory and `validation_context` helper - Detailed failure messages with text preview and check diagnostics +- Benchmark module for quality tracking and regression detection +- `Benchmark` class for evaluating text quality over time with metric storage +- `BenchmarkRun` and `RegressionReport` data models for tracking runs +- SQLite storage backend with WAL mode for concurrent access +- Rolling window baseline computation for historical comparison +- `check_regression()` for statistical comparison against baseline +- `assert_no_regression()` raises `RegressionDetectedError` for CI integration +- Customisable tolerance threshold and window size for regression detection +- Metadata support for tracking git SHA, model versions, etc.