kschappell/veritext
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs(changelog): add benchmark entries

Browse Source 
Document benchmark module features in changelog.
This commit is contained in:
Kai Chappell
2026-02-03 18:10:19 +00:00
parent 6d1bece815
commit 07ac70e835
1 changed files with 9 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
changelog.md
View File

@@ -36,3 +36,12 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
- `text_validation` marker for filtering validation tests - `text_validation` marker for filtering validation tests
- Pytest fixtures: `text_validator` factory and `validation_context` helper - Pytest fixtures: `text_validator` factory and `validation_context` helper
- Detailed failure messages with text preview and check diagnostics - Detailed failure messages with text preview and check diagnostics
- Benchmark module for quality tracking and regression detection
- `Benchmark` class for evaluating text quality over time with metric storage
- `BenchmarkRun` and `RegressionReport` data models for tracking runs
- SQLite storage backend with WAL mode for concurrent access
- Rolling window baseline computation for historical comparison
- `check_regression()` for statistical comparison against baseline
- `assert_no_regression()` raises `RegressionDetectedError` for CI integration
- Customisable tolerance threshold and window size for regression detection
- Metadata support for tracking git SHA, model versions, etc.