|
|
856bcbccbb
|
changelog: metrics module
|
2025-03-15 13:30:08 +00:00 |
|
|
|
afb39cf177
|
test BLEU and lexical metrics
Add comprehensive tests for BLEU and lexical metrics including edge
cases, batch scoring, and aggregate statistics.
|
2025-03-15 12:14:45 +00:00 |
|
|
|
f26e14bf20
|
lexical similarity (jaccard, overlap, cosine)
Implement Jaccard similarity and token overlap metrics with batch
scoring support.
|
2025-03-15 12:09:50 +00:00 |
|
|
|
82b6ffea79
|
feat: BLEU scorer
Implement BLEU-1 through BLEU-4 with modified n-gram precision,
brevity penalty, and support for multiple references.
|
2025-03-15 11:08:36 +00:00 |
|
|
|
7832fa3d59
|
metric protocol and batch scoring types
Add Metric protocol, AggregateStats for statistical summaries, and
BatchResult for batch processing support.
|
2025-03-12 20:13:11 +00:00 |
|
|
|
c53cdd2536
|
gitignore, clean cached files
Add comprehensive gitignore for Python projects. Remove accidentally
committed __pycache__ directories.
|
2025-03-12 19:13:31 +00:00 |
|
|
|
2827dcdf4e
|
tests for tokeniser and types
Cover WordTokeniser (Unicode, empty input, punctuation, multiple scripts)
and validation types (immutability, edge cases, failure summary).
|
2025-03-09 11:42:26 +00:00 |
|
|
|
1fb9e1f835
|
config + structured logging
Implement pydantic-settings based configuration with environment variable
support and structlog integration for JSON/console output modes.
|
2025-03-09 10:32:16 +00:00 |
|
|
|
3e88705404
|
tokeniser with unicode handling
Implement Tokeniser protocol and WordTokeniser class with NFC Unicode
normalisation, optional lowercasing, and punctuation removal.
|
2025-03-09 10:06:28 +00:00 |
|
|
|
494f5d0c85
|
add validation result types
Implement ValidationContext, CheckResult, and ValidationResult models
using Pydantic with frozen (immutable) configuration.
|
2025-03-08 15:30:31 +00:00 |
|
|
|
d20ea7c4ff
|
core exceptions
Implement VeritextError base class and specialised exceptions:
MetricError, ValidationError, BenchmarkError, ConfigurationError, DependencyError.
|
2025-03-08 15:00:29 +00:00 |
|
|
|
bf5884cb27
|
project setup: pyproject.toml, deps, tooling
Configure Python project with pydantic, structlog, typer, rich dependencies.
Set up ruff, mypy, pytest tooling with strict type checking.
|
2025-03-08 14:03:32 +00:00 |
|
