test(core): add tokenisation and types tests

Browse Source

Cover WordTokeniser (Unicode, empty input, punctuation, multiple scripts)
and validation types (immutability, edge cases, failure summary).

...

This commit is contained in:

Kai Chappell

2026-02-03 16:16:20 +00:00

parent a65249fa44

commit 1e3618e637

10 changed files with 348 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

tests/test_core/__pycache__/__init__.cpython-314.pyc Normal file

Binary file not shown.

BIN

tests/test_core/__pycache__/test_tokenisation.cpython-314-pytest-9.0.2.pyc Normal file

Binary file not shown.

BIN

tests/test_core/__pycache__/test_types.cpython-314-pytest-9.0.2.pyc Normal file

Binary file not shown.