tests for tokeniser and types

Browse Source

Cover WordTokeniser (Unicode, empty input, punctuation, multiple scripts)
and validation types (immutability, edge cases, failure summary).

...

This commit is contained in:

Kai Chappell

2025-03-09 11:42:26 +00:00

parent 1fb9e1f835

commit 2827dcdf4e

10 changed files with 303 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

tests/test_core/__pycache__/__init__.cpython-314.pyc Normal file

Binary file not shown.

BIN

tests/test_core/__pycache__/test_tokenisation.cpython-314-pytest-9.0.2.pyc Normal file

Binary file not shown.

BIN

tests/test_core/__pycache__/test_types.cpython-314-pytest-9.0.2.pyc Normal file

Binary file not shown.