aboutsummaryrefslogtreecommitdiffstats
path: root/readme.md (unfollow)
Commit message (Collapse)AuthorFilesLines
2022-06-10Add text content typeLibravatar Titus Wormer1-3/+3
* Add character reference and character escapes in text * Add recursive subtokenization
2022-06-10Add proper support for subtokenizationLibravatar Titus Wormer1-2/+5
- Add “content” content type - Add paragraph - Add skips - Add linked tokens
2022-06-09Add temporary support for stripping whitespaceLibravatar Titus Wormer1-0/+1
2022-06-08Add link in readmeLibravatar Titus Wormer1-0/+3