aboutsummaryrefslogtreecommitdiffstats
path: root/src/tokenizer.rs (follow)
Commit message (Expand)AuthorAgeFilesLines
* Add text content typeLibravatar Titus Wormer2022-06-101-1/+1
* Add proper support for subtokenizationLibravatar Titus Wormer2022-06-101-3/+37
* Add basic subtokenization, string content in fenced codeLibravatar Titus Wormer2022-06-091-7/+8
* Refactor to pass more slices aroundLibravatar Titus Wormer2022-06-091-5/+5
* Add basic support for interrupting contentLibravatar Titus Wormer2022-06-091-1/+57
* .Libravatar Titus Wormer2022-06-081-0/+580