aboutsummaryrefslogtreecommitdiffstats
path: root/src/tokenizer.rs (unfollow)
Commit message (Collapse)AuthorFilesLines
2022-06-16Refactor to reorder thing alphabeticallyLibravatar Titus Wormer1-21/+7
2022-06-16Add support for hard break (trailing)Libravatar Titus Wormer1-2/+11
2022-06-16Add support for hard break escapeLibravatar Titus Wormer1-3/+11
2022-06-15Add code (text)Libravatar Titus Wormer1-5/+22
2022-06-14Reorganize to split utilLibravatar Titus Wormer1-0/+2
2022-06-13Add basic html (text)Libravatar Titus Wormer1-2/+32
* Add all states for html (text) * Fix to link paragraph tokens together * Add note about uncovered bug where linking paragraph tokens together doesn’t work 😅
2022-06-13Add autolinksLibravatar Titus Wormer1-0/+5
2022-06-10Add text content typeLibravatar Titus Wormer1-1/+1
* Add character reference and character escapes in text * Add recursive subtokenization
2022-06-10Add proper support for subtokenizationLibravatar Titus Wormer1-3/+37
- Add “content” content type - Add paragraph - Add skips - Add linked tokens
2022-06-09Add basic subtokenization, string content in fenced codeLibravatar Titus Wormer1-7/+8
2022-06-09Refactor to pass more slices aroundLibravatar Titus Wormer1-5/+5
2022-06-09Add basic support for interrupting contentLibravatar Titus Wormer1-1/+57