Commit message (Collapse) | Author | Files | Lines | ||
---|---|---|---|---|---|
2022-06-10 | Add text content type | Titus Wormer | 1 | -8/+2 | |
* Add character reference and character escapes in text * Add recursive subtokenization | |||||
2022-06-10 | Add proper support for subtokenization | Titus Wormer | 1 | -36/+6 | |
- Add “content” content type - Add paragraph - Add skips - Add linked tokens | |||||
2022-06-09 | Add basic subtokenization, string content in fenced code | Titus Wormer | 1 | -16/+4 | |
2022-06-09 | Refactor to pass more slices around | Titus Wormer | 1 | -1/+1 | |