Commit message (Expand) | Author | Files | Lines | |
---|---|---|---|---|
2022-07-22 | Refactor to remove unneeded tuples in every states | Titus Wormer | 1 | -123/+93 |
2022-07-22 | Refactor to pass ints instead of vecs around | Titus Wormer | 1 | -56/+56 |
2022-07-18 | Add support for turning off constructs | Titus Wormer | 1 | -1/+1 |
2022-07-18 | Refactor examples of states | Titus Wormer | 1 | -63/+77 |
2022-07-07 | Refactor to move token types to `token` | Titus Wormer | 1 | -11/+12 |
2022-07-05 | Refactor code style | Titus Wormer | 1 | -43/+37 |
2022-06-22 | Add `attempt_opt` to tokenizer | Titus Wormer | 1 | -2/+2 |
2022-06-22 | Add docs for token types | Titus Wormer | 1 | -0/+5 |
2022-06-21 | Refactor to improve a bunch of states | Titus Wormer | 1 | -12/+8 |
2022-06-20 | Add improved whitespace handling | Titus Wormer | 1 | -5/+4 |
2022-06-20 | Remove unneeded `content` content type | Titus Wormer | 1 | -3/+3 |
2022-06-20 | Remove unneeded `pub` keywords | Titus Wormer | 1 | -32/+29 |
2022-06-14 | Fix support for deep subtokenization | Titus Wormer | 1 | -10/+14 |
2022-06-14 | Add docs for html (text) | Titus Wormer | 1 | -55/+272 |
2022-06-13 | Add basic html (text) | Titus Wormer | 1 | -0/+480 |