Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Refactor to work on `char`s | Titus Wormer | 2022-07-28 | 1 | -91/+70 |
| | | | | | | | | | | | | | | | Previously, a custom char implementation was used. This was easier to work with, as sometimes “virtual” characters are injected, or characters are ignored. This replaces that with working on actual `char`s. In the hope of in the future working on `u8`s, even. This simplifies the state machine somewhat, as only `\n` is fed, regardless of whether it was a CRLF, CR, or LF. It also feeds `' '` instead of virtual spaces. The BOM, if present, is now available as a `ByteOrderMark` event. | ||||
* | Refactor to not pass codes around | Titus Wormer | 2022-07-25 | 1 | -147/+133 |
| | |||||
* | Remove no longer needed field in `State::Ok` | Titus Wormer | 2022-07-25 | 1 | -1/+1 |
| | |||||
* | Refactor to remove unneeded tuples in every states | Titus Wormer | 2022-07-22 | 1 | -123/+93 |
| | |||||
* | Refactor to pass ints instead of vecs around | Titus Wormer | 2022-07-22 | 1 | -56/+56 |
| | |||||
* | Add support for turning off constructs | Titus Wormer | 2022-07-18 | 1 | -1/+1 |
| | |||||
* | Refactor examples of states | Titus Wormer | 2022-07-18 | 1 | -63/+77 |
| | |||||
* | Refactor to move token types to `token` | Titus Wormer | 2022-07-07 | 1 | -11/+12 |
| | |||||
* | Refactor code style | Titus Wormer | 2022-07-05 | 1 | -43/+37 |
| | |||||
* | Add `attempt_opt` to tokenizer | Titus Wormer | 2022-06-22 | 1 | -2/+2 |
| | |||||
* | Add docs for token types | Titus Wormer | 2022-06-22 | 1 | -0/+5 |
| | |||||
* | Refactor to improve a bunch of states | Titus Wormer | 2022-06-21 | 1 | -12/+8 |
| | | | | | | * Improve passing stuff around * Add traits to enums for markers and such * Fix “life time” stuff I didn’t understand | ||||
* | Add improved whitespace handling | Titus Wormer | 2022-06-20 | 1 | -5/+4 |
| | | | | | | * add several helpers for parsing betwen x and y `space_or_tab`s * use those helpers in a bunch of places * move initial indent parsing to flow constructs themselves | ||||
* | Remove unneeded `content` content type | Titus Wormer | 2022-06-20 | 1 | -3/+3 |
| | |||||
* | Remove unneeded `pub` keywords | Titus Wormer | 2022-06-20 | 1 | -32/+29 |
| | |||||
* | Fix support for deep subtokenization | Titus Wormer | 2022-06-14 | 1 | -10/+14 |
| | | | | | | * Fix a couple of forgotten line ending handling in html (text) * Fix missing initial case for html (text) not having a `<` 😬 * Add line ending handling to `text` construct | ||||
* | Add docs for html (text) | Titus Wormer | 2022-06-14 | 1 | -55/+272 |
| | |||||
* | Add basic html (text) | Titus Wormer | 2022-06-13 | 1 | -0/+480 |
* Add all states for html (text) * Fix to link paragraph tokens together * Add note about uncovered bug where linking paragraph tokens together doesn’t work 😅 |