Commit message (Collapse) | Author | Files | Lines | ||
---|---|---|---|---|---|
2022-08-12 | Refactor to attempt less if never needed | Titus Wormer | 1 | -5/+9 | |
2022-08-12 | Remove `match` statements if clumsy | Titus Wormer | 1 | -20/+21 | |
2022-08-12 | Refactor to improve docs of each function | Titus Wormer | 1 | -30/+30 | |
2022-08-11 | Refactor attempts to remove unneeded state name | Titus Wormer | 1 | -48/+47 | |
2022-08-11 | Refactor to move `space_or_tab_eol` to own file | Titus Wormer | 1 | -2/+2 | |
2022-08-11 | Refactor to move some code to `event.rs` | Titus Wormer | 1 | -86/+86 | |
2022-08-11 | Refactor to move some code to `state.rs` | Titus Wormer | 1 | -77/+78 | |
2022-08-11 | Refactor internal docs, code style of tokenizer | Titus Wormer | 1 | -40/+46 | |
2022-08-10 | Add `State::Retry` | Titus Wormer | 1 | -31/+28 | |
2022-08-10 | Rename `State::Fn` to `State::Next` | Titus Wormer | 1 | -44/+45 | |
2022-08-09 | Add support for passing `ok`, `nok` as separate states to attempts | Titus Wormer | 1 | -1/+5 | |
2022-08-09 | Rewrite algorithm to not pass around boxed functions | Titus Wormer | 1 | -89/+94 | |
* Pass state names from an enum around instead of boxed functions * Refactor to simplify attempts a lot * Use a subtokenizer for the the `document` content type | |||||
2022-08-02 | Refactor to remove most closures | Titus Wormer | 1 | -35/+60 | |
2022-08-01 | Refactor some states | Titus Wormer | 1 | -2/+2 | |
2022-07-29 | Refactor to improve states | Titus Wormer | 1 | -19/+27 | |
* Remove custom kind wrappers, use plain bytes instead * Remove `Into`s, use the explicit expected types instead * Refactor to use `slice.as_str` in most places * Remove unneeded unique check before adding a definition * Use a shared CDATA prefix in constants * Inline byte checks into matches * Pass bytes back from parser instead of whole parse state * Refactor to work more often on bytes * Rename custom `size` to `len` | |||||
2022-07-29 | Refactor to work on bytes (`u8`) | Titus Wormer | 1 | -54/+54 | |
2022-07-28 | Refactor to work on `char`s | Titus Wormer | 1 | -91/+70 | |
Previously, a custom char implementation was used. This was easier to work with, as sometimes “virtual” characters are injected, or characters are ignored. This replaces that with working on actual `char`s. In the hope of in the future working on `u8`s, even. This simplifies the state machine somewhat, as only `\n` is fed, regardless of whether it was a CRLF, CR, or LF. It also feeds `' '` instead of virtual spaces. The BOM, if present, is now available as a `ByteOrderMark` event. | |||||
2022-07-25 | Refactor to not pass codes around | Titus Wormer | 1 | -147/+133 | |
2022-07-25 | Remove no longer needed field in `State::Ok` | Titus Wormer | 1 | -1/+1 | |
2022-07-22 | Refactor to remove unneeded tuples in every states | Titus Wormer | 1 | -123/+93 | |
2022-07-22 | Refactor to pass ints instead of vecs around | Titus Wormer | 1 | -56/+56 | |
2022-07-18 | Add support for turning off constructs | Titus Wormer | 1 | -1/+1 | |
2022-07-18 | Refactor examples of states | Titus Wormer | 1 | -63/+77 | |
2022-07-07 | Refactor to move token types to `token` | Titus Wormer | 1 | -11/+12 | |
2022-07-05 | Refactor code style | Titus Wormer | 1 | -43/+37 | |
2022-06-22 | Add `attempt_opt` to tokenizer | Titus Wormer | 1 | -2/+2 | |
2022-06-22 | Add docs for token types | Titus Wormer | 1 | -0/+5 | |
2022-06-21 | Refactor to improve a bunch of states | Titus Wormer | 1 | -12/+8 | |
* Improve passing stuff around * Add traits to enums for markers and such * Fix “life time” stuff I didn’t understand | |||||
2022-06-20 | Add improved whitespace handling | Titus Wormer | 1 | -5/+4 | |
* add several helpers for parsing betwen x and y `space_or_tab`s * use those helpers in a bunch of places * move initial indent parsing to flow constructs themselves | |||||
2022-06-20 | Remove unneeded `content` content type | Titus Wormer | 1 | -3/+3 | |
2022-06-20 | Remove unneeded `pub` keywords | Titus Wormer | 1 | -32/+29 | |
2022-06-14 | Fix support for deep subtokenization | Titus Wormer | 1 | -10/+14 | |
* Fix a couple of forgotten line ending handling in html (text) * Fix missing initial case for html (text) not having a `<` 😬 * Add line ending handling to `text` construct | |||||
2022-06-14 | Add docs for html (text) | Titus Wormer | 1 | -55/+272 | |
2022-06-13 | Add basic html (text) | Titus Wormer | 1 | -0/+480 | |
* Add all states for html (text) * Fix to link paragraph tokens together * Add note about uncovered bug where linking paragraph tokens together doesn’t work 😅 |