Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Refactor internal docs, code style of tokenizer | Titus Wormer | 2022-08-11 | 1 | -1/+1 |
| | |||||
* | Add `State::Retry` | Titus Wormer | 2022-08-10 | 1 | -2/+2 |
| | |||||
* | Rename `State::Fn` to `State::Next` | Titus Wormer | 2022-08-10 | 1 | -5/+5 |
| | |||||
* | Add support for passing `ok`, `nok` as separate states to attempts | Titus Wormer | 2022-08-09 | 1 | -13/+15 |
| | |||||
* | Rewrite algorithm to not pass around boxed functions | Titus Wormer | 2022-08-09 | 1 | -11/+17 |
| | | | | | | * Pass state names from an enum around instead of boxed functions * Refactor to simplify attempts a lot * Use a subtokenizer for the the `document` content type | ||||
* | Refactor to remove most closures | Titus Wormer | 2022-08-02 | 1 | -6/+9 |
| | |||||
* | Refactor to work on bytes (`u8`) | Titus Wormer | 2022-07-29 | 1 | -1/+1 |
| | |||||
* | Refactor to work on `char`s | Titus Wormer | 2022-07-28 | 1 | -3/+3 |
| | | | | | | | | | | | | | | | Previously, a custom char implementation was used. This was easier to work with, as sometimes “virtual” characters are injected, or characters are ignored. This replaces that with working on actual `char`s. In the hope of in the future working on `u8`s, even. This simplifies the state machine somewhat, as only `\n` is fed, regardless of whether it was a CRLF, CR, or LF. It also feeds `' '` instead of virtual spaces. The BOM, if present, is now available as a `ByteOrderMark` event. | ||||
* | Refactor to drastically improve perf around whitespace | Titus Wormer | 2022-07-26 | 1 | -19/+15 |
| | |||||
* | Refactor to not pass codes around | Titus Wormer | 2022-07-25 | 1 | -5/+5 |
| | |||||
* | Remove no longer needed field in `State::Ok` | Titus Wormer | 2022-07-25 | 1 | -1/+1 |
| | |||||
* | Refactor to remove unneeded tuples in every states | Titus Wormer | 2022-07-22 | 1 | -4/+4 |
| | |||||
* | Refactor to pass ints instead of vecs around | Titus Wormer | 2022-07-22 | 1 | -1/+1 |
| | |||||
* | Refactor to improve performance by passing markers around | Titus Wormer | 2022-07-21 | 1 | -23/+12 |
| | |||||
* | Refactor to improve performance when constructs are turned off | Titus Wormer | 2022-07-18 | 1 | -22/+25 |
| | |||||
* | Add support for turning off constructs | Titus Wormer | 2022-07-18 | 1 | -0/+1 |
| | |||||
* | Add support for trimming whitespace around string, text | Titus Wormer | 2022-06-30 | 1 | -5/+12 |
| | | | | | | | | | | | | | This commit introduces trimming initial and final whitespace around the whole string or text, or around line endings inside that string or text. * Add `register_resolver_before`, to run resolvers earlier than others, used for labels * Add resolver to merge `data` events, which are the most frequent token that occurs, and can happen adjacently. In `micromark-js` this sped up parsing a lot * Fix a bug where a virtual space was not seen as an okay event * Refactor to enable all turned off whitespace tests | ||||
* | Refactor to improve tokenizer, add docs | Titus Wormer | 2022-06-22 | 1 | -3/+4 |
| | |||||
* | Make data a construct | Titus Wormer | 2022-06-21 | 1 | -41/+9 |
| | |||||
* | Refactor to improve a bunch of states | Titus Wormer | 2022-06-21 | 1 | -8/+0 |
| | | | | | | * Improve passing stuff around * Add traits to enums for markers and such * Fix “life time” stuff I didn’t understand | ||||
* | Add some more enabled tests | Titus Wormer | 2022-06-20 | 1 | -2/+0 |
| | |||||
* | Add support for line endings in string | Titus Wormer | 2022-06-20 | 1 | -9/+23 |
| | |||||
* | Remove unneeded `content` content type | Titus Wormer | 2022-06-20 | 1 | -1/+3 |
| | |||||
* | Add support for definitions | Titus Wormer | 2022-06-17 | 1 | -0/+2 |
| | | | | | | * Add definitions * Add partials for label, destination, title * Add `go`, to attempt something, and do something else on `ok` | ||||
* | Refactor to reorder thing alphabetically | Titus Wormer | 2022-06-16 | 1 | -0/+1 |
| | |||||
* | Add text content type | Titus Wormer | 2022-06-10 | 1 | -8/+2 |
| | | | | | * Add character reference and character escapes in text * Add recursive subtokenization | ||||
* | Add proper support for subtokenization | Titus Wormer | 2022-06-10 | 1 | -36/+6 |
| | | | | | | | - Add “content” content type - Add paragraph - Add skips - Add linked tokens | ||||
* | Add basic subtokenization, string content in fenced code | Titus Wormer | 2022-06-09 | 1 | -16/+4 |
| | |||||
* | Refactor to pass more slices around | Titus Wormer | 2022-06-09 | 1 | -1/+1 |
| | |||||
* | . | Titus Wormer | 2022-06-08 | 1 | -0/+120 |