Commit message (Collapse) | Author | Files | Lines | ||
---|---|---|---|---|---|
2022-08-11 | Refactor to move `space_or_tab_eol` to own file | Titus Wormer | 1 | -2/+2 | |
2022-08-11 | Refactor to move some code to `event.rs` | Titus Wormer | 1 | -11/+12 | |
2022-08-11 | Refactor to move some code to `state.rs` | Titus Wormer | 1 | -3/+4 | |
2022-08-11 | Refactor internal docs, code style of tokenizer | Titus Wormer | 1 | -5/+1 | |
2022-08-11 | Add improved container exit injection | Titus Wormer | 1 | -5/+8 | |
2022-08-10 | Rename `State::Fn` to `State::Next` | Titus Wormer | 1 | -2/+2 | |
2022-08-09 | Refactor to share some code | Titus Wormer | 1 | -56/+86 | |
2022-08-09 | Rewrite algorithm to not pass around boxed functions | Titus Wormer | 1 | -7/+6 | |
* Pass state names from an enum around instead of boxed functions * Refactor to simplify attempts a lot * Use a subtokenizer for the the `document` content type | |||||
2022-07-28 | Refactor to use `debug_assert` | Titus Wormer | 1 | -7/+7 | |
2022-07-26 | Refactor to drastically improve perf around whitespace | Titus Wormer | 1 | -6/+8 | |
2022-07-26 | Refactor to simplify tokenizer | Titus Wormer | 1 | -6/+3 | |
2022-07-25 | Refactor to remove need for cloning codes | Titus Wormer | 1 | -10/+4 | |
2022-07-25 | Improve performance w/ a single feed loop | Titus Wormer | 1 | -2/+6 | |
2022-07-22 | Refactor to remove unneeded tuples in every states | Titus Wormer | 1 | -13/+9 | |
2022-07-22 | Refactor to pass ints instead of vecs around | Titus Wormer | 1 | -4/+6 | |
2022-07-21 | Refactor to move `index` field to `point` | Titus Wormer | 1 | -5/+5 | |
2022-07-21 | Refactor to move some event fields to `link` | Titus Wormer | 1 | -35/+36 | |
2022-07-20 | Refactor to share edit map | Titus Wormer | 1 | -3/+3 | |
2022-07-20 | Refactor to use less vecs for events | Titus Wormer | 1 | -2/+4 | |
2022-07-19 | Refactor to remove cloning in `edit_map` | Titus Wormer | 1 | -2/+2 | |
2022-07-19 | Use `edit_map` in `subtokenize` | Titus Wormer | 1 | -67/+40 | |
2022-07-19 | Remove an unneeded `HashMap` | Titus Wormer | 1 | -1/+1 | |
2022-07-15 | Fix annoying bug around virtual spaces in containers | Titus Wormer | 1 | -1/+1 | |
2022-07-07 | Add support for `Flow` content type | Titus Wormer | 1 | -2/+4 | |
2022-07-05 | Refactor to do some to dos | Titus Wormer | 1 | -3/+2 | |
2022-07-04 | Add support for unicode punctuation | Titus Wormer | 1 | -1/+1 | |
2022-07-04 | Update list of todos | Titus Wormer | 1 | -2/+0 | |
2022-06-28 | Fix jumps in `edit_map` | Titus Wormer | 1 | -101/+99 | |
* Use resolve more often (e.g., heading (atx, setext)) * Fix to link whole phrasing (e.g., one big chunk of text in heading (atx, setext), titles, labels) * Replace `ChunkText`, `ChunkString`, with `event.content_type: Option<ContentType>` * Refactor to externalize `edit_map` from `label` | |||||
2022-06-24 | Add link, images (resource) | Titus Wormer | 1 | -12/+26 | |
This is still some messy code that needs cleaning up, but it adds support for links and images, of the resource kind (`[a](b)`). References (`[a][b]`) are parsed and will soon be supported, but need matching. * Fix bug to pad percent-encoded bytes when normalizing urls * Fix bug with escapes counting as balancing in destination * Add `space_or_tab_one_line_ending`, to parse whitespace including up to one line ending (but not a blank line) * Add `ParserState` to share codes, definitions, etc | |||||
2022-06-22 | Refactor some unneeded assignments | Titus Wormer | 1 | -2/+1 | |
2022-06-22 | Add docs for token types | Titus Wormer | 1 | -1/+3 | |
2022-06-21 | Add docs for `subtokenize` | Titus Wormer | 1 | -2/+51 | |
2022-06-21 | Update todo list | Titus Wormer | 1 | -8/+1 | |
2022-06-20 | Add support for BOM | Titus Wormer | 1 | -0/+4 | |
2022-06-20 | Remove unneeded `content` content type | Titus Wormer | 1 | -6/+3 | |
2022-06-14 | Fix support for deep subtokenization | Titus Wormer | 1 | -9/+19 | |
* Fix a couple of forgotten line ending handling in html (text) * Fix missing initial case for html (text) not having a `<` 😬 * Add line ending handling to `text` construct | |||||
2022-06-14 | Reorganize to split util | Titus Wormer | 1 | -6/+4 | |
2022-06-14 | Add docs for html (text) | Titus Wormer | 1 | -0/+1 | |
2022-06-13 | Add basic html (text) | Titus Wormer | 1 | -3/+9 | |
* Add all states for html (text) * Fix to link paragraph tokens together * Add note about uncovered bug where linking paragraph tokens together doesn’t work 😅 | |||||
2022-06-10 | Add text content type | Titus Wormer | 1 | -4/+10 | |
* Add character reference and character escapes in text * Add recursive subtokenization | |||||
2022-06-10 | Add proper support for subtokenization | Titus Wormer | 1 | -50/+116 | |
- Add “content” content type - Add paragraph - Add skips - Add linked tokens | |||||
2022-06-09 | Add basic subtokenization, string content in fenced code | Titus Wormer | 1 | -0/+67 | |