Commit message (Collapse) | Author | Files | Lines | ||
---|---|---|---|---|---|
2022-09-19 | Add support for parsing MDX ESM, expressions | Titus Wormer | 1 | -1/+41 | |
This commit adds support for hooks that lets a user integrate another parser with `micromark-rs`, to parse ESM and expressions according to a particular grammar (such as a programming language, typically JavaScript). For an example integrating with SWC, see `tests/test_utils/mod.rs`. The integration occurs with two functions passed in `options`: `mdx_expression_parse` and `mdx_esm_parse`. The can signal back to micromark when they are successful, whether there is an error at the end (in which case micromark will try to parse more), or whether there is a syntax error (in which case micromark will crash). | |||||
2022-09-14 | Fix to prefer flow over definitions, setext headings | Titus Wormer | 1 | -5/+46 | |
An undocumented part of CommonMark is how to deal with things in definition labels or definition titles (which both can span multiple lines). Can flow (or containers?) interrupt them? They can according to the `cmark` reference parser, so this was implemented here. This adds a new `Content` content type, which houses zero or more definitions, and then zero-or-one paragraphs. Content can be followed by a setext heading underline, which either turns into a setext heading when the content ends in a paragraph, or turns into the start of the following paragraph when it is followed by content that starts with a paragraph, or turns into a stray paragraph. | |||||
2022-09-12 | Fix gfm email autolink literals overlapping | Titus Wormer | 1 | -1/+1 | |
2022-09-09 | Add docs for mdx expressions | Titus Wormer | 1 | -18/+141 | |
2022-09-09 | Add support for mdx attribute (value) expressions | Titus Wormer | 1 | -0/+2 | |
2022-09-09 | Add mdx expression (flow, text) | Titus Wormer | 1 | -0/+5 | |
2022-09-08 | Add docs to mdx jsx events | Titus Wormer | 1 | -24/+437 | |
2022-09-08 | Add support for mdx jsx (flow) | Titus Wormer | 1 | -20/+34 | |
2022-09-06 | Add initial states for MDX JSX (text) | Titus Wormer | 1 | -0/+22 | |
2022-09-05 | Add support for `mailto:`, `xmpp:` protocols | Titus Wormer | 1 | -0/+36 | |
2022-09-05 | Fix some todos | Titus Wormer | 1 | -1/+0 | |
2022-09-05 | Fix shifting points past tabs | Titus Wormer | 1 | -9/+10 | |
2022-08-31 | Add support for GFM tables | Titus Wormer | 1 | -1/+263 | |
2022-08-26 | Add support for math (flow) | Titus Wormer | 1 | -8/+119 | |
2022-08-26 | Add support for math (text) | Titus Wormer | 1 | -4/+62 | |
2022-08-25 | Add support for GFM footnotes | Titus Wormer | 1 | -9/+178 | |
2022-08-22 | Add support for GFM task list item | Titus Wormer | 1 | -1/+78 | |
2022-08-22 | Add support for GFM strikethrough | Titus Wormer | 1 | -2/+57 | |
2022-08-18 | Add support for GFM autolink literals | Titus Wormer | 1 | -89/+180 | |
2022-08-16 | Add support for frontmatter | Titus Wormer | 1 | -1/+91 | |
2022-08-15 | Refactor to proof docs, grammars | Titus Wormer | 1 | -4/+10 | |
2022-08-15 | Add missing mark of `SpaceOrTab` as void event | Titus Wormer | 1 | -1/+2 | |
2022-08-15 | Add derive of `Eq` where possible | Titus Wormer | 1 | -6/+6 | |
2022-08-15 | Refactor to move `content` to `construct` | Titus Wormer | 1 | -47/+47 | |
2022-08-15 | Refactor to rename list construct to list item | Titus Wormer | 1 | -6/+6 | |
2022-08-12 | Refactor to improve entering | Titus Wormer | 1 | -1/+1 | |
2022-08-12 | Refactor to improve docs of each function | Titus Wormer | 1 | -3/+7 | |
2022-08-11 | Refactor to move `space_or_tab_eol` to own file | Titus Wormer | 1 | -182/+182 | |
2022-08-11 | Refactor to move some code to `event.rs` | Titus Wormer | 1 | -43/+101 | |
2022-07-28 | Refactor to work on `char`s | Titus Wormer | 1 | -1/+13 | |
Previously, a custom char implementation was used. This was easier to work with, as sometimes “virtual” characters are injected, or characters are ignored. This replaces that with working on actual `char`s. In the hope of in the future working on `u8`s, even. This simplifies the state machine somewhat, as only `\n` is fed, regardless of whether it was a CRLF, CR, or LF. It also feeds `' '` instead of virtual spaces. The BOM, if present, is now available as a `ByteOrderMark` event. | |||||
2022-07-26 | Refactor to drastically improve perf around whitespace | Titus Wormer | 1 | -43/+5 | |
2022-07-18 | Remove unneeded token | Titus Wormer | 1 | -22/+2 | |
2022-07-18 | Fix token that should be void | Titus Wormer | 1 | -0/+44 | |
2022-07-15 | Remove unneeded token | Titus Wormer | 1 | -20/+1 | |
2022-07-15 | Refactor to sort, document lists in token | Titus Wormer | 1 | -9/+130 | |
2022-07-12 | Fix a lot of list things | Titus Wormer | 1 | -1/+3 | |
* Add `ListItem`, `ListOrdered`, and `ListUnordered` tokens * Add support for multiline list items * Add support for tight lists * Fix bug where 10 digit long list item values worked * Fix skip bug when skipping over nested events | |||||
2022-07-12 | Add initial support for lists | Titus Wormer | 1 | -0/+7 | |
2022-07-07 | Refactor to move token types to `token` | Titus Wormer | 1 | -883/+169 | |
2022-07-07 | Fix some small to dos | Titus Wormer | 1 | -1/+2 | |
2022-07-07 | Add docs for block quote tokens | Titus Wormer | 1 | -1/+76 | |
2022-07-07 | Fix order of tokens | Titus Wormer | 1 | -77/+77 | |
2022-07-07 | Add basic support for block quotes | Titus Wormer | 1 | -12/+26 | |
2022-07-07 | Add support for `Flow` content type | Titus Wormer | 1 | -0/+2 | |
2022-07-07 | Add `go_until` to tokenizer | Titus Wormer | 1 | -7/+37 | |
2022-07-05 | Refactor to do some to dos | Titus Wormer | 1 | -18/+130 | |
2022-07-05 | Refactor code style | Titus Wormer | 1 | -78/+0 | |
2022-07-04 | Add support for unicode punctuation | Titus Wormer | 1 | -1/+1 | |
2022-07-04 | Update list of todos | Titus Wormer | 1 | -2/+0 | |
2022-07-04 | Add support for attention (emphasis, strong) | Titus Wormer | 1 | -0/+9 | |
2022-07-01 | Make paragraphs really fast | Titus Wormer | 1 | -0/+3 | |
The approach that `micromark-js` takes is as follows: to parse a paragraph, check whether each line starts with something else. If it does, exit, otherwise continue. That is slow, because our actual flow parser does similar things: the work was being done twice. To fix this, this commit introduces parsing each line of a paragraph separately. And finally, when done with flow, combining adjacent paragraphs. This same mechanism is reused for setext headings. Additionally, this commit adds support for interrupting things (or not). E.g., HTML (flow, complete) cannot interrupt paragraphs. Definitions cannot interrupt paragraphs, and connect be interrupted either, but they can follow each other. |