aboutsummaryrefslogtreecommitdiffstats
path: root/src/event.rs (unfollow)
Commit message (Collapse)AuthorFilesLines
2022-09-19Add support for parsing MDX ESM, expressionsLibravatar Titus Wormer1-1/+41
This commit adds support for hooks that lets a user integrate another parser with `micromark-rs`, to parse ESM and expressions according to a particular grammar (such as a programming language, typically JavaScript). For an example integrating with SWC, see `tests/test_utils/mod.rs`. The integration occurs with two functions passed in `options`: `mdx_expression_parse` and `mdx_esm_parse`. The can signal back to micromark when they are successful, whether there is an error at the end (in which case micromark will try to parse more), or whether there is a syntax error (in which case micromark will crash).
2022-09-14Fix to prefer flow over definitions, setext headingsLibravatar Titus Wormer1-5/+46
An undocumented part of CommonMark is how to deal with things in definition labels or definition titles (which both can span multiple lines). Can flow (or containers?) interrupt them? They can according to the `cmark` reference parser, so this was implemented here. This adds a new `Content` content type, which houses zero or more definitions, and then zero-or-one paragraphs. Content can be followed by a setext heading underline, which either turns into a setext heading when the content ends in a paragraph, or turns into the start of the following paragraph when it is followed by content that starts with a paragraph, or turns into a stray paragraph.
2022-09-12Fix gfm email autolink literals overlappingLibravatar Titus Wormer1-1/+1
2022-09-09Add docs for mdx expressionsLibravatar Titus Wormer1-18/+141
2022-09-09Add support for mdx attribute (value) expressionsLibravatar Titus Wormer1-0/+2
2022-09-09Add mdx expression (flow, text)Libravatar Titus Wormer1-0/+5
2022-09-08Add docs to mdx jsx eventsLibravatar Titus Wormer1-24/+437
2022-09-08Add support for mdx jsx (flow)Libravatar Titus Wormer1-20/+34
2022-09-06Add initial states for MDX JSX (text)Libravatar Titus Wormer1-0/+22
2022-09-05Add support for `mailto:`, `xmpp:` protocolsLibravatar Titus Wormer1-0/+36
2022-09-05Fix some todosLibravatar Titus Wormer1-1/+0
2022-09-05Fix shifting points past tabsLibravatar Titus Wormer1-9/+10
2022-08-31Add support for GFM tablesLibravatar Titus Wormer1-1/+263
2022-08-26Add support for math (flow)Libravatar Titus Wormer1-8/+119
2022-08-26Add support for math (text)Libravatar Titus Wormer1-4/+62
2022-08-25Add support for GFM footnotesLibravatar Titus Wormer1-9/+178
2022-08-22Add support for GFM task list itemLibravatar Titus Wormer1-1/+78
2022-08-22Add support for GFM strikethroughLibravatar Titus Wormer1-2/+57
2022-08-18Add support for GFM autolink literalsLibravatar Titus Wormer1-89/+180
2022-08-16Add support for frontmatterLibravatar Titus Wormer1-1/+91
2022-08-15Refactor to proof docs, grammarsLibravatar Titus Wormer1-4/+10
2022-08-15Add missing mark of `SpaceOrTab` as void eventLibravatar Titus Wormer1-1/+2
2022-08-15Add derive of `Eq` where possibleLibravatar Titus Wormer1-6/+6
2022-08-15Refactor to move `content` to `construct`Libravatar Titus Wormer1-47/+47
2022-08-15Refactor to rename list construct to list itemLibravatar Titus Wormer1-6/+6
2022-08-12Refactor to improve enteringLibravatar Titus Wormer1-1/+1
2022-08-12Refactor to improve docs of each functionLibravatar Titus Wormer1-3/+7
2022-08-11Refactor to move `space_or_tab_eol` to own fileLibravatar Titus Wormer1-182/+182
2022-08-11Refactor to move some code to `event.rs`Libravatar Titus Wormer1-43/+101
2022-07-28Refactor to work on `char`sLibravatar Titus Wormer1-1/+13
Previously, a custom char implementation was used. This was easier to work with, as sometimes “virtual” characters are injected, or characters are ignored. This replaces that with working on actual `char`s. In the hope of in the future working on `u8`s, even. This simplifies the state machine somewhat, as only `\n` is fed, regardless of whether it was a CRLF, CR, or LF. It also feeds `' '` instead of virtual spaces. The BOM, if present, is now available as a `ByteOrderMark` event.
2022-07-26Refactor to drastically improve perf around whitespaceLibravatar Titus Wormer1-43/+5
2022-07-18Remove unneeded tokenLibravatar Titus Wormer1-22/+2
2022-07-18Fix token that should be voidLibravatar Titus Wormer1-0/+44
2022-07-15Remove unneeded tokenLibravatar Titus Wormer1-20/+1
2022-07-15Refactor to sort, document lists in tokenLibravatar Titus Wormer1-9/+130
2022-07-12Fix a lot of list thingsLibravatar Titus Wormer1-1/+3
* Add `ListItem`, `ListOrdered`, and `ListUnordered` tokens * Add support for multiline list items * Add support for tight lists * Fix bug where 10 digit long list item values worked * Fix skip bug when skipping over nested events
2022-07-12Add initial support for listsLibravatar Titus Wormer1-0/+7
2022-07-07Refactor to move token types to `token`Libravatar Titus Wormer1-883/+169
2022-07-07Fix some small to dosLibravatar Titus Wormer1-1/+2
2022-07-07Add docs for block quote tokensLibravatar Titus Wormer1-1/+76
2022-07-07Fix order of tokensLibravatar Titus Wormer1-77/+77
2022-07-07Add basic support for block quotesLibravatar Titus Wormer1-12/+26
2022-07-07Add support for `Flow` content typeLibravatar Titus Wormer1-0/+2
2022-07-07Add `go_until` to tokenizerLibravatar Titus Wormer1-7/+37
2022-07-05Refactor to do some to dosLibravatar Titus Wormer1-18/+130
2022-07-05Refactor code styleLibravatar Titus Wormer1-78/+0
2022-07-04Add support for unicode punctuationLibravatar Titus Wormer1-1/+1
2022-07-04Update list of todosLibravatar Titus Wormer1-2/+0
2022-07-04Add support for attention (emphasis, strong)Libravatar Titus Wormer1-0/+9
2022-07-01Make paragraphs really fastLibravatar Titus Wormer1-0/+3
The approach that `micromark-js` takes is as follows: to parse a paragraph, check whether each line starts with something else. If it does, exit, otherwise continue. That is slow, because our actual flow parser does similar things: the work was being done twice. To fix this, this commit introduces parsing each line of a paragraph separately. And finally, when done with flow, combining adjacent paragraphs. This same mechanism is reused for setext headings. Additionally, this commit adds support for interrupting things (or not). E.g., HTML (flow, complete) cannot interrupt paragraphs. Definitions cannot interrupt paragraphs, and connect be interrupted either, but they can follow each other.