aboutsummaryrefslogtreecommitdiffstats
path: root/src/construct/code_fenced.rs (unfollow)
Commit message (Collapse)AuthorFilesLines
2022-08-11Refactor to move `space_or_tab_eol` to own fileLibravatar Titus Wormer1-8/+8
2022-08-11Refactor to move some code to `event.rs`Libravatar Titus Wormer1-64/+64
2022-08-11Refactor to move some code to `state.rs`Libravatar Titus Wormer1-35/+36
2022-08-11Refactor internal docs, code style of tokenizerLibravatar Titus Wormer1-11/+11
2022-08-10Add `State::Retry`Libravatar Titus Wormer1-39/+19
2022-08-10Rename `State::Fn` to `State::Next`Libravatar Titus Wormer1-32/+32
2022-08-09Add support for passing `ok`, `nok` as separate states to attemptsLibravatar Titus Wormer1-20/+40
2022-08-09Rewrite algorithm to not pass around boxed functionsLibravatar Titus Wormer1-68/+72
* Pass state names from an enum around instead of boxed functions * Refactor to simplify attempts a lot * Use a subtokenizer for the the `document` content type
2022-08-02Refactor to remove most closuresLibravatar Titus Wormer1-87/+83
2022-07-29Refactor to improve statesLibravatar Titus Wormer1-81/+42
* Remove custom kind wrappers, use plain bytes instead * Remove `Into`s, use the explicit expected types instead * Refactor to use `slice.as_str` in most places * Remove unneeded unique check before adding a definition * Use a shared CDATA prefix in constants * Inline byte checks into matches * Pass bytes back from parser instead of whole parse state * Refactor to work more often on bytes * Rename custom `size` to `len`
2022-07-29Refactor to work on bytes (`u8`)Libravatar Titus Wormer1-28/+28
2022-07-28Refactor to work on `char`sLibravatar Titus Wormer1-38/+27
Previously, a custom char implementation was used. This was easier to work with, as sometimes “virtual” characters are injected, or characters are ignored. This replaces that with working on actual `char`s. In the hope of in the future working on `u8`s, even. This simplifies the state machine somewhat, as only `\n` is fed, regardless of whether it was a CRLF, CR, or LF. It also feeds `' '` instead of virtual spaces. The BOM, if present, is now available as a `ByteOrderMark` event.
2022-07-25Refactor to not pass codes aroundLibravatar Titus Wormer1-74/+71
2022-07-25Remove no longer needed field in `State::Ok`Libravatar Titus Wormer1-2/+2
2022-07-25Improve performance w/ a single feed loopLibravatar Titus Wormer1-3/+3
2022-07-22Refactor to remove unneeded tuples in every statesLibravatar Titus Wormer1-54/+40
2022-07-22Refactor to pass ints instead of vecs aroundLibravatar Titus Wormer1-28/+21
2022-07-18Add support for turning off constructsLibravatar Titus Wormer1-8/+26
2022-07-18Refactor examples of statesLibravatar Titus Wormer1-67/+78
2022-07-15Add missing docs to html (flow)Libravatar Titus Wormer1-1/+7
2022-07-15Remove unneeded fieldLibravatar Titus Wormer1-9/+5
2022-07-15Fix lazy first line in code (fenced)Libravatar Titus Wormer1-13/+7
2022-07-11Add support for lazy linesLibravatar Titus Wormer1-14/+30
2022-07-08Fix closing of flow when exiting containersLibravatar Titus Wormer1-0/+1
2022-07-08Add support for concrete constructsLibravatar Titus Wormer1-3/+16
2022-07-07Refactor to move token types to `token`Libravatar Titus Wormer1-39/+40
2022-07-05Refactor code styleLibravatar Titus Wormer1-11/+18
2022-07-01Make paragraphs really fastLibravatar Titus Wormer1-1/+4
The approach that `micromark-js` takes is as follows: to parse a paragraph, check whether each line starts with something else. If it does, exit, otherwise continue. That is slow, because our actual flow parser does similar things: the work was being done twice. To fix this, this commit introduces parsing each line of a paragraph separately. And finally, when done with flow, combining adjacent paragraphs. This same mechanism is reused for setext headings. Additionally, this commit adds support for interrupting things (or not). E.g., HTML (flow, complete) cannot interrupt paragraphs. Definitions cannot interrupt paragraphs, and connect be interrupted either, but they can follow each other.
2022-07-01Refactor to reorder token typesLibravatar Titus Wormer1-1/+1
2022-06-28Fix jumps in `edit_map`Libravatar Titus Wormer1-6/+6
* Use resolve more often (e.g., heading (atx, setext)) * Fix to link whole phrasing (e.g., one big chunk of text in heading (atx, setext), titles, labels) * Replace `ChunkText`, `ChunkString`, with `event.content_type: Option<ContentType>` * Refactor to externalize `edit_map` from `label`
2022-06-22Refactor some unneeded assignmentsLibravatar Titus Wormer1-4/+2
2022-06-22Add `attempt_opt` to tokenizerLibravatar Titus Wormer1-17/+39
2022-06-22Rename `Whitespace` token to `SpaceOrTab`Libravatar Titus Wormer1-2/+2
2022-06-22Add docs for token typesLibravatar Titus Wormer1-0/+11
2022-06-21Refactor to improve a bunch of statesLibravatar Titus Wormer1-26/+42
* Improve passing stuff around * Add traits to enums for markers and such * Fix “life time” stuff I didn’t understand
2022-06-20Add improved whitespace handlingLibravatar Titus Wormer1-123/+46
* add several helpers for parsing betwen x and y `space_or_tab`s * use those helpers in a bunch of places * move initial indent parsing to flow constructs themselves
2022-06-20Add paragraphLibravatar Titus Wormer1-1/+4
2022-06-20Remove unneeded `content` content typeLibravatar Titus Wormer1-1/+1
2022-06-15Add code (text)Libravatar Titus Wormer1-8/+5
2022-06-14Reorganize to split utilLibravatar Titus Wormer1-3/+3
2022-06-13Add some improved docsLibravatar Titus Wormer1-4/+7