aboutsummaryrefslogtreecommitdiffstats
path: root/src/content/flow.rs (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Rewrite algorithm to not pass around boxed functionsLibravatar Titus Wormer2022-08-091-27/+30
| | | | | | * Pass state names from an enum around instead of boxed functions * Refactor to simplify attempts a lot * Use a subtokenizer for the the `document` content type
* Refactor to work on bytes (`u8`)Libravatar Titus Wormer2022-07-291-2/+2
|
* Refactor to work on `char`sLibravatar Titus Wormer2022-07-281-7/+7
| | | | | | | | | | | | | | | Previously, a custom char implementation was used. This was easier to work with, as sometimes “virtual” characters are injected, or characters are ignored. This replaces that with working on actual `char`s. In the hope of in the future working on `u8`s, even. This simplifies the state machine somewhat, as only `\n` is fed, regardless of whether it was a CRLF, CR, or LF. It also feeds `' '` instead of virtual spaces. The BOM, if present, is now available as a `ByteOrderMark` event.
* Refactor to not pass codes aroundLibravatar Titus Wormer2022-07-251-14/+14
|
* Remove no longer needed field in `State::Ok`Libravatar Titus Wormer2022-07-251-4/+4
|
* Refactor to remove unneeded tuples in every statesLibravatar Titus Wormer2022-07-221-12/+12
|
* Refactor to pass ints instead of vecs aroundLibravatar Titus Wormer2022-07-221-6/+6
|
* Refactor to move token types to `token`Libravatar Titus Wormer2022-07-071-5/+6
|
* Add basic support for block quotesLibravatar Titus Wormer2022-07-071-47/+2
|
* Refactor code styleLibravatar Titus Wormer2022-07-051-2/+2
|
* Add support for unicode punctuationLibravatar Titus Wormer2022-07-041-1/+1
|
* Update list of todosLibravatar Titus Wormer2022-07-041-1/+1
|
* Make paragraphs really fastLibravatar Titus Wormer2022-07-011-22/+24
| | | | | | | | | | | | | | | | | | The approach that `micromark-js` takes is as follows: to parse a paragraph, check whether each line starts with something else. If it does, exit, otherwise continue. That is slow, because our actual flow parser does similar things: the work was being done twice. To fix this, this commit introduces parsing each line of a paragraph separately. And finally, when done with flow, combining adjacent paragraphs. This same mechanism is reused for setext headings. Additionally, this commit adds support for interrupting things (or not). E.g., HTML (flow, complete) cannot interrupt paragraphs. Definitions cannot interrupt paragraphs, and connect be interrupted either, but they can follow each other.
* Add support for sharing identifiers, references before definitionsLibravatar Titus Wormer2022-06-291-5/+7
|
* Add link, images (resource)Libravatar Titus Wormer2022-06-241-6/+14
| | | | | | | | | | | | This is still some messy code that needs cleaning up, but it adds support for links and images, of the resource kind (`[a](b)`). References (`[a][b]`) are parsed and will soon be supported, but need matching. * Fix bug to pad percent-encoded bytes when normalizing urls * Fix bug with escapes counting as balancing in destination * Add `space_or_tab_one_line_ending`, to parse whitespace including up to one line ending (but not a blank line) * Add `ParserState` to share codes, definitions, etc
* Add support for normalizing identifiersLibravatar Titus Wormer2022-06-221-1/+24
|
* Refactor to improve tokenizer, add docsLibravatar Titus Wormer2022-06-221-8/+10
|
* Add some more enabled testsLibravatar Titus Wormer2022-06-201-1/+0
|
* Add improved whitespace handlingLibravatar Titus Wormer2022-06-201-34/+11
| | | | | | * add several helpers for parsing betwen x and y `space_or_tab`s * use those helpers in a bunch of places * move initial indent parsing to flow constructs themselves
* Add paragraphLibravatar Titus Wormer2022-06-201-130/+9
|
* Remove unneeded `content` content typeLibravatar Titus Wormer2022-06-201-27/+27
|
* Add support for definitionsLibravatar Titus Wormer2022-06-171-9/+15
| | | | | | * Add definitions * Add partials for label, destination, title * Add `go`, to attempt something, and do something else on `ok`
* Add heading (setext)Libravatar Titus Wormer2022-06-161-11/+8
|
* Reorganize to split utilLibravatar Titus Wormer2022-06-141-2/+2
|
* Add text content typeLibravatar Titus Wormer2022-06-101-5/+9
| | | | | * Add character reference and character escapes in text * Add recursive subtokenization
* Add proper support for subtokenizationLibravatar Titus Wormer2022-06-101-19/+26
| | | | | | | - Add “content” content type - Add paragraph - Add skips - Add linked tokens
* Add basic subtokenization, string content in fenced codeLibravatar Titus Wormer2022-06-091-17/+6
|
* Refactor to pass more slices aroundLibravatar Titus Wormer2022-06-091-1/+1
|
* Add support for indented lines in paragraphsLibravatar Titus Wormer2022-06-091-23/+20
|
* Add basic support for interrupting contentLibravatar Titus Wormer2022-06-091-69/+95
|
* .Libravatar Titus Wormer2022-06-081-0/+258