aboutsummaryrefslogtreecommitdiffstats
path: root/src/content/text.rs (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Rewrite algorithm to not pass around boxed functionsLibravatar Titus Wormer2022-08-091-23/+22
| | | | | | * Pass state names from an enum around instead of boxed functions * Refactor to simplify attempts a lot * Use a subtokenizer for the the `document` content type
* Refactor to remove most closuresLibravatar Titus Wormer2022-08-021-9/+13
|
* Refactor to work on bytes (`u8`)Libravatar Titus Wormer2022-07-291-10/+10
|
* Refactor to work on `char`sLibravatar Titus Wormer2022-07-281-12/+12
| | | | | | | | | | | | | | | Previously, a custom char implementation was used. This was easier to work with, as sometimes “virtual” characters are injected, or characters are ignored. This replaces that with working on actual `char`s. In the hope of in the future working on `u8`s, even. This simplifies the state machine somewhat, as only `\n` is fed, regardless of whether it was a CRLF, CR, or LF. It also feeds `' '` instead of virtual spaces. The BOM, if present, is now available as a `ByteOrderMark` event.
* Refactor to drastically improve perf around whitespaceLibravatar Titus Wormer2022-07-261-26/+31
|
* Refactor to not pass codes aroundLibravatar Titus Wormer2022-07-251-5/+5
|
* Remove no longer needed field in `State::Ok`Libravatar Titus Wormer2022-07-251-1/+1
|
* Refactor to remove unneeded tuples in every statesLibravatar Titus Wormer2022-07-221-4/+4
|
* Refactor to pass ints instead of vecs aroundLibravatar Titus Wormer2022-07-221-1/+1
|
* Refactor to improve performance by passing markers aroundLibravatar Titus Wormer2022-07-211-46/+19
|
* Refactor to improve performance when constructs are turned offLibravatar Titus Wormer2022-07-181-27/+48
|
* Add support for turning off constructsLibravatar Titus Wormer2022-07-181-0/+1
|
* Refactor code styleLibravatar Titus Wormer2022-07-051-4/+4
|
* Add support for attention (emphasis, strong)Libravatar Titus Wormer2022-07-041-7/+11
|
* Add support for trimming whitespace around string, textLibravatar Titus Wormer2022-06-301-9/+13
| | | | | | | | | | | | | This commit introduces trimming initial and final whitespace around the whole string or text, or around line endings inside that string or text. * Add `register_resolver_before`, to run resolvers earlier than others, used for labels * Add resolver to merge `data` events, which are the most frequent token that occurs, and can happen adjacently. In `micromark-js` this sped up parsing a lot * Fix a bug where a virtual space was not seen as an okay event * Refactor to enable all turned off whitespace tests
* Refactor some docs, fix some grammarLibravatar Titus Wormer2022-06-301-2/+3
|
* Add link, images (resource)Libravatar Titus Wormer2022-06-241-5/+12
| | | | | | | | | | | | This is still some messy code that needs cleaning up, but it adds support for links and images, of the resource kind (`[a](b)`). References (`[a][b]`) are parsed and will soon be supported, but need matching. * Fix bug to pad percent-encoded bytes when normalizing urls * Fix bug with escapes counting as balancing in destination * Add `space_or_tab_one_line_ending`, to parse whitespace including up to one line ending (but not a blank line) * Add `ParserState` to share codes, definitions, etc
* Refactor to improve tokenizer, add docsLibravatar Titus Wormer2022-06-221-8/+10
|
* Make data a constructLibravatar Titus Wormer2022-06-211-41/+12
|
* Refactor to reorder thing alphabeticallyLibravatar Titus Wormer2022-06-161-1/+0
|
* Add support for hard break (trailing)Libravatar Titus Wormer2022-06-161-6/+9
|
* Add support for hard break escapeLibravatar Titus Wormer2022-06-161-3/+4
|
* Add code (text)Libravatar Titus Wormer2022-06-151-4/+6
|
* Fix support for deep subtokenizationLibravatar Titus Wormer2022-06-141-7/+14
| | | | | | * Fix a couple of forgotten line ending handling in html (text) * Fix missing initial case for html (text) not having a `<` 😬 * Add line ending handling to `text` construct
* Add docs for html (text)Libravatar Titus Wormer2022-06-141-1/+1
|
* Add basic html (text)Libravatar Titus Wormer2022-06-131-5/+9
| | | | | | | * Add all states for html (text) * Fix to link paragraph tokens together * Add note about uncovered bug where linking paragraph tokens together doesn’t work 😅
* Add autolinksLibravatar Titus Wormer2022-06-131-4/+5
|
* Add text content typeLibravatar Titus Wormer2022-06-101-0/+80
* Add character reference and character escapes in text * Add recursive subtokenization