aboutsummaryrefslogtreecommitdiffstats
path: root/src/token.rs (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Refactor to work on `char`sLibravatar Titus Wormer2022-07-281-1/+13
| | | | | | | | | | | | | | | Previously, a custom char implementation was used. This was easier to work with, as sometimes “virtual” characters are injected, or characters are ignored. This replaces that with working on actual `char`s. In the hope of in the future working on `u8`s, even. This simplifies the state machine somewhat, as only `\n` is fed, regardless of whether it was a CRLF, CR, or LF. It also feeds `' '` instead of virtual spaces. The BOM, if present, is now available as a `ByteOrderMark` event.
* Refactor to drastically improve perf around whitespaceLibravatar Titus Wormer2022-07-261-43/+5
|
* Remove unneeded tokenLibravatar Titus Wormer2022-07-181-22/+2
|
* Fix token that should be voidLibravatar Titus Wormer2022-07-181-0/+44
|
* Remove unneeded tokenLibravatar Titus Wormer2022-07-151-20/+1
|
* Refactor to sort, document lists in tokenLibravatar Titus Wormer2022-07-151-9/+130
|
* Fix a lot of list thingsLibravatar Titus Wormer2022-07-121-1/+3
| | | | | | | | * Add `ListItem`, `ListOrdered`, and `ListUnordered` tokens * Add support for multiline list items * Add support for tight lists * Fix bug where 10 digit long list item values worked * Fix skip bug when skipping over nested events
* Add initial support for listsLibravatar Titus Wormer2022-07-121-0/+7
|
* Refactor to move token types to `token`Libravatar Titus Wormer2022-07-071-0/+1768