index
:
markdown-rs
main
CommonMark compliant markdown parser in Rust with ASTs and extensions
cel
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
src
/
tokenizer.rs
(
follow
)
Commit message (
Expand
)
Author
Age
Files
Lines
...
*
Refactor to remove unneeded `Option`
Titus Wormer
2022-07-22
1
-14
/
+18
*
Refactor to use a single shared edit map
Titus Wormer
2022-07-22
1
-16
/
+7
*
Refactor to reserve some more vecs
Titus Wormer
2022-07-22
1
-5
/
+9
*
Refactor to pass more references around
Titus Wormer
2022-07-22
1
-26
/
+39
*
Refactor to remove unneeded tuples in every states
Titus Wormer
2022-07-22
1
-60
/
+50
*
Refactor to pass ints instead of vecs around
Titus Wormer
2022-07-22
1
-74
/
+47
*
Refactor to move `index` field to `point`
Titus Wormer
2022-07-21
1
-19
/
+10
*
Refactor to move some event fields to `link`
Titus Wormer
2022-07-21
1
-11
/
+24
*
Refactor to share edit map
Titus Wormer
2022-07-20
1
-2
/
+17
*
Refactor to use less vecs for events
Titus Wormer
2022-07-20
1
-7
/
+5
*
Remove a couple of clones
Titus Wormer
2022-07-19
1
-3
/
+2
*
Refactor to remove cloning in `edit_map`
Titus Wormer
2022-07-19
1
-0
/
+1
*
Use `edit_map` in `subtokenize`
Titus Wormer
2022-07-19
1
-2
/
+0
*
Remove an unneeded `HashMap`
Titus Wormer
2022-07-19
1
-15
/
+43
*
Fix token that should be void
Titus Wormer
2022-07-18
1
-1
/
+10
*
Add docs and refactor list
Titus Wormer
2022-07-15
1
-1
/
+1
*
Add docs and refactor document content type
Titus Wormer
2022-07-15
1
-1
/
+10
*
Add missing docs to tokenizer
Titus Wormer
2022-07-15
1
-14
/
+16
*
Fix annoying bug around virtual spaces in containers
Titus Wormer
2022-07-15
1
-18
/
+22
*
Add support for container state
Titus Wormer
2022-07-14
1
-0
/
+10
*
Add support for lazy lines
Titus Wormer
2022-07-11
1
-1
/
+0
*
Fix block quote bugs
Titus Wormer
2022-07-11
1
-5
/
+6
*
Fix positional info on line ending after shift
Titus Wormer
2022-07-08
1
-4
/
+17
*
Fix closing of flow when exiting containers
Titus Wormer
2022-07-08
1
-14
/
+30
*
Add support for concrete constructs
Titus Wormer
2022-07-08
1
-0
/
+4
*
Refactor to move token types to `token`
Titus Wormer
2022-07-07
1
-1774
/
+6
*
Fix some small to dos
Titus Wormer
2022-07-07
1
-1
/
+2
*
Add docs for block quote tokens
Titus Wormer
2022-07-07
1
-1
/
+76
*
Fix order of tokens
Titus Wormer
2022-07-07
1
-77
/
+77
*
Add basic support for block quotes
Titus Wormer
2022-07-07
1
-12
/
+26
*
Add support for `Flow` content type
Titus Wormer
2022-07-07
1
-0
/
+2
*
Add `go_until` to tokenizer
Titus Wormer
2022-07-07
1
-7
/
+37
*
Refactor to do some to dos
Titus Wormer
2022-07-05
1
-18
/
+130
*
Refactor code style
Titus Wormer
2022-07-05
1
-78
/
+0
*
Add support for unicode punctuation
Titus Wormer
2022-07-04
1
-1
/
+1
*
Update list of todos
Titus Wormer
2022-07-04
1
-2
/
+0
*
Add support for attention (emphasis, strong)
Titus Wormer
2022-07-04
1
-0
/
+9
*
Make paragraphs really fast
Titus Wormer
2022-07-01
1
-0
/
+3
*
Add support for trimming whitespace around string, text
Titus Wormer
2022-06-30
1
-1
/
+8
*
Add docs on resolver, clean feed
Titus Wormer
2022-06-30
1
-77
/
+97
*
Refactor to reorder token types
Titus Wormer
2022-06-30
1
-303
/
+303
*
Add docs to image, link, and other media tokens
Titus Wormer
2022-06-30
1
-16
/
+434
*
Refactor to externalize handlers of compiler
Titus Wormer
2022-06-29
1
-1
/
+1
*
Fix jumps in `edit_map`
Titus Wormer
2022-06-28
1
-33
/
+16
*
Add link, images (resource)
Titus Wormer
2022-06-24
1
-5
/
+106
*
Refactor some unneeded assignments
Titus Wormer
2022-06-22
1
-3
/
+1
*
Add `attempt_opt` to tokenizer
Titus Wormer
2022-06-22
1
-35
/
+30
*
Rename `Whitespace` token to `SpaceOrTab`
Titus Wormer
2022-06-22
1
-15
/
+15
*
Refactor to improve tokenizer, add docs
Titus Wormer
2022-06-22
1
-144
/
+58
*
Add docs for token types
Titus Wormer
2022-06-22
1
-6
/
+1102
[prev]
[next]