index
:
markdown-rs
main
CommonMark compliant markdown parser in Rust with ASTs and extensions
cel
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
src
/
tokenizer.rs
(
unfollow
)
Commit message (
Expand
)
Author
Files
Lines
2022-06-22
Rename `Whitespace` token to `SpaceOrTab`
Titus Wormer
1
-15
/
+15
2022-06-22
Refactor to improve tokenizer, add docs
Titus Wormer
1
-144
/
+58
2022-06-22
Add docs for token types
Titus Wormer
1
-6
/
+1102
2022-06-21
Add support for passing token types to destination, label, title
Titus Wormer
1
-1
/
+1
2022-06-21
Refactor to improve a bunch of states
Titus Wormer
1
-0
/
+1
2022-06-21
Update todo list
Titus Wormer
1
-16
/
+23
2022-06-21
Add support for inferring line ending, configurable
Titus Wormer
1
-2
/
+4
2022-06-20
Add support for BOM
Titus Wormer
1
-0
/
+10
2022-06-20
Fix bug with tabs
Titus Wormer
1
-1
/
+6
2022-06-20
Add improved whitespace handling
Titus Wormer
1
-27
/
+5
2022-06-20
Remove unneeded `content` content type
Titus Wormer
1
-2
/
+0
2022-06-17
Add support for definitions
Titus Wormer
1
-15
/
+67
2022-06-16
Add heading (setext)
Titus Wormer
1
-4
/
+7
2022-06-16
Refactor to reorder thing alphabetically
Titus Wormer
1
-21
/
+7
2022-06-16
Add support for hard break (trailing)
Titus Wormer
1
-2
/
+11
2022-06-16
Add support for hard break escape
Titus Wormer
1
-3
/
+11
2022-06-15
Add code (text)
Titus Wormer
1
-5
/
+22
2022-06-14
Reorganize to split util
Titus Wormer
1
-0
/
+2
2022-06-13
Add basic html (text)
Titus Wormer
1
-2
/
+32
2022-06-13
Add autolinks
Titus Wormer
1
-0
/
+5
2022-06-10
Add text content type
Titus Wormer
1
-1
/
+1
2022-06-10
Add proper support for subtokenization
Titus Wormer
1
-3
/
+37
2022-06-09
Add basic subtokenization, string content in fenced code
Titus Wormer
1
-7
/
+8
2022-06-09
Refactor to pass more slices around
Titus Wormer
1
-5
/
+5
2022-06-09
Add basic support for interrupting content
Titus Wormer
1
-1
/
+57
[prev]