From 0fcfeaf05a95ea17763a72d91b6aa1c01843d067 Mon Sep 17 00:00:00 2001 From: Titus Wormer Date: Wed, 22 Jun 2022 12:34:23 +0200 Subject: Add docs for token types --- readme.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) (limited to 'readme.md') diff --git a/readme.md b/readme.md index 94e127e..e4983a5 100644 --- a/readme.md +++ b/readme.md @@ -68,7 +68,6 @@ cargo doc --document-private-items #### Docs -- [ ] (1) Add docs for token types - [ ] (1) Add docs for tokenizer (`go`, `define_skip`, `account_for_potential_skip`, `attempt_5`, `attempt_7`, `call_multiple`) - [ ] (1) Add docs for sanitation (autolink, definition, resource) @@ -234,6 +233,7 @@ cargo doc --document-private-items - [x] (1) Add docs for virtual spaces - [x] (1) Add docs to `subtokenize.rs` - [x] (1) Add docs for `link.rs` +- [x] (1) Add docs for token types ### Extensions -- cgit