From 5133042973f31a3992f216e591d840bb491bfd45 Mon Sep 17 00:00:00 2001 From: Titus Wormer Date: Fri, 10 Jun 2022 16:29:56 +0200 Subject: Add proper support for subtokenization MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit - Add “content” content type - Add paragraph - Add skips - Add linked tokens --- readme.md | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-) (limited to 'readme.md') diff --git a/readme.md b/readme.md index 15edf87..cf42885 100644 --- a/readme.md +++ b/readme.md @@ -46,8 +46,6 @@ cargo doc --document-private-items ### Some major obstacles -- [ ] (8) Subtokenization: figure out a good, fast way to deal with constructs in - one content type that also are another content type - [ ] (1) Setext headings: can they be solved in content, or do they have to be solved in flow somehow - [ ] (8) Can content (and to a lesser extent string and text) operate more @@ -152,6 +150,11 @@ cargo doc --document-private-items - [x] character escape - [x] character reference +### Done + +- [x] (8) Subtokenization: figure out a good, fast way to deal with constructs in + one content type that also are another content type + ### Extensions The main thing here is is to figure out if folks could extend from the outside -- cgit