diff options
| author |  cel 🌸 <cel@blos.sm> | 2024-03-04 16:14:28 +0000 |
|---|---|---|
| committer | cel 🌸 <cel@blos.sm> | 2024-03-04 16:14:28 +0000 |
| commit | 844f3a5d11e4360e9d6bdb79cfed49287aa8b14d (patch) | |
| tree | 5525c4f134ef3d7a6082935baa61e6097670c968 /src/lexer.rs | |
| download | peanuts-844f3a5d11e4360e9d6bdb79cfed49287aa8b14d.tar.gz peanuts-844f3a5d11e4360e9d6bdb79cfed49287aa8b14d.tar.bz2 peanuts-844f3a5d11e4360e9d6bdb79cfed49287aa8b14d.zip | |
initial commit
Diffstat (limited to 'src/lexer.rs')
| -rw-r--r-- | src/lexer.rs | 9 |
1 files changed, 9 insertions, 0 deletions
diff --git a/src/lexer.rs b/src/lexer.rs new file mode 100644 index 0000000..abb5ebd --- /dev/null +++ b/src/lexer.rs @@ -0,0 +1,9 @@ +// lexer: tokenizes to bits like '<', '<?', '"', etc. + +pub enum Token { + Whitespace, + OpenTag, + CloseTag, + Slash, + Text(String), +} |