lexer.rs « src - peanuts - ergonomic stream-based xml reader/writer serialisation library

about summary refs log tree commit diff stats

path: root/src/lexer.rs

blob: abb5ebd1e7d23ca25ffd0745e9f561fc958327f1 (plain) (blame)

// lexer: tokenizes to bits like '<', '<?', '"', etc.

pub enum Token {
    Whitespace,
    OpenTag,
    CloseTag,
    Slash,
    Text(String),
}