Enum texlang::token::lexer::Result

pub enum Result {
    Token(Token),
    InvalidCharacter(char, Key),
    EndOfLine,
    EndOfInput,
}

Result of calling Lexer::next.

Variants

Token(Token)

A token.

InvalidCharacter(char, Key)

An invalid character appeared in the input.

EndOfLine

The end of a line was reached.

This is only reported from Lexer::next if its report_end_of_line argument is true.

EndOfInput

The end of input was reached.