class documentation

class Lexer:

Known subclasses: django.utils.jslex.JsLexer

View In Hierarchy

A generic multi-state regex-based lexer.
Method __init__ Undocumented
Method lex Lexically analyze text.
Instance Variable regexes Undocumented
Instance Variable state Undocumented
Instance Variable toks Undocumented
def __init__(self, states, first):

Undocumented

def lex(self, text):

Lexically analyze text.

Yield pairs (name, tokentext).

regexes: dict =

Undocumented

state =

Undocumented

toks: dict =

Undocumented