class documentation

class Tokenizer:

Known subclasses: pygments.lexers.robotframework.Comment, pygments.lexers.robotframework.ForLoop, pygments.lexers.robotframework.ImportSetting, pygments.lexers.robotframework.KeywordCall, pygments.lexers.robotframework.Setting, pygments.lexers.robotframework.TemplatedKeywordCall, pygments.lexers.robotframework.Variable

View In Hierarchy

Undocumented

Method __init__ Undocumented
Method ​_is​_assign Undocumented
Method ​_tokenize Undocumented
Method tokenize Undocumented
Class Variable ​_tokens Undocumented
Instance Variable ​_index Undocumented
def _is_assign(self, value):

Undocumented

def tokenize(self, value):

Undocumented

_index: int =

Undocumented