Class | AutoLink |
Autolink tokens. ("<http://www.google.com>") |
Class | CoreTokens |
Undocumented |
Class | Emphasis |
Emphasis tokens. ("some text") |
Class | EscapeSequence |
Escape sequences. ("*") |
Class | HTMLSpan |
Span-level HTML tokens. |
Class | Image |
Image tokens. ("![alt](src "title")") |
Class | InlineCode |
Inline code tokens. ("some code ") |
Class | LineBreak |
Hard or soft line breaks. |
Class | Link |
Link tokens. ("[name](target)") |
Class | RawText |
Raw text. A leaf node. |
Class | SpanToken |
Undocumented |
Class | Strikethrough |
Strikethrough tokens. ("~~some text~~") |
Class | Strong |
Strong tokens. ("some text") |
Class | XWikiBlockMacroEnd |
A "block" macro closing tag. ("<onlySpacesAllowed>{{/macroName}}") |
Class | XWikiBlockMacroStart |
A "block" macro opening tag. ("{{macroName<optionalParams>}}<newLine>") |
Function | add_token |
Allows external manipulation of the parsing process. This function is called in BaseRenderer.__enter__. |
Function | remove_token |
Allows external manipulation of the parsing process. This function is called in BaseRenderer.__exit__. |
Function | reset_tokens |
Resets global _token_types to all token classes in __all__. |
Function | tokenize_inner |
A wrapper around span_tokenizer.tokenize. Pass in all span-level token constructors as arguments to span_tokenizer.tokenize. |
Variable | _attrs |
Undocumented |
Variable | _cdata |
Undocumented |
Variable | _closing_tag |
Undocumented |
Variable | _comment |
Undocumented |
Variable | _declaration |
Undocumented |
Variable | _instruction |
Undocumented |
Variable | _open_tag |
Undocumented |
Variable | _root_node |
Undocumented |
Variable | _tag |
Undocumented |
Variable | _tags |
Undocumented |
Variable | _token_types |
Undocumented |
Parameters | |
token_cls:SpanToken | token to be included in the parsing process. |
position | Undocumented |
Parameters | |
token_cls:SpanToken | token to be removed from the parsing process. |
A wrapper around span_tokenizer.tokenize. Pass in all span-level token constructors as arguments to span_tokenizer.tokenize.
Doing so (instead of importing span_token module in span_tokenizer) avoids cyclic dependency issues, and allows for future injections of custom token classes.
_token_types variable is at the bottom of this module.
See also: span_tokenizer.tokenize, block_token.tokenize.