scrapy.commands.parse.Command

class documentation

class Command(BaseRunSpiderCommand):

View In Hierarchy

Undocumented

Method add​_items Undocumented
Method add​_options Populate option parse with options available for this command
Method add​_requests Undocumented
Method get​_callback​_from​_rules Undocumented
Method prepare​_request Undocumented
Method print​_items Undocumented
Method print​_requests Undocumented
Method print​_results Undocumented
Method process​_options Undocumented
Method process​_request​_cb​_kwargs Undocumented
Method process​_request​_meta Undocumented
Method run Entry point for running commands
Method run​_callback Undocumented
Method set​_spidercls Undocumented
Method short​_desc A short description of the command
Method start​_parsing Undocumented
Method syntax Command syntax (preferably one-line). Do not include command name.
Class Variable first​_response Undocumented
Class Variable items Undocumented
Class Variable requests Undocumented
Class Variable requires​_project Undocumented
Class Variable spider Undocumented
Instance Variable pcrawler Undocumented
Instance Variable spidercls Undocumented
Property max​_level Undocumented

Inherited from ScrapyCommand (via BaseRunSpiderCommand):

Method __init__ Undocumented
Method help An extensive help for the command. It will be shown when using the "help" command. It can contain newlines, since no post-formatting will be applied to its contents.
Method long​_desc A long description of the command. Return short description when not available. It cannot contain newlines, since contents will be formatted by optparser which removes newlines and wraps text.
Method set​_crawler Undocumented
Class Variable crawler​_process Undocumented
Class Variable default​_settings Undocumented
Class Variable exitcode Undocumented
Instance Variable ​_crawler Undocumented
Instance Variable settings Undocumented
def add_items(self, lvl, new_items):

Undocumented

def add_options(self, parser):
overrides scrapy.commands.BaseRunSpiderCommand.add_options
Populate option parse with options available for this command
def add_requests(self, lvl, new_reqs):

Undocumented

def get_callback_from_rules(self, spider, response):

Undocumented

def prepare_request(self, spider, request, opts):

Undocumented

def print_items(self, lvl=None, colour=True):

Undocumented

def print_requests(self, lvl=None, colour=True):

Undocumented

def print_results(self, opts):

Undocumented

def process_options(self, args, opts):
overrides scrapy.commands.BaseRunSpiderCommand.process_options

Undocumented

def process_request_cb_kwargs(self, opts):

Undocumented

def process_request_meta(self, opts):

Undocumented

def run(self, args, opts):
overrides scrapy.commands.ScrapyCommand.run
Entry point for running commands
def run_callback(self, response, callback, cb_kwargs=None):

Undocumented

def set_spidercls(self, url, opts):

Undocumented

def short_desc(self):
overrides scrapy.commands.ScrapyCommand.short_desc
A short description of the command
def start_parsing(self, url, opts):

Undocumented

def syntax(self):
overrides scrapy.commands.ScrapyCommand.syntax
Command syntax (preferably one-line). Do not include command name.
first_response =

Undocumented

items: Dict[int, list] =

Undocumented

requests: Dict[int, list] =

Undocumented

requires_project: bool =
overrides scrapy.commands.ScrapyCommand.requires_project

Undocumented

spider =

Undocumented

pcrawler =

Undocumented

spidercls =

Undocumented

@property
max_level =

Undocumented