scrapy.spiderloader.SpiderLoader

class documentation

class SpiderLoader:

View In Hierarchy

SpiderLoader is a class which locates and loads spiders in a Scrapy project.
Class Method from​_settings Undocumented
Method find​_by​_request Return the list of spider names that can handle the given request.
Method list Return a list with the names of all spiders available in the project.
Method load Return the Spider class for the given spider name. If the spider name is not found, raise a KeyError.
Method __init__ Undocumented
Method ​_check​_name​_duplicates Undocumented
Method ​_load​_all​_spiders Undocumented
Method ​_load​_spiders Undocumented
Instance Variable ​_found Undocumented
Instance Variable ​_spiders Undocumented
Instance Variable spider​_modules Undocumented
Instance Variable warn​_only Undocumented
@classmethod
def from_settings(cls, settings):

Undocumented

def find_by_request(self, request):
Return the list of spider names that can handle the given request.
def list(self):
Return a list with the names of all spiders available in the project.
def load(self, spider_name):
Return the Spider class for the given spider name. If the spider name is not found, raise a KeyError.
def __init__(self, settings):

Undocumented

def _check_name_duplicates(self):

Undocumented

def _load_all_spiders(self):

Undocumented

def _load_spiders(self, module):

Undocumented

_found =

Undocumented

_spiders: dict =

Undocumented

spider_modules =

Undocumented

warn_only =

Undocumented