class documentation

class Crawler:

View In Hierarchy

Undocumented

Method crawl Undocumented
Method stop Starts a graceful stop of the crawler and returns a deferred that is fired when the crawler is stopped.
Instance Variable engine Undocumented
Instance Variable extensions Undocumented
Instance Variable settings Undocumented
Instance Variable signals Undocumented
Instance Variable spider Undocumented
Instance Variable stats Undocumented
Method __init__ Undocumented
Method ​_create​_engine Undocumented
Method ​_create​_spider Undocumented
Instance Variable __remove​_handler Undocumented
Instance Variable crawling Undocumented
Instance Variable logformatter Undocumented
Instance Variable spidercls Undocumented
@defer.inlineCallbacks
def crawl(self, *args, **kwargs):

Undocumented

@defer.inlineCallbacks
def stop(self):
Starts a graceful stop of the crawler and returns a deferred that is fired when the crawler is stopped.
engine =

Undocumented

extensions =

Undocumented

settings =

Undocumented

signals =

Undocumented

spider =

Undocumented

stats =

Undocumented

def __init__(self, spidercls, settings=None):

Undocumented

def _create_engine(self):

Undocumented

def _create_spider(self, *args, **kwargs):

Undocumented

__remove_handler =

Undocumented

crawling: bool =

Undocumented

logformatter =

Undocumented

spidercls =

Undocumented