scrapy.spiders.crawl

module documentation

This modules implements the CrawlSpider which is the recommended spider to use for scraping typical web sites that requires crawling pages.

See documentation in docs/topics/spiders.rst

Class ​Rule Undocumented
Class ​Crawl​Spider Undocumented
Function ​_get​_method Undocumented
Function ​_identity Undocumented
Function ​_identity​_process​_request Undocumented
Variable ​_default​_link​_extractor Undocumented
def _get_method(method, spider):

Undocumented

def _identity(x):

Undocumented

def _identity_process_request(request, response):

Undocumented

_default_link_extractor =

Undocumented