scrapy.downloadermiddlewares.ajaxcrawl.AjaxCrawlMiddleware

class documentation

class AjaxCrawlMiddleware:

View In Hierarchy

Handle 'AJAX crawlable' pages marked as crawlable via meta tag. For more info see https://developers.google.com/webmasters/ajax-crawling/docs/getting-started.
Class Method from​_crawler Undocumented
Method __init__ Undocumented
Method ​_has​_ajax​_crawlable​_variant Return True if a page without hash fragment could be "AJAX crawlable" according to https://developers.google.com/webmasters/ajax-crawling/docs/getting-started.
Method process​_response Undocumented
Instance Variable lookup​_bytes Undocumented
@classmethod
def from_crawler(cls, crawler):

Undocumented

def __init__(self, settings):

Undocumented

def _has_ajax_crawlable_variant(self, response):
Return True if a page without hash fragment could be "AJAX crawlable" according to https://developers.google.com/webmasters/ajax-crawling/docs/getting-started.
def process_response(self, request, response, spider):

Undocumented

lookup_bytes =

Undocumented