scrapy.downloadermiddlewares.httpcache.HttpCacheMiddleware

class documentation

class HttpCacheMiddleware:

View In Hierarchy

Undocumented

Class Method from​_crawler Undocumented
Constant DOWNLOAD​_EXCEPTIONS Undocumented
Method __init__ Undocumented
Method ​_cache​_response Undocumented
Method process​_exception Undocumented
Method process​_request Undocumented
Method process​_response Undocumented
Method spider​_closed Undocumented
Method spider​_opened Undocumented
Instance Variable ignore​_missing Undocumented
Instance Variable policy Undocumented
Instance Variable stats Undocumented
Instance Variable storage Undocumented
@classmethod
def from_crawler(cls, crawler):

Undocumented

Parameters
crawler:CrawlerUndocumented
Returns
HttpCacheMiddlewareTVUndocumented
DOWNLOAD_EXCEPTIONS =

Undocumented

Value
(defer.TimeoutError,
 TimeoutError,
 DNSLookupError,
 ConnectionRefusedError,
 ConnectionDone,
 ConnectError,
 ConnectionLost,
...
def __init__(self, settings, stats):

Undocumented

Parameters
settings:SettingsUndocumented
stats:StatsCollectorUndocumented
def _cache_response(self, spider, response, request, cachedresponse):

Undocumented

Parameters
spider:SpiderUndocumented
response:ResponseUndocumented
request:RequestUndocumented
cachedresponse:Optional[Response]Undocumented
def process_exception(self, request, exception, spider):

Undocumented

Parameters
request:RequestUndocumented
exception:ExceptionUndocumented
spider:SpiderUndocumented
Returns
Optional[Response]Undocumented
def process_request(self, request, spider):

Undocumented

Parameters
request:RequestUndocumented
spider:SpiderUndocumented
Returns
Optional[Response]Undocumented
def process_response(self, request, response, spider):

Undocumented

Parameters
request:RequestUndocumented
response:ResponseUndocumented
spider:SpiderUndocumented
Returns
ResponseUndocumented
def spider_closed(self, spider):

Undocumented

Parameters
spider:SpiderUndocumented
def spider_opened(self, spider):

Undocumented

Parameters
spider:SpiderUndocumented
ignore_missing =

Undocumented

policy =

Undocumented

stats =

Undocumented

storage =

Undocumented