scrapy.pipelines.images.ImagesPipeline

class documentation

class ImagesPipeline(FilesPipeline):

View In Hierarchy

Abstract pipeline that implement the image thumbnail generation logic
Class Method from​_settings Undocumented
Method file​_path Returns the path where downloaded media should be stored
Method get​_media​_requests Returns the media requests to download
Method item​_completed Called per item when all media requests has been processed
Constant DEFAULT​_IMAGES​_RESULT​_FIELD Undocumented
Constant DEFAULT​_IMAGES​_URLS​_FIELD Undocumented
Constant EXPIRES Undocumented
Constant MEDIA​_NAME Undocumented
Constant MIN​_HEIGHT Undocumented
Constant MIN​_WIDTH Undocumented
Constant THUMBS Undocumented
Method __init__ Undocumented
Method convert​_image Undocumented
Method file​_downloaded Undocumented
Method get​_images Undocumented
Method image​_downloaded Undocumented
Method thumb​_path Undocumented
Instance Variable _​Image Undocumented
Instance Variable expires Undocumented
Instance Variable IMAGES​_RESULT​_FIELD Undocumented
Instance Variable images​_result​_field Undocumented
Instance Variable IMAGES​_URLS​_FIELD Undocumented
Instance Variable images​_urls​_field Undocumented
Instance Variable min​_height Undocumented
Instance Variable min​_width Undocumented
Instance Variable thumbs Undocumented

Inherited from FilesPipeline:

Constant DEFAULT​_FILES​_RESULT​_FIELD Undocumented
Constant DEFAULT​_FILES​_URLS​_FIELD Undocumented
Constant STORE​_SCHEMES Undocumented
Method ​_get​_store Undocumented
Method inc​_stats Undocumented
Method media​_downloaded Handler for success downloads
Method media​_failed Handler for failed downloads
Method media​_to​_download Check request before starting download
Instance Variable FILES​_RESULT​_FIELD Undocumented
Instance Variable files​_result​_field Undocumented
Instance Variable FILES​_URLS​_FIELD Undocumented
Instance Variable files​_urls​_field Undocumented
Instance Variable store Undocumented

Inherited from MediaPipeline (via FilesPipeline):

Class Method from​_crawler Undocumented
Constant LOG​_FAILED​_RESULTS Undocumented
Class ​Spider​Info Undocumented
Method ​_cache​_result​_and​_execute​_waiters Undocumented
Method ​_check​_media​_to​_download Undocumented
Method ​_check​_signature Undocumented
Method ​_compatible Wrapper for overridable methods to allow backwards compatibility
Method ​_handle​_statuses Undocumented
Method ​_key​_for​_pipe No summary
Method ​_make​_compatible Make overridable methods of MediaPipeline and subclasses backwards compatible
Method ​_modify​_media​_request Undocumented
Method ​_process​_request Undocumented
Method open​_spider Undocumented
Method process​_item Undocumented
Instance Variable ​_expects​_item Undocumented
Instance Variable allow​_redirects Undocumented
Instance Variable download​_func Undocumented
Instance Variable handle​_httpstatus​_list Undocumented
Instance Variable spiderinfo Undocumented
@classmethod
def from_settings(cls, settings):
overrides scrapy.pipelines.files.FilesPipeline.from_settings

Undocumented

def file_path(self, request, response=None, info=None, *, item=None):
overrides scrapy.pipelines.files.FilesPipeline.file_path
Returns the path where downloaded media should be stored
def get_media_requests(self, item, info):
overrides scrapy.pipelines.files.FilesPipeline.get_media_requests
Returns the media requests to download
def item_completed(self, results, item, info):
overrides scrapy.pipelines.files.FilesPipeline.item_completed
Called per item when all media requests has been processed
DEFAULT_IMAGES_RESULT_FIELD: str =

Undocumented

Value
'images'
DEFAULT_IMAGES_URLS_FIELD: str =

Undocumented

Value
'image_urls'
EXPIRES: int =
overrides scrapy.pipelines.files.FilesPipeline.EXPIRES

Undocumented

Value
90
MEDIA_NAME: str =
overrides scrapy.pipelines.files.FilesPipeline.MEDIA_NAME

Undocumented

Value
'image'
MIN_HEIGHT: int =

Undocumented

Value
0
MIN_WIDTH: int =

Undocumented

Value
0
THUMBS: dict =

Undocumented

Value
{}
def __init__(self, store_uri, download_func=None, settings=None):
overrides scrapy.pipelines.files.FilesPipeline.__init__

Undocumented

def convert_image(self, image, size=None):

Undocumented

def file_downloaded(self, response, request, info, *, item=None):
overrides scrapy.pipelines.files.FilesPipeline.file_downloaded

Undocumented

def get_images(self, response, request, info, *, item=None):

Undocumented

def image_downloaded(self, response, request, info, *, item=None):

Undocumented

def thumb_path(self, request, thumb_id, response=None, info=None):

Undocumented

_Image =

Undocumented

expires =
overrides scrapy.pipelines.files.FilesPipeline.expires

Undocumented

IMAGES_RESULT_FIELD =

Undocumented

images_result_field =

Undocumented

IMAGES_URLS_FIELD =

Undocumented

images_urls_field =

Undocumented

min_height =

Undocumented

min_width =

Undocumented

thumbs =

Undocumented