scrapy.extensions.feedexport.FeedExporter

class documentation

class FeedExporter:

View In Hierarchy

Undocumented

Class Method from​_crawler Undocumented
Method __init__ Undocumented
Method ​_close​_slot Undocumented
Method ​_exporter​_supported Undocumented
Method ​_get​_exporter Undocumented
Method ​_get​_instance Undocumented
Method ​_get​_storage Fork of create_instance specific to feed storage classes
Method ​_get​_uri​_params Undocumented
Method ​_handle​_store​_error Undocumented
Method ​_handle​_store​_success Undocumented
Method ​_load​_components Undocumented
Method ​_settings​_are​_valid If FEED_EXPORT_BATCH_ITEM_COUNT setting or FEEDS.batch_item_count is specified uri has to contain %(batch_time)s or %(batch_id)d to distinguish different files of partial output
Method ​_start​_new​_batch No summary
Method ​_storage​_supported Undocumented
Method close​_spider Undocumented
Method item​_scraped Undocumented
Method open​_spider Undocumented
Instance Variable crawler Undocumented
Instance Variable exporters Undocumented
Instance Variable feeds Undocumented
Instance Variable settings Undocumented
Instance Variable slots Undocumented
Instance Variable storages Undocumented
@classmethod
def from_crawler(cls, crawler):

Undocumented

def __init__(self, crawler):

Undocumented

def _close_slot(self, slot, spider):

Undocumented

def _exporter_supported(self, format):

Undocumented

def _get_exporter(self, file, format, *args, **kwargs):

Undocumented

def _get_instance(self, objcls, *args, **kwargs):

Undocumented

def _get_storage(self, uri, feed_options):

Fork of create_instance specific to feed storage classes

It supports not passing the feed_options parameters to classes that do not support it, and issuing a deprecation warning instead.

def _get_uri_params(self, spider, uri_params, slot=None):

Undocumented

def _handle_store_error(self, f, largs, logfmt, spider, slot_type):

Undocumented

def _handle_store_success(self, f, largs, logfmt, spider, slot_type):

Undocumented

def _load_components(self, setting_prefix):

Undocumented

def _settings_are_valid(self):
If FEED_EXPORT_BATCH_ITEM_COUNT setting or FEEDS.batch_item_count is specified uri has to contain %(batch_time)s or %(batch_id)d to distinguish different files of partial output
def _start_new_batch(self, batch_id, uri, feed_options, spider, uri_template):
Redirect the output data stream to a new file. Execute multiple times if FEED_EXPORT_BATCH_ITEM_COUNT setting or FEEDS.batch_item_count is specified :param batch_id: sequence number of current batch :param uri: uri of the new batch to start :param feed_options: dict with parameters of feed :param spider: user spider :param uri_template: template of uri which contains %(batch_time)s or %(batch_id)d to create new uri
def _storage_supported(self, uri, feed_options):

Undocumented

def close_spider(self, spider):

Undocumented

def item_scraped(self, item, spider):

Undocumented

def open_spider(self, spider):

Undocumented

crawler =

Undocumented

exporters =

Undocumented

feeds: dict =

Undocumented

settings =

Undocumented

slots =

Undocumented

storages =

Undocumented