module documentation

Undocumented

Function arglist​_to​_dict Convert a list of arguments like ['arg1=val1', 'arg2=val2', ...] to a dict
Function build​_component​_list Compose a component list from a { class: order } dictionary.
Function closest​_scrapy​_cfg Return the path to the closest scrapy.cfg file by traversing the current directory and its parents
Function feed​_complete​_default​_values​_from​_settings Undocumented
Function feed​_process​_params​_from​_cli Receives feed export params (from the 'crawl' or 'runspider' commands), checks for inconsistencies in their quantities and returns a dictionary suitable to be used as the FEEDS setting.
Function get​_config Get Scrapy config file as a ConfigParser
Function get​_sources Undocumented
Function init​_env Initialize environment to use command-line tool from inside a project dir. This sets the Scrapy settings module and modifies the Python path to be able to locate the project module.
def arglist_to_dict(arglist):
Convert a list of arguments like ['arg1=val1', 'arg2=val2', ...] to a dict
def build_component_list(compdict, custom=None, convert=update_classpath):
Compose a component list from a { class: order } dictionary.
def closest_scrapy_cfg(path='.', prevpath=None):
Return the path to the closest scrapy.cfg file by traversing the current directory and its parents
def feed_complete_default_values_from_settings(feed, settings):

Undocumented

def feed_process_params_from_cli(settings, output, output_format=None, overwrite_output=None):
Receives feed export params (from the 'crawl' or 'runspider' commands), checks for inconsistencies in their quantities and returns a dictionary suitable to be used as the FEEDS setting.
def get_config(use_closest=True):
Get Scrapy config file as a ConfigParser
def get_sources(use_closest=True):

Undocumented

def init_env(project='default', set_syspath=True):
Initialize environment to use command-line tool from inside a project dir. This sets the Scrapy settings module and modifies the Python path to be able to locate the project module.