scrapy.utils.test

module documentation

This module contains some assorted functions used in tests
Function assert​_gcs​_environ Undocumented
Function assert​_samelines Asserts text1 and text2 have the same lines, ignoring differences in line endings between platforms
Function get​_crawler Return an unconfigured Crawler object. If settings_dict is given, it will be used to populate the crawler settings with a project level priority.
Function get​_from​_asyncio​_queue Undocumented
Function get​_ftp​_content​_and​_delete Undocumented
Function get​_gcs​_content​_and​_delete Undocumented
Function get​_pythonpath Return a PYTHONPATH suitable to use in processes so that they find this installation of Scrapy
Function get​_testenv Return a OS environment dict suitable to fork processes that need to import this installation of Scrapy, instead of a system installed one.
Function mock​_google​_cloud​_storage Creates autospec mocks for google-cloud-storage Client, Bucket and Blob classes and set their proper return values.
Function skip​_if​_no​_boto Undocumented
def assert_gcs_environ():

Undocumented

def assert_samelines(testcase, text1, text2, msg=None):
Asserts text1 and text2 have the same lines, ignoring differences in line endings between platforms
def get_crawler(spidercls=None, settings_dict=None):
Return an unconfigured Crawler object. If settings_dict is given, it will be used to populate the crawler settings with a project level priority.
def get_from_asyncio_queue(value):

Undocumented

def get_ftp_content_and_delete(path, host, port, username, password, use_active_mode=False):

Undocumented

def get_gcs_content_and_delete(bucket, path):

Undocumented

def get_pythonpath():
Return a PYTHONPATH suitable to use in processes so that they find this installation of Scrapy
def get_testenv():
Return a OS environment dict suitable to fork processes that need to import this installation of Scrapy, instead of a system installed one.
def mock_google_cloud_storage():
Creates autospec mocks for google-cloud-storage Client, Bucket and Blob classes and set their proper return values.
def skip_if_no_boto():

Undocumented