scrapy.utils.response

module documentation

This module provides some useful functions for working with scrapy.http.Response objects

Function	`get_base_url`	Return the base url of the given response, joined with the response url
Function	`get_meta_refresh`	Parse the http-equiv refrsh parameter from the given response
Function	`open_in_browser`	Open the given response in a local web browser, populating the <base> tag for external links to work
Function	`response_httprepr`	Return raw HTTP representation (as bytes) of the given response. This is provided only for reference, since it's not the exact stream of bytes that was received (that's not exposed by Twisted).
Function	`response_status_message`	Return status code plus status text descriptive message
Variable	`_baseurl_cache`	Undocumented
Variable	`_metaref_cache`	Undocumented

def get_base_url(response):

Return the base url of the given response, joined with the response url

Parameters
response:`scrapy.http.response.text.TextResponse`	Undocumented
Returns
`str`	Undocumented

def get_meta_refresh(response, ignore_tags=('script', 'noscript')):

Parse the http-equiv refrsh parameter from the given response

Parameters
response:`scrapy.http.response.text.TextResponse`	Undocumented
ignore_tags:`Optional[Iterable[str]]`	Undocumented
Returns
`Union[Tuple[None, None], Tuple[float, str]]`	Undocumented

def open_in_browser(response, _openfunc=webbrowser.open):

Open the given response in a local web browser, populating the <base> tag for external links to work

Parameters
response:`Union[scrapy.http.response.html.HtmlResponse, scrapy.http.response.text.TextResponse]`	Undocumented
_openfunc:`Callable[[str], Any]`	Undocumented
Returns
`Any`	Undocumented

def response_httprepr(response):

Return raw HTTP representation (as bytes) of the given response. This is provided only for reference, since it's not the exact stream of bytes that was received (that's not exposed by Twisted).

Parameters
response:`Response`	Undocumented
Returns
`bytes`	Undocumented

def response_status_message(status):

Return status code plus status text descriptive message

Parameters
status:`Union[bytes, float, int, str]`	Undocumented
Returns
`str`	Undocumented

_baseurl_cache: WeakKeyDictionary[Response, str] =

Undocumented

_metaref_cache: WeakKeyDictionary[Response, Union[Tuple[None, None], Tuple[float, str]]] =

Undocumented