scrapy.spidermiddlewares.referer.ReferrerPolicy

class documentation

class ReferrerPolicy:

Known subclasses: scrapy.spidermiddlewares.referer.NoReferrerPolicy, scrapy.spidermiddlewares.referer.NoReferrerWhenDowngradePolicy, scrapy.spidermiddlewares.referer.OriginPolicy, scrapy.spidermiddlewares.referer.OriginWhenCrossOriginPolicy, scrapy.spidermiddlewares.referer.SameOriginPolicy, scrapy.spidermiddlewares.referer.StrictOriginPolicy, scrapy.spidermiddlewares.referer.StrictOriginWhenCrossOriginPolicy, scrapy.spidermiddlewares.referer.UnsafeUrlPolicy

View In Hierarchy

Undocumented

Method	`origin`	Return serialized origin (scheme, host, path) for a request or response URL.
Method	`origin_referrer`	Undocumented
Method	`potentially_trustworthy`	Undocumented
Method	`referrer`	Undocumented
Method	`strip_url`	https://www.w3.org/TR/referrer-policy/#strip-url
Method	`stripped_referrer`	Undocumented
Method	`tls_protected`	Undocumented
Class Variable	`name`	Undocumented

def origin(self, url):

Return serialized origin (scheme, host, path) for a request or response URL.

def origin_referrer(self, url):

Undocumented

def potentially_trustworthy(self, url):

Undocumented

def referrer(self, response_url, request_url):

overridden in scrapy.spidermiddlewares.referer.NoReferrerPolicy, scrapy.spidermiddlewares.referer.NoReferrerWhenDowngradePolicy, scrapy.spidermiddlewares.referer.OriginPolicy, scrapy.spidermiddlewares.referer.OriginWhenCrossOriginPolicy, scrapy.spidermiddlewares.referer.SameOriginPolicy, scrapy.spidermiddlewares.referer.StrictOriginPolicy, scrapy.spidermiddlewares.referer.StrictOriginWhenCrossOriginPolicy, scrapy.spidermiddlewares.referer.UnsafeUrlPolicy

Undocumented

def strip_url(self, url, origin_only=False):

https://www.w3.org/TR/referrer-policy/#strip-url

If url is null, return no referrer. If url's scheme is a local scheme, then return no referrer. Set url's username to the empty string. Set url's password to null. Set url's fragment to null. If the origin-only flag is true, then:

Set url's path to null. Set url's query to null.

Return url.

def stripped_referrer(self, url):

Undocumented

def tls_protected(self, url):

Undocumented

name: str =

Undocumented