Undocumented
| Module | depth |
Depth Spider Middleware |
| Module | httperror |
HttpError Spider Middleware |
| Module | offsite |
Offsite Spider Middleware |
| Module | referer |
RefererMiddleware: populates Request referer field, based on the Response which originated it. |
| Module | urllength |
Url Length Spider Middleware |