class Crawler:
Undocumented
Method | crawl |
Undocumented |
Method | stop |
Starts a graceful stop of the crawler and returns a deferred that is fired when the crawler is stopped. |
Instance Variable | engine |
Undocumented |
Instance Variable | extensions |
Undocumented |
Instance Variable | settings |
Undocumented |
Instance Variable | signals |
Undocumented |
Instance Variable | spider |
Undocumented |
Instance Variable | stats |
Undocumented |
Method | __init__ |
Undocumented |
Method | _create_engine |
Undocumented |
Method | _create_spider |
Undocumented |
Instance Variable | __remove_handler |
Undocumented |
Instance Variable | crawling |
Undocumented |
Instance Variable | logformatter |
Undocumented |
Instance Variable | spidercls |
Undocumented |