| | |
|
s | |
 |
scrapy |
|
|
scrapy.contracts |
|
|
scrapy.contracts.default |
|
|
scrapy.crawler |
The Scrapy crawler |
|
scrapy.downloadermiddlewares |
|
|
scrapy.downloadermiddlewares.ajaxcrawl |
|
|
scrapy.downloadermiddlewares.chunked |
Chunked Transfer Middleware |
|
scrapy.downloadermiddlewares.cookies |
Cookies Downloader Middleware |
|
scrapy.downloadermiddlewares.defaultheaders |
Default Headers Downloader Middleware |
|
scrapy.downloadermiddlewares.downloadtimeout |
Download timeout middleware |
|
scrapy.downloadermiddlewares.httpauth |
HTTP Auth downloader middleware |
|
scrapy.downloadermiddlewares.httpcache |
HTTP Cache downloader middleware |
|
scrapy.downloadermiddlewares.httpcompression |
Http Compression Middleware |
|
scrapy.downloadermiddlewares.httpproxy |
Http Proxy Middleware |
|
scrapy.downloadermiddlewares.redirect |
Redirection Middleware |
|
scrapy.downloadermiddlewares.retry |
Retry Middleware |
|
scrapy.downloadermiddlewares.robotstxt |
robots.txt middleware |
|
scrapy.downloadermiddlewares.stats |
Downloader Stats Middleware |
|
scrapy.downloadermiddlewares.useragent |
User Agent Middleware |
|
scrapy.exceptions |
Scrapy exceptions |
|
scrapy.exporters |
Item Exporters |
|
scrapy.extensions.closespider |
Close spider extension |
|
scrapy.extensions.corestats |
Core stats collection |
|
scrapy.extensions.debug |
Extensions for debugging Scrapy |
|
scrapy.extensions.logstats |
Basic stats logging |
|
scrapy.extensions.memdebug |
Memory debugger extension |
|
scrapy.extensions.memusage |
Memory usage extension |
|
scrapy.extensions.statsmailer |
StatsMailer extension |
|
scrapy.extensions.telnet |
The Telnet Console |
|
scrapy.http |
Request and Response classes |
|
scrapy.item |
Item and Field classes |
|
scrapy.linkextractors |
Link extractors classes |
|
scrapy.linkextractors.lxmlhtml |
lxml's HTMLParser-based link extractors |
|
scrapy.loader |
Item Loader class |
|
scrapy.loader.processors |
A collection of processors to use with Item Loaders |
|
scrapy.mail |
Email sending facility |
|
scrapy.pipelines.files |
Files Pipeline |
|
scrapy.pipelines.images |
Images Pipeline |
|
scrapy.selector |
Selector class |
|
scrapy.settings |
Settings manager |
|
scrapy.signalmanager |
The signal manager |
|
scrapy.signals |
Signals definitions |
|
scrapy.spidermiddlewares |
|
|
scrapy.spidermiddlewares.depth |
Depth Spider Middleware |
|
scrapy.spidermiddlewares.httperror |
HTTP Error Spider Middleware |
|
scrapy.spidermiddlewares.offsite |
Offsite Spider Middleware |
|
scrapy.spidermiddlewares.referer |
Referer Spider Middleware |
|
scrapy.spidermiddlewares.urllength |
URL Length Spider Middleware |
|
scrapy.spiders |
Spiders base class, spider manager and spider middleware |
|
scrapy.statscollectors |
Stats Collectors |
|
scrapy.utils.log |
Logging utils |
|
scrapy.utils.trackref |
Track references of live objects |