Automatic, intelligent proxy rotation and ban management
Crawlera gives you the power of crawling from multiple IPs and locations without the pain of proxy management. Forget about IP rotation or ban tracking. All of this available to you through a simple HTTP API.
Scrapy Cloud, our platform as a service offering, allows you to easily build crawlers, deploy them instantly and scale them on demand. Watch your spiders as they run and collect data, and then review their data through our beautiful frontend.
1 Scrapy Unit = 1 GB of RAM and 1 concurrent crawl