We’ve launched a new and improved Scrapy Cloud 2.0!
Full details are available on the Scrapinghub blog
, but here are some of the key features:
- Improved capabilities: Better CPU performance and more available memory
- Cheaper cost per job
- Specify resource needs on a per-job basis: No need to rent a whole server to run high performance jobs
Along with all of the new capabilities, there’s a brand new Scrapy Cloud dashboard to manage your resources. Just allocate your Scrapy Cloud container units amongst different groups, and then drag and drop projects between those groups. The jobs in each group are isolated from the other jobs running on the platform, so your performance will never be affected by other resource consuming jobs.