Unable to deploy project to Scrapy Cloud

472 views Asked by At

I made changes to the spider to use some methods of the scrapinghub API and tried re-deploying it to Scrapy Cloud using "shub deploy". I'm getting an error: ImportError: No module named scrapinghub

It points to the import line in the spider

from scrapinghub import Connection

shub version 2.5.0 scrapinghub (1.9.0)

I'm able to run spider locally.

Any ideas what is the problem ?

1

There are 1 answers

0
Zaky On

Adding requirements.txt with

# Scrapinghub
scrapinghub==1.9.0

and updating the scrapinghub.yml solved the issue. Thanks to Carlos Peña