where's data store after deploy spider scrapyd python?

756 views Asked by At

i deployed and scheduled my spider on http://localhost:6800/ success, but where's data of item store ? How could i get them ?

thanks so much !

2

There are 2 answers

1
Ngo Van Anh Tan On BEST ANSWER

You should handle it in process_item() instead of handle by scrapyd.Because scrapyd just logs items, there is no difference in a way to store data except log file. You can find it in documentation of scrapyd.

0
Tasawer Nawaz On

In scrapyd you have to define item directory in scrapyd.conf file, for more information you can look at scrapyd documentation scrapyd.conf