I was trying to scrap links of my playlist songs using scrapy in Spotify website, without using Spotify API ,but iam stuck at accessing the elements through xpath ,I have checked the xpath ,which I copied using full xpath of the element from Google developer tools and it is showing correctly in developer tool but not returning any response while I run the ipython shell , is there a way to parse the path correctly?
I tried response.xpath("//div[@class='main']") ,it gives response but can't get to next div even though.given response.xpath("//div[@class='main']/div[@class='root']")