Scrapy response.follow拋出錯誤

Question

我下面這個介紹到scrapy： https://doc.scrapy.org/en/1.4/intro/overview.html

和代碼運行良好，直到它需要跳轉到下一個頁面，然後我得到下面的錯誤堆棧：

2017-08-09 19:45:37 [scrapy.core.scraper] ERROR: Spider error processing <GET http://quotes.toscrape.com/tag/humor/> (referer: None) 

Traceback (most recent call last): 
    File "/Users/totosh/anaconda/lib/python3.5/site-packages/scrapy/utils/defer.py", line 102, in iter_errback 
    yield next(it) 
    File "/Users/totosh/anaconda/lib/python3.5/site-packages/scrapy/spidermiddlewares/offsite.py", line 29, in process_spider_output 
    for x in result: 
    File "/Users/totosh/anaconda/lib/python3.5/site-packages/scrapy/spidermiddlewares/referer.py", line 22, in <genexpr> 
    return (_set_referer(r) for r in result or()) 
    File "/Users/totosh/anaconda/lib/python3.5/site-packages/scrapy/spidermiddlewares/urllength.py", line 37, in <genexpr> 
    return (r for r in result or() if _filter(r)) 
    File "/Users/totosh/anaconda/lib/python3.5/site-packages/scrapy/spidermiddlewares/depth.py", line 58, in <genexpr> 
    return (r for r in result or() if _filter(r)) 
    File "/Users/totosh/OneDrive/data analysis and ML/python working directory/scrapy0.py", line 48, in parse 
    yield response.follow(next_page, self.parse) 
AttributeError: 'HtmlResponse' object has no attribute 'follow' 

是什麼原因造成的？

是不是因爲html是：<a href="/tag/humor/page/2/">Next <span aria-hidden="true">→</span></a>而且沒有絕對的URL？

謝謝

Answer 1

您使用的是什麼版本的Scrapy？在Scrapy 1.4.0中添加了follow方法Response對象 - 請參閱Release notes。