scrapy公共FTP站點與認證數據，獲取FTP錯誤

Question

我正在寫蜘蛛公共FTP站點與身份驗證

我給了ftp的用戶名和密碼。 Scrapy不處理這個請求，並給予其「FTP_USER」錯誤

# all import stmt 
class my_xml(BaseSpider): 
    name = 'my_xml' 

    def start_requests(self): 
     yield Request(
      url='url', 
      meta={'ftp_user': self.ftp_user, 'ftp_password': self.ftp_password} 
     ) 

    def parse(self, response): 
     print response.body 

我流汗錯誤是這樣的。

2015-04-03 12:46:08+0530 [scrapy] DEBUG: Telnet console listening on 127.0.0.1:6023 
2015-04-03 12:46:08+0530 [scrapy] DEBUG: Web service listening on 127.0.0.1:6080 
2015-04-03 12:46:08+0530 [-] ERROR: Unhandled error in Deferred: 
2015-04-03 12:46:08+0530 [-] Unhandled Error 
    Traceback (most recent call last): 
     File "C:\Python27\lib\site-packages\scrapy\core\downloader\middleware.py", line 38, in process_request 
     return download_func(request=request, spider=spider) 
     File "C:\Python27\lib\site-packages\scrapy\core\downloader\__init__.py", line 123, in _enqueue_request 
     self._process_queue(spider, slot) 
     File "C:\Python27\lib\site-packages\scrapy\core\downloader\__init__.py", line 143, in _process_queue 
     dfd = self._download(slot, request, spider) 
     File "C:\Python27\lib\site-packages\scrapy\core\downloader\__init__.py", line 154, in _download 
     dfd = mustbe_deferred(self.handlers.download_request, request, spider) 
    --- <exception caught here> --- 
     File "C:\Python27\lib\site-packages\scrapy\utils\defer.py", line 39, in mustbe_deferred 
     result = f(*args, **kw) 
     File "C:\Python27\lib\site-packages\scrapy\core\downloader\handlers\__init__.py", line 40, in download_request 
     return handler(request, spider) 
     File "C:\Python27\lib\site-packages\scrapy\core\downloader\handlers\ftp.py", line 72, in download_request 
     creator = ClientCreator(reactor, FTPClient, request.meta["ftp_user"], 
    exceptions.KeyError: 'ftp_user' 

任何人都可以爲這個錯誤提供解決方案。 ？如果我做錯了程序，請給我建議適當的解決方案。如何處理這些類型的蜘蛛？ 請注意：URL，ftp_user和ftp_password是正確的，在瀏覽器中我們可以用這些數據打開它。

Answer 1

試試這個方法：

# -*- coding: utf-8 -*- 
import scrapy 
from scrapy.http import Request 

class my_xml(scrapy.Spider): 
    name = 'my_xml' 
    ftp_host = 'ftp://127.0.0.1' 
    ftp_user = 'your_username' 
    ftp_password = 'your_password' 

    def start_requests(self): 
     yield Request(
      url=self.ftp_host, 
      meta={'ftp_user': self.ftp_user, 'ftp_password': self.ftp_password} 
     ) 

    def parse(self, response): 
     print response.body