2017-03-17 229 views
0

以下是我的工作輸出...在單模式下它運行良好,但在僞分佈模式下,它會拋出以下錯誤時間...我嘗試了很多,但無法滿足任何人的可能解決方案。我需要快速解決問題。在成功輸入路徑不存在:hdfs:// localhost:9000/user/rab/input

高度有義務...

[email protected]:~/hadoop/hadoop-1.2.1$ bin/hadoop jar hadoop-examples-*.jar grep input output 'dfs[a-z.]+' 
17/03/17 22:13:12 INFO util.NativeCodeLoader: Loaded the native-hadoop library 
17/03/17 22:13:12 WARN snappy.LoadSnappy: Snappy native library not loaded 
17/03/17 22:13:12 INFO mapred.JobClient: Cleaning up the staging area hdfs://localhost:9000/tmp/hadoop-rab/mapred/staging/rab/.staging/job_201703172201_0004 
17/03/17 22:13:12 ERROR security.UserGroupInformation: PriviledgedActionException as:rab cause:org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: hdfs://localhost:9000/user/rab/input 
org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: hdfs://localhost:9000/user/rab/input 
at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:197) 
at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:208) 
at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:1081) 
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1073) 
at org.apache.hadoop.mapred.JobClient.access$700(JobClient.java:179) 
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:983) 
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936) 
at java.security.AccessController.doPrivileged(Native Method) 
at javax.security.auth.Subject.doAs(Subject.java:422) 
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190) 
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936) 
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:910) 
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1353) 
at org.apache.hadoop.examples.Grep.run(Grep.java:69) 
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) 
at org.apache.hadoop.examples.Grep.main(Grep.java:93) 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
at java.lang.reflect.Method.invoke(Method.java:498) 
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) 
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) 
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64) 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
at java.lang.reflect.Method.invoke(Method.java:498) 
at org.apache.hadoop.util.RunJar.main(RunJar.java:160) 
+0

我運行follwoing命令RAB @ RAB-VirtualBox的:〜/ hadoop的/ Hadoop的1.2.1 $斌/ hadoop的罐子Hadoop的例子 - *罐grep的輸入輸出 'DFS [AZ。] +' – RabNawazJadoon

+0

。使用8021作爲hdfs端口 –

+0

對於任何需要幫助的問題,您需要[mcve] – Cecilia

回答

0

日誌輸出顯示錯誤:

「org.apache.hadoop.mapred.InvalidInputException:輸入路徑不存在:HDFS://本地主機:9000 /用戶/ RAB /輸入」

  1. 你有稱爲目錄 「下/用戶/ RAB的HDFS文件系統上輸入」?錯誤表明你不知道!該錯誤還表明它正在查看hdfs而不是本地文件系統。你可以用以下命令來檢查

    「HDFS DFS -ls /用戶/ RAB」

  2. ,你使用的「bin/hadoop的罐子Hadoop的例子完整的命令 - *罐子grep的輸入輸出「DFS [ '] +'「希望命令的格式爲」hadoop jar jarfilename classname hdfsinputdirectory hdfsoutputdirectory「,其中classname是要運行的jar文件中類的名稱。

相關問題