2015-08-15 39 views
0

的Hadoop版本 - 1.2.1無法在HDFS創造sharelib爲Oozie的

Oozie的構建而成,具有以下命令

bin/mkdistro.sh -P hadoop-2 -DskipTests 

而且構建了成功。

然後當我開始在hdfs中創建sharelib時,我得到了下面的問題。

[email protected]:~/hadoop/oozie/oozie-4.0.0$ ./bin/oozie-setup.sh sharelib create -fs hdfs://localhost:9000 
    setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m" 
log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell). 
log4j:WARN Please initialize the log4j system properly. 
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. 
SLF4J: Class path contains multiple SLF4J bindings. 
SLF4J: Found binding in [jar:file:/home/hduser/hadoop/oozie/oozie-4.0.0/libtools/slf4j-simple-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class] 
SLF4J: Found binding in [jar:file:/home/hduser/hadoop/oozie/oozie-4.0.0/libtools/slf4j-log4j12-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class] 
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory] 
the destination path for sharelib is: /user/hduser/share/lib 

Error: Failed on local exception: java.io.EOFException; Host Details : local host is: "vignesh-ubuntu/127.0.1.1"; destination host is: "localhost":9000; 

Stack trace for the error was (for debug purposes): 
-------------------------------------- 
java.io.IOException: Failed on local exception: java.io.EOFException; Host Details : local host is: "vignesh-ubuntu/127.0.1.1"; destination host is: "localhost":9000; 
    at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764) 
    at org.apache.hadoop.ipc.Client.call(Client.java:1414) 
    at org.apache.hadoop.ipc.Client.call(Client.java:1363) 
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) 
    at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source) 
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
    at java.lang.reflect.Method.invoke(Method.java:606) 
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:190) 
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:103) 
    at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source) 
    at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:699) 
    at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1762) 
    at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1124) 
    at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1120) 
    at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) 
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1120) 
    at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1398) 
    at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:151) 
    at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:52) 
Caused by: java.io.EOFException 
    at java.io.DataInputStream.readInt(DataInputStream.java:392) 
    at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1054) 
    at org.apache.hadoop.ipc.Client$Connection.run(Client.java:949) 
-------------------------------------- 

hadoop-2默認爲2.x,但我的hadoop版本是1.2.1會是一個問題嗎?

有人能幫我解決這個問題。

回答

0

我有重建默認的Hadoop版本Oozie的爲1.1.1

斌/ mkdistro.sh -DskipTests

現在我能夠在HDFS創建sharelib。

0

不知道你是否已經找到了solution..If不請嘗試以下步驟,讓我知道....

Try1:change the host name to localhost in /etc/hosts

try2:Check the log folder inside oozie .If the permissions are set correctly.

感謝

+0

謝謝阿曼。首先,我嘗試用hadoop 2.x版本構建oozie,然後使用默認的hadoop版本1.1.1成功重建,因爲我的hadoop版本本身是1.2.1。 –