2015-01-02 39 views
0

我試圖建立了Oozie 4.0.1在Hadoop 2.4.1在CentOS 6.5使用命令了Oozie 4.0.1生成錯誤

bin/mkdistro.sh -P hadoop-2 -DskipTests 

構建失敗,在這一點上

[INFO] Apache Oozie Main .................................. SUCCESS [ 0.688 s] 
[INFO] Apache Oozie Client ................................ SUCCESS [ 24.719 s] 
[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.1 .............. SUCCESS [ 0.431 s] 
[INFO] Apache Oozie Hadoop Distcp 1.1.1.oozie-4.0.1 ....... SUCCESS [ 0.035 s] 
[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.1 Test ......... SUCCESS [ 0.065 s] 
[INFO] Apache Oozie Hadoop 2.3.0.oozie-4.0.1 .............. SUCCESS [ 1.626 s] 
[INFO] Apache Oozie Hadoop 2.3.0.oozie-4.0.1 Test ......... SUCCESS [ 0.098 s] 
[INFO] Apache Oozie Hadoop Distcp 2.3.0.oozie-4.0.1 ....... SUCCESS [ 0.038 s] 
[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.1 ............. SUCCESS [ 1.176 s] 
[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.1 Test ........ SUCCESS [ 0.087 s] 
[INFO] Apache Oozie Hadoop Distcp 0.23.5.oozie-4.0.1 ...... SUCCESS [ 0.028 s] 
[INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [ 1.493 s] 
[INFO] Apache Oozie Hbase 0.94.2.oozie-4.0.1 .............. SUCCESS [ 0.148 s] 
[INFO] Apache Oozie Hbase Libs ............................ SUCCESS [ 0.319 s] 
[INFO] Apache Oozie HCatalog 0.5.0.oozie-4.0.1 ............ FAILURE [ 0.127 s] 
[INFO] Apache Oozie HCatalog Libs ......................... SKIPPED 
[INFO] Apache Oozie Share Lib Oozie ....................... SKIPPED 
[INFO] Apache Oozie Share Lib HCatalog .................... SKIPPED 
[INFO] Apache Oozie Core .................................. SKIPPED 
[INFO] Apache Oozie Docs .................................. SKIPPED 
[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED 
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED 
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED 
[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED 
[INFO] Apache Oozie Share Lib Distcp ...................... SKIPPED 
[INFO] Apache Oozie WebApp ................................ SKIPPED 
[INFO] Apache Oozie Examples .............................. SKIPPED 
[INFO] Apache Oozie Share Lib ............................. SKIPPED 
[INFO] Apache Oozie Tools ................................. SKIPPED 
[INFO] Apache Oozie MiniOozie ............................. SKIPPED 
[INFO] Apache Oozie Distro ................................ SKIPPED 
[INFO] ------------------------------------------------------------------------ 
[INFO] BUILD FAILURE 
[INFO] ------------------------------------------------------------------------ 
[INFO] Total time: 31.826 s 
[INFO] Finished at: 2015-01-02T21:17:00+05:30 
[INFO] Final Memory: 40M/358M 
[INFO] ------------------------------------------------------------------------ 
[ERROR] Failed to execute goal on project oozie-hcatalog: Could not resolve dependencies for project org.apache.oozie:oozie-hcatalog:jar:0.5.0.oozie-4.0.1: Failed to collect dependencies at org.apache.hcatalog:hcatalog-server-extensions:jar:0.5.0-incubating -> org.apache.hcatalog:hcatalog-core:jar:0.5.0-incubating -> org.apache.hive:hive-metastore:jar:0.10.0 -> org.datanucleus:datanucleus-enhancer:jar:2.0.3 -> asm:asm:jar:[3.0, 4.0): No versions available for asm:asm:jar:[3.0, 4.0) within specified range -> [Help 1] 

,我已經試過庫鏈接如下:

<url>https://repository.cloudera.com/cloudera/ext-release-local/</url>  
<url>http://121.241.113.72:8080/archiva/repository/internal/</url> 
<url>http://maven.icm.edu.pl/artifactory/repo</url> 
<url>https://github.com/CeON/oozie-maven-plugin</url> 
<url>https://repository.cloudera.com/artifactory/cloudera-repos/</url> 
<url>http://repository.jboss.org/nexus/content/groups/public-jboss/</url> 
<url>http://repo1.maven.org/maven2/</url> 

但所有導致同樣的錯誤,而DIST ro創建過程僅在該特定點失敗。 對於hadoop 2.4.1我也更改了所需的POM條目。

cd hadooplibs 
File hadoop-2/pom.xml : change hadoop-client & hadoop-auth dependency version to 2.4.1 
File hadoop-distcp-2/pom.xml: change hadoop-distcp version to 2.4.1 
File hadoop-test-2/pom.xml: change hadoop-minicluster version to 2.4.1 

,並在主Oozie的POM文件這

 <profile> 
      <id>hadoop-2</id> 
      <activation> 
       <activeByDefault>false</activeByDefault> 
      </activation> 
      <properties> 
       <hadoop.version>2.4.1</hadoop.version> 
       <hadoop.auth.version>2.4.1</hadoop.auth.version> 
       <pig.classifier>h2</pig.classifier> 
       <sqoop.classifier>hadoop200</sqoop.classifier> 
      </properties> 
     </profile> 

請告訴我一個方法來安裝此Oozie的4.0.1使用Hadoop 2.4.1 任何幫助,將不勝感激。

+0

你解決這個問題?我也面臨同樣的問題。它看起來像回購中的最新oozie-hadoop罐子是2.3, –

+0

Nops。 我仍然堅持下去。 –

+0

@ Mb-One有沒有更新?我也面臨同樣的問題?我正在使用的Hadoop版本是1.2.1 –

回答

0

請按照下面的鏈接構建oozie 4.1.0。

http://gauravkohli.com/2014/08/26/apache-oozie-installation-on-hadoop-2-4-1/

其精細的工作。現在用的是構建Hadoop的2.6.0

+0

什麼是回購網址?我在默認回購中看不到oozie-hadoop罐子高於2.3。 http://search.maven.org/#search%7Cga%7C1%7Ca%3A%22oozie-hadoop%22 –

+0

@karthik:我之前跟着同一個網站,但都是徒勞的。陷入了同樣的問題 –

0

我使用了Oozie-4.0.1使用Hadoop 2.3.0

我有一個類似的錯誤。

... 
    [INFO] Apache Oozie Hbase 0.94.2.oozie-4.0.1 .............. SUCCESS [ 0.172 s] 
    [INFO] Apache Oozie Hbase Libs ............................ SUCCESS [ 0.530 s] 
    [INFO] Apache Oozie HCatalog 0.5.0.oozie-4.0.1 ............ FAILURE [ 0.436 s] 
    [INFO] Apache Oozie HCatalog 0.6.0.oozie-4.0.1 ............ SKIPPED 
    [INFO] Apache Oozie HCatalog Libs ......................... SKIPPED 
    [INFO] Apache Oozie Share Lib Oozie ....................... SKIPPED 
    [INFO] Apache Oozie Share Lib HCatalog .................... SKIPPED 
    [INFO] Apache Oozie Core .................................. SKIPPED 
    [INFO] Apache Oozie Docs .................................. SKIPPED 
    [INFO] Apache Oozie Share Lib Pig ......................... SKIPPED 
    [INFO] Apache Oozie Share Lib Hive ........................ SKIPPED 
    [INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED 
    [INFO] Apache Oozie Share Lib Streaming ................... SKIPPED 
    [INFO] Apache Oozie Share Lib Distcp ...................... SKIPPED 
    [INFO] Apache Oozie WebApp ................................ SKIPPED 
    [INFO] Apache Oozie Examples .............................. SKIPPED 
    [INFO] Apache Oozie Share Lib ............................. SKIPPED 
    [INFO] Apache Oozie Tools ................................. SKIPPED 
    [INFO] Apache Oozie MiniOozie ............................. SKIPPED 
    [INFO] Apache Oozie Distro ................................ SKIPPED 
    [INFO] ------------------------------------------------------------------------ 
    [INFO] BUILD FAILURE 
    [INFO] ------------------------------------------------------------------------ 
    [INFO] Total time: 32.522 s 
    [INFO] Finished at: 2015-11-11T12:58:10-05:00 
    [INFO] Final Memory: 44M/643M 
    [INFO] ------------------------------------------------------------------------ 
    [ERROR] Failed to execute goal on project oozie-hcatalog: Could not resolve dependencies for project org.apache.oozie:oozie-hcatalog:jar:0.5.0.oozie-4.0.1: Failed to coll 
    ect dependencies at org.apache.hcatalog:hcatalog-server-extensions:jar:0.5.0-incubating -> org.apache.hcatalog:hcatalog-core:jar:0.5.0-incubating -> org.apache.hive:hive- 
    builtins:jar:0.10.0 -> org.apache.hive:hive-exec:jar:0.10.0 -> org.apache.hive:hive-metastore:jar:0.10.0 -> javax.jdo:jdo2-api:jar:2.3-ec: Failed to read artifact descrip 
    tor for javax.jdo:jdo2-api:jar:2.3-ec: Could not transfer artifact javax.jdo:jdo2-api:pom:2.3-ec from/to Codehaus repository (http://repository.codehaus.org/): repository 
    .codehaus.org: Unknown host repository.codehaus.org -> [Help 1] 

我能夠完全消除,因爲從codehause.org基地的pom.xml庫來解決它「現在所有Codehaus的服務已被終止。」從pom.xml的上http://www.codehaus.org/

刪除以下行表示

<repository> 
     <id>Codehaus repository</id> 
     <url>http://repository.codehaus.org/</url> 
     <snapshots> <enabled>false</enabled> </snapshots> 
</repository>