2014-09-21 104 views
4

如果依賴項的POM.xml在pom.xml的「Profile」部分中存在傳遞依賴關係,那麼這些依賴關係不由SBT解決,而由Maven解決。 如: 時,包含在項目中的以下依賴.....SBT無法解決POM的<Profile>部分中的傳遞依賴關係

<dependency> 
     <groupId>org.apache.hbase</groupId> 
     <artifactId>hbase-client</artifactId> 
     <version>0.98.0-hadoop2</version> 
    </dependency> 

...那麼下面的相關性不是由SBT解決,但通過行家都解決了:

hadoop-annotations , hadoop-mapreduce-client-core , hadoop-auth , hadoop-common 

有人可以幫助我理解爲什麼這種分辨率的差異以及如何讓SBT包含這些瞬態依賴關係。

以下是用於測試build.sbt:

name := "StreamMaker" 

version := "1.0" 

scalaVersion := "2.10.4" 

resolvers += "Local Maven Repository" at "file://"+Path.userHome.absolutePath+"/.m2/repository" 

libraryDependencies += "org.apache.hbase" % "hbase-client" % "0.98.0-hadoop2" 

net.virtualvoid.sbt.graph.Plugin.graphSettings 

以下是HBase的客戶端的pom.xml的條目:由SBT 0.13.5解決

<profile> 
    <id>hadoop-2.0</id> 
    <activation> 
    <property> 
     <name>!hadoop.profile</name> 
    </property> 
    </activation> 
    <dependencies> 
    <dependency> 
     <groupId>org.apache.hadoop</groupId> 
     <artifactId>hadoop-common</artifactId> 
     <exclusions> 
     <exclusion> 
      <groupId>javax.servlet.jsp</groupId> 
      <artifactId>jsp-api</artifactId> 
     </exclusion> 
     <exclusion> 
      <groupId>com.sun.jersey</groupId> 
      <artifactId>jersey-server</artifactId> 
     </exclusion> 
     <exclusion> 
      <groupId>javax.servlet</groupId> 
      <artifactId>servlet-api</artifactId> 
     </exclusion> 
     <exclusion> 
      <groupId>tomcat</groupId> 
      <artifactId>jasper-compiler</artifactId> 
     </exclusion> 
     <exclusion> 
      <groupId>tomcat</groupId> 
      <artifactId>jasper-runtime</artifactId> 
     </exclusion> 
     </exclusions> 
    </dependency> 
    <dependency> 
     <groupId>org.apache.hadoop</groupId> 
     <artifactId>hadoop-auth</artifactId> 
    </dependency> 
    <dependency> 
     <groupId>org.apache.hadoop</groupId> 
     <artifactId>hadoop-mapreduce-client-core</artifactId> 
     <exclusions> 
     <exclusion> 
     <groupId>com.sun.jersey.jersey-test-framework</groupId> 
     <artifactId>jersey-test-framework-grizzly2</artifactId> 
     </exclusion> 
    </exclusions> 
    </dependency> 
    <dependency> 
     <groupId>org.apache.hadoop</groupId> 
     <artifactId>hadoop-annotations</artifactId> 
    </dependency> 
    </dependencies> 
</profile> 

Depedencies:

+-org.apache.hbase:hbase-client:0.98.0-hadoop2 
    +-com.github.stephenc.findbugs:findbugs-annotations:1.3.9-1 
    +-com.google.guava:guava:12.0.1 
    | +-com.google.code.findbugs:jsr305:1.3.9 
    | 
    +-com.google.protobuf:protobuf-java:2.5.0 
    +-commons-codec:commons-codec:1.7 
    +-commons-io:commons-io:2.4 
    +-commons-lang:commons-lang:2.6 
    +-commons-logging:commons-logging:1.1.1 
    +-io.netty:netty:3.6.6.Final 
    +-junit:junit:4.11 
    | +-org.hamcrest:hamcrest-core:1.3 
    | 
    +-log4j:log4j:1.2.17 
    +-org.apache.hbase:hbase-protocol:0.98.0-hadoop2 
    | +-com.github.stephenc.findbugs:findbugs-annotations:1.3.9-1 
    | +-com.google.protobuf:protobuf-java:2.5.0 
    | +-junit:junit:4.11 
    | | +-org.hamcrest:hamcrest-core:1.3 
    | | 
    | +-log4j:log4j:1.2.17 
    | 
    +-org.apache.zookeeper:zookeeper:3.4.5 
    | +-log4j:log4j:1.2.15 (evicted by: 1.2.17) 
    | +-log4j:log4j:1.2.16 (evicted by: 1.2.17) 
    | +-log4j:log4j:1.2.17 
    | +-org.slf4j:slf4j-api:1.6.1 
    | +-org.slf4j:slf4j-log4j12:1.6.1 
    | +-log4j:log4j:1.2.15 (evicted by: 1.2.17) 
    | +-log4j:log4j:1.2.16 (evicted by: 1.2.17) 
    | +-log4j:log4j:1.2.17 
    | +-org.slf4j:slf4j-api:1.6.1 
    | 
    +-org.cloudera.htrace:htrace-core:2.04 
    | +-com.google.guava:guava:12.0.1 
    | | +-com.google.code.findbugs:jsr305:1.3.9 
    | | 
    | +-commons-logging:commons-logging:1.1.1 
    | +-org.mortbay.jetty:jetty-util:6.1.26 
    | 
    +-org.codehaus.jackson:jackson-mapper-asl:1.8.8 
    +-org.codehaus.jackson:jackson-core-asl:1.8.8 

Maven 3.0.4解決的依賴關係:

- org.apache.hbase:hbase-client:jar:0.98.0-hadoop2:compile 
    +- org.apache.hbase:hbase-common:jar:0.98.0-hadoop2:compile 
    | \- commons-collections:commons-collections:jar:3.2.1:compile 
    +- org.apache.hbase:hbase-protocol:jar:0.98.0-hadoop2:compile 
    +- commons-codec:commons-codec:jar:1.7:compile 
    +- commons-io:commons-io:jar:2.4:compile 
    +- commons-lang:commons-lang:jar:2.6:compile 
    +- commons-logging:commons-logging:jar:1.1.1:compile 
    +- com.google.guava:guava:jar:12.0.1:compile 
    | \- com.google.code.findbugs:jsr305:jar:1.3.9:compile 
    +- com.google.protobuf:protobuf-java:jar:2.5.0:compile 
    +- io.netty:netty:jar:3.6.6.Final:compile 
    +- org.apache.zookeeper:zookeeper:jar:3.4.5:compile 
    +- org.cloudera.htrace:htrace-core:jar:2.04:compile 
    | \- org.mortbay.jetty:jetty-util:jar:6.1.26:compile 
    +- org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile 
    | \- org.codehaus.jackson:jackson-core-asl:jar:1.8.8:compile 
    +- org.apache.hadoop:hadoop-common:jar:2.2.0:compile 
    | +- commons-cli:commons-cli:jar:1.2:compile 
    | +- org.apache.commons:commons-math:jar:2.1:compile 
    | +- xmlenc:xmlenc:jar:0.52:compile 
    | +- commons-httpclient:commons-httpclient:jar:3.1:compile 
    | +- commons-net:commons-net:jar:3.1:compile 
    | +- org.mortbay.jetty:jetty:jar:6.1.26:compile 
    | +- com.sun.jersey:jersey-core:jar:1.9:compile 
    | +- com.sun.jersey:jersey-json:jar:1.9:compile 
    | | +- org.codehaus.jettison:jettison:jar:1.1:compile 
    | | | \- stax:stax-api:jar:1.0.1:compile 
    | | +- com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:compile 
    | | | \- javax.xml.bind:jaxb-api:jar:2.2.2:compile 
    | | |  \- javax.activation:activation:jar:1.1:compile 
    | | +- org.codehaus.jackson:jackson-jaxrs:jar:1.8.3:compile 
    | | \- org.codehaus.jackson:jackson-xc:jar:1.8.3:compile 
    | +- commons-el:commons-el:jar:1.0:runtime 
    | +- net.java.dev.jets3t:jets3t:jar:0.6.1:compile 
    | +- commons-configuration:commons-configuration:jar:1.6:compile 
    | | +- commons-digester:commons-digester:jar:1.8:compile 
    | | | \- commons-beanutils:commons-beanutils:jar:1.7.0:compile 
    | | \- commons-beanutils:commons-beanutils-core:jar:1.8.0:compile 
    | +- org.apache.avro:avro:jar:1.7.4:compile 
    | | +- com.thoughtworks.paranamer:paranamer:jar:2.3:compile 
    | | \- org.xerial.snappy:snappy-java:jar:1.0.4.1:compile 
    | +- com.jcraft:jsch:jar:0.1.42:compile 
    | \- org.apache.commons:commons-compress:jar:1.4.1:compile 
    |  \- org.tukaani:xz:jar:1.0:compile 
    +- org.apache.hadoop:hadoop-auth:jar:2.2.0:compile 
    +- org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.2.0:compile 
    | +- org.apache.hadoop:hadoop-yarn-common:jar:2.2.0:compile 
    | | +- org.apache.hadoop:hadoop-yarn-api:jar:2.2.0:compile 
    | | +- com.google.inject:guice:jar:3.0:compile 
    | | | +- javax.inject:javax.inject:jar:1:compile 
    | | | \- aopalliance:aopalliance:jar:1.0:compile 
    | | +- com.sun.jersey:jersey-server:jar:1.9:compile 
    | | | \- asm:asm:jar:3.1:compile 
    | | \- com.sun.jersey.contribs:jersey-guice:jar:1.9:compile 
    | \- com.google.inject.extensions:guice-servlet:jar:3.0:compile 
    +- org.apache.hadoop:hadoop-annotations:jar:2.2.0:compile 
    | \- jdk.tools:jdk.tools:jar:1.7:system 
    +- com.github.stephenc.findbugs:findbugs-annotations:jar:1.3.9-1:compile 
    \- junit:junit:jar:4.11:compile 
    \- org.hamcrest:hamcrest-core:jar:1.3:compile 

回答

1

SBT不處理的Maven配置文件。 您應該將依賴關係(在給定的配置文件中提到)添加到您的sbt文件。

name := "StreamMaker" 

version := "1.0" 

scalaVersion := "2.10.4" 

resolvers += "Local Maven Repository" at "file://"+Path.userHome.absolutePath+"/.m2/repository" 

libraryDependencies += "org.apache.hbase" % "hbase-client" % "0.98.0-hadoop2" 

// Add the dependencies from the active profile. 
libraryDependencies ++= Seq("org.apache.hadoop" % "hadoop-mapreduce-client-core" % "2.2.0", 
          "org.apache.hadoop" % "hadoop-mapreduce-client-jobclient" % "2.2.0", 
          "org.apache.hadoop" % "hadoop-hdfs" % "2.2.0", 
          "org.apache.hadoop" % "hadoop-auth" % "2.2.0", 
          "org.apache.hadoop" % "hadoop-common" % "2.2.0", 
          "org.apache.hadoop" % "hadoop-client" % "2.2.0", 
          "org.apache.hadoop" % "hadoop-annotations" % "2.2.0") 

net.virtualvoid.sbt.graph.Plugin.graphSettings 

參見this discussion

報價喬希:

的Maven確實允許這一點,但它是一種不好的形式。您如何知道 哪個配置文件在部署中處於活動狀態?在活動配置文件上更改基於 的依賴關係是非常有用。我會聯繫該項目的作者,並要求他們找到另一種方法。

+0

謝謝@Shyamendra。任何導致我們如何創建一個插件或一些代碼來擴充SBT來自動推斷配置文件和選擇依賴關係,因爲列出所有的瞬態依賴關係可能很困難,特別是即使瞬態依賴關係具有配置文件時也是如此。 – DeKay 2014-09-24 17:16:28