Apache nutch錯誤NoClassDefFoundError「com/google/protobuf/Message」

我使用apache nutch 2.3與hadoop 1.2.1和hbase 0.94。我已經配置Apache分佈式模式。當我運行爬行，它提供了以下錯誤Apache nutch錯誤NoClassDefFoundError「com/google/protobuf/Message」

15/12/21 12:06:56 INFO zookeeper.ClientCnxn: Session establishment complete on server node1/1.11.1.2:2181, sessionid = 0x151ba038ac60250, negotiated timeout = 180000 
Exception in thread "main" java.lang.NoClassDefFoundError: com/google/protobuf/Message 
    at org.apache.hadoop.hbase.io.HbaseObjectWritable.<clinit>(HbaseObjectWritable.java:265) 
    at org.apache.hadoop.hbase.ipc.Invocation.write(Invocation.java:139) 
    at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.sendParam(HBaseClient.java:620) 
    at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:989) 
    at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:87) 
    at com.sun.proxy.$Proxy5.getProtocolVersion(Unknown Source) 
    at org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:141) 
    at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:813) 
    at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:127) 
    at org.apache.gora.hbase.store.HBaseStore.initialize(HBaseStore.java:115) 
    at org.apache.gora.store.DataStoreFactory.initializeDataStore(DataStoreFactory.java:104) 
    at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:163) 
    at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:137) 
    at org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:78) 
    at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:218) 
    at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:252) 
    at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:275) 
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) 
    at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:284) 
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
    at java.lang.reflect.Method.invoke(Method.java:483) 
    at org.apache.hadoop.util.RunJar.main(RunJar.java:160) 
Caused by: java.lang.ClassNotFoundException: com.google.protobuf.Message 
    at java.net.URLClassLoader$1.run(URLClassLoader.java:372) 
    at java.net.URLClassLoader$1.run(URLClassLoader.java:361) 
    at java.security.AccessController.doPrivileged(Native Method) 
    at java.net.URLClassLoader.findClass(URLClassLoader.java:360) 
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424) 
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) 
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357) 
    ... 24 more

在Nutch的LIB的，還有的protobuf-java的2.4.1.jar 的罐子怎麼解決呢？

來源

2015-12-21 Shafiq

我認爲你應該添加protobuf-java {version} .jar到hadoop lib目錄。它應該解決你的問題。用於類路徑驗證。運行以下命令：

hadoop classpath |grep protobuf

如果它包含相應的jar，那麼這意味着它已被添加到classpath中。

來源

2015-12-21 07:37:23 HMS

我不知道細節，但它解決了我的問題 – Shafiq

Apache nutch錯誤NoClassDefFoundError「com/google/protobuf/Message」

回答

相關問題