EMR Hadoop的豬作業錯誤「內部錯誤創造就業結構」

我有一頭豬工作在Amazon EMR運行和suddnly它已停止工作給予了以下錯誤：EMR Hadoop的豬作業錯誤「內部錯誤創造就業結構」

Pig Stack Trace 
--------------- 
ERROR 2017: Internal error creating job configuration. 

org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException: ERROR 2017: Internal error creating job configuration. 
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:855) 
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:294) 
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:177) 
    at org.apache.pig.PigServer.launchPlan(PigServer.java:1264) 
    at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249) 
    at org.apache.pig.PigServer.execute(PigServer.java:1239) 
    at org.apache.pig.PigServer.executeBatch(PigServer.java:333) 
    at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:137) 
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198) 
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170) 
    at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84) 
    at org.apache.pig.Main.run(Main.java:479) 
    at org.apache.pig.Main.main(Main.java:159) 
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
    at java.lang.reflect.Method.invoke(Method.java:606) 
    at org.apache.hadoop.util.RunJar.main(RunJar.java:187) 
Caused by: java.lang.NullPointerException 
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.adjustNumReducers(JobControlCompiler.java:875) 
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:480) 
    ... 17 more 
================================================================================

有誰知道爲什麼或可能是什麼問題？這是我見過的最模糊的錯誤之一。

來源

2015-02-10 Mo.

分享豬腳本，這是發生在調整減速器的數量..所以你可以檢查一次減速器，讓我們知道輸出.. – 2015-02-11 02:58:05

信不信由你無法找到一個輸入文件被處理....他們需要處理他們的錯誤記錄。 – 2015-02-12 16:39:44

該問題實際上證明是PIG無法找到要處理的輸入文件之一，但該錯誤甚至不會遠程提示丟失的文件問題。

來源

2015-02-12 16:40:35

EMR Hadoop的豬作業錯誤「內部錯誤創造就業結構」

回答

相關問題