YARN JobHistory錯誤：容器重定向失敗

我們最近部署了YARN和CDH 5（2.3.0-cdh5.1.3），集羣正在運行文件，作業也在運行。但我們無法從資源管理器用戶界面的訪問日誌，如果作業完成（成功/失敗），我們得到以下錯誤YARN JobHistory錯誤：容器重定向失敗

Failed redirect for container_1412716537481_0322_01_000001 
Failed while trying to construct the redirect url to the log server. Log Server url may not be configured 
Container does not exist.

也有一些例外，正在運行的作業：

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=mapred, ac 
cess=READ, inode="/user/history/done_intermediate/xyz/job_1412716537481_0426-1412782860181-xyz-PigLatin%3ACategory+li 
ft+for+pixels%3A9259-1412782882528-1-1-SUCCEEDED-root.brianfemiano-1412782867082.jhit":xyz:supergroup:-rwxrwx--- 
     at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:271) 
     at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:257) 
     at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:185) 
     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5607) 
     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5589) 
     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPathAccess(FSNamesystem.java:5551) 
     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsUpdateTimes(FSNamesystem.java:1717) 
     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1669) 
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsUpdateTimes(FSNamesystem.java:1717)   [1804/1922] 
     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1669) 
     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1649) 
     at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1621) 
     at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:482) 
     at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServe 
rSideTranslatorPB.java:322)

什麼是hdfs：// user/history /？的適當權限。

任何人有同樣的問題？

來源

2014-10-08 roy

我認爲你的集羣是Secured（啓用了Kerberos）並且在安全env中進行HTTP驗證，你需要設置下面的參數。參考 http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/ds_Hadoop/hadoop-project-dist/hadoop-common/HttpAuthentication.html

-Arun voma

來源

2014-10-08 15:53:36 user2225997

不，我們沒有任何安全/ Kerberos的，它更關係到紗線的權限，我認爲。 – roy 2014-10-08 16:04:52

不知道這是否與https://issues.cloudera.org/browse/DISTRO-612相關 – roy 2014-10-08 16:44:20

YARN JobHistory錯誤：容器重定向失敗

回答

相關問題