container exit code 127

yarn启动spark进行测试时候发现,几台机器上启动executor都失败了,日志如下2018-11-22 14:32:24 WARN YarnAllocator:66 - Container marked as failed: container_1516236189600_0229_01_000011 on host: cloud3. Exit status: 127. Diagnostics: Exception from container-launch.

Container id: container_1516236189600_0229_01_000011
Exit code: 127
Stack trace: ExitCodeException exitCode=127:
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:601)
	at org.apache.hadoop.util.Shell.run(Shell.java:504)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:786)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:213)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

Container exited with a non-zero exit code 127

2018-11-22 14:32:26 INFO  YarnAllocator:54 - Driver requested a total number of 0 executor(s).

在google上查了很久也没解决问题,直到看到有个人建议用yarn logs -applicationId <APP_ID>查日志才发现如下情况

Container: container_1516236189600_0231_01_000001 on cloud3_22681
===================================================================
LogType:stderr
Log Upload Time:星期四 十一月 22 14:48:13 +0800 2018
LogLength:75
Log Contents:
/bin/bash: /data/platform/jdk1.8.0_144/bin/java: No such file or directory

LogType:stdout
Log Upload Time:星期四 十一月 22 14:48:13 +0800 2018
LogLength:0
Log Contents:

已经很明显了,然后连到相应机器上看,确实没有jdk1.8.0_144,增加jdk1.8.0_144。重启job发现没问题了。

 

原文地址:https://www.cnblogs.com/bainily/p/10001369.html

时间: 2024-10-15 23:35:50

container exit code 127的相关文章

Fedora19安装smplayer后遇到&quot;Mplayer has finished unexpectedly. Exit code 127&quot;的错误

最近在使用fedora系统时,由于需要用到播放器,本来可以使用其自带的播放器,但是后来想找个更好的,于是上网浏览了一番,发现有一个叫做 "smplayer" 的播放器,由于看到整个linux社区对它的评价都不错,所以想把它安装到我的 Fedora19系统上面. 由于Fedora系统默认安装完后缺少该软件的相关源,所以即使使用 普通的 "yum install smplayer" 也不能安装.因此我们需要县安装必要的源. 一. 安装 Fedora 源地址(由于我是直接

svn Error: post-commit hook failed (exit code 127) with output

Command: Commit Modified: C:\Users\xsdff\Desktop\project\index.html Sending content: C:\Users\xsdff\Desktop\project\index.html Committing transaction...: Completed: At revision: 5 Error: post-commit hook failed (exit code 127) with output: Error: /sv

启动Eclipse时,弹出JVM terminated. Exit code=127..错误的解决方案

在Linux环境下,启动Eclipse,会弹出并报如下的错误,且不能启动该工具 JVM terminated. Exit code=127/eclipse/jdk1.7.0_71/bin/java-Dosgi.requiredJavaVersion=1.6-XX:MaxPermSize=256m-Xms40m-Xmx512m-jar /root/source1/eclipse//plugins/org.eclipse.equinox.launcher_1.3.0.v20140415-2008.j

spark sql运行出错(Container killed on request. Exit code is 143)

错误描述: SQL三张表做join运行出错: 用hive执行报错如下: Diagnostic Messages for this Task: Container [pid=27756,containerID=container_1460459369308_5864_01_000570] is running beyond physical memory limits. Current usage: 4.2 GB of 4 GB physical memory used; 5.0 GB of 16

运行nodejs项目报Process finished with exit code 1 错误

在项目中,明明在别人的机子上项目可以运行,但是复制到自己的电脑就无法就无法启动.报Process finished with exit code 1错误,也没提示错误地方.自己倒腾了很久总结了几个解决办法: 1.没有任何错误提示 这是因为你自己本机没有部署插件 在项目的根目录下输入 : npm install 2.提示:Error: Redis connection to 127.0.0.1:6379 failed - connect ECONNREFUSED 没有启动Redis, 去安装Red

出现( linker command failed with exit code 1)错误总结(http://blog.csdn.net/hengshujiyi/article/details/21182813)

这种问题,通常出现在添加第三方库文件或者多人开发时. 这种问题一般是找不到文件而导致的链接错误. 我们可以从如下几个方面着手排查. 1.以如下错误为例,如果是多人开发,你同步完成后发现出现如下的错误. [html] view plaincopy Undefined symbols for architecture armv7: "_OBJC_CLASS_$_MyPageLogViewController", referenced from: objc-class-ref in Baid

eclipse:JVM terminated. Exit code=14

Linux下安装eclipse后运行,报错:JVM terminated. Exit code=14 解决办法: # vi /etc/eclipse.ini 删除第一行:-PreventMasterEclipseLaunch Done

eclipse不能启动【 java was started but returned exit code=14】

出现java was started but returned exit code=14的问题, 原因是javaw.exe出问题了,重新配置一下eclipse.ini就可以了. 配置如下: 添加红色部分,javaw.exe的路径根据自己的情况填写 eclipse不能启动[ java was started but returned exit code=14],布布扣,bubuko.com

用Tortoisegit往GitHub上push时,失败并显示git did not exit cleanly (exit code 1),可能是GitHub的Email的原因

之前我看到错误,总是没有耐心地读完整个错误,而是不假思索地搜索一部分错误,导致偏离正确轨道,相当于号错脉了,比如这里只是搜索git did not exit cleanly (exit code 1),尝试的方法都没有效果,越走越远.后来去到github中,把private前面的对勾去掉,才解决这一问题.