Spark-shell 启动WARN---java.net.BindException: Address already in use

同时打开了两个SecureCRT的终端界面,其中一个已经进入了Spark-shell,在另一个SecureCRT界面中执行

"spark-shell --master yarn --deploy-mode client < cha02.scala" 时报错,如下:

[[email protected] test_code]# spark-shell --master yarn --deploy-mode client <cha02.scala
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
17/05/07 20:41:35 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/05/07 20:41:37 WARN component.AbstractLifeCycle: FAILED [email protected]{HTTP/1.1}{0.0.0.0:4040}: java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)

17/05/07 21:00:46 WARN util.Utils: Service ‘SparkUI‘ could not bind on port 4040. Attempting port 4041.
17/05/07 21:00:59 WARN yarn.Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
17/05/07 21:01:37 WARN metastore.ObjectStore: Failed to get database global_temp, returning NoSuchObjectException
Spark context Web UI available at http://192.168.1.200:4041
Spark context available as ‘sc‘ (master = yarn, app id = application_1494142860645_0005).
Spark session available as ‘spark‘.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ ‘_/
/___/ .__/\_,_/_/ /_/\_\ version 2.1.0
/_/

Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_121)
Type in expressions to have them evaluated.
Type :help for more information.

scala>

这是由于启动一个Spark context 时,SparkUI 默认会使用 4040 端口,当 4040 端口被占用时,则尝试使用另外一个端口,即日志中的

Service ‘SparkUI‘ could not bind on port 4040. Attempting port 4041.

时间: 2024-10-25 14:08:13

Spark-shell 启动WARN---java.net.BindException: Address already in use的相关文章

[已解决]Tomcat启动报 java.net.BindException: Address already in use: JVM_Bind

启动多个Tomcat的的时候记得要改3个端口: <Server port="8001" shutdown="SHUTDOWN"> <Connector port="6301" protocol="HTTP/1.1" /> <Connector port="8006" protocol="AJP/1.3" redirectPort="8443&quo

Tomcate 启动异常,java.net.BindException: Address already in use: JVM_Bind:80的解决办法

一直用Tomcat,但是前几天突然报错:           java.net.BindException: Address already in use: JVM_Bind:80 第一反应就是80端口被占用了. 解决方案: 1.先用命令 netstat -ano 看一下各个端口(Local Address 列的端口号)占用和进程PID. 查看后发现我本地的8080端口被进程PID13888占用 2.然后在任务管理器里,查看进程,找到PID为13888的进程然后结束它(我的13888进程已经结束

(解决tomcat端口被占用的问题)create[8005]java.net.BindException: Address already in use: JVM_Bind

create[8005]java.net.BindException: Address already in use: JVM_Bind”,原来是Tomcat8005端口被其他进程占用,8005端口是用来关闭TOMCAT服务的端口,解决的方法如下 1.方法一,修改tomcat/conf/server.xml文件 打开server.xml 将<Server port="8005" shutdown="SHUTDOWN">中8005改成不常用的端口号即可,比

严重: StandardServer.await: create[localhost:8005]: java.net.BindException: Address already in use: JVM_Bind

错误描述:严重: StandardServer.await: create[localhost:8005]: java.net.BindException: Address already in use: JVM_Bind 解决方法:这是端口号被占用,先查看端口号是被谁占用的,我的第一次查找到的是Tomcat7.0,kill掉进程,重新打开eclipse启动tomcat,发现还是同样的错: 又使用同样的方法,发现是java.exe占用,然后kill掉,发现Tomcat可启动. ---------

Unable to open debugger port (127.0.0.1:63777): java.net.BindException &quot;Address already in use: JVM

对Intellij IDEA是又爱又恨呀,爱的比myeclipse用起来爽手多了,恨的是刚开始用还不是很习惯. 偶尔启动Debug模式用Tomcat来调试会报以下错误: Unable to open debugger port (127.0.0.1:63777): java.net.BindException "Address already in use: JVM_Bind" 困扰了我好久,试过删掉taget文件夹rebuild,试过杀掉java进程和重启机器,但是就是没效果. 今天

connections java.net.BindException: Address already in use_解决方案

一.问题描述 在Linux服务器(CentOS7系统)中配置并启动JMeter远程监控服务器资源所需的ServerAgent目录下的 startAgent.sh 文件时,系统出现异常提示,如 [[email protected] ServerAgent-2.2.3]# ./startAgent.sh INFO 2018-12-15 10:29:17.634 [kg.apc.p] (): Binding UDP to 4444 ERROR 2018-12-15 10:29:17.686 [kg.a

解决springboot 出现异常: java.net.BindException: Address already in use: bind

解决springboot 出现异常: java.net.BindException: Address already in use: bind 这是引文在启动springboot 的时候,没有关闭端口号8080(或者自定义的端口号),需要进行手动关闭. 操作步骤: 1,windows+R -->cmd,进入命令窗口. 2,命令行内输入 :netstat   -ano|findstr  8080 8080指的是你启动的时候的端口号 查找最后一列的pid. 命令行输入: taskkill  /pid

java.rmi.server.ExportException: Port already in use: 7888; nested exception is: java.net.BindException: Address already in use: JVM_Bind 报错解决

1. 问题描述 运行多个 spring boot 程序,出现报错 java.rmi.server.ExportException: Port already in use: 7888; nested exception is: java.net.BindException: Address already in use: JVM_Bind.网上查找相关问题多数是叫结束占用端口的进程,但是占用该端口的进程实际上也是需要启动的 spring boot 程序,关掉进程,程序也将停止. 2. 问题解决

java.net.BindException: Address already in use: JVM_Bind &lt;null&gt;:8080错误

今天打开myeclipse出现java.net.BindException: Address already in use: JVM_Bind <null>:8080错误 从网上搜了一下大多是讲端口被占用 用netstat -ano 查看8080端口,根据PID结束对应的进程. 表示很无语,我用命令查看8080端口没有被占用,下面是我搜索的另外的解决方法,我的能够成功解决. 在tomcat--->bin/startup.bat 编辑 添加java的环境就可以了: set JAVA_HOM

端口占用的一种形式 Failed to initialize end point associated with ProtocolHandler [&quot;ajp-bio-8090&quot;] java.net.BindException: Address already in use: JVM_Bind &lt;null&gt;:8090

严重: Failed to initialize end point associated with ProtocolHandler ["ajp-bio-8090"]java.net.BindException: Address already in use: JVM_Bind <null>:8090 at org.apache.tomcat.util.net.JIoEndpoint.bind(JIoEndpoint.java:413) at org.apache.tomc