cdh 系统配置文件更新 error parsing conf core-site.xml

环境描述：redhat7.3 CDH5.15.1 采用parcels方式部署

报错描述：airflow调度程序，最近2周偶尔报错，报错类型有2类：1、无法初始化集群配置；2、读取配置权限问题

报错一：

Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there‘s no reduce operator
java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:143)
at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:108)
at org.apache.hadoop.mapreduce.Cluster.(Cluster.java:101)
at org.apache.hadoop.mapred.JobClient.init(JobClient.java:477)
at org.apache.hadoop.mapred.JobClient.(JobClient.java:455)

报错二

19/12/21 04:06:27 ERROR conf.Configuration: error parsing conf core-site.xml
java.io.FileNotFoundException: /etc/hive/conf.cloudera.hive/core-site.xml (Permission denied)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.(FileInputStream.java:138)
at java.io.FileInputStream.(FileInputStream.java:93)
at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)

报错三

setfacl: Permission denied. user=dip is not the owner of inode=.hive-staging_hive_2019-12-22_07-44-25_997_2557429548076828737-1
java.lang.RuntimeException: java.io.FileNotFoundException: /etc/hive/conf.cloudera.hive/hive-site.xml (Permission denied)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2811)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2663)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2559)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:1340)
at org.apache.hadoop.hive.conf.HiveConf.getVar(HiveConf.java:2756)
at org.apache.hadoop.hive.conf.HiveConf.getVar(HiveConf.java:2777)
at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:2849)
at org.apache.hadoop.hive.conf.HiveConf.(HiveConf.java:2792)

检查集群中的所有机器，发现有一台机器配置文件一直在疯狂更新：

/etc/hive/conf.cloudera.hive

/etc/hadoop/conf.cloudera.yarn

/etc/hbase/conf.cloudera.hbase

检查：

该机器: /var/lib/alternatives 下面有空文件

操作:

删除/var/lib/alternatives 下面所有文件，

重启agent

cd /var/lib/alternatives

rm  -rf   *

systemctl restart cloudera-scm-agent.service

观察：配置文件不再疯狂更新，问题解决。

原文地址：https://www.cnblogs.com/students/p/12092728.html

时间： 2024-10-17 23:23:14

cdh 系统配置文件更新 error parsing conf core-site.xml的相关文章

hadoop 出现FATAL conf.Configuration: error parsing conf file，异常

FATAL conf.Configuration: error parsing conf file: com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException: Invalid byte 1 of 1-byte UTF-8 sequence. 14/07/12 23:51:40 ERROR namenode.NameNode: java.lang.RuntimeException: com.sun.org.

Apache的主配置文件：/etc/httpd/conf/httpd.conf

Apache的主配置文件:/etc/httpd/conf/httpd.conf默认站点主目录:/var/www/html/Apache服务器的配置信息全部存储在主配置文件/etc/httpd/conf/httpd.conf中,这个文件中的内容非常多,用wc命令统计一共有1009行,其中大部分是以#开头的注释行.[[email protected] ~]# wc -l /etc/httpd/conf/httpd.conf 1009 /etc/httpd/conf/httpd.conf [[emai

spring mybatis 整合问题Error parsing Mapper XML. Cause: java.lang.NullPointerException

14:30:40,872 DEBUG SqlSessionFactoryBean:431 - Parsed configuration file: 'class path resource [mybatis/mybatis-config.xml]'14:30:40,883 WARN XmlWebApplicationContext:489 - Exception encountered during context initialization - cancelling refresh att

Mongodb_"Error parsing YAML config file: yaml-cpp: error at line 3, column 9: illegal map value"解决方法

在启动配置文件的时候,系统报错:Error parsing YAML config file: yaml-cpp: error at line 3, column 9: illegal map value 首先检查一下各个参数是否配置正确第二步查看文件路径中是否正确,路径中用双引号包围时("D:\MongoDB\data"),应该将路径中的"\"换成"/"("D:/MongoDB/data") 第三步查看配置文件中是否以Ta

linux系统配置文件

1./etc/sysconfig/i18n(语言配置文件). LANG="zh_CN.UTF-8" #中文 LANG="en_US.UTF-8"或LANG="" #英文 2./etc/sysconfig/network-scripts/ifcfg-eth0(eth0配置文件) 静态: DEVICE=eth0 #网卡接口名称 HWADDR=00:0C:29:13:5D:74 #网卡设备MAC地址 TYPE=Ethe

[转]安卓虚拟机启动后报错：类似 SDK Manager] Error: Error parsing .devices.xml 解决方案

昨天用android sdk manager 更新了android sdk, 我是在myeclipse上面安装adt来开发android的现在每次打开myeclipse都报错, 而且我每次打开虚拟机的时候也报错.报错的信息都是一样的. 报错的信息如下:[2015-05-30 10:14:35 - Android SDK] Error when loading the SDK: Error: Error parsing D:/android-sdks/system-images/android-2

安卓虚拟机启动后报错：类似 SDK Manager] Error: Error parsing .....devices.xml 解决方案

【瑞星系统】更新积分不对

SET QUOTED_IDENTIFIER ON GOSET ANSI_NULLS ON GO ALTER trigger POSUpdateValidVIP on POSSRLBF for update asbegin declare @SECTION varchar(80), @CODE varchar(80) declare @TAG varbinary(8) declare @ERROR int,@ERRMSG varchar(255) select @SECTION ='财务处理',

关于自定义控件在布局文件中使用时提示error: Error parsing XML: not well-formed (invalid token)错误的问题

今天在尝试自定义一个控件后,在布局文件中使用的时候报错 <RelativeLayout xmlns:android="http://schemas.android.com/apk/res/android" xmlns:tools="http://schemas.android.com/tools" xmlns:carrey="http://schemas.android.com/apk/res/com.example.customview"