异常-Phoenix HBASE Last region should end with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole

1 详细异常信息

RROR: There is a hole in the region chain between \x03\x00\x00\x00\x00\x00\x00\x00\x00 and \x05\x00\x00\x00\x00\x00\x00\x00\x00.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: There is a hole in the region chain between \x08\x00\x00\x00\x00\x00\x00\x00\x00 and \x09\x00\x00\x00\x00\x00\x00\x00\x00.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: Last region should end with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole.
ERROR: Found inconsistency in table WMBIGDATA:T_CHARGING_ORDER
ERROR: (region WMBIGDATA:ODS_PLUS_ES_CHARGING_STATION,\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00,1570851021283.cd3a2e47eae11e7516f40c96ef18f9e0.) First region should start with an empty key.  You need to  create a new region and regioninfo in HDFS to plug the hole.
ERROR: There is a hole in the region chain between \x05\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 and \x06\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: There is a hole in the region chain between \x07\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 and \x08\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: Found inconsistency in table WMBIGDATA:ODS_PLUS_ES_CHARGING_STATION
ERROR: (region WMBIGDATA:ODS_ES_CHARGING_EQUIPMENT_EFFECT_INDEX,\x01\x00\x00\x00\x00\x00\x00,1570863380329.262f7bf1c70f3fe0caa2df5f04184d1b.) First region should start with an empty key.  You need to  create a new region and regioninfo in HDFS to plug the hole.
ERROR: There is a hole in the region chain between \x02\x00\x00\x00\x00\x00\x00 and \x03\x00\x00\x00\x00\x00\x00.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: There is a hole in the region chain between \x04\x00\x00\x00\x00\x00\x00 and \x07\x00\x00\x00\x00\x00\x00.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: Found inconsistency in table WMBIGDATA:ODS_ES_CHARGING_EQUIPMENT_EFFECT_INDEX
ERROR: There is a hole in the region chain between \x01 and \x04.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: There is a hole in the region chain between \x07 and \x09.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: There is a hole in the region chain between \x0A and \x0B.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: Found inconsistency in table WMBIGDATA:WM_USER_ACCOUNT_DEPOSIT_LOG
ERROR: There is a hole in the region chain between \x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 and \x03\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: There is a hole in the region chain between \x05\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 and \x08\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: Found inconsistency in table WMBIGDATA:ODS_PLUS_ES_CHARGING_CONNECTOR
ERROR: There is a hole in the region chain between \x02 and \x03.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: There is a hole in the region chain between \x04 and \x05.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: There is a hole in the region chain between \x08 and \x09.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: Last region should end with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole.
ERROR: Found inconsistency in table WMBIGDATA:WM_TRAVEL_ORDER
ERROR: There is a hole in the region chain between \x01 and \x02.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: There is a hole in the region chain between \x09 and \x0A.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: Found inconsistency in table WMBIGDATA:WM_ORDER_ER_ORDER
ERROR: There is a hole in the region chain between \x01 and \x03.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: There is a hole in the region chain between \x07 and \x08.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.
ERROR: Last region should end with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole.
ERROR: Found inconsistency in table WMBIGDATA:WM_COUPON
ERROR: There is a hole in the region chain between \x02 and \x03.  You need to create a new .regioninfo and region dir in hdfs to plug the hole.

2 解决心路历程

  A尝试命令修复,不起作用

sudo -u hbase   hbase hbck repair

  B 尝试重新分配,继续修复,不起作用

sudo -u hbase hbase hbck -fixAssignments

  C 删除zookeeper的节点/hbase目录,照样不起作用

  D 暴力删除 hdfs dfs -rmr /hbase/WALs/ 下面的节点信息,重启集群,也不起作用

3 最终解决

  上面也是hbase RIT问题能搜索到的很多信息

参考博客: https://cloud.tencent.com/developer/article/1359221

  然后增加配置hbase-site.xml

  

<property>

<name>hbase.regionserver.executor.openregion.threads</name>

<value>100</value>

</property>

重启集群,服务正常。

  

    

原文地址:https://www.cnblogs.com/QuestionsZhang/p/12041250.html

时间: 2024-10-30 05:20:58

异常-Phoenix HBASE Last region should end with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole的相关文章

HBase 系统架构及数据结构

一.基本概念 ????2.1 Row Key (行键) ????2.2 Column Family(列族) ????2.3 Column Qualifier (列限定符) ????2.4 Column(列) ????2.5 Cell ????2.6 Timestamp(时间戳) 二.存储结构 ????2.1 Regions ????2.2 Region Server 三.Hbase系统架构 ????3.1 系统架构 ????3.2 组件间的协作 四.数据的读写流程简述 ????4.1 写入数据的

HBase 系列(二)—— HBase 系统架构及数据结构

一.基本概念 一个典型的 Hbase Table 表如下: 1.1 Row Key (行键) Row Key 是用来检索记录的主键.想要访问 HBase Table 中的数据,只有以下三种方式: 通过指定的 Row Key 进行访问: 通过 Row Key 的 range 进行访问,即访问指定范围内的行: 进行全表扫描. Row Key 可以是任意字符串,存储时数据按照 Row Key 的字典序进行排序.这里需要注意以下两点: 因为字典序对 Int 排序的结果是 1,10,100,11,12,1

高效的两段式循环缓冲区──BipBuffer

Simon Cooke,美国 (原作者) 北京理工大学 20981 陈罡(翻译) 写在前面的话: 循环缓冲区是一个非常常用的数据存储结构,已经被广泛地用于连续.流数据的存储和通信应用中.对于循环缓冲区,传统的操作方法是开辟一块连续的存储区,不 断地写入数据,当写入到存储区的末尾的时候,再从存储区的首部再开始写入数据,由此不断地重复下去构成了循环缓冲区.偶曾经写过很多循环缓冲区,也看过很 多人编写的循环缓冲区,但是拜读Simon Cooke先生的文章────“两段式”循环缓冲区(原文名称是:The

The Bip Buffer - The Circular Buffer with a Twist

Introduction The Bip-Buffer is like a circular buffer, but slightly different. Instead of keeping one head and tail pointer to the data in the buffer, it maintains two revolving regions, allowing for fast data access without having to worry about wra

hbase日常运维管用命令,region管理

1         Hbase日常运维 1.1       监控Hbase运行状况 1.1.1        操作系统 1.1.1.1 IO 群集网络IO,磁盘IO,HDFS IO IO越大说明文件读写操作越多.当IO突然增加时,有可能:1.compact队列较大,集群正在进行大量压缩操作. 2.正在执行mapreduce作业 可以通过CDH前台查看整个集群综合的数据或进入指定机器的前台查看单台机器的数据: Io wait 磁盘IO对集群的影响比较大,如果io wait时间过长需检查系统或磁盘是

hbase(一)region

前言 文章不含源码,只是一些官方资料的整理和个人理解 架构总览 这张图在大街小巷里都能看到,感觉是hbase架构中最详细最清晰的一张,稍微再补充几点. 1) Hlog是低版本hbase术语,现在称为WALs. 2) 1个region包含了多个store,1个store包含了1个colum family,这样就比较好理解 3) 1个store包含了多个storefile,1个sotrefile就是1个hfile文件 这在HDFS路径也能体现,大概长这样 table/region/column fa

Phoenix on HBase

(一)概要 Apache Phoenix是基于BSD许可开源的一个Java中间层,可以让开发者在Apache HBase上执行SQL查询.Apache Phoenix主要特性: 嵌入式的JDBC驱动,实现了大部分的java.sql接口,包括元数据API 可以通过多部行键或是键/值单元对列进行建模 完善的查询支持,可以使用多个谓词以及优化的扫描键 DDL支持:通过CREATE TABLE.DROP TABLE及ALTER TABLE来添加/删除列 版本化的模式仓库:当写入数据时,快照查询会使用恰当

hbase region, store, storefile和列簇,的关系

先来一张大图. Hbase上Regionserver的内存分为两个部分,一部分作为Memstore,主要用来写:另外一部分作为BlockCache,主要用于读数据:这里主要介绍写数据的部分,即Memstore.当RegionServer(RS)收到写请求的时候(writerequest),RS会将请求转至相应的Region.每一个Region都存储着一些列(a set of rows).根据其列族的不同,将这些列数据存储在相应的列族中(Column Family,简写CF).不同的CF中的数据存

HBase原理–所有Region切分的细节都在这里了

本文来自网易云社区 作者:范欣欣 Region自动切分是HBase能够拥有良好扩张性的最重要因素之一,也必然是所有分布式系统追求无限扩展性的一副良药.HBase系统中Region自动切分是如何实现的?这里面涉及很多知识点,比如Region切分的触发条件是什么?Region切分的切分点在哪里?如何切分才能最大的保证Region的可用性?如何做好切分过程中的异常处理?切分过程中要不要将数据移动?等等,这篇文章将会对这些细节进行基本的说明,一方面可以让大家对HBase中Region自动切分有更加深入的