OGG抽取进程异常问题排查一例

1、问题现象
抽取进程常常running，但是没有新产生trail文件，lag比较大

GGSCI (xxxdb) 3> info all
Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING
EXTRACT     RUNNING     EXT1        05:35:57      492:33:56
EXTRACT     RUNNING     PUMP1       00:00:00      00:00:02
GGSCI (xxxdb) 4>
GGSCI (xxxdb) 4> info EXT1,showch

EXTRACT    EXT1      Last Started 2018-05-28 17:20   Status RUNNING
Checkpoint Lag       05:35:57 (updated 492:35:53 ago)
Log Read Checkpoint  Oracle Redo Logs
                     2018-05-07 23:13:49  Seqno 5331, RBA 289991960
                     SCN 3439.4180128660 (14774572659604)

2018-05-28 17:20:53  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (dtogg): start EXT1.
2018-05-28 17:20:53  INFO    OGG-00963  Oracle GoldenGate Manager for Oracle, mgr.prm:  Command received from GGSCI on host pacsdb (START EXTRACT EXT1 ).
2018-05-28 17:20:53  INFO    OGG-00975  Oracle GoldenGate Manager for Oracle, mgr.prm:  EXTRACT EXT1 starting.
2018-05-28 17:20:53  INFO    OGG-00992  Oracle GoldenGate Capture for Oracle, ext1.prm:  EXTRACT EXT1 starting.
2018-05-28 17:20:53  INFO    OGG-03035  Oracle GoldenGate Capture for Oracle, ext1.prm:  Operating system character set identified as ISO-8859-1. Locale: en
_US, LC_ALL:.
2018-05-28 17:20:54  INFO    OGG-01815  Oracle GoldenGate Capture for Oracle, ext1.prm:  Virtual Memory Facilities for: BR
    anon alloc: mmap(MAP_ANON)  anon free: munmap
    file alloc: mmap(MAP_SHARED)  file free: munmap
    target directories:
    /oracle/10.2/ogg/BR/EXT1.
2018-05-28 17:20:54  INFO    OGG-01815  Oracle GoldenGate Capture for Oracle, ext1.prm:  Virtual Memory Facilities for: COM
    anon alloc: mmap(MAP_ANON)  anon free: munmap
    file alloc: mmap(MAP_SHARED)  file free: munmap
    target directories:
    /oracle/10.2/ogg/dirtmp.
2018-05-28 17:20:54  INFO    OGG-01639  Oracle GoldenGate Capture for Oracle, ext1.prm:  BOUNDED RECOVERY:  ACTIVE: for object pool 1: p48169162_extr.
2018-05-28 17:20:54  INFO    OGG-01640  Oracle GoldenGate Capture for Oracle, ext1.prm:  BOUNDED RECOVERY: recovery start XID: 117.11.252267.
2018-05-28 17:20:54  INFO    OGG-01641  Oracle GoldenGate Capture for Oracle, ext1.prm:  BOUNDED RECOVERY: recovery start position: SeqNo: 5327, RBA: 322457
76, SCN: 3439.4175624574 (14774568155518), Timestamp: 2018-05-07 21:09:55.000000.
2018-05-28 17:20:54  INFO    OGG-01642  Oracle GoldenGate Capture for Oracle, ext1.prm:  BOUNDED RECOVERY: recovery end position: SeqNo: 5329, RBA: 82061788
4, SCN: 3439.4180119353 (14774572650297), Timestamp: 2018-05-07 23:09:01.000000, Thread: 1.
2018-05-28 17:20:54  INFO    OGG-01579  Oracle GoldenGate Capture for Oracle, ext1.prm:  BOUNDED RECOVERY: VALID BCP: CP.EXT1.000001412.
2018-05-28 17:20:54  INFO    OGG-01629  Oracle GoldenGate Capture for Oracle, ext1.prm:  BOUNDED RECOVERY: PERSISTED OBJECTS RECOVERED: 9.
2018-05-28 17:20:54  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (dtogg):  start ext1.
2018-05-28 17:20:55  INFO    OGG-01513  Oracle GoldenGate Capture for Oracle, ext1.prm:  Positioning to Sequence 5327, RBA 32245776, SCN 3439.4175624574.
2018-05-28 17:20:57  INFO    OGG-01516  Oracle GoldenGate Capture for Oracle, ext1.prm:  Positioned to Sequence 5327, RBA 32245776, SCN 3439.4175624574, May
 7, 2018 9:09:55 PM.

2、问题解决
通过 info ext1 showch 查看抽取进程的Recovery Checkpoint，设置抽取进程到相应时间

GGSCI (xxxdb) 7> alter extract EXT1 ,tranlog ,begin 2018-05-07 23:13:49
EXTRACT altered.

GGSCI (xxxdb) 8> start EXT1

Sending START request to MANAGER ...
EXTRACT EXT1 starting

GGSCI (xxxdb) 9> info EXT1

EXTRACT    EXT1      Initialized   2018-05-28 17:28   Status RUNNING
Checkpoint Lag       498:14:13 (updated 00:00:10 ago)
Log Read Checkpoint  Oracle Redo Logs
                     2018-05-07 23:13:49  Seqno 0, RBA 0
                     SCN 0.0 (0)

GGSCI (xxxdb) 12> info EXT1

EXTRACT    EXT1      Last Started 2018-05-28 17:28   Status RUNNING
Checkpoint Lag       498:13:54 (updated 00:00:09 ago)
Log Read Checkpoint  Oracle Redo Logs
                     2018-05-07 23:14:31  Seqno 5331, RBA 834580564
                     SCN 3439.4180220954 (14774572751898)

GGSCI (xxxdb) 13> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING
EXTRACT     RUNNING     EXT1        498:09:51     00:00:03
EXTRACT     RUNNING     PUMP1       498:10:04     00:00:04    

GGSCI (xxxdb) 14>  info EXT1

EXTRACT    EXT1      Last Started 2018-05-28 17:28   Status RUNNING
Checkpoint Lag       498:08:55 (updated 00:00:07 ago)
Log Read Checkpoint  Oracle Redo Logs
                     2018-05-07 23:20:30  Seqno 5333, RBA 1141071888
                     SCN 3439.4180340086 (14774572871030)

2018-05-28 17:28:02  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (dtogg): alter extract EXT1  tranlog ,begin 2018-05
-07 23:13:49.
2018-05-28 17:28:09  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (dtogg): start EXT1.
2018-05-28 17:28:09  INFO    OGG-00963  Oracle GoldenGate Manager for Oracle, mgr.prm:  Command received from GGSCI on host pacsdb (START EXTRACT EXT1 ).
2018-05-28 17:28:09  INFO    OGG-00975  Oracle GoldenGate Manager for Oracle, mgr.prm:  EXTRACT EXT1 starting.
2018-05-28 17:28:09  INFO    OGG-00992  Oracle GoldenGate Capture for Oracle, ext1.prm:  EXTRACT EXT1 starting.
2018-05-28 17:28:09  INFO    OGG-03035  Oracle GoldenGate Capture for Oracle, ext1.prm:  Operating system character set identified as ISO-8859-1. Locale: en
_US, LC_ALL:.
2018-05-28 17:28:09  INFO    OGG-01635  Oracle GoldenGate Capture for Oracle, ext1.prm:  BOUNDED RECOVERY: reset to initial or altered checkpoint.
2018-05-28 17:28:09  INFO    OGG-01815  Oracle GoldenGate Capture for Oracle, ext1.prm:  Virtual Memory Facilities for: BR
    anon alloc: mmap(MAP_ANON)  anon free: munmap
    file alloc: mmap(MAP_SHARED)  file free: munmap
    target directories:
    /oracle/10.2/ogg/BR/EXT1.
2018-05-28 17:28:09  INFO    OGG-01815  Oracle GoldenGate Capture for Oracle, ext1.prm:  Virtual Memory Facilities for: COM
    anon alloc: mmap(MAP_ANON)  anon free: munmap
    file alloc: mmap(MAP_SHARED)  file free: munmap
    target directories:
    /oracle/10.2/ogg/dirtmp.
2018-05-28 17:28:10  INFO    OGG-01515  Oracle GoldenGate Capture for Oracle, ext1.prm:  Positioning to begin time May 7, 2018 11:13:49 PM.
2018-05-28 17:28:15  INFO    OGG-01516  Oracle GoldenGate Capture for Oracle, ext1.prm:  Positioned to Sequence 5331, RBA 279352336, SCN 0.0, May 7, 2018 11
:13:49 PM.
2018-05-28 17:28:15  INFO    OGG-00993  Oracle GoldenGate Capture for Oracle, ext1.prm:  EXTRACT EXT1 started.
2018-05-28 17:28:15  INFO    OGG-01055  Oracle GoldenGate Capture for Oracle, ext1.prm:  Recovery initialization completed for target file /oradata/ogg/dird
at/e1002586, at RBA 1024.
2018-05-28 17:28:15  INFO    OGG-01478  Oracle GoldenGate Capture for Oracle, ext1.prm:  Output file /oradata/ogg/dirdat/e1 is using format RELEASE 11.2.
2018-05-28 17:28:15  WARNING OGG-01438  Oracle GoldenGate Capture for Oracle, ext1.prm:  Checkpoint marked as from graceful shutdown, but records found afte
r checkpoint in trail /oradata/ogg/dirdat/e1.  Expected EOF Seqno 2583, RBA 6228814.  Found Seqno 2586, RBA 1024.
2018-05-28 17:28:15  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, ext1.prm:  Rolling over remote file /oradata/ogg/dirdat/e1002586.
2018-05-28 17:28:15  INFO    OGG-01053  Oracle GoldenGate Capture for Oracle, ext1.prm:  Recovery completed for target file /oradata/ogg/dirdat/e1002587, at
 RBA 1024.
2018-05-28 17:28:15  INFO    OGG-01057  Oracle GoldenGate Capture for Oracle, ext1.prm:  Recovery completed for all targets.
2018-05-28 17:28:15  INFO    OGG-01517  Oracle GoldenGate Capture for Oracle, ext1.prm:  Position of first record processed Sequence 5331, RBA 279352336, SC
N 3439.4180128606, May 7, 2018 11:13:49 PM.

shell下通过下列脚本过滤出OGG进程状态，留作监控使用

(echo info all;echo exit)|./ggsci|grep -E "EXTRACT|REPLICAT" |awk ‘BEGIN {FS=" +"} {print $1","$3","$2","$4","$5}‘

原文地址：https://www.cnblogs.com/lYng/p/9480900.html

时间： 2024-10-22 00:13:53

OGG抽取进程异常问题排查一例的相关文章

【翻译自mos文章】对于oracle 数据库来说，OGG的抽取进程什么时候到database中获取数据？

对于oracle 数据库来说,OGG的抽取进程什么时候到database中获取数据? 参考原文: When GoldenGate Fetches Data From The Database On Extraction For Oracle (Doc ID 1059583.1) 适用于: Oracle GoldenGate - Version 4.0.0 and later Information in this document applies to any platform. 解决方法: 问

YS VTM模块存在格式化字符串漏洞，可导致VTM进程异常退出【高危】

YS VTM模块存在格式化字符串漏洞,可导致VTM进程异常退出[高危] 问题描述:          YS VTM模块开放对外监听端口(8554和8664),此次使用sulley fuzzing框架对监听在8664端口的私有二进制协议进行测试,以检测可能发生的各种问题.在该协议中,客户端会向8664端口发送一个二进制+文本格式的报文,对该报文格式的各个字段进行fuzzing,发现当向服务端的VTM进程传入格式化字符串时会崩溃并退出. 测试步骤: 1.  分别在客户机和服务器安装sulley fu

修改Oracle GoldenGate(ogg)各个进程的读检查点和写检查点

请注意:请慎重修改Oracle GoldenGate(ogg)各个进程的读检查点和写检查点.请确保已经 掌握 ogg 各个进程的读检查点和写检查点的具体含义. BEGIN {NOW | yyyy-mm-dd[:hh:mi:[ss[.cccccc]]] | EOF | SEQNO <sequence number>} --修改抽取进程的开始抽取点:(即:myext的读检查点) alter extract myext BEGIN yyyy-mm-dd:hh:mi:ss alter extract 

详谈 UNIX 环境进程异常退出

原文链接:http://www.ibm.com/developerworks/cn/aix/library/1206_xiejd_unixexception/ 详谈 UNIX 环境进程异常退出 本文详细论述 UNIX 环境上的进程异常退出,将导致进程异常退出的各种情景归纳为两类,对每类情况详细分析了问题出现的根本原因,同时添加了相应的实例以易于您更好地进行了解.在此基础上,文章最后论述了应该如何避免和调试进程异常退出问题.希望读者阅读此文后,对进程异常退出问题有更深层的认识,有更系统的梳理,对调

怀疑服务器存在异常流量排查日记，使用ifconfig，nethogs等命令

怀疑服务器存在异常流量排查日记一.用ifconfig查看网卡流量[email protected] ~]# ifconfigeth4 Link encap:Ethernet HWaddr 00:50:56:0A:A6:E9 inet addr:192.168.1.91 Bcast:192.168.1.255 Mask:255.255.255.0inet6 addr: fa70::220:58af:faba:6e8/64 Scope:LinkUP BROADCAST RUNNING MULTICA

ceph同步数据过程OSD进程异常退出记录

做的操作: ceph集群扩容了几个节点. 异常现象: ceph集群同步时,总是OSD进程异常的宕掉(同步一段时间数据后). ceph版本:  9.2.1 日志: 7月 25 09:25:57 ceph6 ceph-osd[26051]: 0> 2017-07-25 09:25:57.471502 7f46fe478700 -1 common/HeartbeatMap.cc: In function 'bool ceph::HeartbeatMap::_ch 7月 25 09:25:57 ceph

【翻译自mos文章】OGG replicat 进程使用的 TCP 端口

OGG replicat 进程使用的 TCP 端口 来源于: TCP PORT USED BY REPLICAT PROCESSES (文档 ID 1060954.1) 适用于: Oracle GoldenGate - Version 10.4.0.12 and later Information in this document applies to any platform. ***Checked for relevance on 25-May-2012*** 症状: 若是一个客户基于少量的

ogg初始化进程配置

网上搜索"ogg配置",基本上都是配置流程,较少有ogg初始化进程的技术文档.一般ogg初始化主要分为两种,一种是源数据库表列不含clob类型,另一种 情况是源数据库表列含有clob类型. 此处测试为:源数据库表为source.test1,目的端IP为192.168.100.20,OGG用户和密码为ogg,ogg,目的端数据库实例为orcl 方式一(适合不包含clob数据类型的数据库) 1.源端初始化进程配置    ADD EXTRACT ini_1,SOURCEISTABLE    

CentOS服务器上搭建Gitlab安装步骤、中文汉化详细步骤、日常管理以及异常故障排查

一, 服务器快速搭建gitlab方法 可以参考gitlab中文社区 的教程 centos7安装gitlab:https://www.gitlab.cc/downloads/#centos7 centos6安装gitlab:https://www.gitlab.cc/downloads/#centos6 如下方法按照官网来操作,手工安装过于麻烦.当前测试平台为小鸟云的三个月centos 7测试机. 1. 安装配置依赖项 如想使用Postfix来发送邮件,在安装期间请选择'Internet Site