系统架构：
OGG基本配置（单向传输）
1、数据库配置（Source DB)
建立Tablespace： 11:58:56 [email protected] prod >create tablespace ogg_tbs 11:59:12 2 datafile ‘/u01/app/oracle/oradata/prod/oggtbs1.dbf‘ size 100m ; 建立ogg用户： 12:01:17 [email protected] prod >create user ogg identified by ogg default tablespace ogg_tbs temporary tablespace temp quota unlimited on ogg_tbs; User created. 用户授权： 12:01:39 [email protected] prod >grant connect,resource to ogg; Grant succeeded. 12:01:55 [email protected] prod >grant create session,alter session to ogg; Grant succeeded. 12:02:18 [email protected] prod >grant select any dictionary,select any table to ogg; Grant succeeded. 12:02:42 [email protected] prod >grant alter any table to ogg; Grant succeeded. 12:02:53 [email protected] prod >grant flashback any table to ogg; Grant succeeded. 12:03:03 [email protected] prod >grant execute on dbms_flashback to ogg; Grant succeeded. 在Database上启用附加日志功能： 12:19:26 [email protected] prod >select SUPPLEMENTAL_LOG_DATA_MIN from v$database; SUPPLEME -------- NO 12:20:53 [email protected] prod >alter database add supplemental log data; Database altered. 数据库应为归档模式： 12:21:10 [email protected] prod >archive log list; Database log mode Archive Mode Automatic archival Enabled Archive destination /dsk4/arch_prod Oldest online log sequence 78 Next log sequence to archive 80 Current log sequence 80 13:22:45 [email protected] prod >select force_logging from v$database; FOR --- NO 13:24:22 [email protected] prod >alter database force logging; Database altered. 13:24:30 [email protected] prod >select force_logging from v$database; FOR --- YES 建立用于传输测试的Table： 12:12:26 [email protected] prod >create table emp_ogg as select * from emp; Table created.
2、数据库配置（Target DB)
建立Tablespace： 12:07:50 [email protected] prod >create tablespace ogg_tbs 12:08:09 2 datafile ‘/u01/app/oracle/oradata/prod/oggtbs1.dbf‘ size 100m; 建立ogg用户： 12:08:47 [email protected] prod >create user ogg identified by ogg default tablespace ogg_tbs temporary tablespace temp quota unlimited on ogg_tbs; User created. 用户授权： 12:09:44 [email protected] prod >grant connect,resource to ogg; Grant succeeded. 12:10:06 [email protected] prod >grant create session ,alter session to ogg; Grant succeeded. 12:10:20 [email protected] prod >grant select any table,select any dictionary to ogg; Grant succeeded. 12:10:45 [email protected] prod >grant create table to ogg; 创建测试Table： 12:13:47 [email protected] prod >create table emp_ogg as select * from emp; Table created. 12:14:04 [email protected] prod >grant all on emp_ogg to ogg； Grant succeeded.
3、OGG配置（source）
配置MGR: [[email protected] ogg]$ ./ggsci Oracle GoldenGate Command Interpreter for Oracle Version 11.2.1.0.1 OGGCORE_11.2.1.0.1_PLATFORMS_120423.0230_FBO Linux, x86, 32bit (optimized), Oracle 11g on Apr 23 2012 08:09:25 Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved. GGSCI (ogg) 2> dblogin userid ogg,password ogg; Successfully logged into database. GGSCI (ogg) 3> add trandata scott.emp_ogg; ERROR: No viable tables matched specification. goldengate add trandata 提示找不到表 ERROR: No viable tables matched specification goldengate对符号比较敏感，在add trandata时不要用分号 GGSCI (ogg) 4> add trandata scott.emp_ogg 2014-09-10 14:00:25 WARNING OGG-00869 No unique key is defined for table ‘EMP_OGG‘. All viable columns will be used to represent the key, but may not guarantee uniqueness. KEYCOLS may be used to define the key. Logging of supplemental redo data enabled for table SCOTT.EMP_OGG. 注意：提示table：emp_ogg未建立primary key，建立primary key后重新add GGSCI (ogg) 8> delete trandata scott.emp_ogg Logging of supplemental redo log data disabled for table SCOTT.EMP_OGG. GGSCI (ogg) 9> add trandata scott.emp_ogg Logging of supplemental redo data enabled for table SCOTT.EMP_OGG. GGSCI (ogg) 11> info trandata scott.* Logging of supplemental redo log data is enabled for table SCOTT.EMP_OGG. Columns supplementally logged for table SCOTT.EMP_OGG: EMPNO. GGSCI (ogg) 13> edit params mgr port 7809 dynamicportlist 7800-8000 autorestart extract *,waitminutes 2,resetminutes 5 编辑mgr参数文件，并写入以上信息！ GGSCI (ogg) 14> start mgr Manager started. GGSCI (ogg) 16> info all Program Status Group Lag at Chkpt Time Since Chkpt MANAGER RUNNING
配置Extract： 添加extract服务，并启动extract服务： GGSCI (ogg) 11> add extract eini_1,sourceistable EXTRACT added. GGSCI (ogg) 14> info extract *,tasks EXTRACT EINI_1 Initialized 2014-09-10 14:28 Status STOPPED Checkpoint Lag Not Available Log Read Checkpoint Not Available First Record Record 0 Task SOURCEISTABLE 编辑extract参数文件 GGSCI (ogg) 18>EDIT PARAMS EINI_1 EXTRACT EINI_1 SETENV (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK) USERID ogg, PASSWORD ogg RMTHOST 192.168.8.249,MGRPORT 7809 RMTTASK REPLICAT, GROUP RINI_1 TABLE scott.EMP_OGG; GGSCI (ogg) 15> start eini_1 Sending START request to MANAGER ... EXTRACT EINI_1 starting GGSCI (ogg) 16> info eini_1 EXTRACT EINI_1 Initialized 2014-09-10 14:28 Status RUNNING Checkpoint Lag Not Available Log Read Checkpoint Not Available First Record Record 0 Task SOURCEISTABLE GGSCI (ogg) 17> view report eini_1 2014-09-10 14:30:34 INFO OGG-01017 Wildcard resolution set to IMMEDIATE because SOURCEISTABLE is used. *********************************************************************** Oracle GoldenGate Capture for Oracle Version 11.2.1.0.1 OGGCORE_11.2.1.0.1_PLATFORMS_120423.0230_FBO Linux, x86, 32bit (optimized), Oracle 11g on Apr 23 2012 08:20:38 Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved. Starting at 2014-09-10 14:30:34 *********************************************************************** Operating System Version: Linux Version #1 SMP Wed Sep 1 01:26:34 EDT 2010, Release 2.6.32-71.el6.i686 Node: ogg Machine: i686 soft limit hard limit Address Space Size : unlimited unlimited Heap Size : unlimited unlimited File Size : unlimited unlimited CPU Time : unlimited unlimited Process id: 6159 Description: *********************************************************************** ** Running with the following parameters ** *********************************************************************** 2014-09-10 14:30:34 INFO OGG-03035 Operating system character set identified as UTF-8. Locale: en_US, LC_ALL:. EXTRACT EINI_1 SETENV (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK) Set environment variable (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK) USERID ogg,PASSWORD *** RMTHOST 192.168.8.249,MGRPORT 7809 RMTTASK REPLICAT,GROUP RINI_1 TABLE scott.EMP_OGG; Using the following key columns for source table SCOTT.EMP_OGG: EMPNO. 2014-09-10 14:30:36 INFO OGG-01815 Virtual Memory Facilities for: COM anon alloc: mmap(MAP_ANON) anon free: munmap file alloc: mmap(MAP_SHARED) file free: munmap target directories: /u01/ogg/dirtmp. CACHEMGR virtual memory values (may have been adjusted) CACHESIZE: 2G CACHEPAGEOUTSIZE (normal): 4M PROCESS VM AVAIL FROM OS (min): 2.75G CACHESIZEMAX (strict force to disk): 2.47G Database Version: Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production PL/SQL Release 11.2.0.1.0 - Production CORE 11.2.0.1.0 Production TNS for Linux: Version 11.2.0.1.0 - Production NLSRTL Version 11.2.0.1.0 - Production Database Language and Character Set: NLS_LANG = "AMERICAN_AMERICA.ZHS16GBK" NLS_LANGUAGE = "AMERICAN" NLS_TERRITORY = "AMERICA" NLS_CHARACTERSET = "ZHS16GBK" 2014-09-10 14:30:36 WARNING OGG-01223 TCP/IP error 111 (Connection refus Source Context : SourceModule : [er.idlx] SourceID : [/net/ap1109nap-vlan900/vol/ifarm_ports/ifarm_views/aime_oggcore_210874/oggcore/OpenSys/src/app/er/idlx.c] SourceFunction : [idlx_tcp_error] SourceLine : [1414] ThreadBacktrace : [10] elements : [/u01/ogg/libgglog.so(CMessageContext::AddThreadContext()+0x26) [0x1f9166]] : [/u01/ogg/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigned int, ...)+0x2c5) [0x1f5125]] : [/u01/ogg/libgglog.so(_MSG_ERR_TCP_GENERIC(CSourceContext*, char const*, CMessageFactory::MessageDisposition)+0x36) [0 x1d755c]] : [/u01/ogg/extract() [0x8148d0c]] : [/u01/ogg/extract(IDLX_tcp_send_data+0xf4) [0x8149ae0]] : [/u01/ogg/extract(IDLX_send_session_begin_cmd+0xa6) [0x8149e12]] : [/u01/ogg/extract(process_source_files()+0x584) [0x819662e]] : [/u01/ogg/extract(main+0x5fc) [0x819820c]] : [/lib/libc.so.6(__libc_start_main+0xe6) [0x8aecc6]] : [/u01/ogg/extract(__gxx_personality_v0+0x3ad) [0x81144e1]] 2014-09-10 14:32:35 ERROR OGG-01224 TCP/IP error 111 (Connection refused); retries exceeded. 2014-09-10 14:32:35 ERROR OGG-01668 PROCESS ABENDING.
注意：出现以上tcp/ip错误，是因为目标端未配置mgr，无法通讯！
源端配置extract进程，用于数据同步： GGSCI (ogg) 25> edit params eora_1 EXTRACT EORA_1 SETENV (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK) USERID ogg,PASSWORD ogg EXTTRAIL ./dirdat/aa TABLE scott.emp_ogg; GGSCI (ogg) 27> add extract eora_1,tranlog,begin now EXTRACT added. GGSCI (ogg) 29> add exttrail ./dirdat/aa,extract eora_1,megabytes 5 EXTTRAIL added. GGSCI (ogg) 30> start extract eora_1 Sending START request to MANAGER ... EXTRACT EORA_1 starting GGSCI (ogg) 31> info extract eora_1 EXTRACT EORA_1 Initialized 2014-09-10 14:47 Status STOPPED Checkpoint Lag 00:00:00 (updated 00:02:06 ago) Log Read Checkpoint Oracle Redo Logs 2014-09-10 14:47:22 Seqno 0, RBA 0 SCN 0.0 (0) 在源端配置pump进程，用于数据同步： GGSCI (ogg) 41> edit params pora_1 EXTRACT PORA_1 SETENV (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK) PASSTHRU RMTHOST 192.168.8.249,MGRPORT 7809 RMTTRAIL ./dirdat/pa TABLE scott.emp_ogg; GGSCI (ogg) 35> add extract pora_1,exttrailsource ./dirdat/pa EXTRACT added. GGSCI (ogg) 36> info extract pora_1 EXTRACT PORA_1 Initialized 2014-09-10 15:01 Status STOPPED Checkpoint Lag 00:00:00 (updated 00:00:22 ago) Log Read Checkpoint File ./dirdat/pa000000 First Record RBA 0 GGSCI (ogg) 42> start extract pora_1 Sending START request to MANAGER ... EXTRACT PORA_1 starting GGSCI (ogg) 43> info extract pora_1 EXTRACT PORA_1 Initialized 2014-09-10 15:01 Status STOPPED Checkpoint Lag 00:00:00 (updated 00:03:35 ago) Log Read Checkpoint File ./dirdat/pa000000 First Record RBA 0 以上eora_1和pora_1服务都处于stop状态，正常应为running，通过以下方式进行纠正； 解决方法： GGSCI (rh6.cuug.net) 7> delete extract eora_1,tranlog,begin now 2014-09-10 16:16:15 WARNING OGG-01753 Cannot unregister EXTRACT EORA_1 from database because no database login was provided. You can manually unregister this group later with the UNREGISTER EXTRACT command with LOGRETENTION. Issue DBLOGIN first. Deleted EXTRACT EORA_1. GGSCI (rh6.cuug.net) 8> dblogin userid ogg,password ogg Successfully logged into database. GGSCI (rh6.cuug.net) 9> delete extract eora_1,tranlog,begin now ERROR: EXTRACT EORA_1 does not exist. GGSCI (rh6.cuug.net) 10> add extract eora_1,tranlog,begin now EXTRACT added. GGSCI (rh6.cuug.net) 11> add exttrail ./dirdat/aa ,extract eora_1,megabytes 5 EXTTRAIL added. GGSCI (rh6.cuug.net) 12> start extract eora_1 Sending START request to MANAGER ... EXTRACT EORA_1 starting GGSCI (rh6.cuug.net) 13> info extract eora_1 EXTRACT EORA_1 Last Started 2014-09-10 16:17 Status RUNNING Checkpoint Lag 00:00:54 (updated 00:00:07 ago) Log Read Checkpoint Oracle Redo Logs 2014-09-10 16:16:51 Seqno 80, RBA 42201104 SCN 0.0 (0) GGSCI (rh6.cuug.net) 27> edit params pora_1 RMTTRAIL EXTRACT PORA_1 SETENV (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK) PASSTHRU RMTHOST 192.168.8.249,MGRPORT 7809 RMTTRAIL ./dirdat/pa TABLE scott.emp_ogg; ~ GGSCI (rh6.cuug.net) 28> start extract pora_1 Sending START request to MANAGER ... EXTRACT PORA_1 starting GGSCI (rh6.cuug.net) 29> info all Program Status Group Lag at Chkpt Time Since Chkpt MANAGER RUNNING EXTRACT RUNNING EORA_1 00:00:00 00:00:04 EXTRACT RUNNING PORA_1 00:00:00 00:03:18
@至此，Source端，Extract配置基本完毕 ！
时间： 2024-10-11 00:52:58