DBA Hub

📋Steps in this guide1/13

Schema replication using oracle goldengate DBACLASS

In this tutorial, we will explain how to do schema replication in goldengate. Schema replication means, replicating all the tables of a schema.   1. add supplemental for all tables of a schema [ SOURCE ] add trandata <schema_name>.* GGSCI > dblogin userid ggate_user, password ggate_user Successfully logged into database. GGSCI > ADD TRANDATA COMP_USR.* […]

oracle replicationintermediate
by OracleDba
14 views
1

1. add supplemental for all tables of a schema [ SOURCE ]

add trandata <schema_name>.*

Code/Command (click line numbers to comment):

1
2
3
4
5
6
7
8
9
10
11
12
13
14
GGSCI > dblogin userid ggate_user, password ggate_user
Successfully logged into database.

GGSCI > ADD TRANDATA COMP_USR.*

Logging of supplemental redo data enabled for table COMP_USR.TAB1.
TRANDATA for scheduling columns has been added on table 'COMP_USR.TAB1'.
TRANDATA for instantiation CSN has been added on table 'COMP_USR.TAB1'.
Logging of supplemental redo data enabled for table COMP_USR.TAB2.
TRANDATA for scheduling columns has been added on table 'COMP_USR.TAB2'.
TRANDATA for instantiation CSN has been added on table 'COMP_USR.TAB2'.
Logging of supplemental redo data enabled for table COMP_USR.TAB3.
TRANDATA for scheduling columns has been added on table 'COMP_USR.TAB3'.
TRANDATA for instantiation CSN has been added on table 'COMP_USR.TAB3'.
2

2. Prepare extract file [ SOURCE ]

Code/Command (click line numbers to comment):

1
2
3
4
5
6
7
8
9
10
11
12
ggsci> edit params EX_C1
EXTRACT EX_C1
SETENV (ORACLE_SID="SRCDB")
SETENV (ORACLE_HOME="/oracle/app/oracle/product/12.1.0.2/dbhome_1")
userid ggate_user, password ggate_user
FETCHOPTIONS  FETCHPKUPDATECOLS, USESNAPSHOT, USELATESTVERSION
DBOPTIONS ALLOWUNUSEDCOLUMN
CACHEMGR CACHESIZE 500M
DISCARDFILE /ggate_user/DISCARD/CRM_B2B1.dsc, APPEND, MEGABYTES 100
EXTTRAIL /ggate_user/TRAILFILE/S2
WARNLONGTRANS 6H, CHECKINTERVAL 1H
TABLE COMP_USR.*;
3

3. Prepare extract pump parameter file [ SOURCE ]

Code/Command (click line numbers to comment):

1
2
3
4
5
6
7
8
9
ggsci>edit params EX_C1P

EXTRACT EX_C1P
userid ggate_user, password ggate_user
SETENV (ORACLE_HOME="/oracle/app/oracle/product/12.1.0.2/dbhome_1")
RMTHOST 172.41.32.42, MGRPORT 7809
RMTTRAIL /ggate/install/datacapture/T2
DBOPTIONS ALLOWUNUSEDCOLUMN
TABLE COMP_USR.*;
4

4. Add extract process [SOURCE]

Code/Command (click line numbers to comment):

1
2
3
add extract EX_C1,tranlog,begin now 

EXTRACT added.
5

5. Add the extract trail [SOURCE]

Code/Command (click line numbers to comment):

1
2
GGSCI > add exttrail /ggate_user/TRAILFILE/S2,extract EX_C1
EXTTRAIL added.
6

6. Add the extract pump process [SOURCE]

Code/Command (click line numbers to comment):

1
2
GGSCI > add extract EX_C1P, exttrailsource /ggate_user/TRAILFILE/S2
EXTRACT added.
7

7. Add remote trail [SOURCE]

Code/Command (click line numbers to comment):

1
2
GGSCI > add rmttrail /ggate/install/datacapture/T2,extract EX_C1P
RMTTRAIL added.
8

8. Prepare replicat file [ TARGET ]

Here we have to add HANDLECOLLISION parameter to resolve conflicts for the transactions during initial loading. We will remove this parameter once the lag is cleared after initial loading. As per Oracle DOC: > Use the HANDLECOLLISIONS and NOHANDLECOLLISIONS parameters to control whether or not Replicat tries to resolve duplicate-record and missing-record errors when applying SQL on the target. These errors, called collisions, occur during an initial load, when data from source tables is being loaded to target tables while Oracle GoldenGate is replicating transactional changes that are being made to those tables. When Oracle GoldenGate applies the replicated changes after the load is finished, HANDLECOLLISIONS provides Replicat with error-handling logic for these collisions. Use the HANDLECOLLISIONS and NOHANDLECOLLISIONS parameters to control whether or not Replicat tries to resolve duplicate-record and missing-record errors when applying SQL on the target. These errors, called collisions, occur during an initial load, when data from source tables is being loaded to target tables while Oracle GoldenGate is replicating transactional changes that are being made to those tables. When Oracle GoldenGate applies the replicated changes after the load is finished, HANDLECOLLISIONS provides Replicat with error-handling logic for these collisions.

Code/Command (click line numbers to comment):

1
2
3
4
5
6
7
8
9
10
11
ggsci> edit params REP_S1

REPLICAT REP_S1
SETENV (ORACLE_HOME = "/u01/app/oracle/product/12.1.0/db_1")
SETENV (ORACLE_SID = "TRGDB")
USERID ggate_user, PASSWORD ggate_user
DBOPTIONS SUPPRESSTRIGGERS,DEFERREFCONST
ASSUMETARGETDEFS
HANDLECOLLISIONS
DISCARDFILE /ggate/install/datacapture/discardcrm.dsc,append
MAP COMP_USR.*,TARGET COMP_USR.*;
9

9. add the replicat process [ TARGET ]

Code/Command (click line numbers to comment):

1
2
GGSCI > add replicat REP_S1, exttrail /ggate/install/datacapture/T2
REPLICAT added.
10

10.Start the extract and pump process [ SOURCE ]

Code/Command (click line numbers to comment):

1
2
3
4
5
6
7
8
9
10
11
START  EX_C1

START EX_C1P

GGSCI > info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING
EXTRACT     RUNNING     EX_C1        00:00:00      00:00:03
EXTRACT     RUNNING     EX_C1P       00:00:00      00:02:34
11

11. Initial loading:

Now export this schema using expdp in the source database and import in the target database.

Code/Command (click line numbers to comment):

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
--- SOURCE DB 

expdp dumpfile=initload.dmp logfile=initload.log directory=DIRT schemas=COMP_USR

Username: / as sysdba


Connected to: Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
FLASHBACK automatically enabled to preserve database integrity.
Starting "SYS"."SYS_EXPORT_TABLE_02":  /******** AS SYSDBA dumpfile=initload.dmp logfile=initload.log directory=DIRT schemas=COMP_USR
Estimate in progress using BLOCKS method...
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Total estimation using BLOCKS method: 16 MB
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
. . exported "COMP_USR"."TAB1"                            3.473 MB   90323 rows
. . exported "COMP_USR"."TAB2"                           3.473 MB   90323 rows
. . exported "COMP_USR"."TAB3"                            3.473 MB   90323 rows
Master table "SYS"."SYS_EXPORT_TABLE_02" successfully loaded/unloaded
******************************************************************************
Dump file set for SYS.SYS_EXPORT_TABLE_02 is:
  /archive/dump/initload.dmp


-- TRANSFER THE DUMP TO TARGET SERVER:

 scp oracle@**********:/archive/dump/initload.dmp .


-- -IMPORT IN TARGET DATABASE:

impdp dumpfile=initload.dmp logfile=imp_initialload.log directory=FULL_REFRESH

Import: Release 12.1.0.2.0 - Production on Sun Jul 23 12:01:58 2017

Copyright (c) 1982, 2014, Oracle and/or its affiliates.  All rights reserved.

Username: / as sysdba

Connected to: Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, OLAP, Advanced Analytics and Real Application Testing options
Master table "SYS"."SYS_IMPORT_FULL_04" successfully loaded/unloaded
import done in AL32UTF8 character set and AL16UTF16 NCHAR character set
export done in AL32UTF8 character set and UTF8 NCHAR character set
WARNING: possible data loss in character set conversions
Starting "SYS"."SYS_IMPORT_FULL_04":  /******** AS SYSDBA dumpfile=initload.dmp logfile=imp_initialload.log directory=FULL_REFRESH
Processing object type TABLE_EXPORT/TABLE/PROCACT_INSTANCE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
. . imported "COMP_USR"."TAB1"                            3.473 MB   90323 rows
. . imported "COMP_USR"."TAB2"                            3.473 MB   90323 rows
. . imported "COMP_USR"."TAB3"                            3.473 MB   90323 rows
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
12

12. Start the replicat: [ SOURCE ]

Use LAG command to monitor the lag at replicat. As lag is zero now, Remove the handlescollision parameter and restart the replicat.

Code/Command (click line numbers to comment):

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
GGSCI > start REP_S1

Sending START request to MANAGER ...
REPLICAT REP_S1 starting

GGSCI >  lag replicat REP_S1

2017-07-24 15:33:12  INFO    OGG-14054  Lag from heartbeat table requires DBLOGIN.

Sending GETLAG request to REPLICAT REPR1 ...
Last record lag 6 seconds.



GGSCI >  !

2017-07-24 15:33:12  INFO    OGG-14054  Lag from heartbeat table requires DBLOGIN.

Sending GETLAG request to REPLICAT REP_S1 ...
Last record lag 6 seconds.

At EOF, no more records to process. -------- >>>>>>>>> This indicates lag is zero.
13

13. Remove handlecollison parameter and restart replicat[ TARGET ]

goldengate Schema replication has been completed.

Code/Command (click line numbers to comment):

1
2
3
4
5
6
7
8
9
10
11
12
13
REPLICAT REP_S1
SETENV (ORACLE_HOME = "/u01/app/oracle/product/12.1.0/db_1")
SETENV (ORACLE_SID = "TRGDB")
USERID ggate_user, PASSWORD ggate_user
DBOPTIONS SUPPRESSTRIGGERS,DEFERREFCONST
ASSUMETARGETDEFS
--HANDLECOLLISIONS
DISCARDFILE /ggate/install/datacapture/discardcrm.dsc,append
MAP COMP_USR.*,TARGET COMP_USR.*;

ggsci>stop REP_S1

ggsci>start REP_S1

Comments (0)

Please to add comments

No comments yet. Be the first to comment!