Oracle Teradata Installation and Setup Guide GoldenGate software Installation and Setup Guide

Oracle® GoldenGate
GoldenGate for Teradata Installation and Setup Guide
Release 11.2.1 for Windows and Unix
E27295-01
August 2012
Oracle® GoldenGate GoldenGate for Teradata Installation and Setup Guide, Release 11.2.1 for Windows and
Unix
E27295-01
Copyright © 2010, 2011, 2012 Oracle and/or its affiliates. All rights reserved.
This software and related documentation are provided under a license agreement containing restrictions on
use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your
license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify,
license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means.
Reverse engineering, disassembly, or decompilation of this software, unless required by law for
interoperability, is prohibited.
The information contained herein is subject to change without notice and is not warranted to be error-free. If
you find any errors, please report them to us in writing.
If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it
on behalf of the U.S. Government, the following notice is applicable:
U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data
delivered to U.S. Government customers are "commercial computer software" or "commercial technical
data" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental
regulations. As such, the use, duplication, disclosure, modification, and adaptation shall be subject to the
restrictions and license terms set forth in the applicable Government contract, and, to the extent applicable
by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial
Computer Software License (December 2007). Oracle America, Inc., 500 Oracle Parkway, Redwood City, CA
94065.
This software or hardware is developed for general use in a variety of information management
applications. It is not developed or intended for use in any inherently dangerous applications, including
applications that may create a risk of personal injury. If you use this software or hardware in dangerous
applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other
measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages
caused by use of this software or hardware in dangerous applications.
Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of
their respective owners.
Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks
are used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD,
Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced
Micro Devices. UNIX is a registered trademark of The Open Group.
This software or hardware and documentation may provide access to or information on content, products,
and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly
disclaim all warranties of any kind with respect to third-party content, products, and services. Oracle
Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your
access to or use of third-party content, products, or services.
Contents
Preface ................................................................................................................................................................ vii
Audience...................................................................................................................................................... vii
Documentation Accessibility .................................................................................................................... vii
Related Documents .................................................................................................................................... vii
Conventions ............................................................................................................................................... viii
1 System Requirements and Preinstallation Instructions
1.1
1.2
1.3
1.4
1.4.1
1.4.2
1.4.3
1.4.4
1.4.5
1.4.6
1.4.7
1.5
1.5.1
1.5.2
1.6
1.6.1
1.6.2
1.6.3
1.6.4
1.6.5
1.6.6
1.6.7
1.7
1.7.1
1.7.2
Overview of Oracle GoldenGate for Teradata........................................................................
What this documentation provides..........................................................................................
Supported platforms for a replication server .........................................................................
Operating system requirements ...............................................................................................
Memory requirements ........................................................................................................
Disk requirements ...............................................................................................................
Relay Services Gateway (RSG) vprocs.............................................................................
Network ................................................................................................................................
Operating system privileges ..............................................................................................
Console ..................................................................................................................................
Other programs....................................................................................................................
Database requirements...............................................................................................................
Database configuration .......................................................................................................
Database user for Oracle GoldenGate processes.............................................................
Supported Teradata data types.................................................................................................
Limitations of support for numeric data types ...............................................................
Limitations of support for single-byte character data types .........................................
Conditions and limitations of support for multi-byte character data..........................
Limitations of support for binary data types...................................................................
Limitations of support for large object data types..........................................................
Limitations of support for date data types ......................................................................
Limitations of support for IDENTITY data types ...........................................................
Supported objects and operations for Teradata .....................................................................
DML .......................................................................................................................................
DDL........................................................................................................................................
1-1
1-1
1-2
1-2
1-2
1-3
1-3
1-3
1-4
1-4
1-4
1-4
1-4
1-5
1-5
1-7
1-7
1-7
1-7
1-7
1-8
1-8
1-8
1-8
1-8
2 Installing Oracle GoldenGate
2.1
Installation overview.................................................................................................................. 2-1
iii
2.2
2.3
2.4
2.4.1
2.5
2.5.1
2.6
2.6.1
2.6.2
2.6.3
2.6.4
2.7
2.7.1
2.7.2
Downloading Oracle GoldenGate ............................................................................................
Setting library paths for dynamic builds on UNIX................................................................
Preparing to install Oracle GoldenGate within a cluster ......................................................
Deciding where to install Oracle GoldenGate binaries and files in the cluster..........
Installing Oracle GoldenGate on Linux and UNIX................................................................
Installing the Oracle GoldenGate files..............................................................................
Installing Oracle GoldenGate on Windows ............................................................................
Installing Oracle GoldenGate into a Windows Cluster..................................................
Installing the Oracle GoldenGate files..............................................................................
Specifying a custom Manager name .................................................................................
Installing Manager as a Windows service........................................................................
Integrating Oracle GoldenGate into a cluster .........................................................................
General requirements in a cluster .....................................................................................
Adding Oracle GoldenGate as a Windows cluster resource.........................................
2-1
2-2
2-3
2-3
2-4
2-4
2-4
2-5
2-5
2-5
2-6
2-7
2-7
2-8
3 Preparing the System for Oracle GoldenGate
3.1
3.1.1
3.1.2
3.1.2.1
3.1.2.2
3.2
3.3
3.4
3.5
Preparing tables for processing.................................................................................................
Disabling triggers and cascade constraints......................................................................
Assigning row identifiers ...................................................................................................
How Oracle GoldenGate determines the kind of row identifier to use ...............
Using KEYCOLS to specify a custom key.................................................................
Creating a Teradata replication group.....................................................................................
Activating DDL capture by the Teradata TAM......................................................................
Disabling the capture of DDL ...................................................................................................
Configuring the TAM initialization file...................................................................................
3-1
3-1
3-1
3-1
3-2
3-2
3-3
3-4
3-4
4 Configuring Oracle GoldenGate
4.1
4.1.1
4.1.2
4.1.3
4.2
4.2.1
4.2.2
4.2.3
4.3
4.3.1
4.3.2
4.3.3
4.3.4
4.3.5
Configuring Oracle GoldenGate in maximum protection mode.........................................
Recommended maximum protection configuration ......................................................
Configuring Extract in maximum protection mode .......................................................
Configuring Replicat to support maximum protection mode ......................................
Configuring Oracle GoldenGate in maximum performance mode ....................................
Recommended maximum performance configuration..................................................
Configuring Extract in maximum performance mode...................................................
Configuring Replicat to support maximum performance mode..................................
Additional Oracle GoldenGate configuration guidelines.....................................................
Configuring DDL support..................................................................................................
Handling massive update and delete operations ...........................................................
Preventing multiple connections.......................................................................................
Improving Replicat performance over ODBC.................................................................
Performing initial synchronization ...................................................................................
4-1
4-1
4-2
4-4
4-5
4-5
4-5
4-7
4-8
4-8
4-8
4-8
4-8
4-8
5 Configuring DDL Synchronization for a Teradata Database
5.1
5.2
5.3
iv
About this documentation......................................................................................................... 5-1
Overview of DDL synchronization .......................................................................................... 5-1
Limitations of Oracle GoldenGate DDL support ................................................................... 5-2
5.3.1
5.3.2
5.3.3
5.3.4
5.4
5.4.1
5.4.2
5.4.3
5.4.4
5.4.5
5.4.6
5.5
5.5.1
5.5.1.1
5.5.2
5.5.3
5.6
5.7
5.7.1
5.7.2
5.8
5.8.1
5.8.1.1
5.8.1.2
5.8.1.3
5.8.2
5.8.2.1
5.8.2.2
5.8.3
5.9
5.10
5.10.1
5.10.2
5.11
5.12
5.12.1
5.12.2
5.12.3
5.13
DDL statement length ......................................................................................................... 5-2
Supported topologies .......................................................................................................... 5-2
Filtering, mapping, and transformation........................................................................... 5-2
DDL response time .............................................................................................................. 5-2
Configuration guidelines for DDL support ............................................................................ 5-2
Database privileges.............................................................................................................. 5-3
Parallel processing ............................................................................................................... 5-3
DDL and DML in data pumps and VAM-sort Extracts ................................................. 5-3
Object names......................................................................................................................... 5-3
Data definitions.................................................................................................................... 5-4
Initial synchronization ........................................................................................................ 5-4
Understanding DDL scopes ...................................................................................................... 5-4
Mapped scope ...................................................................................................................... 5-4
Mapping ALTER INDEX............................................................................................. 5-6
Unmapped scope ................................................................................................................. 5-6
Other scope ........................................................................................................................... 5-6
Enabling DDL support ............................................................................................................... 5-6
Filtering DDL replication........................................................................................................... 5-7
Combining DDL parameter options .............................................................................. 5-10
DDL EXCLUDE ALL........................................................................................................ 5-11
How Oracle GoldenGate handles derived object names ................................................... 5-11
Mapping derived objects ................................................................................................. 5-11
MAP exists for base object, but not derived object............................................... 5-12
MAP exists for base and derived objects ............................................................... 5-12
MAP exists for derived object, but not base object............................................... 5-12
New tables as derived objects ......................................................................................... 5-13
RENAME .................................................................................................................... 5-13
CREATE TABLE AS SELECT .................................................................................. 5-13
Disabling the mapping of derived objects .................................................................... 5-14
Using DDL string substitution............................................................................................... 5-15
How DDL is evaluated for processing.................................................................................. 5-15
How Extract evaluates DDL............................................................................................ 5-15
How Replicat evaluates DDL.......................................................................................... 5-16
Handling DDL processing errors .......................................................................................... 5-17
Viewing DDL report information.......................................................................................... 5-17
Extract DDL reporting ..................................................................................................... 5-17
Replicat DDL reporting.................................................................................................... 5-18
Statistics in the process reports....................................................................................... 5-18
Tracing DDL processing ......................................................................................................... 5-18
6 Modifying Objects in the Oracle GoldenGate Configuration
6.1
6.2
6.3
6.4
Deleting an Extract group..........................................................................................................
Adding a table to an existing Extract group ...........................................................................
Moving a table to a new Extract group....................................................................................
Modifying columns of a table ...................................................................................................
6-1
6-1
6-2
6-3
v
7 Uninstalling Oracle GoldenGate
7.1
7.2
7.3
Uninstalling Oracle GoldenGate from Linux or UNIX ......................................................... 7-1
Uninstalling Oracle GoldenGate from Windows (non-cluster) ........................................... 7-1
Uninstalling Oracle GoldenGate from Windows Cluster..................................................... 7-2
A Oracle GoldenGate installed components
A.1
A.2
A.3
A.4
vi
Oracle Goldengate Programs And Utilities ...........................................................................
Oracle Goldengate Subdirectories ...........................................................................................
Other Oracle GoldenGate files .................................................................................................
Oracle GoldenGate checkpoint table.......................................................................................
A-1
A-2
A-4
A-8
Preface
This guide helps you get started with installing Oracle GoldenGate in a Teradata
database environment and configuring the Teradata database to support Oracle
GoldenGate capture and delivery.
Audience
This guide is intended for installers, database administrators, and system
administrators who are installing, configuring and running Oracle GoldenGate.
Documentation Accessibility
For information about Oracle's commitment to accessibility, visit the Oracle
Accessibility Program website at
http://www.oracle.com/pls/topic/lookup?ctx=acc&id=docacc.
Access to Oracle Support
Oracle customers have access to electronic support through My Oracle Support. For
information, visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=info or
visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing
impaired.
Related Documents
The complete Oracle GoldenGate documentation set includes the following
components:
HP NonStop Platform
■
Oracle GoldenGate for NonStop Reference Guide
■
Oracle GoldenGate for NonStop Administrator's Guide
Windows, UNIX, and Linux Platforms
■
Oracle GoldenGate Installation and Setup Guides per supported database
■
Oracle GoldenGate Windows and UNIX Administrator’s Guide
■
Oracle GoldenGate Windows and UNIX Reference Guide
■
Oracle GoldenGate Windows and UNIX Troubleshooting and Tuning Guide
■
Oracle GoldenGate Upgrade Guide
vii
Other Oracle GoldenGate Products
■
Oracle GoldenGate Adapter for Flat Files Administrator’s Guide
■
Oracle GoldenGate Adapter for Java Administrator’s Guide
■
Oracle GoldenGate Director Administrator’s Guide
■
Oracle GoldenGate Monitor Administrator’s Guide
■
Oracle GoldenGate Veridata Administrator’s Guide
Conventions
The following text conventions are used in this document:
Convention
Meaning
boldface
Boldface type indicates graphical user interface elements associated
with an action, such as "From the File menu, select Save." Boldface also
is used for terms defined in text or in the glossary.
italic
Italic type indicates placeholder variables for which you supply
particular values, such as in the parameter statement: TABLE table_
name. Italic type also is used for book titles and emphasis.
italic
monospace
MONOSPACE
viii
Monospace type indicates code components such as user exits and
scripts; the names of files and database objects; URL paths; and input
and output text that appears on the screen. Uppercase monospace type
is generally used to represent the names of Oracle GoldenGate
parameters, commands, and user-configurable functions, as well as
SQL commands and keywords.
UPPERCASE
Uppercase in the regular text font indicates the name of a utility unless
the name is intended to be a specific case.
{}
Braces within syntax enclose a set of options that are separated by pipe
symbols, one of which must be selected, for example: {option1 |
option2 | option3}.
[]
Brackets within syntax indicate an optional element. For example in
this syntax, the SAVE clause is optional: CLEANUP REPLICAT group_name
[, SAVE count]. Multiple options within an optional element are
separated by a pipe symbol, for example: [option1 | option2].
1
System Requirements and Preinstallation
Instructions
1
This chapter contains the requirements for the system and database resources that
support Oracle GoldenGate.
1.1 Overview of Oracle GoldenGate for Teradata
Oracle GoldenGate supports the replication of data as follows:
■
■
between a Teradata source database (known as a source server) and a Teradata
target database (known as a subscriber server).
between Teradata databases and other supported database platforms.
In addition, Oracle GoldenGate replicates DDL operations between identical Teradata
source and subscriber servers.
Oracle GoldenGate operates on a replication server, which is separate from the servers
that contain the Teradata databases. There can be one replication server, or there can
be one on the source and another on the target.
Oracle GoldenGate receives transactional changes or table-copy operations from the
Teradata Change Data Capture (CDC) facility and transmits them to the subscriber
over ODBC. Communication between the CDC and Oracle GoldenGate is managed by
the Teradata Access Module (TAM).
Oracle GoldenGate for Teradata supports the filtering, mapping, and transformation
of data unless noted otherwise in this documentation.
1.2 What this documentation provides
This documentation contains information that is specific to the setup of the Oracle
GoldenGate solution within a Teradata environment. It assumes that the reader has a
fundamental knowledge of the Teradata database and the Teradata Replication
Solutions. It also assumes that the following have been configured properly:
■
Relay Services Gateway (RSG)
■
Change Data Capture (CDC)
■
Teradata Access Module (TAM)
■
Replication groups
To configure replication for the Teradata database, see the Teradata Replication Solutions
documentation from Teradata Corporation.
System Requirements and Preinstallation Instructions
1-1
Supported platforms for a replication server
1.3 Supported platforms for a replication server
In a Teradata environment, you install Oracle GoldenGate on a server that is separate
from the one where the Teradata source and target databases are installed. This
machine will be the replication server and must be a platform that is supported by
Oracle GoldenGate for the Teradata database. To find out which Oracle GoldenGate
builds are available for a specific combination of database version and operating
system, log onto http://support.oracle.com and select the Certifications tab.
For assistance, click Tips for Finding Certifications. An e-mail and password are
required to enter this site.
Some notes about choosing a replication server or servers:
■
■
The replication server can exist in the same location as the source or target server,
or it can be remote from one or both. For replication between Teradata systems in
remote locations, install the Oracle GoldenGate Extract process on a replication
server at the source location, and install the Oracle GoldenGate Replicat process
on a different replication server at the target location.
If possible, install Oracle GoldenGate on a multi-node cluster server to minimize
the impact of any Oracle GoldenGate outages that are caused by server failure.
For additional configuration considerations, consult the Teradata Replication Services
Using Oracle GoldenGate documentation from Teradata Corporation before installing
Oracle GoldenGate.
1.4 Operating system requirements
This section outlines the operating system resources that are necessary to support
Oracle GoldenGate. These resources may apply to the database servers, the replication
server(s), or all servers.
1.4.1 Memory requirements
The amount of memory on a replication server that is required for Oracle GoldenGate
depends on the number of concurrent processes that will be running on that system.
At minimum on the source replication server, there is a primary Extract process that
captures source data and a secondary Extract data-pump process that transfers data
across the network. At minimum on the target replication server is at least one
Replicat process that applies the replicated data to the target database. In some cases,
these processes might all operate on the same system, depending on the configuration
that you implement.
It is possible that you will need to use additional, parallel processes to improve
throughput if your environment generates a large volume of transactional data that
must be replicated. Oracle GoldenGate supports up to 5,000 concurrent Extract and
Replicat processes per instance of Oracle GoldenGate. Each Extract and Replicat
process needs approximately 25-55 MB of memory, or more depending on the size of
the transactions and the number of concurrent transactions.
The actual amount of physical memory that is used by any Oracle GoldenGate process
is controlled by the operating system, not the Oracle GoldenGate program. The Oracle
GoldenGate cache manager takes advantage of the memory management functions of
the operating system to ensure that Oracle GoldenGate processes work in a sustained
and efficient manner. For more information about evaluating Oracle GoldenGate
memory requirements, see the CACHEMGR parameter in the Oracle GoldenGate
Windows and UNIX Reference Guide.
1-2 Oracle GoldenGate for Teradata Installation and Setup Guide
Operating system requirements
1.4.2 Disk requirements
The recommended hardware configuration for the Oracle GoldenGate replication
server is:
■
Four 300-GB disks
■
4 dual-core CPUs
■
8 GB of RAM
Assign the following free disk space:
■
■
■
■
50-150 MB, depending on the database and platform. This includes space for the
compressed download file and space for the uncompressed files. You can delete
the download file after the installation is complete.
40 MB for the working directories and binaries for each instance of Oracle
GoldenGate that you are installing on the system. For example, to install two
builds of Oracle GoldenGate into two separate directories, allocate 80 MB of space.
An additional 1 GB of disk space on any system that hosts Oracle GoldenGate
trails, which are files that contain the working data. You may need more or less
than this amount, because the space that is consumed by the trails depends on the
volume of data that will be processed. See the guidelines for sizing trails in in the
Oracle GoldenGate Windows and UNIX Administrator’s Guide.
To install Oracle GoldenGate into a cluster environment, install the Oracle
GoldenGate binaries and files on a shared file system that is available to all cluster
nodes.
1.4.3 Relay Services Gateway (RSG) vprocs
Replication tasks run on RSG vprocs on the source database server for connections
with the replication server. The connection implements the TCP/IP protocol. As of
Teradata V12, each system node can have one RSG.
1.4.4 Network
The following network resources must be available to support Oracle GoldenGate.
■
■
■
■
■
Configure the systems that are involved with Oracle GoldenGate to use TCP/IP
services, including DNS. Oracle GoldenGate supports IPv4 and IPv6 and can
operate in a system that supports one or both of these protocols.
Configure the network with the host names or IP addresses of all systems that will
be hosting Oracle GoldenGate processes and to which Oracle GoldenGate will be
connecting. Host names are easier to use.
Oracle GoldenGate requires some unreserved and unrestricted TCP/IP ports, the
number of which depends on the number and types of processes in your
configuration. See the Oracle GoldenGate Windows and UNIX Administrator's Guide
for details on how to configure the Manager process to handle the required ports.
Keep a record of the ports that you assigned to Oracle GoldenGate. You will
specify them with parameters when configuring the Manager process.
Configure your firewalls to accept connections through the Oracle GoldenGate
ports.
System Requirements and Preinstallation Instructions
1-3
Database requirements
1.4.5 Operating system privileges
The Manager process requires an operating system user that has privileges to control
Oracle GoldenGate processes and to read, write, and purge files and subdirectories in
the Oracle GoldenGate directory. The Extract and Replicat processes require privileges
to access the database.
1.4.6 Console
The operating system and the command console must have the same character sets.
Mismatches occur on Microsoft Windows systems, where the operating system is set
to one character set, but the DOS command prompt uses a different, older DOS
character set. Oracle GoldenGate uses the character set of the operating system to send
information to GGSCI command output; therefore a non-matching console character
set causes characters not to display correctly. You can set the character set of the
console before opening a GGSCI session by using the following DOS command:
chcp OS character set
If the characters do not display correctly after setting the code page, try changing the
console font to Lucida Console, which has an extended character set.
1.4.7 Other programs
The following are additional considerations in support of Oracle GoldenGate.
■
■
Before installing Oracle GoldenGate on a Windows system, install and configure
the Microsoft Visual C ++ 2005 SP1 Redistributable Package. Make certain it is the
SP1 version of this package, and make certain to get the correct bit version for your server.
This package installs runtime components of Visual C++ Libraries. For more
information, and to download this package, go to
http://www.microsoft.com.
Oracle GoldenGate fully supports virtual machine environments created with any
virtualization software on any platform. When installing Oracle GoldenGate into a
virtual machine environment, select a build that matches the database and the
operating system of the virtual machine, not the host system.
1.5 Database requirements
This section contains Oracle GoldenGate requirements that are specific to the Teradata
database.
1.5.1 Database configuration
■
■
■
Install an appropriate ODBC (Open Database Connectivity) driver:
■
12.00.00.01 or greater for the TTU 12.0 family, V12
■
13.00.00.00 or greater for the TTU 13.0 family, V13.1
Configure ODBC on each source and target system, including the creation of a
data source name (DSN). A DSN stores information about how to connect to the
database. See the ODBC Driver for Teradata User Guide for instructions.
Create Teradata replication groups for the source tables. For instructions, see the
Teradata Replication Services Using Oracle GoldenGate documentation.
1-4 Oracle GoldenGate for Teradata Installation and Setup Guide
Supported Teradata data types
1.5.2 Database user for Oracle GoldenGate processes
■
■
■
Create a database user that is dedicated to Oracle GoldenGate. It can be the same
user for all of the Oracle GoldenGate processes that must connect to a database:
■
Extract (source database)
■
Replicat (target database)
■
The DEFGEN utility (source or target database)
To preserve the security of your data, and to monitor Oracle GoldenGate
processing accurately, do not permit other users, applications, or processes to log
on as, or operate as, the Oracle GoldenGate database user.
If using Oracle GoldenGate to capture from a source Teradata database, issue the
following security grants to the Extract database user.
GRANT
GRANT
GRANT
GRANT
GRANT
GRANT
GRANT
GRANT
GRANT
GRANT
■
SELECT ON DBC.REPGROUP TO user;
SELECT ON DBC.TVM TO user;
SELECT ON DBC.DBASE TO user;
SELECT ON DBC.ERRORMSGS TO user;
SELECT ON DBC.TVFIELDS TO user;
SELECT ON DBC.INDEXES TO user;
SELECT ON DBC.INDOUBTRESLOG TO user;
REPLCONTROL TO user;
ALL ON database TO user;
ALL ON SYSUDTLIB TO user WITH GRANT OPTION;
If using Oracle GoldenGate to replicate to a target Teradata database, grant
SELECT, INSERT, UPDATE, and DELETE on all of the target tables to the Replicat
database user.
1.6 Supported Teradata data types
The following table shows the Teradata data types that Oracle GoldenGate supports.
Any limitations or conditions that apply follow this table.
Table 1–1
Supported Data Types by Oracle Goldengate, Per Teradata Version
Data type
v12
v13
v13.1
BLOB
No
Yes
Yes
BYTEINT
Yes
Yes
Yes
VARBYTE
Yes
Yes
Yes
BIGINT
Yes
Yes
Yes
BYTEINT
Yes
Yes
Yes
DATE
Yes
Yes
Yes
DECIMAL - 18 and
under
Yes
Yes
Yes
DECIMAL - 19 to 38 No
Yes
Yes
DOUBLE PRECISION
Yes
Yes
Yes
FLOAT
Yes
Yes
Yes
INTEGER
Yes
Yes
Yes
NUMERIC - 18 and
under
Yes
Yes
Yes
System Requirements and Preinstallation Instructions
1-5
Supported Teradata data types
Table 1–1 (Cont.) Supported Data Types by Oracle Goldengate, Per Teradata Version
Data type
v12
v13
v13.1
NUMERIC - 19 to 38 No
Yes
Yes
REAL
Yes
Yes
Yes
SMALLIINT
Yes
Yes
Yes
TIME
Yes
Yes
Yes
TIMESTAMP
Yes
Yes
Yes
INTERVAL
Yes
Yes
Yes
INTERVAL DAY
Yes
Yes
Yes
INTERVAL DAY TO
HOUR
Yes
Yes
Yes
INTERVAL DAY TO
MINUTE
Yes
Yes
Yes
INTERVAL DAY TO
SECOND
Yes
Yes
Yes
INTERVAL HOUR
Yes
Yes
Yes
INTERVAL HOUR TO
MINUTE
Yes
Yes
Yes
INTERVAL HOUR TO
SECOND
Yes
Yes
Yes
INTERVAL MINUTE
Yes
Yes
Yes
INTERVAL MINUTE TO
SECOND
Yes
Yes
Yes
INTERVAL MONTH
Yes
Yes
Yes
INTERVAL SECOND
Yes
Yes
Yes
INTERVAL YEAR
Yes
Yes
Yes
INTERVAL YEAR TO
MONTH
Yes
Yes
Yes
CHAR
Yes
Yes
Yes
CLOB
No
Yes
Yes
CHAR VARYING
Yes
Yes
Yes
LONG VARCHAR
Yes
Yes
Yes
VARCHAR
Yes
Yes
Yes
GRAPHIC
Yes
Yes
Yes
LONG VARGRAPHIC
Yes
Yes
Yes
VARGRAPHIC
Yes
Yes
Yes
PERIOD (DATE)
No
Yes
Yes
PERIOD (TIME)
No
Yes
Yes
PERIOD (TIMESTAMP) No
Yes
Yes
No
Yes
Yes
UDT
1-6 Oracle GoldenGate for Teradata Installation and Setup Guide
Supported Teradata data types
1.6.1 Limitations of support for numeric data types
Numeric data types are fully supported between Teradata source and target
databases. When replicating these data types from a different type of database to
Teradata, truncation can occur if the source database supports a higher precision that
Teradata does.
The support of range and precision for floating-point numbers depends on the host
machine. In general, the precision is accurate to 16 significant digits, but you should
review the database documentation to determine the expected approximations. Oracle
GoldenGate rounds or truncates values that exceed the supported precision.
1.6.2 Limitations of support for single-byte character data types
Single-byte character types are fully supported within a single-byte Latin character set
between a Teradata source and Teradata targets, and between other databases and
Teradata. A VARCHAR or CHAR column cannot have more than 32k-1 bytes. If using
UTF-16, this is 16k-2 characters.
1.6.3 Conditions and limitations of support for multi-byte character data
■
Install Oracle GoldenGate on a Windows or Linux replication server.
■
Use the Teradata ODBC driver version 12.0.0.x or later.
■
Do not use filtering, mapping, and transformation for multi-byte data types.
■
■
■
■
■
Source Teradata tables can contain only CHAR, VARCHAR, INTEGER, SMALLINT,
DATE, TIME, and TIMESTAMP columns. No other data types can be replicated
while multi-byte data is being replicated.
A CHAR or VARCHAR column cannot contain more than 32k-1 bytes. If using
UTF-16, these columns cannot contain more than 16k-2 characters.
Set the ODBC driver and the Teradata Access Module (TAM) to the UTF-16
character set in the initialization file (see ).
When creating Replicat groups, use the NODBCHECKPOINT option with the ADD
REPLICAT command. The Replicat database checkpointing feature does not
support an ODBC driver that is set to the UTF-16 character set. Checkpoints will
be maintained in the checkpoint file on disk.
To support Unicode on Linux, Oracle GoldenGate must be configured in
pass-through mode, and the ODBC Teradata Linux driver must be version 12.0.0.7
or higher, or 13.0.0.5 or higher. For more information about pass-through mode,
see the PASSTHRU parameter in the Oracle GoldenGate Windows and UNIX
Reference Guide .
1.6.4 Limitations of support for binary data types
No limitations. These data types are supported between a Teradata source and
Teradata targets, and between other source databases and Teradata targets.
1.6.5 Limitations of support for large object data types
■
To replicate UDTs, the target database must be Teradata Database 12.00.00.01 or
greater or later.
System Requirements and Preinstallation Instructions
1-7
Supported objects and operations for Teradata
■
■
To replicate large objects from other databases to Teradata, use Teradata ODBC
driver version 12.0 or higher on the target system. The target must support large
objects that are delivered by ODBC.
Enable the UseNativeLOBSupport flag in the ODBC configuration file. See the
Teradata ODBC documentation.
1.6.6 Limitations of support for date data types
■
■
■
■
Date types are fully supported between Teradata source and Teradata target
databases. Additionally, INTERVAL is supported between Teradata and Oracle if
the size of the target column is equal to, or greater than, that of the source.
DATE, TIME, and TIMESTAMP are fully supported when replicated from a different
type of source database to Teradata.
TIME with TIMESZONE, TIMESTAMP with TIMEZONE, and INTERVAL are not
supported from a different type of source database to Teradata.
Oracle GoldenGate does not support negative dates.
1.6.7 Limitations of support for IDENTITY data types
IDENTITY must be configured as GENERATED BY DEFAULT AS IDENTITY on the
target to enable the correct value to be inserted by Replicat. To include IDENTITY in a
bi-directional replication configuration, the ranges of the values defined on the source
and target systems must be disjoint, for example odd on one and even on the other.
1.7 Supported objects and operations for Teradata
This section lists the data operations and database objects that Oracle GoldenGate
supports.
1.7.1 DML
■
Oracle GoldenGate supports the maximum number of columns per table that is
supported by the database.
1.7.2 DDL
A Teradata DDL statement can be replicated when it satisfies one of the following
conditions:
■
The DDL statement affects a table that is a member of a replication group.
■
The DDL statement matches a user-defined replication rule.
■
The DDL statement changes certain properties of a replication group.
Oracle GoldenGate supports the extraction and replication of the following Teradata
DDL operations, up to 2 MB in statement length. At least TAM 13.0 is required, and
both source and target databases must be Teradata Database 13.0 or later.
1-8 Oracle GoldenGate for Teradata Installation and Setup Guide
Supported objects and operations for Teradata
Table 1–2
Supported Teradata DDL
Operations
Object
CREATE
TABLE table name1
GLOBAL TEMPORARY TABLE table name2
[RECURSIVE] VIEW view name
MACRO macro name
HASH INDEX index name
JOIN INDEX index name
TRIGGER trigger name
ALTER
TABLE
DROP
TABLE table name
VIEW view name
MACRO macro name
HASH INDEX index name
JOIN INDEX index name
TRIGGER trigger name
RENAME
TABLE table name TO
VIEW view name TO
MACRO macro name
TRIGGER trigger name
GRANT ... ON
TABLE table name
REVOKE ... ON
VIEW view name
MACRO macro name
REPLACE
[RECURSIVE] VIEW view name
TRIGGER trigger name
MACRO macro name
COMMENT ON
3
TABLE table name
COLUMN table name.column name
VIEW view name
COLUMN view name.column name
MACRO macro name
TRIGGER trigger name
COLLECT STATISTICS
ON4
table name
DROP STATISTICS ON
1
2
3
4
DDL operations on tables that are members of a replication group are automatically captured.
DDL statements that refer to the temporary materialized state of the table cannot be replicated.
Only COMMENT statements that create a user-defined description of an object in the data dictionary are
captured.
Only the optimizer form that is used by the Optimizer for generating table access and join plans is
captured.
System Requirements and Preinstallation Instructions
1-9
Supported objects and operations for Teradata
The actual size limit of the DDL support is approximate,
because the size will not only include the statement text but also
Oracle GoldenGate maintenance overhead that depends on the length
of the object name, the DDL type, and other characteristics of keeping
a DDL record internally.
Note:
The following DDL statements that change the properties of replication groups will be
replicated automatically.
■
ALTER REPLICATION GROUP with ADD and/or DROP clauses
■
CREATE REPLICATION RULESET
■
REPLACE REPLICATION RULESET
■
DROP REPLICATION RULESET
An ALTER REPLICATION GROUP statement that is used to
generate a new security token will not be replicated.
Note:
See the Oracle GoldenGate Windows and UNIX Administrator's Guide for additional
support limitations and configuration instructions.
1-10 Oracle GoldenGate for Teradata Installation and Setup Guide
2
Installing Oracle GoldenGate
2
These instructions are for installing Oracle GoldenGate for the first time. To upgrade
Oracle GoldenGate from one version to another, follow the instructions on:
http://www.oracle.com/technology/software/products/goldengate/index.html
Installing Oracle GoldenGate installs all of the components that are required to run
and manage the processing (excluding any components required from other vendors,
such as drivers or libraries) and it installs the Oracle GoldenGate utilities.
The installation process takes a short amount of time.
2.1 Installation overview
To install Oracle GoldenGate, the following steps are required:
■
Section 2.2, "Downloading Oracle GoldenGate"
■
Section 2.3, "Setting library paths for dynamic builds on UNIX"
■
Section 2.4, "Preparing to install Oracle GoldenGate within a cluster"
■
Section 2.5, "Installing Oracle GoldenGate on Linux and UNIX"
■
Section 2.6, "Installing Oracle GoldenGate on Windows"
■
Section 2.7, "Integrating Oracle GoldenGate into a cluster"
2.2 Downloading Oracle GoldenGate
Download the appropriate Oracle GoldenGate build to each system that will be part of
the Oracle GoldenGate configuration.
1.
Navigate to http://edelivery.oracle.com
2.
On the Welcome page:
3.
■
Select your language.
■
Click Continue.
On the Export Validation page:
■
Enter your identification information.
■
Accept the Trial License Agreement (even if you have a permanent license).
■
Accept the Export Restrictions .
■
Click Continue.
Installing Oracle GoldenGate
2-1
Setting library paths for dynamic builds on UNIX
4.
5.
6.
On the Media Pack Search page:
■
Select the Oracle Fusion Middleware Product Pack.
■
Select the platform on which you will be installing the software.
■
Click Go.
In the Results List:
■
Select the Media Pack that you want to download.
■
Click Continue.
On the Download page:
■
Click Download for each component that you want. Follow the automatic
download process to transfer the mediapack.zip file to your system.
Before installing the software, review the release notes for any
new features, new requirements, or bug fixes that affect your current
configuration. Review the readme file for known issues.
Note:
2.3 Setting library paths for dynamic builds on UNIX
Oracle GoldenGate uses shared libraries. When you install Oracle GoldenGate on a
UNIX system, the following must be done before you run GGSCI or any other Oracle
GoldenGate process . If you will be running an Oracle GoldenGate program from
outside the Oracle GoldenGate installation directory on a UNIX system:
■
■
(Optional) Add the Oracle GoldenGate installation directory to the PATH
environment variable.
(Required) Add the Oracle GoldenGate installation directory to the
shared-libraries environment variable.
For example, given an Oracle GoldenGate installation directory of /users/ogg, the
second command in the following example requires these variables to be set:
Table 2–1
Command Requiring Library Variable
Command
Requires GG libraries in environment variable?
$ users/ogg > ./ggsci
No
$ users > ./ogg/ggsci
Yes
To set the variables in Korn shell
PATH=installation_directory:$PATH
export PATH
shared_libraries_variable=absolute_path_of_installation_directory:$shared_
libraries_variable
export shared_libraries_variable
To set the variables in Bourne shell
export PATH=installation_directory:$PATH
export shared_libraries_variable=absolute_path_of_installation_directory:$shared_
libraries_variable
To set the variables in C shell
setenv PATH installation_directory:$PATH
2-2 Oracle GoldenGate for Teradata Installation and Setup Guide
Preparing to install Oracle GoldenGate within a cluster
setenv shared_libraries_variable absolute_path_of_installation_directory:$shared_
libraries_variable
Where: shared libraries variable is one of the variables shown in Table 2–2:
Table 2–2
UNIX/Linux library path variables per platform
1
Platform
Environment variable
IBM AIX
LIBPATH
IBM z/OS
HP-UX
SHLIB_PATH
Sun Solaris
LD_LIBRARY_PATH2
HP Tru64 (OSF/1)
LINUX
1
2
A specific platform may or may not be supported by Oracle GoldenGate for your database.
In 64-bit environments with 32-bit Oracle databases, Oracle GoldenGate requires the LD_LIBRARY_PATH to
include the 32-bit Oracle libraries.
Example
export LD_LIBRARY_PATH=/ggs/10.0:$LD_LIBRARY_PATH
To view the libraries that are required by an Oracle
GoldenGate process, use the ldd goldengate_process shell command
before starting the process. This command also shows an error
message for any that are missing.
Note:
2.4 Preparing to install Oracle GoldenGate within a cluster
This topic covers the installation requirements that apply when Oracle GoldenGate
will be installed in a cluster environment. Oracle GoldenGate can be used with any
cluster-management solution that is Oracle-certified.
2.4.1 Deciding where to install Oracle GoldenGate binaries and files in the cluster
You will need to install at least some Oracle GoldenGate objects on shared storage.
Select cluster-aware shared storage that is independent of, but available to, all nodes of
the cluster. The best practice is the install Oracle GoldenGate entirely on shared
storage. This allows you to start the Oracle GoldenGate processes from any of the
nodes without having to make changes to the parameter files. If the active node fails,
the processes can be started quickly on another node, using the processing checkpoints
that are preserved in the installation directory.
If you decide to install the Oracle GoldenGate binaries and files on each node, rather
than on shared storage, the following must be true:
■
■
The Oracle GoldenGate installation must have the same location path on every
node.
At minimum, install the following directories on the shared storage to support
Oracle GoldenGate recovery requirements. On UNIX or Linux, you can create
symbolic links to them from the installation directory on each node.
■
br
■
dirchk
Installing Oracle GoldenGate
2-3
Installing Oracle GoldenGate on Linux and UNIX
■
dirdat
■
dirtmp
These directories are among those created when you issue CREATE SUBDIRS during
installation.
■
The parameter files in the dirprm directory, if not placed on the shared drive, must
be identical on all nodes. To resolve environment settings that must be different
from one node to the other, you can set environment settings so they are inherited
from the local Manager process or reference a node-specific Oracle GoldenGate
macro file. Because this scenario can be difficult to enforce, the inherent concerns
can be avoided by storing the parameter files on the shared drive.
See also Section 2.7, "Integrating Oracle GoldenGate into a cluster" after you install
Oracle GoldenGate.
2.5 Installing Oracle GoldenGate on Linux and UNIX
Follow these steps to install Oracle GoldenGate for Oracle on a Linux or UNIX system
or in the appropriate location in a cluster. See Section 2.4, "Preparing to install Oracle
GoldenGate within a cluster" for more information.
2.5.1 Installing the Oracle GoldenGate files
1.
Extract the Oracle GoldenGate mediapack.zip file to the system and directory
where you want Oracle GoldenGate to be installed.
2.
Run the command shell.
3.
Change directories to the new Oracle GoldenGate directory.
4.
From the Oracle GoldenGate directory, run the GGSCI program.
GGSCI
5.
In GGSCI, issue the following command to create the Oracle GoldenGate working
directories.
CREATE SUBDIRS
6.
Issue the following command to exit GGSCI.
EXIT
7.
Install the Teradata Access Module (TAM) library into the root Oracle GoldenGate
directory on the replication server. The TAM communicates with an Oracle
GoldenGate API that is known as a Vendor Access Module, or VAM. The VAM
passes transactional data changes to the Extract process. For instructions on
pairing the correct TAM version with your Teradata version, and for configuring
the TAM for use with the Teradata database and Oracle GoldenGate, see the
Teradata Replication Services Using Oracle GoldenGate documentation. In general, the
TAM version should match the database version.
2.6 Installing Oracle GoldenGate on Windows
Follow these steps to install Oracle GoldenGate for Oracle on a Windows system or in
the appropriate location in a cluster. See Section 2.4, "Preparing to install Oracle
GoldenGate within a cluster" for more information.
2-4 Oracle GoldenGate for Teradata Installation and Setup Guide
Installing Oracle GoldenGate on Windows
2.6.1 Installing Oracle GoldenGate into a Windows Cluster
1.
Log into one of the nodes in the cluster.
2.
Choose a drive for the Oracle GoldenGate installation location. This drive must be
a resource within the same cluster group that contains the database instance.
3.
Ensure that this cluster group is owned by the cluster node that you are logging
into.
4.
Install Oracle GoldenGate according to the following instructions.
2.6.2 Installing the Oracle GoldenGate files
1.
Unzip the downloaded file(s) by using WinZip or an equivalent compression
product.
2.
Move the files in binary mode to a folder on the drive where you want to install
Oracle GoldenGate. Do not install Oracle GoldenGate into a folder that contains
spaces in its name, even if the path is in quotes. For example:
C:\"Oracle GoldenGate " is not valid.
C:\Oracle_GoldenGate is valid.
3.
From the Oracle GoldenGate folder, run the GGSCI program.
4.
In GGSCI, issue the following command to create the Oracle GoldenGate working
directories.
CREATE SUBDIRS
5.
Issue the following command to exit GGSCI.
EXIT
6.
Install the Teradata Access Module (TAM) library into the root Oracle GoldenGate
directory on the replication server. The TAM communicates with an Oracle
GoldenGate API that is known as a Vendor Access Module, or VAM. The VAM
passes transactional data changes to the Extract process. For instructions on
pairing the correct TAM version with your Teradata version, and for configuring
the TAM for use with the Teradata database and Oracle GoldenGate, see the
Teradata Replication Services Using Oracle GoldenGate documentation. In general, the
TAM version should match the database version.
2.6.3 Specifying a custom Manager name
You must specify a custom name for the Manager process if either of the following is
true:
■
■
You want to use a name for Manager other than the default of GGSMGR.
There will be multiple Manager processes running as Windows services on this
system. Each Manager on a system must have a unique name. Before proceeding
further, note the names of any local Manager services.
To specify a custom Manager name
1. From the directory that contains the Manager program, run GGSCI.
2.
Issue the following command.
EDIT PARAMS ./GLOBALS
Installing Oracle GoldenGate
2-5
Installing Oracle GoldenGate on Windows
The ./ portion of this command must be used, because the
GLOBALS file must reside at the root of the Oracle GoldenGate
installation file.
Note:
3.
In the file, add the following line, where name is a one-word name for the Manager
service.
MGRSERVNAME name
4.
Save the file. The file is saved automatically with the name GLOBALS, without a file
extension. Do not move this file. It is used during installation of the Windows
service and during data processing.
2.6.4 Installing Manager as a Windows service
By default, Manager is not installed as a service and can be run by a local or domain
account. However, when run this way, Manager will stop when the user logs out.
When you install Manager as a service, you can operate it independently of user
connections, and you can configure it to start manually or at system start-up.
Installing Manager as a service is required on a Windows Cluster, but optional
otherwise.
To install Manager as a Windows service
1. (Recommended) Log on as the system administrator.
2.
Click Start then Run and type cmd in the Run dialog box.
3.
From the directory that contains the Manager program that you are installing as a
service, run the INSTALL utility with the following syntax:
install option [...]
Where: option is one of the following:
Table 2–3
INSTALL utility options
Option
Description
ADDEVENTS
Adds Oracle GoldenGate events to the Windows Event
Manager. By default, Oracle GoldenGate errors are generic. To
produce more specific error content, copy the following files
from the Oracle GoldenGate installation directory to the
SYSTEM32 directory.
category.dll
ggsmsg.dll
ADDSERVICE
Adds Manager as a service with the name that is specified with
the MGRSERVNAME parameter in the GLOBALS file, if one exists, or
by the default of GGSMGR. ADDSERVICE configures the service to
run as the Local System account, the standard for most
Windows applications because the service can be run
independently of user logins and password changes. To run
Manager as a specific account, use the USER and PASSWORD
options.1
The service is installed to start at system boot time (see
AUTOSTART ). To start it after installation, either reboot the system
or start the service manually from the Services applet of the
Control Panel.
2-6 Oracle GoldenGate for Teradata Installation and Setup Guide
Integrating Oracle GoldenGate into a cluster
Table 2–3 (Cont.) INSTALL utility options
Option
Description
AUTOSTART
Sets the service that is created with ADDSERVICE to start at system
boot time. This is the default unless MANUALSTART is used.
MANUALSTART
Sets the service that is created with ADDSERVICE to start manually
through GGSCI, a script, or the Services applet of the Control
Panel. The default is AUTOSTART .
USER name
Specifies a domain user account that executes Manager. For the
name, include the domain name, a backward slash, and the user
name, for example HEADQT\GGSMGR .
By default, the Manager service is installed to use the Local
System account.
PASSWORD password
1
4.
Specifies the password for the user that is specified with USER .
A user account can be changed by selecting the Properties action from the Services applet of the Windows
Control Panel.
(Windows Server 2008) If Windows User Account Control (UAC) is enabled, you
are prompted to allow or deny the program access to the computer. Select Allow
to enable the INSTALL utility to run.
The INSTALL utility installs the Manager service with a local system account
running with administrator privileges. No further UAC prompts will be
encountered when running Manager if installed as a service.
If Manager is not installed as a service, Oracle GoldenGate
users will receive a UAC prompt to confirm the elevation of privileges
for Manager when it is started from the GGSCI command prompt.
Running other Oracle GoldenGate programs also triggers a prompt.
Note:
2.7 Integrating Oracle GoldenGate into a cluster
If you installed Oracle GoldenGate in a cluster, take the following steps to integrate
Oracle GoldenGate within the cluster solution.
2.7.1 General requirements in a cluster
1.
Register the Oracle GoldenGate Manager process (and only Manager) as a
cluster-managed resource as you would any other application. Manager must be
the only Oracle GoldenGate process that the cluster-management software starts
and stops, because it is the parent process that manages all other processes.
2.
If the cluster uses a virtual IP address, you may need to obtain an available fixed
IP address for the Manager process. The VIP must be an available IP address on
the public subnet and cannot be determined through DHCP. In the parameter files
of the Extract data pumps, specify the VIP of the remote Manager as the input
value of the RMTHOST parameter. Other Oracle GoldenGate products that access
Manager also should use the VIP.
3.
Make certain that all nodes in the cluster have synchronized system clocks. The
clocks must be synchronized with the clock on the system where Extract is
executed. Oracle GoldenGate compares the time of the local system to the commit
timestamps to make critical decisions. For information about synchronizing
system clocks, consult www.ntp.org or your systems administrator. See also the
Installing Oracle GoldenGate
2-7
Integrating Oracle GoldenGate into a cluster
IOLATENCY option of the THREADOPTIONS parameter in the Oracle GoldenGate
Windows and UNIX Reference Guide .
4.
When you configure Manager, add the AUTOSTART and AUTORESTART parameters so
that Manager starts the replication processes automatically. You can, when
needed, control Extract, Replicat, and other Oracle GoldenGate processes from
within the Oracle GoldenGate user interfaces.
5.
Mount the shared drive on one node only. This prevents processes from being
started on another node. Use the same mount point on all nodes.
6.
Configure Oracle GoldenGate as directed in this documentation.
2.7.2 Adding Oracle GoldenGate as a Windows cluster resource
When installing Oracle GoldenGate in a Windows cluster, follow these instructions to
establish Oracle GoldenGate as a cluster resource and configure the Manager service
correctly on all nodes.
■
■
■
In the cluster administrator, add the Manager process to the group that contains
the database to which Oracle GoldenGate will connect.
Make sure all nodes on which Oracle GoldenGate will run are selected as possible
owners of the resource.
Make certain the Manager Windows service has the following dependencies
(configurable from the Services control panel):
■
The database resource
■
The disk resource that contains the Oracle GoldenGate directory
■
The disk resource that contains the database transaction log files
■
The disk resource that contains the database transaction log backup files
2-8 Oracle GoldenGate for Teradata Installation and Setup Guide
3
Preparing the System for Oracle GoldenGate
3
This chapter contains guidelines for preparing the database and the system to support
Oracle GoldenGate.
3.1 Preparing tables for processing
The following table attributes must be addressed in an Oracle GoldenGate
environment.
3.1.1 Disabling triggers and cascade constraints
Disable triggers, cascade delete constraints, and cascade update constraints on target
Sybase tables, or alter them to ignore changes made by the Oracle GoldenGate
database user. Oracle GoldenGate replicates DML that results from a trigger or
cascade constraint. If the same trigger or constraint gets activated on the target table, it
becomes redundant because of the replicated version, and the database returns an
error. Consider the following example, where the source tables are emp_src and
salary_src and the target tables are emp_targ and salary_targ.
1.
A delete is issued for emp_src.
2.
It cascades a delete to salary_src.
3.
Oracle GoldenGate sends both deletes to the target.
4.
The parent delete arrives first and is applied to emp_targ.
5.
The parent delete cascades a delete to salary_targ.
6.
The cascaded delete from salary_src is applied to salary_targ.
7.
The row cannot be located because it was already deleted in step 5.
3.1.2 Assigning row identifiers
Oracle GoldenGate requires some form of unique row identifier on the source and
target tables to locate the correct target rows for replicated updates and deletes.
3.1.2.1 How Oracle GoldenGate determines the kind of row identifier to use
Unless a KEYCOLS clause is used in the TABLE or MAP statement, Oracle GoldenGate
selects a row identifier to use in the following order of priority:
1.
Primary key
2.
First unique key alphanumerically that does not contain a timestamp or
non-materialized computed column.
Preparing the System for Oracle GoldenGate
3-1
Creating a Teradata replication group
3.
If none of the preceding key types exist (even though there might be other types of
keys defined on the table) Oracle GoldenGate constructs a pseudo key of all
columns that the database allows to be used in a unique key, excluding those that
are not supported by Oracle GoldenGate in a key or those that are excluded from
the Oracle GoldenGate configuration.
Note: If there are other, non-usable keys on a table or if there are no
keys at all on the table, Oracle GoldenGate logs an appropriate
message to the report file. Constructing a key from all of the columns
impedes the performance of Oracle GoldenGate on the source system.
On the target, this key causes Replicat to use a larger, less efficient
WHERE clause.
3.1.2.2 Using KEYCOLS to specify a custom key
If a table does not have one of the preceding types of row identifiers, or if you prefer
those identifiers not to be used, you can define a substitute key if the table has
columns that always contain unique values. You define this substitute key by
including a KEYCOLS clause within the Extract TABLE parameter and the Replicat MAP
parameter. The specified key will override any existing primary or unique key that
Oracle GoldenGate finds. For more information, see the Oracle GoldenGate Windows
and UNIX Reference Guide.
3.2 Creating a Teradata replication group
To create a replication group, use a CreateGroupStmtFile (Create Group Statement)
file. By using a CreateGroupStmtFile, the correct identifier information for the
replication group is automatically written to the tam.ini file. For more information,
see the Teradata Replication Services Using Oracle GoldenGate documentation.
All objects that have dependencies on one another must be specified in the same
replication group. A transaction must be wholly contained within the same replication
group.
To create a Create Group Statement file
1. Use a text editor to create a text file.
2.
Add the following lines:
■
The Teradata command create replication group
■
The name of the Teradata replication group
■
The table list that is associated with the replication group. A table can only be
associated with one replication group. Only one replication group is allowed
per Oracle GoldenGate Extract group.
3.
Save the file with the suffix .sql in a directory within the Oracle GoldenGate
installation directory, either at the root level or in a sub-directory that you create,
such as dirtam.
4.
Specify the name of this file with the CreateGroupStmtFile parameter in the TAM
initialization file. See Section 3.5, "Configuring the TAM initialization file" for
more information.
Example 3–1 Sample Create Group Statement file
Create Replication Group HRTRG1 (HR.EMPLOYEE, HR.EMP_INFO, HR.EMP_DEPT, HR.EMP_
3-2 Oracle GoldenGate for Teradata Installation and Setup Guide
Activating DDL capture by the Teradata TAM
REVIEWS);
3.3 Activating DDL capture by the Teradata TAM
To specify DDL that you want the Teradata TAM to pass to Oracle GoldenGate, you
create a replication ruleset statement for a replication group. A ruleset statement
creates a set of one or more DDL-capture rules and associates them with the specified
replication group. The rules are applied against the names and types of the target
objects of the DDL statements as those operations are executed, making them
immediately available for replication. DDL operations on tables that are members of a
replication group are automatically captured.
The Teradata RSG must be properly configured. For more
information, see the Teradata Replication Services Using Oracle
GoldenGate documentation.
Note:
To activate DDL capture by the Teradata TAM
1. Log in as a user with REPLCONTROL privilege.
2.
Create the replication ruleset.
[CREATE | REPLACE] REPLICATION RULESET rule set name
[, DEFAULT]
FOR replication group name
AS rule specification [, rule specification]
Where:
■
rule specification is:
object kind LIKE string literal [ESCAPE character literal]
[AND NOT LIKE string literal [ESCAPE character literal] ]
■
object kind is:
TABLE | TEMPORARY TABLE | VIEW | MACRO | TRIGGER | INDEX
Usage requirements
■
A replication group must contain explicitly defined members with a table list, or it
must be an empty group that is associated with a replication ruleset.
■
■
■
If the CREATE form of the statement is used, and a rule set with the same rule set
name already exists for the specified replication group, the CREATE statement fails.
If the REPLACE form of the statement is used, and a rule set with the same rule set
name already exists for the specified replication group, the existing ruleset is
replaced by the new rule set.
If the DEFAULT option is used, all of the rules in the rule set are considered to be
default rules. A default rule is applied if no other rule matches the object.
–
A non-default rule must not match the same object as a non-default rule that is
associated with another replication group.
–
A default rule must not match the same object as a default rule that is
associated with another replication group.
–
The LIKE and NOT LIKE clauses specify pattern strings to match against the
fully-qualified names of the objects of the SQL statements. The pattern strings
Preparing the System for Oracle GoldenGate
3-3
Disabling the capture of DDL
can contain wildcard characters. The pattern and the optional ESCAPE character
are used together in the same way as the LIKE predicate operator.
For more information about creating replication groups and rulesets, see the Teradata
Replication Services Using Oracle GoldenGate documentation.
Example
This example creates a rule set named Sales1 for the replication group named
MyRepGroup to capture any table that is created in the database named SalesDB and
also capture any DDL that affects any view in SalesDB where the view name does not
have the suffix _s.
CREATE REPLICATION GROUP MyRepGroup
CREATE REPLICATION RULESET Sales1 FOR MyRepGroup AS
TABLE LIKE 'SalesDB.%',
VIEW LIKE 'SalesDB.%' AND NOT LIKE '%z_s' ESCAPE 'z'
Note the use of an escape character to override the normal treatment of the underscore
("_") as a wildcard.
To configure Oracle GoldenGate DDL replication, see the Oracle GoldenGate Windows
and UNIX Administrator's Guide.
3.4 Disabling the capture of DDL
This section contains instructions for disabling the capture and replication of Teradata
DDL in either of two cases: Keeping the replication group or deleting the replication
group.
Both cases require REPLCONTROL privilege.
To disable the capture of DDL and keep the replication group
DROP REPLICATION RULESET rule set name FOR replication group name
For example:
DROP REPLICATION RULESET Sales1 FOR MyRepGroup;
To disable the capture of DDL and delete the replication group
DROP REPLICATION GROUP group name [ ( table name [, ... ] )]
For example:
DROP REPLICATION GROUP MyRepGroup
3.5 Configuring the TAM initialization file
The Teradata Access Module (TAM) provides the Extract process with links to the
Teradata environment. To configure the TAM, create an initialization file.
1.
Use a text editor to create a text file.
2.
Add the following required parameters to the file. Optional parameters that are
listed also can be used as needed. See Example 3–2 for an example.
3-4 Oracle GoldenGate for Teradata Installation and Setup Guide
Configuring the TAM initialization file
Table 3–1
Required TAM initialization file parameters
Parameter
Description
Mode={Replication}
Required
Specifies that the replication mode will be change data capture.
To configure Extract for change data capture, see the Oracle
GoldenGate Windows and UNIX Administrator's Guide.
DictOdbcConnString=ODBC
connection string for
metadata
Required
The logon string of a user with access rights to the dictionary
tables.
MgmtOdbcConnString=
Required
ODBC connection string
The logon string of a user with rights to execute management
for management functions functions, such as CREATE REPLICATION GROUP. This logon
requires the REPLCONTROL privilege.
CreateGroupStmtFile=
Required for TAM12 and later
name
The name of the Create Group statement file that contains the
CREATE REPLICATION GROUP statement for a new group. If the
replication group was not created with a Create Group
statement file, omit or comment out this parameter and use the
GroupID and SecurityToken parameters.
GroupID=
ID
Required if SecurityToken is used
The ID of the replication group that is associated with the TAM.
If GroupID is used, SecurityToken must be used.
You can view the ID of any replication group with this
command:
HELP REPLICATION GROUP rep group name;
For example:
help replication group g1;
The ID is a numerical ID in the Identifier column next to the
name of the group.
SecurityToken=
token
Required if replication group was not created with Create Group
Statement
The security token for the replication group that is associated
with the TAM. If a group was created with a Create Group
Statement file and you specify that file with the
CreateGroupStmtFile parameter, the SecurityToken and
GroupID parameters can be omitted because they will be
generated automatically at runtime.
AltControlRSG=
IP or name
Optional
CharacterSet=
{ASCII | UTF16}
Required
ControlRSG=address[:port
]
DataRSG1=address[:port]
[DataRSG2=address[:port]
] [...]
Required
Specifies the IP address or name of a server that can take over as
the control RSG when the primary one fails.
The character set for this replication group. There is more
overhead associated with UTF16, so use it only when required
The RSG node addresses. Can be either a node name or an IP
address and can be appended with an optional port number.
The control RSG should be the highest numbered of the RSGs in
the system.
Preparing the System for Oracle GoldenGate
3-5
Configuring the TAM initialization file
Table 3–1 (Cont.) Required TAM initialization file parameters
Parameter
Description
Encryption=
{None | Control | Data |
All}
Required
RsgTimeoutSec=number of
seconds
Optional
RsgTimeoutMSec=number of
milliseconds
Optional
Tracing= {
Debug |
Performance |
All |
None}
Optional
The types of messages to encrypt. There is little difference in
overhead between encrypting just data messages and encrypting
both data and control messages. Use All to specify encryption or
None to specify no encryption.
The timeout, in seconds, when polling RSG for data. The default
is 1. Valid range is 0-60 seconds.
The timeout, in milliseconds, when polling RSG for data. The
default is 0. Valid range is 0-60000000 milliseconds.
The level of debug tracing.
The default is None.
MaxProtTransCompleteThre Optional, valid for max protection mode
sh=number of
The number of outstanding transactions that can be held after
transactions
which an Oracle GoldenGate checkpoint must be requested. This
is significant when operating in maximum protection mode. If
there are numerous sessions that are applying transactions at a
high rate, this parameter can be set to a higher value, such as 10.
However, if the number of sessions is small, or if the rate of
submission is low, you can set it to a lower value, such as 1-4, to
minimize latency and maximize throughput. The default is 0.
Valid range is 0-24 transactions.
Bidirectional
{TRUE | FALSE}
Optional
Specifies whether or not before images of data are sent to Oracle
GoldenGate. Must be TRUE if the Extract parameter
GETUPDATEBEFORES is used. The default is FALSE, which sends
only the after image of data to reduce the CDC overhead and
communication bandwidth that is used.
3.
Save the file as an ASCII file named tam.ini within the Oracle GoldenGate
installation directory, either at the root level or in a sub-directory that you create,
such as "dirtam."
4.
Specify the name of this file with the VAM parameter in the Extract parameter file.
Example 3–2 EXASample TAM initialization file.
Mode=Replication
DictOdbcConnString=DSN=myDsn;uid=myUser;pwd=myPass
MgmtOdbcConnString=DSN=myDsn;uid=myUser;pwd=myPass
CreateGroupStmtFile=c:\GGS\Teradata\dirtam\hrtrg1.sql
CharacterSet=ASCII
ControlRSG=10.10.10.49:1152
DataRSG1=10.10.10.50:1153
DataRSG2=node3
DataRSG3=node4:1155
Encryption=All
3-6 Oracle GoldenGate for Teradata Installation and Setup Guide
4
Configuring Oracle GoldenGate
4
Oracle GoldenGate works with the Change Data Capture (CDC) component of a
source Teradata database to operate in either maximum protection mode or maximum
performance mode. The mode determines the commit protocol that is used and whether
or not Oracle GoldenGate has an effect on the Teradata applications.
■
Configuring Oracle GoldenGate in maximum protection mode
■
Configuring Oracle GoldenGate in maximum performance mode
4.1 Configuring Oracle GoldenGate in maximum protection mode
Maximum protection mode is the recommended Oracle GoldenGate configuration for
the Teradata database. Maximum protection mode incorporates Oracle GoldenGate
into the production system by using a two-phase commit protocol between CDC on
the source server and a primary Extract process on the replication server (through the
TAM). The two-phase commit requires a source transaction to be committed to Oracle
GoldenGate as well as to the source database, ensuring that no transactions are lost in
transit or duplicated if communication is interrupted or a component fails.
In this mode, a transaction is in doubt (not committed) until the primary Extract
acknowledges that it received all of the data and saved it to an Oracle GoldenGate
VAM trail on disk.
■
■
If CDC receives the acknowledgement within a given timeout period, it releases
the transaction for commit to the application, for commit to the database, and for
propagation by Oracle GoldenGate.
If CDC does not receive the acknowledgement within a given timeout period, it
rolls back the transaction, and the application user receives an error message.
The VAM trail is a series of files that work like a transaction log. It stores incoming
data in the order that it is received, but not necessarily in transaction order. A
secondary Extract process, known as a VAM-sort Extract, sorts the data into transaction
order and either deletes a transaction if a rollback is received (because the two-phase
commit failed) or releases it to a regular trail for further processing.
4.1.1 Recommended maximum protection configuration
Install the Extract and Replicat processes on separate replication servers and use a data
pump with a local trail on the server where the Extract processes are installed. In this
configuration, the primary Extract group captures the data, and then the VAM-sort
Extract persists the sorted data to a regular Oracle GoldenGate trail on the local disk.
A data-pump Extract reads this trail and sends the data across TCP/IP to a trail on the
Replicat replication server, where it is read again by a Replicat process and applied to
Configuring Oracle GoldenGate
4-1
Configuring Oracle GoldenGate in maximum protection mode
the target. If there is a failure of communication between the Extract server and the
Replicat server, only the data pump is affected. The other two Extract processes can
continue to do their work without running out of memory if the outage persists.
Figure 4–1 Recommended maximum protection configuration
4.1.2 Configuring Extract in maximum protection mode
Perform these steps on the source replication server.
1.
Configure the Manager process according to the instructions in the Oracle
GoldenGate Windows and UNIX Administrator's Guide.
2.
In the Manager parameter file, use the PURGEOLDEXTRACTS parameter to control the
purging of files from the local trail.
3.
Run GGSCI.
4.
Create a primary Extract group. For documentation purposes, this group is called
ext.
ADD EXTRACT ext, VAM
5.
Create a local trail that is to be the VAM trail.
ADD EXTTRAIL VAM_trail, EXTRACT ext
Use the EXTRACT argument to link this trail to the primary Extract group. That
Extract group creates this trail as a VAM trail.
6.
Use the EDIT PARAMS command to create a parameter file for the primary Extract
group. Include the parameters shown in Example 4–1 plus any others that apply to
your database environment.
Encryption options exist for encrypting the database
password, the data in the trail, and the data sent across TCP/IP. See
the Oracle GoldenGate Security Guide for more information about
security features.
Note:
Example 4–1 Parameters for the primary Extract group
-- Identify the Extract group:
EXTRACT ext
-- Specify database login information as needed for the database:
[SOURCEDB dsn1,][USERID user[, PASSWORD pw]]
-- Specify the VAM trail:
EXTTRAIL VAM_trail
-- Specify that this Extract creates and writes to a VAM trail:
4-2 Oracle GoldenGate for Teradata Installation and Setup Guide
Configuring Oracle GoldenGate in maximum protection mode
DSOPTIONS CREATETRANLOG
-- Specify library, TAM initialization file, and other parameters:
VAM library, PARAMS ("init file", "...>")
-- Specify tables to be captured:
TABLE owner.table;
7.
Create a VAM-sort Extract group to read the VAM trail. For documentation
purposes, this group is called extsort.
ADD EXTRACT extsort, VAMTRAILSOURCE VAM_trail
8.
Add a local trail to receive the sorted data.
ADD EXTTRAIL local_trail, EXTRACT extsort
Use the EXTRACT argument to link this trail to the VAM-sort Extract group. A data
pump group will read this trail.
9.
Use the EDIT PARAMS command to create a parameter file for the VAM-sort Extract
group. Include the parameters shown in Example 4–2 plus any others that apply to
your database environment.
Example 4–2 Parameters for the VAM-sort Extract group
-- Identify the Extract group:
EXTRACT extsort
-- Specify database login information as needed for the database:
[SOURCEDB dsn1,][USERID user[, PASSWORD pw]]
-- Specify that this Extract reads a VAM trail and sorts the data:
DSOPTIONS SORTTRANLOG
-- Specify the local trail to receive the sorted data:
EXTTRAIL local_trail
-- Specify tables to be captured:
TABLE owner.table;
10. Create a data pump group to read the local trail and send the data to a remote trail
on one of the following:
■
■
The replication server where Replicat is running against a target Teradata
database.
A target server where Replicat is running against another database platform
that is supported by Oracle GoldenGate.
ADD EXTRACT pump, EXTTRAILSOURCE local_trail
For documentation purposes, this group is called pump.
11. Add the remote trail.
ADD RMTTRAIL remote_trail, EXTRACT pump
Use the EXTRACT argument to link the remote trail to the data pump group.
12. Create a parameter file for the data pump. Include the parameters shown in
Example 4–3 plus any others that apply to your database environment.
Example 4–3 Parameters for data pump Extract group
-- Identify the data pump group:
EXTRACT pump
-- Specify database login information as needed for the database:
[SOURCEDB dsn1,][USERID user[, PASSWORD pw]]
Configuring Oracle GoldenGate
4-3
Configuring Oracle GoldenGate in maximum protection mode
-- Specify the name or IP address of the remote system:
RMTHOST target, MGRPORT portnumber
-- Specify the remote trail:
RMTTRAIL remote_trail
-- Allow mapping, filtering, conversion or pass data through as-is:
[PASSTHRU | NOPASSTHRU]
-- Specify tables to be captured:
TABLE owner.table;
To use PASSTHRU mode, the names of the source and target
objects must be identical. No column mapping, filtering, SQLEXEC
functions, transformation, or other functions that require data
manipulation can be specified in the parameter file. You can combine
normal processing with pass-through processing by pairing PASSTHRU
and NOPASSTHRU with different TABLE statements.
Note:
4.1.3 Configuring Replicat to support maximum protection mode
Replicat does not require any special configuration with regard to maximum
protection mode. This section highlights basic Replicat parameters that are required
for most target database types. Additional parameters may be required. See the Oracle
GoldenGate documentation for your target database and also the Oracle GoldenGate
reference documentation.
Perform these steps on the target replication server or target database system.
1.
Configure the Manager process according to the instructions in the Oracle
GoldenGate Windows and UNIX Administrator's Guide.
2.
In the Manager parameter file, use the PURGEOLDEXTRACTS parameter to control the
purging of files from the local trail.
3.
Create a Replicat checkpoint table. There are multiple options for this purpose. For
instructions, see the Oracle GoldenGate Windows and UNIX Administrator's Guide.
4.
Create a Replicat group. For documentation purposes, this group is called rep.
ADD REPLICAT rep, EXTTRAIL remote_trail
Use the EXTTRAIL argument to link the Replicat group to the remote trail that you
specified for the data pump on the source server.
5.
Use the EDIT PARAMS command to create a parameter file for the Replicat group.
Include the parameters shown in Example 4–4 plus any others that apply to your
database environment.
Example 4–4 Parameters for the Replicat group
-- Identify the Replicat group:
REPLICAT rep
-- State whether or not source and target definitions are identical:
SOURCEDEFS {full_pathname | ASSUMETARGETDEFS}
-- Specify database login information as needed for the database:
[TARGETDB dsn2,] [USERID user id[, PASSWORD pw]]
-- Specify error handling rules (See the NOTE following parameter file):
REPERROR (error, response)
-- Specify tables for delivery:
MAP owner.table, TARGET owner.table[, DEF template name];
4-4 Oracle GoldenGate for Teradata Installation and Setup Guide
Configuring Oracle GoldenGate in maximum performance mode
Teradata Multiload does not participate in the full two-phase
commit protocol of maximum protection mode. In a recovery
situation, it is possible that Replicat could attempt to apply some
updates twice. If a multiset table is affected, this could result in
duplicate rows being created. Use the REPERROR parameter in the
Replicat parameter file so that Replicat ignores duplicate rows.
Note:
4.2 Configuring Oracle GoldenGate in maximum performance mode
Maximum performance mode is faster and less intrusive than maximum protection
mode, but it is less fault tolerant. When the source application issues a commit, CDC
begins transmitting the data to the replication server, where it is buffered and sorted
by Extract. When the data is finished being transmitted, CDC sends Extract a commit
and releases the transaction for commit to the application and to the database.
The maximum performance configuration does not persist incoming data to disk, nor
does it have an acknowledgement system between CDC and Extract that prevents data
loss. If communication between the primary Extract and the Teradata source is
interrupted, or if a component fails, the source and target data are no longer
synchronized.
4.2.1 Recommended maximum performance configuration
Install the Extract and Replicat processes on separate replication servers, and use a
data pump with a local trail on the Extract server. In this configuration, the primary
Extract persists transactions to a local Oracle GoldenGate trail. A data pump Extract
reads this trail and sends the data across TCP/IP to a trail on the Replicat server,
where it is read again by Replicat and applied to the target. If there is a failure of
communication between the Extract and Replicat replication servers, only the data
pump is affected. The primary Extract can continue to write incoming data to disk
instead of having to retain it in memory, which otherwise could be depleted in a
longlasting outage.
Figure 4–2 Recommended maximum performance configuration
4.2.2 Configuring Extract in maximum performance mode
Perform these steps on the source replication server.
1.
Configure the Manager process according to the instructions in the Oracle
GoldenGate Windows and UNIX Administrator's Guide.
2.
In the Manager parameter file, use the PURGEOLDEXTRACTS parameter to control the
purging of files from the local trail.
3.
Run GGSCI.
4.
Create a primary Extract group. For documentation purposes, this group is called
ext.
Configuring Oracle GoldenGate
4-5
Configuring Oracle GoldenGate in maximum performance mode
ADD EXTRACT ext, VAM
5.
Add a local trail.
ADD EXTTRAIL local_trail, EXTRACT ext
Use the EXTRACT argument to link this trail to the primary Extract group.
6.
Use the EDIT PARAMS command to create a parameter file for the primary Extract
group. Include the parameters in Example 4–5 plus any others that apply to your
database environment.
Encryption options exist for encrypting the database
password, the data in the trail, and the data sent across TCP/IP. See
the Oracle GoldenGate Windows and UNIX Administrator's Guide for
more information about security features.
Note:
Example 4–5 Parameters for the primary Extract group
EXTRACT ext
-- Identify the Extract group:
-- Specify database login information as needed for the database:
[SOURCEDB dsn1,][USERID user[, PASSWORD pw]]
-- Specify the local trail that this Extract writes to:
EXTTRAIL local_trail
-- Specify that this Extract is in maximum performance mode:
DSOPTIONS COMMITTEDTRANLOG, RESTARTAPPEND
-- Specify library, TAM initialization file, and other parameters:
VAM library, PARAMS ("init file", "...")
-- Specify tables to be captured:
TABLE owner.table;
7.
Create a data pump group to read the local trail and send the data to a remote trail
on one of the following:
■
■
The replication server where Replicat is running against a target Teradata
database.
A target server where Replicat is running against another database platform
that is supported by Oracle GoldenGate.
ADD EXTRACT pump, EXTTRAILSOURCE local_trail
For documentation purposes, this group is called pump.
8.
Add the remote trail.
ADD RMTTRAIL remote_trail, EXTRACT pump
Use the EXTRACT argument to link the remote trail to the data pump group.
9.
Create a parameter file for the data pump. Include the parameters shown in
Example 4–6 plus any others that apply to your database environment.
Example 4–6 Parameters for the Extract data pump
-- Identify the data pump group:
EXTRACT pump
-- Specify database login information as needed for the database:
[SOURCEDB dsn1,][USERID user[, PASSWORD pw]]
-- Specify the name or IP address of the remote system:
4-6 Oracle GoldenGate for Teradata Installation and Setup Guide
Configuring Oracle GoldenGate in maximum performance mode
RMTHOST target, MGRPORT portnumber
-- Specify the remote trail:
RMTTRAIL remote_trail
-- Allow mapping, filtering, conversion or pass data through as-is:
[PASSTHRU | NOPASSTHRU]
-- Specify tables to be captured:
TABLE owner.table
To use PASSTHRU mode, the names of the source and target
objects must be identical. No column mapping, filtering, SQLEXEC
functions, transformation, or other functions that require data
manipulation can be specified in the parameter file. You can combine
normal processing with pass-through processing by pairing PASSTHRU
and NOPASSTHRU with different TABLE statements.
Note:
4.2.3 Configuring Replicat to support maximum performance mode
Replicat does not require any special configuration with regard to maximum
protection mode. This section highlights basic Replicat parameters that are required
for most target database types. Additional parameters may be required. See the Oracle
GoldenGate documentation for your target database and also the Oracle GoldenGate
reference documentation.
Perform these steps on the target replication server or target database system.
1.
Configure the Manager process according to the instructions in the Oracle
GoldenGate Windows and UNIX Administrator's Guide.
2.
In the Manager parameter file, use the PURGEOLDEXTRACTS parameter to control the
purging of files from the local trail.
3.
Create a Replicat checkpoint table. There are multiple options for this purpose. For
instructions, see the Oracle GoldenGate Windows and UNIX Administrator's Guide.
4.
Create a Replicat group. For documentation purposes, this group is called rep.
ADD REPLICAT rep, EXTTRAIL remote_trail
Use the EXTTRAIL argument to link the Replicat group to the remote trail that you
specified for the data pump on the source server.
5.
Use the EDIT PARAMS command to create a parameter file for the Replicat group.
Include the parameters shown in Example 4–7 plus any others that apply to your
database environment.
Example 4–7 Parameters for the Replicat group
-- Identify the Replicat group:
REPLICAT rep
-- State whether or not source and target definitions are identical:
SOURCEDEFS full_pathname | ASSUMETARGETDEFS
-- Specify database login information as needed for the database:
[TARGETDB dsn2,] [USERID user id[, PASSWORD pw]]
-- Specify error handling rules:
REPERROR (error, response)
-- Specify tables for delivery:
MAP owner.table, TARGET owner.table[, DEF template name];
;
Configuring Oracle GoldenGate
4-7
Additional Oracle GoldenGate configuration guidelines
4.3 Additional Oracle GoldenGate configuration guidelines
The following are additional considerations to make once you have installed and
configured your Oracle GoldenGate environment.
4.3.1 Configuring DDL support
Oracle GoldenGate supports the replication of Teradata DDL. For more information,
see "Configuring DDL Synchronization for a Teradata Database" on page 5-1.
4.3.2 Handling massive update and delete operations
Operations that update or delete a large number of rows will generate discrete
updates and deletes for each row on the subscriber database. This could cause a lock
manager overflow on the Teradata subscriber system, and thus terminate the Replicat
process.
To avoid these errors, you can do either of the following:
■
Temporarily suspend replication for these operations and then perform them
manually on the source and target systems. To suspend replication, use the
following command, which suspends replication for that session only. The
operations of other sessions on that table are replicated normally.
set session override replication on;
commit;
■
Set the Replicat parameter MAXTRANSOPS to a value of less than 1000. This
parameter splits large transactions into smaller ones.
4.3.3 Preventing multiple connections
By default, the Extract and Replicat processes create a new connection for catalog
queries. You can prevent this extra connection by using the DBOPTIONS parameter with
the NOCATALOGCONNECT option.
4.3.4 Improving Replicat performance over ODBC
To improve the throughput of the Replicat process, consider using multiple trails and
parallel Replicat processes. Because each Replicat uses a single ODBC session,
multiple sessions might be necessary to achieve reasonably high delivery rates. For
configuration instructions, see the Oracle GoldenGate Windows and UNIX
Administrator’s Guide.
4.3.5 Performing initial synchronization
Perform an initial synchronization of the source and target data before using Oracle
GoldenGate to transmit transactional changes for the first time. The preferred methods
for synchronizing two Teradata databases is to use any of the Teradata data loader
utilities. The recommended utility is MultiLoad. To configure an initial load, see the
Oracle GoldenGate Windows and UNIX Administrator's Guide.
4-8 Oracle GoldenGate for Teradata Installation and Setup Guide
5
Configuring DDL Synchronization for a
Teradata Database
5
This chapter contains information to help you understand and configure DDL support
in Oracle GoldenGate.
5.1 About this documentation
This documentation contains information that is specific to the setup of the Oracle
GoldenGate solution within a Teradata environment. It assumes that the reader has a
fundamental knowledge of the Teradata database and the Teradata Replication
Solutions. It also assumes that the following have been configured properly:
■
Relay Services Gateway (RSG)
■
Change Data Capture (CDC)
■
Teradata Access Module (TAM)
■
Replication groups
For a complete description of how to configure replication for the Teradata database,
see the Teradata Replication Solutions documentation.
5.2 Overview of DDL synchronization
Oracle GoldenGate supports the synchronization of DDL operations from one
database to another. DDL synchronization can be active when:
■
■
business applications are actively accessing and updating the source and target
objects.
Oracle GoldenGate transactional data synchronization is active.
The components that support the replication of DDL and the replication of
transactional data changes (DML) are independent of each other. Therefore, you can
synchronize:
■
just DDL changes
■
just DML changes
■
both DDL and DML
Configuring DDL Synchronization for a Teradata Database 5-1
Limitations of Oracle GoldenGate DDL support
5.3 Limitations of Oracle GoldenGate DDL support
This topic contains some limitations of the DDL feature. For any additional limitations
that were found after this documentation was published, see the Oracle GoldenGate
release notes or the readme file that comes with the software.
5.3.1 DDL statement length
Oracle GoldenGate measures the length of a DDL statement in bytes, not in characters.
The supported length is approximately 2 MB, allowing for some internal overhead that
can vary in size depending on the name of the affected object and its DDL type, among
other characteristics. If the DDL is longer than the supported size, Extract will issue a
warning and ignore the DDL operation.
5.3.2 Supported topologies
Oracle GoldenGate supports DDL synchronization only in a like-to-like configuration.
The source and target object definitions must be identical.
Oracle GoldenGate does not support DDL on a standby database.
Oracle GoldenGate supports DDL replication in all supported uni-directional
configurations, and in bi-directional configurations between two, and only two,
systems.
5.3.3 Filtering, mapping, and transformation
DDL operations cannot be transformed by any Oracle GoldenGate process. However,
source DDL can be mapped and filtered to a different target object by a primary
Extract or a Replicat process. Mapping or filtering of DDL by a data-pump Extract or a
VAM-sort Extract is not permitted, and the DDL is passed as it was received from the
primary Extract. This is known as PASSTHRU mode.
For example, ALTER TABLE TableA is processed by a data pump or a VAM-sort Extract
as ALTER TABLE TableA. It cannot be mapped by that process as ALTER TABLE TableB,
regardless of any TABLE statements that specify otherwise.
5.3.4 DDL response time
The response time for DDL statements that are captured for replication might increase
because of the inherent latency of the synchronization protocol between the Teradata
database and the replication system, including the Oracle GoldenGate component. The
response time overhead should not exceed one second under most conditions. The
response time of DDL that is not captured should not be significantly affected. The
performance cost of capturing changed data in tables with UDTs or LOBs, compared
to tables without those data types, should be comparable to other methods of
exporting data.
5.4 Configuration guidelines for DDL support
The following are guidelines to take into account when configuring Oracle
GoldenGate processes to support DDL replication.
5-2 Oracle GoldenGate for Teradata Installation and Setup Guide
Configuration guidelines for DDL support
5.4.1 Database privileges
See "Database user for Oracle GoldenGate processes" on page 1-5 for database
privileges that are required for Oracle GoldenGate to support DDL capture and
replication.
5.4.2 Parallel processing
If using parallel Extract and/or Replicat processes, keep related DDL and DML
together in the same process stream to ensure data integrity. Configure the processes
so that:
■
■
all DDL and DML for any given object are processed by the same Extract group
and by the same Replicat group.
all objects that are relational to one another are processed by the same process
group.
For example, if ReplicatA processes DML for Table1, then it should also process the
DDL for Table1. If Table2 has a foreign key to Table1, then its DML and DDL
operations also should be processed by ReplicatA.
If an Extract group writes to multiple trails that are read by different Replicat groups,
Extract sends all of the DDL to all of the trails. Use each Replicat group to filter the
DDL by using the filter options of the DDL parameter in the Replicat parameter file.
5.4.3 DDL and DML in data pumps and VAM-sort Extracts
If using a data pump or a VAM-sort Extract, configure DML for PASSTHRU mode if the
objects are using DDL support. DDL is passed through a data pump or a VAM-sort
Extract in PASSTHRU mode, so the same must be true of the DML. Any filtering,
mapping, or transformation of the DML must be done by the primary Extract or by
Replicat. However, tables that do not use DDL support can be configured in
NOPASSTHRU mode to allow data filtering, and manipulation by a data pump.
To configure tables for PASSTHRU, NOPASSTHRU, or both
1. In the parameter file of the data pump or VAM-sort Extract, place the PASSTHRU
parameter before all of the TABLE statements that contain tables that use DDL
support.
2.
In the same parameter file, you can place the NOPASSTHRU parameter before any
TABLE statements that contain tables that do not use DDL support, if you want
data filtering, mapping, or transformation to be performed for them.
3.
Do not use any of the DDL configuration parameters for a data pump or
VAM-sort Extract: DDL, DDLOPTIONS, DDLSUBST, DDLERROR, or any of the Oracle
GoldenGate tracing parameters with DDL options.
For more information about PASSTHRU and NOPASSTHRU, see the Oracle GoldenGate
Windows and UNIX Reference Guide.
5.4.4 Object names
Oracle GoldenGate preserves the database-defined object name, case, and character
set. This support preserves single-byte and multibyte names, symbols, and accent
characters at all levels of the database hierarchy. For more information about support
for object names, see the Oracle GoldenGate Windows and UNIX Administrator's Guide.
Configuring DDL Synchronization for a Teradata Database 5-3
Understanding DDL scopes
You can use the question mark (?) and asterisk (*) wildcards to specify object names in
configuration parameters that support DDL synchronization. For more information
about support for wildcards, see the Oracle GoldenGate Windows and UNIX
Administrator's Guide. To process wildcards correctly, the WILDCARDRESOLVE parameter
is set to DYNAMIC by default. If WILDCARDRESOLVE is set to anything else, the Oracle
GoldenGate process that is processing DDL operations will abend and write the error
to the process report.
5.4.5 Data definitions
Because DDL support requires a like-to-like configuration, the ASSUMETARGETDEFS
parameter must be used in the Replicat parameter file. Replicat will abend if objects
are configured for DDL support and the SOURCEDEFS parameter is being used. For
more information about ASSUMETARGETDEFS, see the Oracle GoldenGate Windows and
UNIX Reference Guide.
5.4.6 Initial synchronization
To configure DDL replication, start with a target database that is synchronized with
the source database. DDL support is compatible with the Replicat initial load method.
DDL support is also compatible with the Teradata FastLoad initial synchronization
method. See the Teradata documentation for more information about this feature.
Before executing an initial load, disable DDL extraction and replication. DDL
processing is controlled by the DDL parameter in the Extract and Replicat parameter
files.
5.5 Understanding DDL scopes
Database objects are classified into scopes. A scope is a category that defines how DDL
operations on an object are handled by Oracle GoldenGate. The scopes are:
■
MAPPED
■
UNMAPPED
■
OTHER
The use of scopes enables granular control over the filtering of DDL operations, string
substitutions, and error handling.
5.5.1 Mapped scope
Objects that are specified in TABLE and MAP statements are of MAPPED scope. Extraction
and replication instructions in those statements apply to both data (DML) and DDL on
the specified objects, unless override rules are applied. For objects in TABLE and MAP
statements, the DDL operations listed in Table 5–1 are supported.
5-4 Oracle GoldenGate for Teradata Installation and Setup Guide
Understanding DDL scopes
Table 5–1
Objects That Can be Mapped in MAP and TABLE Statements
Operations
Object
CREATE
TABLE (includes AS SELECT)
ALTER
INDEX
DROP
TRIGGER
RENAME
VIEW
COMMENT ON
FUNCTION
PROCEDURE
MACRO
GRANT
TABLE
REVOKE
The following limitations apply to MAPPED scope:
■
TABLE and MAP do not support some special characters that could be used in an
object name. For a list of those characters, see the Oracle GoldenGate Windows
and UNIX Administrator’s Guide. Objects with non-supported special characters are
supported by the scopes of UNMAPPED and OTHER.
■
Support for COMMENT ON applies to COMMENT ON TABLE and COMMENT ON COLUMN.
■
DDL on an index is not supported for HASH and JOIN operations.
For Extract, MAPPED scope marks an object for DDL capture according to the
instructions in the TABLE statement. For Replicat, MAPPED scope marks DDL for
replication and maps it to the object specified by the owner and name in the TARGET
clause of the MAP statement.
Assume the following TABLE and MAP statements:
Extract (source)
Replicat (target)
TABLE fin.expen;
MAP fin.expen, TARGET fin2.expen2;
TABLE hr.tab*;
MAP hr.tab*, TARGET hrBackup.bak_*;
Also assume a source DDL statement of:
ALTER TABLE fin.expen ADD notes varchar2(100);
In this example, because the source table fin.expen is in a MAP statement with a
TARGET clause that maps to a different owner and table name, the target DDL
statement becomes:
ALTER TABLE fin2.expen2 ADD notes varchar2(100);
Likewise, the following source and target DDL statements are possible for the second
set of TABLE and MAP statements in the example:
Source: CREATE TABLE hr.tabPayables ... ;
Target: CREATE TABLE hrBackup.bak_tabPayables ...;
When objects are of MAPPED scope, you can omit their names from the DDL
configuration parameters, unless you want to refine their DDL support further. If you
ever need to change the object names in TABLE and MAP statements, the changes will
apply automatically to the DDL on those objects.
Configuring DDL Synchronization for a Teradata Database 5-5
Enabling DDL support
If you include an object in a TABLE statement, but not in a MAP statement, the DDL for
that object is MAPPED in scope on the source but UNMAPPED in scope on the target.
5.5.1.1 Mapping ALTER INDEX
An ALTER INDEX...RENAME command cannot be mapped to a different target index
name, but it can be mapped to a different target owner. Consider following ALTER
INDEX...RENAME:
ALTER INDEX src.ind RENAME TO indnew;
This DDL can be mapped with wildcards as:
MAP src.* TARGET tgt.*;
Alternatively, it can be mapped explicitly as the following, making sure to use the
original index name in the source and target specifications:
MAP src.ind TARGET tgt.ind;
In either of the preceding cases, the target DDL will be:
ALTER INDEX tgt.ind RENAME TO indnew;
A MAP statement such as the following is not valid:
MAP src.ind TARGET tgt.indnew;
That statement maps the old name to the new name, and the target DDL becomes:
ALTER INDEX tgt.indnew RENAME TO indnew;
5.5.2 Unmapped scope
If a DDL operation is supported for use in a TABLE or MAP statement, but its base object
name is not included in one of those parameters, it is of UNMAPPED scope.
An object name can be of UNMAPPED scope on the source (that is, it is not contained in
an Extract TABLE statement), but of MAPPED scope on the target (that is, it is contained in
a Replicat MAP statement), or the other way around. When Teradata DDL is of
UNMAPPED scope in the Replicat configuration, it is applied to the target in one of these
ways:
■
■
If the required Replicat connection parameter TARGETDB contains just a DSN (as in
tdtarg ), but not a database name, it is applied to the target object with the same
owner (database name) and object name as in the source DDL.
If a specific database name is used in TARGETDB (as in db@tdtarg ), all of the DDL
operations are applied to the target with the owner from TARGETDB.
5.5.3 Other scope
DDL operations that cannot be mapped are of OTHER scope. When DDL is of OTHER
scope in the Replicat configuration, it is applied to the target with the same owner and
object name as in the source DDL. An example of OTHER scope is a DDL operation that
makes a system-specific reference, such as DDL that operates on data file names.
5.6 Enabling DDL support
By default, the status of DDL replication support is as follows:
5-6 Oracle GoldenGate for Teradata Installation and Setup Guide
Filtering DDL replication
■
■
On the source, Oracle GoldenGate DDL support is disabled by default, although
the Teradata TAM sends all of the DDL to the Oracle GoldenGate VAM. You must
configure Extract to capture DDL by using the DDL parameter.
On the target, DDL support is enabled by default, to maintain the integrity of
transactional data that is replicated. By default, Replicat will process all DDL
operations that the trail contains. If needed, you can use the DDL parameter to
configure Replicat to ignore or filter DDL operations.
5.7 Filtering DDL replication
Use the DDL parameter to filter DDL operations so that specific (or all) DDL is applied
to the target database according to your requirements.
When used without options, the DDL parameter performs no filtering, and it causes all
DDL operations to be propagated as follows:
■
■
As an Extract parameter, it captures all supported DDL operations that are
generated on all supported database objects and sends them to the trail.
As a Replicat parameter, it replicates all DDL operations from the Oracle
GoldenGate trail and applies them to the target. This is the same as the default
behavior without this parameter.
When used with options, the DDL parameter acts as a filtering agent to include or
exclude DDL operations based on:
■
scope
■
object type
■
operation type
■
object name
■
strings in the DDL command syntax or comments, or both
Only one DDL parameter can be used in a parameter file, but you can combine multiple
inclusion and exclusion options to filter the DDL to the required level.
■
■
■
■
DDL filtering options are valid for a primary Extract that captures from the
transaction source, but not for a data-pump Extract.
When combined, multiple filter option specifications are linked logically as AND
statements.
All filter criteria specified with multiple options must be satisfied for a DDL
statement to be replicated.
When using complex filtering criteria, it is recommended that you test your
configuration in a test environment before using it in production.
Note: Before you create a DDL parameter statement, it might help to
review Section 5.10, "How DDL is evaluated for processing".
Example 5–1 Syntax for Filtering DDL replication
DDL [
{INCLUDE | EXCLUDE}
[, MAPPED | UNMAPPED | OTHER | ALL]
[, OPTYPE type]
[, OBJTYPE 'type']
Configuring DDL Synchronization for a Teradata Database 5-7
Filtering DDL replication
[, OBJNAME name]
[, INSTR 'string']
[, EVENTACTIONS (action specification)
]
[...]
Table 5–2
DDL inclusion and exclusion options
Option
Description
INCLUDE | EXCLUDE
Use INCLUDE and EXCLUDE to identify the beginning of an
inclusion or exclusion clause.
■
■
An inclusion clause contains filtering criteria that identifies
the DDL that this parameter will affect.
An exclusion clause contains filtering criteria that excludes
specific DDL from this parameter.
The inclusion or exclusion clause must consist of the INCLUDE or
EXCLUDE keyword followed by any valid combination of other
options of the parameter that is being applied.
If you use EXCLUDE, you must create a corresponding INCLUDE
clause. For example, the following is invalid:
DDL EXCLUDE OBJNAME "hr.*"
However, you can use either of the following:
DDL INCLUDE ALL, EXCLUDE OBJNAME "hr.*"
DDL INCLUDE OBJNAME "fin.*" EXCLUDE "fin.ss"
An EXCLUDE takes priority over any INCLUDEs that contain the
same criteria. You can use multiple inclusion and exclusion
clauses.
MAPPED | UNMAPPED |
OTHER | ALL
Use MAPPED, UNMAPPED, OTHER, and ALL to apply INCLUDE or
EXCLUDE based on the DDL operation scope.
■
■
■
■
OPTYPE type
MAPPED applies INCLUDE or EXCLUDE to DDL operations that
are of MAPPED scope. MAPPED filtering is performed before
filtering that is specified with other DDL parameter options.
UNMAPPED applies INCLUDE or EXCLUDE to DDL operations
that are of UNMAPPED scope.
OTHER applies INCLUDE or EXCLUDE to DDL operations that
are of OTHER scope.
ALL applies INCLUDE or EXCLUDE to DDL operations of all
scopes.
Use OPTYPE to apply INCLUDE or EXCLUDE to a specific type of
DDL operation, such as CREATE, ALTER, and RENAME. For type, use
any DDL command that is valid for the database. For example,
to include ALTER operations, the correct syntax is:
DDL INCLUDE OPTYPE ALTER
OBJTYPE 'type'
Use OBJTYPE to apply INCLUDE or EXCLUDE to a specific type of
database object. For type, use any object type that is valid for the
database, such as TABLE, INDEX, and TRIGGER. Enclose the name
of the object type within single quotes. For example:
DDL INCLUDE OBJTYPE ‘INDEX’
5-8 Oracle GoldenGate for Teradata Installation and Setup Guide
Filtering DDL replication
Table 5–2 (Cont.) DDL inclusion and exclusion options
Option
Description
OBJNAME name
Use OBJNAME to apply INCLUDE or EXCLUDE to the fully qualified
name of an object, for example owner.table_name. You can use a
wildcard only for the object name.
Example:
DDL INCLUDE OBJNAME accounts.*
When using OBJNAME with MAPPED in a Replicat parameter file,
the value for OBJNAME must refer to the name specified with the
TARGET clause of the MAP statement. For example, given the
following MAP statement, the correct value is OBJNAME fin2.*.
MAP fin.exp_*, TARGET fin2.*;
In the following example, a CREATE TABLE statement executes
like this on the source:
CREATE TABLE fin.exp_phone;
And like this on the target:
CREATE TABLE fin2.exp_phone;
If a target owner is not specified in the MAP statement, Replicat
maps it to the database user that is specified with the USERID
parameter.
For DDL that creates derived objects, such as a trigger, the value
for OBJNAME must be the name of the base object, not the name of
the derived object.
For example, to include the following DDL statement, the
correct value is hr.accounts, not hr.insert_trig.
CREATE TRIGGER hr.insert_trig ON hr.accounts;
For RENAME operations, the value for OBJNAME must be the new
table name. For example, to include the following DDL
statement, the correct value is hr.acct.
ALTER TABLE hr.accounts RENAME TO acct;
INSTR 'string'
Use INSTR to apply INCLUDE or EXCLUDE to DDL statements that
contain a specific character string within the command syntax.
For example, the following excludes DDL that creates an index.
DDL INCLUDE ALL EXCLUDE INSTR 'CREATE INDEX'
Enclose the string within single quotes. The string search is not
case sensitive.
INSTR does not support single quotation marks (' ') that are
within the string, nor does it support NULL values.
Configuring DDL Synchronization for a Teradata Database 5-9
Filtering DDL replication
Table 5–2 (Cont.) DDL inclusion and exclusion options
Option
Description
INSTRWORDS 'word list'
Use INSTRWORDS to apply INCLUDE or EXCLUDE to DDL statements
that contain the specified words.
For word list, supply the words in any order, within single
quotes. To include spaces, put the space (and the word, if
applicable) in double quotes. Double quotes also can be used to
enclose sentences.
All specified words must be present in the DDL for INSTRWORDS
to take effect.
Example:
ALTER TABLE INCLUDE INSTRWORDS 'ALTER CONSTRAINT " xyz"
These examples will match:
ALTER TABLE ADD CONSTRAINT xyz CHECK
and
ALTER TABLE DROP CONSTRAINT xyz
INSTRWORDS does not support single quotation marks (' ') that are
within the string, nor does it support NULL values.
EVENTACTIONS (action
specification)
Causes the Extract or Replicat process take a defined action
based on a DDL record in the transaction log or trail, which is
known as the event record. The DDL event is triggered if the DDL
record is eligible to be written to the trail by Extract or a data
pump, or to be executed by Replicat, as determined by the other
filtering options of the DDL parameter. You can use this system to
customize processing based on database events.
For action specification see EVENTACTIONS under the MAP and
TABLE parameters.
Guidelines for using EVENTACTIONS on DDL records:
■
■
CHECKPOINTBEFORE: Since each DDL record is autonomous,
the DDL record is guaranteed to be the start of a
transaction; therefore, the CHECKPOINT BEFORE event action
is implied for a DDL record.
IGNORE: This option is not valid for DDL records. Because
DDL operations are autonomous, ignoring a record is
equivalent to ignoring the entire transaction.
EVENTACTIONS does not support the following DDL objects
because they are derived objects:
■
indexes
■
triggers
■
synonyms
■
RENAME on a table and ALTER TABLE RENAME
5.7.1 Combining DDL parameter options
The following is an example of how to combine DDL parameter options.
Example 5–2 Combining DDL Parameter Options
DDL &
INCLUDE UNMAPPED &
OPTYPE alter &
OBJTYPE 'table' &
OBJNAME users.tab* &
5-10 Oracle GoldenGate for Teradata Installation and Setup Guide
How Oracle GoldenGate handles derived object names
INCLUDE MAPPED OBJNAME * &
EXCLUDE MAPPED OBJNAME temporary.tab
The combined filter criteria in this statement specify the following:
■
■
■
INCLUDE all ALTER TABLE statements for tables that are not mapped with a TABLE or
MAP statement (UNMAPPED scope), but only if those tables are owned by users and
their names start with tab,
and INCLUDE all DDL operation types for all tables that are mapped with a TABLE
or MAP statement (MAPPED scope),
and EXCLUDE all DDL operation types for all tables that are MAPPED in scope, but
only if those tables are owned by temporary and only if their names begin with
tab.
5.7.2 DDL EXCLUDE ALL
DDL EXCLUDE ALL is a special processing option that maintains up-to-date object
metadata for Oracle GoldenGate, while blocking the replication of the DDL operations
themselves. You can use DDL EXCLUDE ALL when using a method other than Oracle
GoldenGate to apply DDL to the target, but you want Oracle GoldenGate to replicate
data changes to the target objects. It provides the current metadata to Oracle
GoldenGate as objects change, thus preventing the need to stop and start the Oracle
GoldenGate processes. The following special conditions apply to DDL EXCLUDE ALL :
■
■
DDL EXCLUDE ALL does not require the use of an INCLUDE clause.
When using DDL EXCLUDE ALL, you may set the WILDCARDRESOLVE parameter to
IMMEDIATE to allow immediate DML resolution if required.
To prevent all DDL metadata and operations from being replicated, omit the DDL
parameter entirely.
5.8 How Oracle GoldenGate handles derived object names
DDL operations can contain a base object name and also a derived object name. A base
object is an object that contains data. A derived object is an object that inherits some
attributes of the base object to perform a function related to that object. DDL
statements that have both base and derived objects are:
■
RENAME
■
CREATE and DROP on an index or trigger
Consider the following DDL statement:
CREATE INDEX hr.indexPayrollDate ON TABLE hr.tabPayroll (payDate);
In this case, the table is the base object. Its name (hr.tabPayroll ) is the base name and
is subject to mapping with TABLE or MAP under the MAPPED scope. The derived object is
the index, and its name (hr.indexPayrollDate ) is the derived name.
5.8.1 Mapping derived objects
You can map a derived name in its own TABLE or MAP statement, separately from that
of the base object. Or, you can use one MAP statement to handle both. In the case of MAP,
the conversion of derived object names to the target works as shown in these sections:
Section 5.8.1.1, "MAP exists for base object, but not derived object"
Configuring DDL Synchronization for a Teradata Database
5-11
How Oracle GoldenGate handles derived object names
Section 5.8.1.2, "MAP exists for base and derived objects"
Section 5.8.1.3, "MAP exists for derived object, but not base object"
5.8.1.1 MAP exists for base object, but not derived object
If there is a MAP statement for the base object, but not for the derived object, the result
is an implicit mapping of the derived object. Assuming the DDL parameter includes
MAPPED, Replicat gives the derived object the same target owner as that of the base
object. The name of the derived object stays the same as in the source statement. For
example, assume the following:
Extract (source)
Replicat (target)
TABLE hr.tab*;
MAP hr.tab*, TARGET hrBackup.*;
Assume the following source DDL statement:
CREATE INDEX hr.indexPayrollDate ON TABLE hr.tabPayroll (payDate);
The CREATE INDEX statement is executed by Replicat on the target as:
CREATE INDEX hrBackup.indexPayrollDate ON TABLE hrBackup.tabPayroll (payDate);
The rule for the implicit mapping is based the typical industry practice of giving
derived objects the same owner as the base object. Also, when indexes are owned by
the same target owner as the base object, an implicit mapping eliminates the need to
map derived object names explicitly.
5.8.1.2 MAP exists for base and derived objects
If there is a MAP statement for the base object and also one for the derived object, the
result is an explicit mapping. Assuming the DDL parameter includes MAPPED, Replicat
converts the owner and name of each object according to its own TARGET clause. For
example, assume the following:
Extract (source)
Replicat (target)
TABLE hr.tab*;
MAP hr.tab*, TARGET hrBackup.*;
TABLE hr.index*;
MAP hr.index*, TARGET hrIndex.*;
Assume the following source DDL statement:
CREATE INDEX hr.indexPayrollDate ON TABLE hr.tabPayroll (payDate);
The CREATE INDEX statement is executed by Replicat on the target as:
CREATE INDEX hrIndex.indexPayrollDate ON TABLE hrBackup.tabPayroll (payDate);
Use an explicit mapping when the index on the target must be owned by a different
owner from that of the base object, or when the name on the target must be different
from that of the source.
5.8.1.3 MAP exists for derived object, but not base object
If there is a MAP statement for the derived object, but not for the base object, Replicat
does not perform any name conversion for either object. The target DDL statement is
the same as that of the source. To map a derived object, the choices are:
■
Use an explicit MAP statement for the base object.
5-12 Oracle GoldenGate for Teradata Installation and Setup Guide
How Oracle GoldenGate handles derived object names
■
■
If names permit, map both base and derived objects in the same MAP statement by
means of a wildcard.
Create a MAP statement for each object, depending on how you want the names
converted.
5.8.2 New tables as derived objects
The following explains how Oracle GoldenGate handles new tables that are created
from:
Section 5.8.2.1, "RENAME"
Section 5.8.2.2, "CREATE TABLE AS SELECT"
5.8.2.1 RENAME
In RENAME operations, the base object is always the new table name. In the following
example, the base object name is considered to be index_paydate.
RENAME hr.indexPayrollDate TO index_paydate;
The derived object name is hr.indexPayrollDate.
5.8.2.2 CREATE TABLE AS SELECT
CREATE TABLE AS SELECT statements include SELECT statements and INSERT
statements that affect any number of underlying objects. On the target, Oracle
GoldenGate obtains the data for the AS SELECT clause from the target database.
The objects in the AS SELECT clause must exist in the target database, and their names
must be identical to the ones on the source.
In a MAP statement, Oracle GoldenGate only maps the name of the new table (CREATE
TABLE name ) to the TARGET specification, but does not map the names of the underlying
objects from the AS SELECT clause. There could be dependencies on those objects that
could cause data inconsistencies if the names were converted to the TARGET
specification.
The following shows an example of a CREATE TABLE AS SELECT statement on the
source and how it would be replicated to the target by Oracle GoldenGate.
CREATE TABLE a.tab1 AS SELECT * FROM a.tab2;
The MAP statement for Replicat is:
MAP a.tab*, TARGET a.x*;
The target DDL statement that Replicat applies is this:
CREATE TABLE a.xtab1 AS SELECT * FROM a.tab2;
The name of the table in the AS SELECT * FROM clause remains as it was on the source:
tab2.
To keep the data in the underlying objects consistent on source and target, you can
configure them for data replication by Oracle GoldenGate. In the preceding example,
you could use the following statements to accommodate this requirement:
Configuring DDL Synchronization for a Teradata Database
5-13
How Oracle GoldenGate handles derived object names
Source
Target
TABLE a.tab*;
MAPEXCLUDE a.tab2
MAP a.tab*, TARGET a.x*;
MAP a.tab2, TARGET a.tab2;
5.8.3 Disabling the mapping of derived objects
Use the DDLOPTIONS parameter with the NOMAPDERIVED option to prevent the
conversion of the name of a derived object according to a TARGET clause of a MAP
statement that includes it. NOMAPDERIVED overrides any explicit MAP statements that
contain the name of the base or derived object. Source DDL that contains derived
objects is replicated to the target with the same owner and object names as on the
source.
Table 5–3 shows the results of MAPDERIVED compared to NOMAPDERIVED, based on
whether there is a MAP statement just for the base object, just for the derived object, or
for both.
Table 5–3
[NO]MAPDERIVED results on target based on mapping configuration
Base Object
Derived Object
DERIVED?
Derived object
converted per a
MAP?
mapped1
mapped
MAPDERIVED
yes
no
mapped
not mapped
MAPDERIVED
no
yes
not mapped
mapped
MAPDERIVED
no
no
not mapped
not mapped
MAPDERIVED
no
no
mapped
mapped
NOMAPDERIVED
no
no
mapped
not mapped
NOMAPDERIVED
no
no
not mapped
mapped
NOMAPDERIVED
no
no
not mapped
not mapped
NOMAPDERIVED
no
no
MAP/NOMAP
1
Derived object gets
owner of base
object?
Mapped means included in a MAP statement.
The following examples illustrate the results of MAPDERIVED as compared to
NOMAPDERIVED.
In the first example, shown in Table 5–4, both trigger and table are owned by rpt on
the target because both base and derived names are converted by means of
MAPDERIVED.
Table 5–4
Default mapping of derived object names (MAPDERIVED)
MAP statement
Source DDL statement captured
by Extract
MAP fin.*, TARGET rpt.*; CREATE TRIGGER fin.act_trig ON
fin.acct;
Target DDL statement applied by Replicat
CREATE TRIGGER rpt.act_trig ON rpt.acct;
In the second example, shown in Table 5–5, the trigger is owned by fin, because
conversion is prevented by means of NOMAPDERIVED.
5-14 Oracle GoldenGate for Teradata Installation and Setup Guide
How DDL is evaluated for processing
Table 5–5
Mapping of derived object names when using NOMAPDERIVED
Source DDL statement captured
by Extract
MAP statement
MAP fin.*, TARGET rpt.*; CREATE TRIGGER fin.act_trig ON
fin.acct;
Target DDL statement applied by Replicat
CREATE TRIGGER fin.act_trig ON rpt.acct;
In the case of a RENAME statement, the new table name is
considered to be the base table name, and the old table name is
considered to be the derived table name.
Note:
5.9 Using DDL string substitution
You can substitute strings within a DDL operation while it is being processed by
Oracle GoldenGate. This feature provides a convenience for changing and mapping
directory names, and other things that are not directly related to data structures. String
substitution is controlled by the DDLSUBST parameter.
For more information, see the Oracle GoldenGate Windows and UNIX Reference Guide.
Before you create a DDLSUBST parameter statement, it might
help to review the following section: "How DDL is evaluated for
processing"
Note:
5.10 How DDL is evaluated for processing
The following explains how Oracle GoldenGate processes DDL statements on the
source and target systems. It shows the order in which different criteria in the Oracle
GoldenGate parameters are processed, and it explains the differences between how
Extract and Replicat each process the DDL.
5.10.1 How Extract evaluates DDL
1.
Extract captures a DDL operation.
2.
Extract searches for the DDL parameter. (This example assumes it exists.)
3.
Extract gets the base object name and, if present, the derived object name.
4.
Extract determines the DDL scope: MAPPED, UNMAPPED or OTHER. It is MAPPED if:
■
the operation and object types are supported for mapping.
and...
■
the base object name and/or derived object name (if RENAME ) is in a TABLE
parameter.
It is UNMAPPED if:
■
the operation and object types are not supported for mapping.
and...
■
the base object name and/or derived object name (if RENAME ) is not in a TABLE
parameter.
Otherwise the operation is identified as OTHER.
Configuring DDL Synchronization for a Teradata Database
5-15
How DDL is evaluated for processing
5.
Extract checks the DDL parameter for INCLUDE and EXCLUDE clauses, and it evaluates
the DDL parameter criteria in those clauses. All options must evaluate to TRUE in
order for the INCLUDE or EXCLUDE to evaluate to TRUE. The following occurs:
■
■
If an EXCLUDE clause evaluates to TRUE, Extract discards the DDL operation and
evaluates another DDL operation. In this case, the processing steps start over.
If an INCLUDE clause evaluates to TRUE, or if the DDL parameter does not have
any INCLUDE or EXCLUDE clauses, Extract includes the DDL operation, and the
processing logic continues.
6.
Extract searches for a DDLSUBST parameter and evaluates the INCLUDE and EXCLUDE
clauses. If the criteria in those clauses add up to TRUE, Extract performs string
substitution. Extract evaluates the DDL operation against each DDLSUBST statement
in the parameter file. For all true DDLSUBST statements, Extract performs string
substitution in the order that the DDLSUBST parameters are listed in the file.
7.
Extract writes the DDL statement to the trail.
5.10.2 How Replicat evaluates DDL
1.
Replicat reads the DDL operation from the trail.
2.
Replicat evaluates the DDL synchronization scope to determine if the DDL
qualifies for name mapping. Anything else is of OTHER scope.
3.
Replicat evaluates the MAP statements in the parameter file. If the source base
object name for this DDL (as read from the trail) appears in any of the MAP
statements, the operation is marked as MAPPED in scope. Otherwise it is marked as
UNMAPPED in scope.
4.
Replicat replaces the source base object name with the base object name that is
specified in the TARGET clause of the MAP statement.
5.
If there is a derived object, Replicat searches for DDLOPTIONS MAPDERIVED. If it is
present, Replicat replaces the source derived name with the target derived name
from the MAP statement.
6.
Replicat checks the DDL parameter for INCLUDE and EXCLUDE clauses, and it
evaluates the DDL parameter criteria contained in them. All options must evaluate
to TRUE in order for the INCLUDE or EXCLUDE to evaluate to TRUE. The following
occurs:
■
■
If any EXCLUDE clause evaluates to TRUE, Replicat discards the DDL operation
and starts evaluating another DDL operation. In this case, the processing steps
start over.
If any INCLUDE clause evaluates to TRUE, or if the DDL parameter does not have
any INCLUDE or EXCLUDE clauses, Replicat includes the DDL operation, and the
processing logic continues.
7.
Replicat searches for the DDLSUBST parameter and evaluates the INCLUDE and
EXCLUDE clauses. If the options in those clauses add up to TRUE, Replicat performs
string substitution. Replicat evaluates the DDL operation against each DDLSUBST
statement in the parameter file. For all true DDLSUBST statements, Replicat
performs string substitution in the order that the DDLSUBST parameters are listed in
the file.
8.
Replicat executes the DDL operation on the target database.
9.
If there are no errors, Replicat processes the next DDL statement. If there are
errors, Replicat performs the following steps.
5-16 Oracle GoldenGate for Teradata Installation and Setup Guide
Viewing DDL report information
10. Replicat analyzes the INCLUDE and EXCLUDE rules in the Replicat DDLERROR
parameter statements in the order that they appear in the parameter file. If
Replicat finds a rule for the error code, it applies the specified error handling;
otherwise, it applies DEFAULT handling.
11. If the error handling does not enable the DDL operation to succeed, Replicat does
one of the following: abends, ignores the operation, or discards it as specified in
the rules.
If there are multiple targets for the same source in a MAP
statement, the processing logic executes for each one.
Note:
5.11 Handling DDL processing errors
Use the DDLERROR parameter to handle errors on objects found by Extract for which
metadata cannot be found, and for Replicat errors that occur when DDL is applied to
the target database. With DDLERROR options, you can handle most errors in a default
manner, for example to stop processing, and also handle other errors in a specific
manner. You can use multiple instances of DDLERROR in the same parameter file to
handle all errors that are anticipated. For options and usage, see the Oracle
GoldenGate Windows and UNIX Reference Guide.
5.12 Viewing DDL report information
By default, Oracle GoldenGate shows basic statistics about DDL operations at the end
of the Extract and Replicat reports. To enable expanded DDL reporting, use the
DDLOPTIONS parameter with the REPORT option. Expanded reporting includes the
following information about DDL processing:
■
■
A step-by-step history of the DDL operations that were processed by Oracle
GoldenGate.
The DDL filtering and processing parameters that are being used.
Expanded DDL report information increases the size of the report file, but it might be
useful in certain situations, such as for troubleshooting.
To view a report, use the VIEW REPORT command in GGSCI.
VIEW REPORT group
5.12.1 Extract DDL reporting
The Extract report lists the following:
■
■
■
The entire syntax of each captured DDL operation, its Oracle GoldenGate CSN
number, the Teradata sequence number, and the size of the operation in bytes.
A subsequent entry that shows how processing criteria was applied to the
operation, for example string substitution or INCLUDE and EXCLUDE filtering.
Another entry showing whether the operation was written to the trail or excluded.
The following is an example taken from an Extract report file.
Example 5–3 Sample from an Extract Report
2011-01-21 18:41:40 GGS INFO 2100 DDL found, operation [DROP TABLE "SMIJATOVDBS"."src13_tabtable_
9" ; (size 59)], start CSN [2500FF3F0200363A], DDL seqno [00000025000000000000381500000021].
Configuring DDL Synchronization for a Teradata Database
5-17
Tracing DDL processing
2011-01-21 18:41:40 GGS INFO 2100 DDL operation included [include mapped objname "*"], optype
[DROP], objtype [TABLE], objowner [SMIJATOVDBS], objname [SRC13_TABTABLE_9].
2011-01-21 18:41:40 GGS INFO 2100 DDL operation written to extract trail file.
5.12.2 Replicat DDL reporting
The Replicat report lists:
■
■
■
■
The entire syntax of each DDL operation that Replicat processed from the trail.
A subsequent entry that shows the scope of the operation (MAPPED, UNMAPPED,
OTHER ) and how object names were mapped in the target DDL statement, if
applicable.
Another entry that shows how processing criteria was applied.
Additional entries that show whether the operation succeeded or failed, and
whether or not Replicat applied error handling rules.
The following is an example taken from a Replicat parameter file.
Example 5–4 Sample from a Replicat Report
2011-01-21 18:41:44 GGS INFO 2104 DDL found, operation [DROP TABLE "SMIJATOVDBS"."src13_
tabtable_9" ; (size 59)].
2011-01-21 18:41:44 GGS INFO 2100 DDL is of mapped scope, after mapping new operation [DROP
TABLE "SMIJATOVDBT"."SRC13_TABTABLE_9" ; (size 59)].
2011-01-21 18:41:44 GGS INFO 2100 Executing DDL operation.
2011-01-21 18:41:44 GGS INFO 2105 DDL operation successful.
5.12.3 Statistics in the process reports
You can send current statistics for DDL processing to the Extract and Replicat reports
by using the SEND command in GGSCI.
SEND {EXTRACT | REPLICAT} group REPORT
The statistics show totals for:
■
All DDL operations
■
Operations that are MAPPED in scope
■
Operations that are UNMAPPED in scope
■
Operations that are OTHER in scope
■
Operations that were excluded (number of operations minus included ones)
■
Errors (Replicat only)
■
Retried errors (Replicat only)
■
Discarded errors (Replicat only)
■
Ignored operations (Replicat only)
5.13 Tracing DDL processing
If you open a support case with Oracle GoldenGate Technical Support, you might be
asked to turn on tracing. The following parameters control DDL tracing.
■
TLTRACE controls Extract tracing
■
TRACE and TRACE2 control Replicat tracing.
5-18 Oracle GoldenGate for Teradata Installation and Setup Guide
Tracing DDL processing
These parameters have options to isolate the tracing of DDL from the tracing of DML.
For more information, see the Oracle GoldenGate Windows and UNIX Reference Guide.
Configuring DDL Synchronization for a Teradata Database
5-19
Tracing DDL processing
5-20 Oracle GoldenGate for Teradata Installation and Setup Guide
6
Modifying Objects in the Oracle GoldenGate
Configuration
6
This chapter contains instructions for performing some common maintenance tasks
when using the Oracle GoldenGate replication solution.
6.1 Deleting an Extract group
To delete an Oracle GoldenGate Extract group, the Extract process must be decoupled
from the Teradata replication group.
1.
Start GGSCI.
2.
While Extract is still running, issue this command:
SEND EXTRACT group, VAMMESSAGE "control:terminate"
3.
Stop Extract.
STOP EXTRACT group
4.
Delete the Extract group forcefully.
DELETE EXTRACT group !
5.
From any Teradata client, issue this command:
DROP REPLICATION GROUP repgroup name
6.2 Adding a table to an existing Extract group
1.
Suspend activity on the source tables that are linked to Oracle GoldenGate.
2.
Start GGSCI.
3.
In GGSCI, issue this command:
INFO EXTRACT group
4.
On the Checkpoint Lag line, verify whether there is any Extract lag. If needed,
continue to issue INFO EXTRACT until lag is zero, which indicates that all of the
transaction data so far has been processed.
5.
While Extract is still running, issue this command:
SEND EXTRACT group, VAMMESSAGE "control:terminate"
6.
Stop the Extract group.
Modifying Objects in the Oracle GoldenGate Configuration 6-1
Moving a table to a new Extract group
STOP EXTRACT group
7.
From any Teradata client, issue this command to add the new table:
ALTER REPLICATION GROUP group ADD database.table
8.
From any Teradata client, issue this command to generate a security token.
ALTER REPLICATION GROUP group
9.
Edit the TAM initialization file and specify the security token with the
SecurityToken parameter.
10. Edit the Extract parameter file to add a TABLE parameter that specifies the new
table.
EDIT PARAMS group
11. Save and close the file.
12. In GGSCI, issue this command to start Extract:
START EXTRACT group
13. Allow activity on the source tables that are linked to Oracle GoldenGate.
6.3 Moving a table to a new Extract group
1.
Suspend activity on the source database for all tables that are linked to Oracle
GoldenGate.
2.
Edit the current Teradata Create Group Statement file to remove the table from the
CREATE REPLICATION GROUP statement.
3.
Start GGSCI.
4.
In GGSCI, issue this command for the current Extract group:
INFO EXTRACT group
5.
On the Checkpoint Lag line, verify whether there is any Extract lag. If needed,
continue to issue INFO EXTRACT until lag is zero, which indicates that all of the
transaction data so far has been processed.
6.
In GGSCI, issue this command:
SEND EXTRACT group, VAMMESSAGE "control:terminate"
7.
Stop the current Extract group.
STOP EXTRACT group
8.
Edit the current Extract parameter file.
EDIT PARAMS group
9.
Remove the TABLE parameter that contains the table.
10. From any Teradata client, issue this command to drop the replication group that
contains the table that is being moved:
ALTER REPLICATION GROUP group DROP table
11. In GGSCI, issue this command to start the current Extract group, so that it can
continue processing its assigned tables, minus the one that was moved:
6-2 Oracle GoldenGate for Teradata Installation and Setup Guide
Modifying columns of a table
START EXTRACT group
12. Add a new Extract group that contains a TABLE statement for the moved table, and
then add the other processes, trails, and parameter files that are appropriate for
the capture method that you are using. See "Configuring Oracle GoldenGate" on
page 4-1 for instructions.
13. Create a new tam.ini file and a new Teradata Create Group Statement file that
contains the table. See "Configuring the TAM initialization file" on page 3-4 and
"Creating a Teradata replication group" on page 3-2.
14. Start the new Extract group and any associated processes.
START EXTRACT new_group
15. Allow user activity to resume on all of the source tables that are linked to Oracle
GoldenGate.
6.4 Modifying columns of a table
1.
Suspend activity on the source database for all tables that are linked to Oracle
GoldenGate.
2.
Start GGSCI.
3.
In GGSCI, issue this command for the Extract group:
INFO EXTRACT group
4.
On the Checkpoint Lag line, verify whether there is any Extract lag. If needed,
continue to issue INFO EXTRACT until lag is zero, which indicates that all of the
transaction data so far has been processed.
5.
While Extract is still running, issue this command:
SEND EXTRACT group, VAMMESSAGE "control:terminate"
6.
Stop the Extract group.
STOP EXTRACT group
7.
In GGSCI, issue this command for the Replicat group:
INFO REPLICAT group
8.
On the Checkpoint Lag line, verify whether there is any Replicat lag. If needed,
continue to issue INFO REPLICAT until lag is zero, which indicates that all of the
data in the trail has been processed.
9.
Stop the Replicat group.
STOP REPLICAT group
10. Perform the table modifications on the source and target databases.
11. Start the Extract and Replicat processes.
START EXTRACT group
START REPLICAT group
12. Allow user activity to resume on all of the source tables that are linked to Oracle
GoldenGate.
Modifying Objects in the Oracle GoldenGate Configuration 6-3
Modifying columns of a table
6-4 Oracle GoldenGate for Teradata Installation and Setup Guide
7
Uninstalling Oracle GoldenGate
7
This procedure assumes that you no longer need the data in the Oracle GoldenGate
trails, and that you no longer need to preserve the current Oracle GoldenGate
environment. To preserve your current environment and data, make a backup of the
Oracle GoldenGate directory and all subdirectories before starting this procedure.
7.1 Uninstalling Oracle GoldenGate from Linux or UNIX
1.
Run the command shell.
2.
(Suggested) Log on as the system administrator, or as a user with permission to
issue Oracle GoldenGate commands, and to delete files and directories from the
operating system.
3.
Run GGSCI.
4.
While Extract is still running, issue the following command.
SEND EXTRACT group, VAMMESSAGE "control:terminate"
5.
Stop Extract.
STOP EXTRACT group
6.
Delete the Extract group forcefully.
DELETE EXTRACT group !
7.
Stop the Manager process (where ! in the following command can be used to
bypass the interactive prompt).
Stop Manager [!]
8.
Exit GGSCI.
9.
From any Teradata client, issue the following command.
DROP REPLICATION GROUP repgroup name
10. Remove the Oracle GoldenGate files by removing the installation directory.
11. Drop any Oracle GoldenGate-related objects from the database as needed.
7.2 Uninstalling Oracle GoldenGate from Windows (non-cluster)
1.
(Suggested) Log on as the system administrator, or as a user with permission to
issue Oracle GoldenGate commands, and to delete files and directories from the
operating system.
Uninstalling Oracle GoldenGate
7-1
Uninstalling Oracle GoldenGate from Windows Cluster
2.
Run GGSCI.
3.
While Extract is still running, issue the following command.
SEND EXTRACT group, VAMMESSAGE "control:terminate"
4.
Stop Extract.
STOP EXTRACT group
5.
Delete the Extract group forcefully.
DELETE EXTRACT group !
6.
Stop the Manager process (where ! in the following command can be used to
bypass the interactive prompt).
STOP MANAGER [!]
7.
Exit GGSCI.
8.
From any Teradata client, issue the following command.
DROP REPLICATION GROUP repgroup name
9.
Click Start then Run and type cmd in the Run dialog box.
10. Change directories to the Oracle GoldenGate installation directory.
11. Run the INSTALL utility using the following syntax.
install deleteevents deleteservice
This command stops Oracle GoldenGate events from being reported to the
Windows Event Manager and removes the Manager service.
12. Delete the CATEGORY.DLL and GGSMSG.DLL files from the Windows SYSTEM32 folder.
13. Delete the Oracle GoldenGate installation folder.
14. Drop any Oracle GoldenGate-related objects from the database as needed.
7.3 Uninstalling Oracle GoldenGate from Windows Cluster
1.
Log into the node in the cluster that owns the cluster group that contains the
Manager resource. Log on as the system administrator, or as a user with
permission to issue Oracle GoldenGate commands and to delete files and
directories from the operating system.
2.
Run GGSCI.
3.
While Extract is still running, issue the following command.
SEND EXTRACT group, VAMMESSAGE "control:terminate"
4.
Stop Extract.
STOP EXTRACT group
5.
Delete the Extract group forcefully.
DELETE EXTRACT group !
6.
Stop the Manager process (where ! in the following command can be used to
bypass the interactive prompt).
7-2 Oracle GoldenGate for Teradata Installation and Setup Guide
Uninstalling Oracle GoldenGate from Windows Cluster
STOP MANAGER [!]
7.
Exit GGSCI.
8.
Use the Cluster Administrator tool to take the Manager resource offline.
9.
Right click the resource and select Delete to remove it.
10. Run the INSTALL utility using the following syntax.
INSTALL DELETEEVENTS DELETESERVICE
This command stops Oracle GoldenGate events from being reported to the
Windows Event Manager and removes the Manager service.
11. Delete the CATEGORY.DLL and GGSMSG.DLL files from the Windows SYSTEM32 folder.
12. Move the cluster group to the next node in the cluster, and repeat from step 10.
13. From any Teradata client, issue the following command.
DROP REPLICATION GROUP repgroup name
14. Delete the Oracle GoldenGate installation folder.
15. Drop any Oracle GoldenGate-related objects from the database as needed.
Uninstalling Oracle GoldenGate
7-3
Uninstalling Oracle GoldenGate from Windows Cluster
7-4 Oracle GoldenGate for Teradata Installation and Setup Guide
A
Oracle GoldenGate installed components
A
This appendix describes the programs, directories, and other components created or
used by the Oracle GoldenGate software in the Oracle GoldenGate installation
directory. Additional files not listed here might be installed on certain platforms. Files
listed here might not be installed on every platform.
A.1 Oracle Goldengate Programs And Utilities
This section describes programs installed in the root Oracle Goldengate installation
directory.
Some programs may not exist in all installations. For example,
if only capture or delivery is supported by Oracle GoldenGate for
your platform, the extract or replicat program will not be installed,
respectively. Likewise, special files might be installed to support a
specific database.
Note:
Table A–1
Oracle GoldenGate installed programs and utilities
Program
Description
convchk
Converts checkpoint files to a newer version.
ddlgen
Generates target database table definitions based on source
database DDL. Used primarily on the NonStop platform.
defgen
Generates data definitions and is referenced by Oracle
GoldenGate processes when source and target tables have
dissimilar definitions.
emsclnt
Sends event messages created by Collector and Replicat on
Windows or UNIX systems to EMS on NonStop systems.
extract
Performs capture from database tables or transaction logs or
receives transaction data from a vendor access module.
ggmxinstall
Oracle GoldenGate installation script for the SQL/MX database.
ggsci
User interface to Oracle GoldenGate for issuing commands and
managing parameter files.
ggsmgr.jcl
Start the Oracle GoldenGate Manager process from a batch job
or the operator console on a z/OS system. Installed to support
DB2 z/OS databases.
ggsmgr.proc
ggsmgrst.jcl
ggsmgrst.proc
Oracle GoldenGate installed components A-1
Oracle Goldengate Subdirectories
Table A–1 (Cont.) Oracle GoldenGate installed programs and utilities
Program
Description
install
Installs Oracle GoldenGate as a Windows service and provides
other Windows-based service options.
keygen
Generates data-encryption keys.
logdump
A utility for viewing and saving information stored in extract
trails or files.
mgr
(Manager) Control process for resource management, control
and monitoring of Oracle GoldenGate processes, reporting, and
routing of requests through the GGSCI interface.
replicat
Applies data to target database tables.
reverse
A utility that reverses the order of transactional operations, so
that Replicat can be used to back out changes from target tables,
restoring them to a previous state.
server
The Collector process, an Extract TCP/IP server collector that
writes data to remote trails.
triggen
Generates scripts that create the Oracle GoldenGate log table
and logging triggers to support the trigger-based extraction
method.
vamserv
Started by Extract to read the TMF audit trails generated by
TMF-enabled applications. Installed to support the NonStop
SQL/MX database.
A.2 Oracle Goldengate Subdirectories
This Section describes the subdirectories of the Oracle Goldengate installation
directory and their contents.
Note:
Some directories may not exist in all installations.
Table A–2
Oracle GoldenGate installed subdirectories
Directory
Description
br
Contains the checkpoint files for the bounded recover feature.
cfg
Contains the property and XML files that are used to configure
Oracle GoldenGate Monitor.
dirdb
Contains the datastore that is used to persist information that is
gathered from an Oracle GoldenGate instance for use by the
Oracle GoldenGate Monitor application or within Oracle
Enterprise Manager.
A-2 Oracle GoldenGate for Teradata Installation and Setup Guide
Oracle Goldengate Subdirectories
Table A–2 (Cont.) Oracle GoldenGate installed subdirectories
Directory
Description
dirchk
Contains the checkpoint files created by Extract and Replicat
processes, which store current read and write positions to
support data accuracy and fault tolerance. Written in internal
Oracle GoldenGate format.
File name format is group_name+sequence_number.ext where
sequence_number is a sequential number appended to aged files
and ext is either cpe for Extract checkpoint files or cpr for
Replicat checkpoint files.
Do not edit these files.
Examples:
ext1.cpe
rep1.cpr
dirdat
The default location for Oracle GoldenGate trail files and extract
files that are created by Extract processes to store extracted data
for further processing by the Replicat process or another
application or utility. Written in internal Oracle GoldenGate
format.
File name format is a user-defined two-character prefix followed
by either a six-digit sequence number (trail files) or the
user-defined name of the associated Extract process group
(extract files).
Do not edit these files.
Examples:
rt000001
finance
dirdef
The default location for data definitions files created by the
DEFGEN utility to contain source or target data definitions used
in a heterogeneous synchronization environment. Written in
external ASCII. File name format is a user-defined name
specified in the DEFGEN parameter file.
These files may be edited to add definitions for newly created
tables. If you are unsure of how to edit a definitions file, contact
Oracle GoldenGate technical support.
Example:
defs.dat
dirjar
Contains the Java executable files that support Oracle
GoldenGate Monitor.
dirout
This directory is not used any more.
dirpcs
Default location for status files. File name format is
group.extension where group is the name of the group and
extension is either pce (Extract), pcr (Replicat), or pcm
(Manager).
These files are only created while a process is running. The file
shows the program name, the process name, the port number,
and the process ID.
Do not edit these files.
Examples:
mgr.pcm
ext.pce
Oracle GoldenGate installed components A-3
Other Oracle GoldenGate files
Table A–2 (Cont.) Oracle GoldenGate installed subdirectories
Directory
Description
dirprm
The default location for Oracle GoldenGate parameter files
created by Oracle GoldenGate users to store run-time
parameters for Oracle GoldenGate process groups or utilities.
Written in external ASCII format. File name format is group
name/user-defined name.prm or mgr.prm .
These files may be edited to change Oracle GoldenGate
parameter values after stopping the process. They can be edited
directly from a text editor or by using the EDIT PARAMS
command in GGSCI.
Examples:
defgen.prm
finance.prm
dirrec
Not used by Oracle GoldenGate.
dirrpt
The default location for process report files created by Extract,
Replicat, and Manager processes to report statistical information
relating to a processing run. Written in external ASCII format.
File name format is group name+sequence number.rpt where
sequence number is a sequential number appended to aged files.
Do not edit these files.
Examples:
fin2.rpt
mgr4.rpt
dirsql
Used by the triggen utility to store SQL scripts before triggen
was deprecated. Currently used to store training scripts and any
user-created SQL scripts that support Oracle GoldenGate.
dirtmp
The default location for storing transaction data when the size
exceeds the memory size that is allocated for the cache manager.
Do not edit these files.
dirwlt
Contains the Oracle Wallet that supports Oracle GoldenGate
Monitor. This directory is not installed until you run the utility
that creates the wallet.
UserExitExamples
Contains sample files to help with the creation of user exits.
A.3 Other Oracle GoldenGate files
This section describes other files, templates, and objects created or installed in the root
Oracle GoldenGate installation directory.
Some files may not be installed in your environment,
depending on the database and OS platform.
Note:
Table A–3
Other Oracle GoldenGate installed files
Component
Description
bcpfmt.tpl
Template for use with Replicat when creating a run file for the
Microsoft BCP/DTS bulk-load utility.
bcrypt.txt
Blowfish encryption software license agreement.
A-4 Oracle GoldenGate for Teradata Installation and Setup Guide
Other Oracle GoldenGate files
Table A–3 (Cont.) Other Oracle GoldenGate installed files
Component
Description
cagent.dll
Contains the Windows dynamic link library for the Oracle
GoldenGate Monitor C sub-agent.
category.dll
Windows dynamic link library used by the INSTALL utility.
chkpt_db_create.sql
Script that creates a checkpoint table in the local database. A
different script is installed for each database type.
db2cntl.tpl
Template for use with Replicat when creating a control file for
the IBM LOADUTIL bulk-load utility.
ddl_access.tpl
Template used by the DDLGEN utility to convert source DDL to
Microsoft Access DDL.
ddl_cleartrace.sql
Script that removes the DDL trace file. (Oracle installations)
ddl_db2.tpl
Template used by the DDLGEN utility to convert source DDL to
DB2 DDL (Linux, UNIX, Windows).
ddl_db2_os390.tpl
Template used by the DDLGENutility to convert source DDL to
DB2 DDL (z/OS systems).
ddl_ddl2file.sql
Script that saves DDL from the marker table to a file.
ddl_disable.sql
Script that disables the Oracle GoldenGate DDL trigger. (Oracle
installations)
ddl_enable.sql
Script that enables the Oracle GoldenGate DDL trigger. (Oracle
installations)
ddl_filter.sql
Script that supports filtering of DDL by Oracle GoldenGate. This
script runs programmatically; do not run it manually.
ddl_informix.tpl
Template used by the DDLGEN utility to convert source DDL to
Informix DDL.
ddl_mss.tpl
Template used by the DDLGEN utility to convert source DDL to
SQL Server DDL.
ddl_mysql.tpl
Template used by the DDLGEN utility to convert source DDL to
MySQL DDL.
ddl_
nopurgeRecyclebin.sql
Empty script file for use by Oracle GoldenGate support staff.
ddl_nssql.tpl
Template used by the DDLGEN utility to convert source DDL to
NonStop SQL DDL.
ddl_ora9.sql
Scripts that run programmatically as part of Oracle GoldenGate
DDL support; do not run these scripts.
ddl_ora10.sql
ddl_ora11.sql
ddl_ora10upCommon.sql
ddl_oracle.tpl
Template used by the DDLGEN utility to convert source DDL to
Oracle DDL.
ddl_pin.sql
Script that pins DDL tracing, the DDL package, and the DDL
trigger for performance improvements. (Oracle installations)
ddl_purgeRecyclebin.sql
Script that purges the Oracle recyclebin in support of the DDL
replication feature.
ddl_remove.sql
Script that removes the DDL extraction trigger and package.
(Oracle installations)
ddl_session.sql
Supports the installation of the Oracle DDL objects. This script
runs programmatically; do not run it manually.
ddl_session1.sql
Oracle GoldenGate installed components A-5
Other Oracle GoldenGate files
Table A–3 (Cont.) Other Oracle GoldenGate installed files
Component
Description
ddl_setup.sql
Script that installs the Oracle GoldenGate DDL extraction and
replication objects. (Oracle installations)
ddl_sqlmx.tpl
Template used by the DDLGEN utility to convert Tandem
Enscribe DDL to NonStop SQL/MX DDL.
ddl_status.sql
Script that verifies whether or not each object created by the
Oracle GoldenGate DDL support feature exists and is
functioning properly. (Oracle installations)
ddl_staymetadata_off.sql Scripts that control whether the Oracle DDL trigger collects
metadata. This script runs programmatically; do not run it
ddl_staymetadata_on.sql
manually.
ddl_sybase.tpl
Template used by the DDLGEN utility to convert source DDL to
Sybase DDL.
ddl_tandem.tpl
Template used by the DDLGEN utility to convert source DDL to
NonStop SQL DDL.
ddl_trace_off.sql
Scripts that control whether DDL tracing is on or off.
ddl_trace_on.sql
ddl_tracelevel.sql
Script that sets the level of tracing for the DDL support feature.
(Oracle installations)
debug files
Debug text files that may be present if tracing was turned on.
demo_db_scriptname.sql
demo_more_db_
scriptname.sql
Scripts that create and populate demonstration tables for use
with tutorials and basic testing.
.dmp files
Dump files created by Oracle GoldenGate processes for tracing
purposes.
ENCKEYS
User-created file that stores encryption keys. Written in external
ASCII format.
exitdemo.c
User exit example.
exitdemo_utf16.c
User exit example that demonstrates how to use UTF16 encoded
data in the callback structures for information exchanged
between the user exit and the process.
freeBSD.txt
License agreement for FreeBSD.
ggmessage.dat
Data file that contains error, informational, and warning
messages that are returned by the Oracle GoldenGate processes.
The version of this file is checked upon process startup and must
be identical to that of the process in order for the process to
operate.
ggserr.log
File that logs processing events, messages, errors, and warnings
generated by Oracle GoldenGate.
ggsmsg.dll
Windows dynamic link library used by the install program.
GLOBALS
User-created file that stores parameters applying to the Oracle
GoldenGate instance as a whole.
help.txt
Help file for the GGSCI command interface.
icudt38.dll
Windows shared libraries for International Components for
Unicode.
icuin38.dll
icuuc38.dll
A-6 Oracle GoldenGate for Teradata Installation and Setup Guide
Other Oracle GoldenGate files
Table A–3 (Cont.) Other Oracle GoldenGate installed files
Component
Description
jagent.bat
Windows batch file for the Java Agent for Oracle GoldenGate
Monitor.
jagent.log
Log files for the Oracle GoldenGate Monitor Agent.
jagentjni.log
jagent.sh
UNIX shell script for the Java Agent for Oracle GoldenGate
Monitor
LGPL.txt
Lesser General Public License statement. Applies to free libraries
from the Free Software Foundation.
libodbc.so
ODBC file for Ingres 2.6 on Unix.
libodbc.txt
License agreement for libodbc.so.
libxml2.dll
Windows dynamic link library containing the XML library for
the Oracle GoldenGate XML procedures.
libxml2.txt
License agreement for libxml2.dll .
marker.hist
File created by Replicat if markers were passed from a NonStop
source system.
marker_remove.sql
Script that removes the DDL marker table. (Oracle installations)
marker_setup.sql
Script that installs the Oracle GoldenGate DDL marker table.
(Oracle installations)
marker_status.sql
Script that confirms successful installation of the DDL marker
table. (Oracle installations)
notices.txt
Third-party software license file.
odbcinst.ini
Ingres 2.6 on Unix ODBC configuration file.
params.sql
Script that contains configurable parameters for DDL support.
(Oracle installations)
pthread-win32.txt
License agreement for pthread-VC.dll .
pthread-VC.dll
POSIX threads library for Microsoft Windows.
prvtclkm.plb
Supports the replication of Oracle encrypted data.
pw_agent_util.bat
Script files that support the Oracle GoldenGate Monitor Agent.
pw_agent_util.sh
role_setup.sql
Script that creates the database role necessary for Oracle
GoldenGate DDL support. (Oracle installations)
sampleodbc.ini
Sample ODBC file for Ingres 2.6 on UNIX.
sqlldr.tpl
Template for use with Replicat when creating a control file for
the Oracle SQL*Loader bulk-load utility.
start.prm
z/OS paramlib members to start and stop the Manager process.
stop.prm
stopmgr
z/OS Unix System Services scripts to start the Manager process
from GGSCI.
startmgrcom
z/OS system input command for the Manager process.
startmgr
stopmgrcom
tcperrs
File containing user-defined instructions for responding to
TCP/IP errors.
Oracle GoldenGate installed components A-7
Oracle GoldenGate checkpoint table
Table A–3 (Cont.) Other Oracle GoldenGate installed files
Component
Description
usrdecs.h
Include file for user exit API.
xerces-c_2_8.dll
Apache XML parser library.
zlib.txt
License agreement for zlib compression library.
A.4 Oracle GoldenGate checkpoint table
When database checkpoints are being used, Oracle GoldenGate creates a checkpoint
table with a user-defined name in the database upon execution of the ADD
CHECKPOINTTABLE command, or a user can create the table by using the chkpt_db_
create.sql script (where db is an abbreviation of the type of database that the script
supports).
Do not change the names or attributes of the columns in this table. You can change
table storage attributes as needed.
Table A–4
Checkpoint table definition
Column
Description
GROUP_NAME (primary key) The name of a Replicat group using this table for checkpoints.
There can be multiple Replicat groups using the same table.
GROUP_KEY (primary key)
A unique identifier that, together with GROUPNAME, uniquely
identifies a checkpoint regardless of how many Replicat groups
are writing to the same table.
SEQNO
The sequence number of the checkpoint file.
RBA
The relative byte address of the checkpoint in the file.
AUDIT_TS
The timestamp of the checkpoint position in the checkpoint file.
CREATE_TS
The date and time when the checkpoint table was created.
LAST_UPDATE_TS
The date and time when the checkpoint table was last updated.
CURRENT_DIR
The current Oracle GoldenGate home directory or folder.
A-8 Oracle GoldenGate for Teradata Installation and Setup Guide
">