Data Replication Strategies
Capture, Manipulate, Copy – faster, easier, cheaper
The strategies for data replication and the tools for data synchronization are very different. IRI's data replication technologies in general, and its real-time database replication techniques in particular, can help you quickly and affordably copy, edit, and synchronize data from heterogeneous data sources, enabling you to use regular, fresh data copies for testing, reporting, or other applications.
Replicate massive amounts of relational databases, mainframe datasets, flat files, and other sequential data sources using either real-time change data capture methods or batch programs with the IRI Workbench IDE, which is based on Eclipse™.
When considering the use cases below, please keep in mind that IRI's data and database replication software is unique among real-time data replication tools, meaning it is
Scalable in volume (via multi-threading and task/IO consolidation)
· Database andPlatform independence
Reliable in terms of data (and referential) integrity
· Functionally flexible, whether batch or real-time
Cheaper and easier to use than replication software like GoldenGate
Examples of data replication
Do you have a single data source that needs to be re-cast into a different format for data replication? To copy data from a non-relational COBOL index file into a CSV file for Excel or another relational target, leverage the data replication capabilities of IRI NextForm. See this simple example.
Do you have a simple replication set or a Database subset, that you need for data replication and must share with other users? Use this IRI CoSort or IRI FieldShield or the larger IRI Voracity-data management platform that contains them) and simultaneously mask personally identifiable information (PII).
Replicate multiple sources (like relational or NoSQL DB tables) at once, output them to multiple schemas or other destinations, or perform similar manipulations on the fly:
Deduplication and selection
· Splitting, Merging of data elements
Cleaning, enrichment, and validation
· Change data captureCenters for Disease Control and Prevention
Normalize or Denormalize
· Sorting, Joining, and Aggregation
· Data masking, encryption, etc.
You can perform the tasks mentioned above and combine them into one or more jobs, which are then divided into functional assistants and ETL-Workflows defined in Voracity. Execute these transformation jobs „on the fly“ during replication in Voracity, and as data masking scripts, for example, alongside DB cloning operations in Commvaultt, Windocks and Actifio run.
Use the IRI Ripcurrent Real-time Change Data Capture In IRI Voracity, to incrementally update, mask, cleanse, transform, or report on data when MS SQL, MySQL, Oracle, and PostgreSQL database rows are inserted, updated, or deleted, or to notify you when their structure changes.
Otherwise, you can also insert event-driven triggers before the orders or after Filter by Timestamp or ID Column Values, to replicate only the newer lines, as in this example between Oracle and MongoDB.
Design, execute, and manage mappings in (and versions of) these projects in the free IRI Workbench IDE for Voracity et al, which builds on Eclipse. Deploy the resulting, self-documenting job scripts to any platform. Send results directly to your targets, Federation sources or a replication server.
You can even use the output mappings you create to automatically define new table metadata and load utility configuration files to populate your targets with pre-sorted data!
To provide test data in any format without accessing or replicating production data, use IRI RowGen.