Discover and Model Data
Profile and Prepare to Integrate
All the feature-functions listed below are supported in software and solutions within the IRI Data Manager suite, and the IRI Voracity total data management platform for data discovery, integration (ETL), migration, governance, and analytics.
Note: DTP refers to the Data Tools Platform plugin, and the Data Source Explorer that connects, reveals, and interacts with your RDB sources. DTP is included in the free IRI Workbench IDE, built on Eclipse™, which ships with all IRI software products.
|
Activity |
Options |
|
Analyze data structures, keys, and enumerated domains in tables and file in the IRI Workbench GUI for Voracity. Workbench includes Eclipse DTP and robust IRI wizards for ER Diagramming, Database (DB) Profiling, Flat-File Profiling, Metadata Discovery, and Dark Data Discovery for unstructured text sources. Use the DB Profiler, for example, to generate selected column statistics, search for patterns and fuzzy value matches, and check referential integrity, or build entity-relationship models and diagrams for any connected DB schema. Submit validation rules, discover column value anomalies, and silo data out of range ahead of data integration, quality, masking or test data operations in Voracity. Use IRI professional services or partners for help to identify, isolate, and address actionable data, master data, and data at risk throughout the enterprise. |
|
|
Data Modeling & Classification |
Use the free ER diagramming wizard in IRI Workbench to visualize relational, star, and other DW schema. Use CoSort SortCL programs in Voracity to migrate between schema (e.g. relational to star). Define and manage enterprise-wide data class libraries, and use them to apply transformation and protection field rules across multiple sources at once. |
|
Metadata Definition |
Use the Metadata Discovery wizard to preview structured data and auto-define fields in IRI-standard Data Definition File (DDF) format. Use the Dark Data Discovery wizard to report on metadata in unstructured documents -- and define the DDF layouts for the structured files it creates -- from pattern-matching values in those documents. Use automatic metadata conversion ("2DDF") utilities to create DDF form DDL, file structures, and third-party metadata structures. Use Erwin Mapping Manager or MIMB to create reusable DDF metadata repositories for IRI jobs from metadata you already have from third-party BI, CRM, DB, ETL, and modeling tools. Import existing DDF, and create DDF via direct scripting, GUI form editors, or during source-target mapping. Manage DDF versions, lineage, and security in EGit, etc. |
|
Discover existing transaction and reference data. Use the MDM Data Unification wizard to identify, unify, and store master values. Create composite data values as new template data types in SortCL. Build composite forms in RowGen for master test data. |
