Speed or Leave Informatica


Accelerate or Re-platform Your ETL Jobs

Challenges

 

PowerCenter transforms of very large data volumes require partitioning and can run slower than desired, even after consulting and tuning. Bottlenecks may occur during large sort, join, aggregation, load, or unload operations. Informatica's initial "pushdown optimization" options shift the burden into an already-busy database (Oracle) or very expensive/complex platform (Teradata).  Another serious need is the protection of sensitive production data moving through Informatica data warehouse, data mart, or test operations. You may need to apply role-based data protections or generate large volumes of realistic, referentially correct test data to prototype applications and populate specific targets.

 

Big data bottlenecks are large sorts, joins, aggregations, loads, and sometimes unloads. Parallelization or optimization in other layers or tools can be unwieldy, if not expensive, and may adversely affect performance for other users.

 

From a security standpoint, IBM's data masking solutions may be expensive or cumbersome for some, or may not provide all of the PII discovery or privacy functions for others.

  • Pushdown Optimization via IRI CoSort

    To speed transforms, reports, and field-level protections in general, consider the use of CoSort SortCL programs alongside your PowerCenter or PowerMart operations.

     

    The American Stock Exchange uses CoSort as a "pushdown optimization" solution to dramatically increase transformation performance. On a 4-CPU IBM p640 that took PowerCenter 20m:35s to sort, SortCL did the same job in 1m:19s. This represented only a nominal incremental software investment and did not tax their database.

     

    Run large sorts, joins, aggregations, and loads in the file system, where it's much faster. Plus, convert file and data types, mask PII, and generate custom reports -- all at the same time (in the same job script and I/O pass).

    Learn more.

  • Affordable Data Masking for Informatica

    You may not want to use the Dynamic Data Masking software that Informatica acquired. IRI's data-centric security product, FieldShield, has more methods for protecting fields in structured datasets and uses simple, portable, Eclipse™-supported job scripts.

     

    Your business rules dictate the feature you choose to apply to each column: format-preserving AES-256, Open SSL and GPG encryption, lookup-value substitution (pseudonymization), character masking, custom expression logic, user field functions, and more.

  • Compliant Test Data for Informatica

    Do you need test data for Informatica ETL prototyping? Use IRI RowGen to generate it rapidly and affordably. With RowGen, you can build realistic, referentially correct test data to populate target tables, data marts, flat files, and production reports, while leveraging your database data model (.DDL) files and Informatica metadata.