Accelerate Informatica or replace it entirely

Accelerate or redesign ETL jobs

Overview
DataStage
ETI*Solution
Informatica
OWB & ODI
Pentaho
Talend
Other
Challenges

PowerCenter transformations on very large data volumes require partitioning and may still run slower than desired even after consultation and tuning. Bottlenecks can occur with large sort, join, aggregate, load, or unload operations. Informatica's initial „push-down optimization“ options offload the load to an already busy database (Oracle) or a very expensive/complex platform (Teradata).

Another serious necessity is the protection of sensitive production data that is transported through the Informatica Data Warehouse, Data Mart, or test environment. You may need to apply role-based data masking or generate large amounts of realistic, referenceless test data for prototype applications and populate certain targets.

Solutions
To speed up transformations, reports, and field-level protection in general, you should use CoSort SortCL–Consider programs alongside your PowerCenter or PowerMart operations.
 
The American Stock Exchange uses CoSort as a „push-down optimization“ to dramatically increase transformation performance. On a 4-CPU IBM p640 that required PowerCenter 20m:35s for sorting, SortCL completed the same job in 1m:19s. This represented only a nominal incremental software investment and did not burden their database.
 
Perform large sorts, joins, aggregations, and loads in the file system, where it's much faster. Plus, convert file and data types, mask PII, and create custom reports – all at the same time (in the same job script and I/O pass). Here are more details.

You may not want to use the dynamic data masking software acquired by Informatica. IRI's data-centric security product, FieldShield, features more methods for protecting fields in structured datasets and uses simple, portable, Eclipse™-enabled job scripts.

Your business rules determine which function you choose for each column: format-preserving AES-256, Open SSL, and GPG encryption, lookup value substitution (pseudonymization), character masking, custom expression logic, user field functions, and more.

Do you need test data for Informatica ETL prototyping? Use IRI RowGen, to generate it quickly and cost-effectively. RowGen enables you to create realistic, referentially correct test data to populate target tables, data marts, data vault models, full EDWs, flat files, and production reports by leveraging your database data model files (.DDL) and Informatica metadata.

 

You Can ETL jobs in Informatica now automatically about the Erwin (formerly AnalytiX DS) Code Automation Frameworks (CATfx) technology in Voracity Convert. Both Informatica and Voracity metadata are modeled in Erwin Mapping Manager, allowing you to move projects easily between the two platforms. Voracity is many times faster and more cost-effective than Informatica PowerCenter and with this proven Technology Is it finally possible to switch?.

Related solutions

Product links

Blog Article

Other resources