Faster ETI Data Transformations

Integrate CoSort specifications into ETI code templates

Overview
DataStage
ETI*Solution
Informatica
OWB & ODI
Pentaho
Talend
Other
Challenges

High-volume data transformations can represent a performance bottleneck for some users of the ETI solution. The current workaround, if any, might be a separate product, a separate run, and a separate location for processing the data.

Separate transformation programs or tools do not offer an easy way to leverage existing ETL metadata. This presents inconveniences in job design, inefficiency in execution, or both.

Solutions

It's easy to improve the performance of high-volume data transformation. Call IRI CoSort directly in the ETI solution.

Use ETI Solution Code Templates to CoSort's Sort Control Language (SortCLFill field layout and data manipulation commands based on existing ETI metadata and transformation requirements.

Provide a startup routine with SortCL Job Controls that can call other specifications. The startup routine can call other functions.

The results are combined with existing ETI metadata to create runnable SortCL job scripts that include the correct file names, sort keys, field attributes, etc. In fact, you can use SortCL to run, accelerate, and/or combine data:

  • Filtering (Selection, Scrub, Links to DQ Tools)
  • Transformation (Sorting, Merging, Aggregation, Calculation, etc.)
  • Conversion (Data Type and File Format Migrations)
  • Presentation (Batch, Summary, and Delta Reports)
  • Protection (Field Encryption, De-ID, Masking)

Ask IRI for a combined ETI-CoSort/SortCL code example.

Related solutions

Product links