Solutions

The Sort Control Language (SortCL) program in the IRI CoSort data transformation package and IRI Voracity data management (ETL) platform can simultaneously filter, sort, join, aggregate, and reformat multiple table and file sources at once.

SortCL uses simple, explicit 4GL text files to define data sources, targets, and transformations. Automatic script creation, cross-platform execution, modification, and management are supported in the free Eclipse GUI, IRI Workbench.

SortCL supports inner and outer join functionality to produce combined outputs and file compares based on specified conditions. Input, join, and output one or more pre-sorted or unsorted tables and/or files.

Eliminate inner join results from an outer join. Eliminate and reformat null records.

In the same, simple job script and I/O pass, cross-calculate and derive new values from matched results. Add field-level data masking functions to sensitive fields. For output, custom-define multiple detail and summary report targets, and hand-off selected information in different formats for data visualization tools.

The bottom line? Joining big data in SortCL allows you to compare files and table data externally, capture changed data, produce business intelligence from it, and reduce database query and refresh overhead.

Related Solutions

• Data Integration
• Database Acceleration
• Data Transformation > Table Lookups
• BI > Change Data Capture