High-speed data transformations

Combine tasks in Voracity or accelerate existing ETL jobs

High-speed data transformations

Combine tasks in Voracity or accelerate existing ETL jobs

Are you looking for data transformation tools?

ETL tools, Perl scripts, custom programs, and SQL procedures can be slow, costly, and complex data transformation solutions. Unfamiliar user interfaces and coding make job specification difficult, and run times suffer under the load of large data volumes. Can you do it?

· Transform massive amounts of data without using your DB or changing your IT structure, for example, without Hadoop, NoSQL, or an ELT appliance?
· utilize multiple CPUs and cores for large tasks, run multiple tasks in the same I/O, and dynamically allocate resources to optimize performance?
· Understand, share, and modify your data and order definitions with minimal learning effort?

The 4GL SortCL program inside the IRI CoSort Packages and the IRI Voracity platform is a long-standing (and visually configurable) big data transformation engine that handles the heavy lifting in the world's largest data warehouses, operational data stores, core banking applications, clickstream data webhouses, data lakes, and other applications.

And if you Use Hadoop, You can also seamlessly execute many of the transformations defined in SortCL jobs in MapReduce, Spark, Spark Stream, Storm, and Tez.

Optimize ETL operations by combining sorts, joins, and aggregates into a single job script, partition, and I/O pass. Simultaneously, you can deduplicate and filter, convert and remap, lookup, rank, (de-)normalize, compute, move, encrypt and protect, as well as mask and remap.

Transform large amounts of data from many different table and file sources together. Discover, define, and present your data and manipulation definitions in simple text files.Metadata-Repositories that you in the free and Eclipse-based IRI Workbench GUI can manage. Use named fields for mapping:

Mapping of sources to targets
Reducing script size and build times
Streamlining Reorg and ETL Operations
Creating metadata for the
Loading and file comparison

Continue performing the transformations that slower and more complex SQL procedures or ETL tools do:

Change data capture
Rotation of the Row Column (Pivot/Unpivot)
Slowly changing dimensions reporting
Star (or snowflake) schema targeted at the goal.
Static, structured, running, and aggregate
Discrete and operational value lookups
Format Mass and Other Value Changes
Data cleansing
Data Privacy (Masking, Encryption, Pseudonymization, etc.)

Create Customized reports and deliver pre-processed subsets to the files, tables, and composite views that your applications, data marts, and BI users can immediately leverage.

SortCL and related facilities in the CoSort package accept many third-party data layouts, e.g., DB DDL, COBOL Copybooks, CSV, LDIF, and XML files, CLF and ELF weblogs, and SQL\*Loader Control File metadata. SortCL job scripts contain SQL-familiar commands that use and/or reference these layouts. Its GUI recognizes and generates these layouts. automatic.

SortCL transformations work hand-in-hand with data extraction and load utilities. For example, SortCL can process VLDB data that's extracted by IRI FACT (Fast Extract) loaded, laid flat, and pre-sorted into database load programs like SQL*Loader. SortCL can also connect to other files, tables, and spreadsheets on-premises or in the cloud to capture and deliver data.

SortCL transformations can be run alongside ETL tools like Informatica and DataStage to enhance their To optimize performance. SortCL jobs can be run from the command line, in batch scripts, from 3GL programs, via API calls, or in the Eclipse™-based IRI Workbench GUI to be executed. You can easily embed these transformations to accelerate your applications, just like Kalido, Terastream, General Dynamics, and Minsait do, to name a few.

SortCL utilizes CoSort's granular speed adjustment and flexible CPU licensing. IRI's continuous innovation in parallel data movement, I/O, and memory management, data manipulation functions and consolidation, and our meaningful industry partnerships keep you at the forefront of big data transformation.

High-speed data transformations

Combine tasks in Voracity or accelerate existing ETL jobs