ETL Deployment

Serialization Mappings for Local, Remote, and HDFS Execution

All of the functions listed below are provided by the data integration and management platform IRI Voracity supported.
GUI refers to the graphical user interface of IRI Workbench. IRI Workbench is the free, Eclipse™-based Integrated Development Environment (IDE) for Voracity and all common IRI software products or suites.

Provision

Options

Run configured GUI

Map once and deploy your jobs anywhere. Voracity users can run jobs on local, remote, or Hadoop systems individually or in a scheduled (batch) sequence from IRI Workbench, their shell, or a third-party workflow automation platform. On this page find examples.

Batch creation

Create ETL jobs quickly and easily using wizards, mapping diagrams, or scripts; see this page for instructions. Optional use of ETL code generation for Voracity in Erwin Mapping Manager.

Flow Management

Storing, accessing, and modifying data processing workflows in the GUI.

Scheduler Integration

Use the built-in IRI Voracity Scheduler for each job or a third-party scheduler to automate and initiate dependent jobs (e.g., see IRI Whitepaper on integration with Oracle Jobs Scheduler).

Test, reshape, repeat

Preview with real or test data to optimize and re-run task blocks, job scripts, or entire workflows for debugging and „what-if“ analyses.

Call

Executing orders via GUI, command line, batch script, or
Application program, another ETL tool and Hadoop.

Monitoring

Displays the progress of the event during the job in the GUI console or at the command line.

Tuning

Performance control through configuration files for jobs, users, and global resources or registry settings.

Statistics

Switching during the generation of runtime performance and application statistics for console or later file verification.

Error messages

Validate orders in the syntax-aware editor or in debug mode. Errors will be stored in the error log.

Logging

Storing, reviewing, and/or querying statistics, performance, and XML audit files for activity and compliance review.