ETL Deployment


Serialize Mappings for Local, Remote, & HDFS Execution

All the feature-functions below are supported in the IRI Voracity data integration and management platform.

GUI refers to the IRI Workbench Graphical User Interface. IRI Workbench is the free Integrated Development Environment (IDE), built on Eclipse™, for Voracity and all constituent IRI software products or suites.

Deployment

Options

Run Config GUI

Map once, and deploy your jobs anywhere. Voracity users can run jobs on local, remote, or Hadoop systems individually, or in a planned (batch) sequence from IRI Workbench, their shell, or any third-party workflow automation platform. See this page for examples.

Batch Generation

Rapidly build ETL jobs through wizards, mapping diagrams or scripts; see this page for instructions. Optionally leverage ETL code generation for Voracity in AnalytiX DS Mapping Manager.

Flow Management

Save, access, and modify data processing workflows in the GUI

Scheduler Integration

Use the built-in IRI Voracity scheduler in Eclipse for any job, or any third-party scheduler for automate and initiate dependent jobs (e.g. see IRI white paper on the integration with Oracle Jobs Scheduler)

Test, Recast, Repeat

Preview with real or test data to tweak and re-run task blocks, job scripts, or full workflows for debugging and what-if analyses

Invocation

Run jobs from GUI, command line, batch script, application program, other ETL tool, and Hadoop

Monitoring

Display in-job event progress in GUI console or command line display

Tuning

Control performance through job, user, and global-level resource configuration files or registry settings

Statistics

Toggle on generation of runtime performance and application stats for console or later file review

Error Messaging

Validate jobs in the syntax aware editor or by running in debug mode. Errors are saved in the error log.

Logging

Store, review, and/or query statistics, performance, and XML audit files to verify activity and compliance