IRI @ Big Data Bootcamp

Discover, integrate, migrate, manage, and analyze data

Big Data Bootcamp – Tampa, Florida

At the Big Data Bootcamp on December 9th, IRI informed attendees about the developments of its new End-to-End Platform for Big Data Management, Voracity.

 
 
Background on the speakers

Since 1978, IRI, The CoSort Company, has continuously innovated in data processing software, announcing big data handling in 2003. David Friedland, VP and COO, joined the company in 1988 and has focused on the data management product line and company growth. Also present is Don Purnhagen, IRI's CTO and resident data scientist. He has been with the company for approximately 15 years and is the lead developer of Hadoop and other Big Data Initiatives, including IoT and analytical platform integration.

Current Related Work

We have the five core areas of the IRI Big Data Management Platform. Voracity expanded functions. These are: data discovery, integration, migration, governance, and analytics. Furthermore, we specialize in streaming data from web services, IoT devices, and Kafka, as well as the compatibility of Amazon and Azure with sources and destinations. Other recent developments include further data protection initiatives with data classification and master data management, as well as a new firewall that local and cloudDatabases monitors, protects, and verifies.

Top 5 IRI Big Data Use Cases

1. Customer segmentation and promotion based on IP (web) traffic and/or CDR (call) log analysis

2. Integrity of claims in health insurance using our data transformation engine in a data warehouse for fraud detection

3. Masking and Pseudonymizing Protected Health Information (PHI) in NoSQL Documents and RDBMS Tables

4. Generation of comprehensive test sets for Cassandra, MongoDB, Teradata, and HDFS to simulate production conditions

5. Yield Optimization and Fleet Efficiency in Transportation through Migration and Use of Historical and Operational Data

Big Data Bootcamp Presentation
Presentation Takeaways

The participants learned about the breadth and depth of Voracity's scope and related it to their own data management lifecycle. Questions were posed about their big data challenges, including prominent topics such as:

Data Discovery - How to Search, Profile, and Classify Data in Files, Tables, and Documents.

Data Integration - How to quickly extract, transform, and load data between heterogeneous silos or accelerate other ETL tools.

Data migration – how to convert data from one type, file format, database table, or endianness to another.

Data Governance – How to Clean, Mask, and Unify Data, and Manage Metadata.

Data Analysis - How to Report on Transforming or Preparing Data for R, Splunk, and Tableau.