XML files

Convert, Transform, Mask, Report, Test

Overview
CLF/ELF
CSV
Excel
JSON
LDIF
LS-RS-VS
MF-ISAM
MFVL
Text
Variable blocked
Vision
VSAM
XML
Challenges

Although XML is a popular file exchange format for SOA, databases, and other applications, it has not been a practical format for transferring large amounts of data. Additionally, conversions between legacy index or flat files and XML rely on slower parsing technologies like XSLT and do not allow for simultaneous processing.

Transformations with XQuery can't or only temporarily transform large amounts of XML data into meaningful information in XML (or another format). There was no efficient way to quickly convert, process, protect, or create huge XML files.

For example, it may be necessary:

  • Sorting a huge XML file
  • Extracting data or reports from an XML file
  • Convert a CSV, LDIF, or other file to XML
  • Convert XML to Text, CSV, LDIF, ISAM, etc.
  • Masking, encrypting, or otherwise de-identifying fields in an XML file
  • Linking data in an XML file with another XML or other source
  • Load XML data into a spreadsheet or database
  • Create an XML file from an old or extract file
  • Generating Test Data in XML Format

You may even need to perform more than one of these functions simultaneously, against many massive source and target files.

Solutions

IRI offers XML and other file conversion capabilities in various products. Please select as needed:

Use the free Lite Edition of IRI NextForm, to convert huge, flat XML files* to other formats (like CSV, LDIF, COBOL, Text, etc.) or from these other formats into XML. If your XML files are semi-structured or unstructured, you can use the:

    Assistant for Dark Data Recognition, to use pattern matching to identify the required elements search and structure  „Sonra's Flexter Data Liberator“ Add-on for VoracityNextForm Legacy Edit to display your source files in the Data Source Explorer with an XML driver.

NextForm contains an XML file parser to automatically generate XDEF field layouts used in file conversion scripts. NextForm also supports field-level data type conversion and record layout remapping. NextForm job definitions also work in CoSort. SortCL and Voracity, should you decide to upgrade later!

Use the program SortCL in the IRI Voracity–Platform or in IRI CoSort-Package to convert, transform, mask, report, and create new XML files and other targets that represent structured data.

Declare one or more XML and non-XML files for input and output as part of any SortCL job that includes data:

    Filtering (Selection, Scrub, Links to DQ Tools)
    Transformation (Sorting, Merging, Aggregation, Calculation, etc.)
    Conversion (Data Type and File Format Migrations)
    Reporting (CDC, detailed and summary formats)
    Protection (Field Encryption, De-ID, Masking)

SortCL provides all these functionalities, one or more at a time, to data architects working with XML and other sources to have to work

Use IRI FieldShield or IRI DarkShield, to encrypt, edit, or otherwise de-identify PII in XML files. Both tools share data classes and masking functions, and will be supported in IRI Workbench and included in Voracity.

Use IRI RowGen, to create XML test files. RowGen uses the same layout metadata as CoSort, NextForm and FieldShield, so that you can easily switch between generating test data and transforming real data.

 

XML data elements must conform to a flattened structure, extracting a similarly named element at a specific level. If you have multiple tags with the same name, IRI engines will extract the last occurrence of a specific name. Field names must be unique and encompass a single record without additional dependencies.

Product links

Other resources