Data profiling to properly protect sensitive data
Through its graphical IRI Workbench-An Eclipse-based frontend, IRI FieldShield® supports the definition, detection, and de-identification of personally identifiable information (PII) across multiple Data sources simultaneously.
FieldShield's data classification and profiling tools, custom pattern, value, and fuzzy matching search, and metadata, structure, and relationship discovery tools all work together to support your ability to categorize, identify, and mask data to support your data privacy compliance initiatives.
Data classification
Define enterprise-wide data class libraries, automatically scan your sources to catalog the data within, and then apply transformation and protection rules that you've mapped to your classes.
Metadata Discovery
Connect to structured and semi-structured files and relational databases. Redefine or redefine column names, offsets, and data types, so you can centralize metadata for your data sources in data definition filesDDFssave, share, and reuse, compatible with any IRI software application.
Database profiling
Create statistics, check referential integrity, and search for lookup, string, pattern, and fuzzy matching values in each JDBC-connected data source.
Flat-File Profiling
Create statistics and search for lookup, string, pattern, and fuzzy matching values in each sequential File format, which the IRI supports.
ER Diagram Creation
Define enterprise-wide data class libraries, automatically scan your sources, catalog the data they contain, and apply transformation and protection rules mapped to your classes.
Directory data class search
The Directory Data Class Search Assistant in the IRI Workbench (WB) matches data in structured files within one or more directories against configured data classes. The search process compares the matches in the data classes with the data in these files to determine the best match, if any. The matches can be either patterns or fixed file searches. If only a few, select structured files need to be searched, use the Data Class Library Editor for faster results.
Schema search
Create statistics and search for lookup, string, pattern, and fuzzy matching values in each sequential File format, supported by the IRI. On this way Can you also provide these results with data classes? link.
Discovery of Dark Data
Find data that matches patterns or values in search files, within MS Office files, PDF documents, NoSQL DB collections, JSON, XML or other text files (log files), and images „hidden“ on your computer or LAN. Extract this dark data and associated metadata into flat, queryable DDF-Files. Mask this data simultaneously with IRI DarkShield.
Schema Data Class Search
Find and use all data schemas that correspond to the attributes of your data classes or data class groups. Automatically scan through each column in the schema, rather than through a table at once. Use this in conjunction with the wizard for the Masking of the DB data class.
There is also an assistant for Directory data class search and the corresponding Masking Data Class Files), to find and de-identify PII in one or more flat files distributed over a LAN.
Data Quality Assessment
Use pattern definition and calculation validation scripts to localize and verify the formats and values of data you define in data classes or groups (catalogs) for the purposes of discovery and function rule assignment (e.g., for Voracity cleansing, transformation, or masking jobs). You can also „if-then-else logic“ on the field level and use „iscompare“ functions of SortCL to isolate null values and incorrect data formats in DB tables and flat files. Or use outer joins to compare source values, that do not match master (reference) data records, to store in silos. Use data formatting templates and your date validation functions to for example, the correctness of input days and dates.
Alternatively, you can also send DarkShield log data directly to:
1. A SIEM/SOC tool (see Splunk ES example below) for custom display or alert requirements.
2. Custom 2D reports from data with the CoSort SortCL program in Voracity; DarkShield creates metadata for SortCL use in log querying and reporting.
3. Another cloud dashboard or KNIME—both within the same Eclipse user interface—for BI or analytics needs.
