Snowflake - JET-Software

Snowflake ETL and PII masking

Fast, cost-effective data mapping & management

Challenges

You may be experiencing one or more of these time-consuming issues when working with Snowflake:

- Data search, profiling and/or classification

- Integration or data wrangling for DW/BI ops

- Data movement/migration to/from tables

- Transforming or loading large tables

- Change data capture or replication

- Clustering or performance query

- Generation of intelligent and secure test data

- Masking sensitive data

Specific performance diagnostics and tuning also take time and can affect other users. Finally, stored SQL procedures can also be programmed inefficiently and require optimization and then still take too long.

Solutions

With IRI CoSort you can presort flat files for bulk loads and inserts and bypass slower in-database transformations such as sorting, joining and filtering by using the external data processing program CoSort SortCL for Snowflake data. This removes the overhead of this work from Snowflake when it is required and improves the performance of clustering and frequently performed queries.

IRI Voracity leverages CoSort's multi-threaded, memory-optimized and task-consolidating performance to perform ETL operations and act as a production analytics platform to simultaneously prepare, package (and even report on) data. For more information, visit the Tabs here.

IRI NextForm Database Edition to capture, remap, format, and create/populate new tables during migration to and from Snowflake. You can also use NextForm or the SortCL program in CoSort to remap and convert data in Snowflake, Customized reports, Copies and Federated views of data.

IRI FieldShield for classifying, finding and masking structured data (or IRI DarkShield for semi/unstructured data) in Snowflake columns, such as personally identifiable information (PII) or protected health information (PHI). Apply redaction, encryption, pseduonymization, blurring, and other De-identification functions to comply with data protection laws such as HIPAA, PCI DSS, FERPA and GDPR and to support DevOps. For structured data, find out here, how to connect to Snowflake, and here, how to mask and map data in Snowflake.

IRI RowGen, to quickly populate Snowflake operations with safe test data. RowGen uses relational data models to automatically populate realistic test data for an entire database or DataVault 2.0 models with referential (or business key) integrity. IRI RowGen, FieldShield and subsetting operations are also closely integrated with the ValueLabs Test Data Hub for the Test data management (TDM) has been integrated into Snowflake.