Clickstream analyses
Log File (Data Webhouse) Staging and Reporting
Challenges
Data webhousing, or clickstream data warehousing (CDW), is a specialized practice used for website traffic reports, clickstream pattern analysis, customer segmentation, and business decisions.
You may also need good information to improve your website's navigation, page content, referral sources, banner ads, product offerings, and overall effectiveness. However, because the size of log files can be so large, such analyses can be slow or even impossible.
You may need a specialized data reduction, integration, manipulation, and reporting tool for web visitor log files. And since some of the data in these logs is sensitive or confidential, you may need to mask certain fields.
Solutions
A CDW supports basic decision making around web traffic by parsing, cleaning, reformatting, and loading data based on visitor data log files. The program Sort Control Language (SortCLin the IRI Voracity platform or the IRI CoSort Product can quickly process multiple log file formats with its simple 4GL, supported by Eclipse.
Use it to:
- Transform, reformat, and report on log files
- Applying selection logic to filter and segment data
- Masking URLs, IPs, and other fields or substrings
- Replicate, Link, and Multicast Datasets
Compare files and silo changes, create custom summary reports, combine associated transaction data from other sources, and simultaneously send the results to multiple destinations in multiple formats.
Support and accelerate regular CDW updates immediately after unboxing, at a fraction of the time and cost of complex data integration (ETL) and BI tools. Powerful data transformation algorithms and hardware optimization techniques optimize the efficiency of these operations in the file system (or in Voracity, optionally via Hadoop), without impacting online web or database operations.
Within the same product, order scripts, and I/O passes, you can facilitate the analysis and presentation of clickstream data:
- Metadata and processing support for C/ELF log files
- Support for IP addresses and timestamp data types
- Embedded Reports (via embedded HTML tags)
- Reduced and reformatted data for dashboards
- Simultaneous feeds for DB, BI, and analytics platforms
So, if you need to integrate, transform, and/or analyze large amounts of weblog data, turn to IRI Voracity or CoSort…. proven, well-supported weblog movement and manipulation software you can tailor to your business needs and optimize in any environment.