Skip to content

Collector logging formats

Yali Sassoon edited this page May 7, 2013 · 4 revisions

HOME > [SNOWPLOW TECHNICAL DOCUMENTATION](Snowplow technical documentation) > Collectors

Overview

Different Snowplow collectors write Snowplow data to logs of different formats.

Here we document the different formats, and show which collectors generate what. This document should be used by anyone:

  1. Building a new collector, who would like to ensure it logs to a Snowplow supported format.
  2. Building an ETL module, to ensure that the ETL module can successfully read the raw Snowplow logs generated by each collector, and write them to the data structures used by the storage modules.

Logging formats

Logging formats Description Status Collector
Cloudfront logs Amazon's Cloudfront log formats with Amazon Cloudfront filename naming convention Supported (both pre and post Sept 2012 formats) Cloudfront collector
Tomcat access logs Tomcat access logs with Amazon Elastic Beanstalk filename naming convention Supported Clojure collector
Fluentd logs Fluentd logs with the fluent-s3 plugin filename conventions Not currently supported SnowCannon
## The Cloudfront logging format (with Cloudfront naming convention)

TO WRITE

## The Tomcat access log format (with Amazon Elastic Beanstalk filename naming convention)

TO WRITE

## The Fluentd log format (with s3 plugin filename convention)

TO WRITE

Clone this wiki locally