PulsarIO Demo

PulsarIODemo gives an example of the visualization solution for data analyzing.

Pre-Request

Please set up your pipeline following Get-Started

Data Feeding

We have some demo data feed into the pipeline and MetricCalculator does the aggregation and persistent the metrics into Cassandra.

1. In collector application, there is one EventGenerator processor push mocked PulsarRawEvent into pipeline and go through collector->sessionization->distributor->MetricCalculator
   Pause traffic: http://HOST:8002/Event/Processor/EventGenerator/?pause
   Start traffic: http://HOST:8002/Event/Processor/EventGenerator/?start

2. In TwitterSample application, it will listen on the twitter messages and push the data into MetricCalculator directly.

Dashboard

Dashboard url: http://:8088

1. Realtime tab
   In this tab, you will see the past 5 minutes event aggregation count trend and break down list chat and pie chat based on country/browser/OS dimension in real-time mode (10s refresh).
   Demo data is coming from Collector EventGenerator processor and going through collector->sessionization->distributor->MetricCalculator.
   MetricCalculator does the run-time aggregation on several metrics with 10s interval and broadcast the metric data to MertricUI through Jetstream message. And then MertricUI aggregates on the metrics in its Esper again in 10s interval then broadcast the metrics to browser via websocket channel.
   MetricCalculator EPL
   MetricUI EPL

2. Batch tab
   In this tab, you will see the past 24 hours event aggregation count trend and break down list chat and pie chat based on country/browser/OS dimension. Click the country link, it will lead you to the drill down page.
   Demo data is coming from Collector EventGenerator processor and going through collector->sessionization->distributor->MetricCalculator.
   MetricCalculator does the run-time aggregation on several metrics within a longer window(5 min), aggregation result are stored to a metric store and it's Cassandra. MertricUI pulls the metrics from Cassandra through MetricService to draw the graph.
   MetricCalculator EPL

3. Twitter Feed tab
   In this tab, you will see the past 5 minutes event aggregation count trend and break down list chat and pie chat based on country/language/Hashtag dimension in real-time mode (10s refresh).
   Demo data is coming from twitterSample application and push to MetricCalculator directly. MetricCalculator does the run-time aggregation on several metrics with 10s interval and broadcast the metric data to MertricUI through Jetstream message. And then MertricUI aggregates on the metrics in its Esper again in 10s interval then broadcast the metrics to browser via websocket channel.
   MetricCalculator EPL
   MetricUI EPL