viyadb-spark-wikimedia

Example of using ViyaDB Spark processing backend based on Wikimedia updates stream coming through IRC channel.

Running the Example

Prerequisites

• Consul

Building

mvn package

Running

First, create needed keys in Consul by running:

(cd consul/ ; ./create-conf.sh)

Then, run the Spark streaming application:

spark-submit --class com.github.viyadb.spark.samples.wikimedia.Job \
    target/viyadb-spark-wikimedia_2.11-0.0.2.jar --indexer-id wikimedia