Skip to content

Latest commit

 

History

History
70 lines (44 loc) · 2.23 KB

README.md

File metadata and controls

70 lines (44 loc) · 2.23 KB
Raw

Elasticsearch Example

ELK stack VM with Vagrant and Puppet including the Movies100k rating dataset by Movielens.

Prerequisites

You need the following tools:

  • Ruby 2.x
  • Vagrant 1.8.6
  • VirtualBox 5.1.6
  • bundler

Setup

The VM is set up to install the following tools / frameworks.

  • Elasticsearch 2.3.0 with plugin kopf
  • Logstash 2.3
  • Kibana 4.5.0

Set up the box from inside the vagrant folder, this requires a recent Ruby. First all gems are installed, then all puppet modules and finally the box is provisioned.

The Vagrant setup also requires a few plugins, landrush and vbguest (only when using VirtualBox provider).

$ vagrant plugin install landrush
$ vagrant plugin install vagrant-vbguest  # only with Virtualbox

To install all gems and set up Puppet run:

$ cd vagrant
$ bundle install
$ librarian-puppet install
$ vagrant up --provider virtualbox

After provisioning succeeds log into the box

$ vagrant ssh

Kopf

The kopf plugin offers a web interface to the Elasticsearch cluster and is available at http://elastic.dev:9200/_plugin/kopf/ and via the IP of the VM, http://172.17.1.22:9200/_plugin/kopf/. The former URL is available via the landrush vagrant plugin.

Kibana

Kibana is installed into the folder /usr/share/kibana/kibana-4.5.0-linux-x64/. It should run already and is available at url http://localhost:5601 inside the VM. To access Kibana from the host access http://172.17.1.22:5601.

Marvel

To install Marvel follow the steps in the Get Started Guide.

Movielens data set

There is a gem that can be used to install a data set, the Movielens data set by Grouplens that offers data from their movie recommendation service. For more information on how to install and use this data set check this Readme!.