Meltano Demo

Overview

Meltano is an open source self-managed data integration platform. This repo uses Meltano to load data from a local CSV file into a PostgreSQL database. This repo was created by following this tutorial and using a different extractor.

Repo Plugins

• Extractor: CSV
• Loader: PostgreSQL

Prerequisites

• Python3
• PostgreSQL
• Install Meltano

Setup

Create a python virtual environment for installing packages and activate it

python -m venv </path/to/new/virtual/environment>

source env/bin/activate

Run the pipeline

meltano run tap-csv target-postgres

Check the database for your data

psql -d demo -U meltano

Meltano will create schema with the name of the data source and a table with the entity name

select count(*) from tap_csv.buildings;