SQLBits 2023 - Wales

This repo is for the attendees at the SQLBits 2023 PreCon: Azure Data Integration Bootcamp in Newport, Wales

Sources

We are going to use the follwoing sources:

https://www.kaggle.com/code/fahd09/eda-of-crime-in-chicago-2005-2016/data and for your conveinience (of you not already have an account at Kaggle) I have placed a copy of the files here in this repo.

https://data.cityofchicago.org/Facilities-Geographic-Boundaries/Chicago-Zip-Code-and-Neighborhood-Map/mapn-ahfc

Demo

Create Resource Group (< 10 min)

Create Resource Group

Create Azure Synapse Analytics (<15 min)

Create Azure Synapse Analytics

Create you first Serverless Pool Table

Create Serverless Pool

Create you first Azure Data Factory ( < 5 min )

Create Azure Data Factory

Create your first Data Flow ( < 10 min ) (Enriched)

Create your first data flow

Create your first pipeline

Create your first pipeline

Create a sample Power BI report

Create your first Power BI report

Create a data flow to curate the data

Create Data Flow for curated data

Create your curated pipeline

Create Pipeline for curated data flow

Create Power BI for curated data

Create Power BI report for curated

Connect Azure Synapse Analytics to Power BI

Connect To Power BI

Create a Power BI report in Synapse Studio

Create Report

Play with read partitions if time permits

Configure read partitioning strategi

Play with write partitions if time permits

Configure write partitioning strategi

Enhance data from other sources (Excercise)

Link pipelines (Excercise)

Dive into