Skip to content

This lab demonstrates different ways to enrich data streams in Flink. This is part of the Deep Dive Masterclass of Flink Forward 2024.

License

Notifications You must be signed in to change notification settings

ververica/lab-stream-enrichment

Repository files navigation

Stream Enrichment Lab

This lab demonstrates different ways to enrich data streams in Flink.

You can specify parameters of your Kafka cluster, your MySQL database via the command line parameters. See StreamEnrichmentJobExercise.main() on exactly which command line parameters are supported and their default values. For example, you can specify the following main arguments:

--bootstrap-servers <broker_1:port,broker_2:port,broker_3:port> --kafka-topic <kafka-topic> \
--mysql-host <host> --mysql-port <port> --mysql-db <database> --mysql-user <user> --mysql-pass <pass>

This project is using Gradle. To package your job for submission to Flink, use:

./gradlew clean shadowJar 

Afterward, you'll find the jar to use in the build/libs folder.

Lab Environment Setup

The lab environment has been set up for your training in advance by the trainer. In case you want to set up a similar environment at home, see the instructions here.

Exercises & Solutions

The detailed exercise instructions and solutions will be provided by your trainer during the training.

About

This lab demonstrates different ways to enrich data streams in Flink. This is part of the Deep Dive Masterclass of Flink Forward 2024.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages