Practical work

• Data engineering / distributed systems
• Ecodesign

Tools you need

Have a stackoverflow account : https://stackoverflow.com/

Have a github account : https://github.com/

A Scala IDE :

1. Install the IDE "Intellij Idea": https://www.jetbrains.com/fr-fr/idea/download
2. Fork this repo to have your own copy.
3. Clone your fork on your machine
4. Open Intellij, go to "File" then "Open" and then only select the folder of the current exercice from your fork clone on your computer. Then, on IntelliJ set up the scala SDK and JDK

Beware : For Spark code, we have to use Java 17 (JDK17) or inferior, otherwise you'll have this error :

Extracting Structure Failed

Docker and Compose

Take time to read and install

https://docs.docker.com/get-started/overview/

docker --version
Docker version XX.XX.XX

https://docs.docker.com/compose/

docker-compose --version # Or docker compose --version
docker-compose version X.XX.X

Fork OR update the repo on your own Github account

Fork

• Click on https://github.com/polomarcus/tp/fork

Update your fork

• https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork