Skip to content

LagosScala/introduction-scala-spark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

The project contains two application for tweet data analysis on Spark.

Usually for most analysis, there is a source of data, thus for this case, a simple scala application was written to extract tweets given a particular tag.

Beyond getting the data, there is the need to then analyze the data, for this case, we used spark for analysis on the tweet data.

Spark application in a Build, Run and Package approach, this is oftentimes possible when using IDE as that InteliJ. However, in cases you are using Scala Interpreter, where you can then build your scala projects using a notebook, it's uusually good to use an Already deployed cluster environement such as Databricks.

I have added Intelij Idea based Compile and run code in the sparkProject folder. However, to view the project on Databricks, Kindly click on the following link:

https://databricks-prod-cloudfront.cloud.databricks.com/public/4027ec902e239c93eaaa8714f173bcfc/3881084886152354/488187245034858/352067245670700/latest.html

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published