

Now, let’s unzip either using Winzip, 7-Zip, or any other zip extracts you have. You can either download the windows installer(.exe) or as a compressed zip (.zip) file based on your convenience.IntelliJ IDEA comes with a community & ultimate edition, In order to run the Spark application written in Scala, the community edition is just enough for us, so download IntelliJ IDEA community edition. Most of the Spark engineers use IntelliJ IDEA to run Spark applications written in Scala due to its good Scala compatibility hence, It’s better to have a development environment setup using IntelliJ. You might be aware that Spark was created in Scala language and Scala is a JVM language that needs JVM to run hence, to compile & execute Spark applications you need to have Java installed on your system.ĭownload and Install Java 8 or above from 2.

Spark with Python (PySpark) Tutorial For Beginners 1.
