Apache Spark - Setup Development Environment

As we understood details related to File Systems and Cluster Types such as YARN, let us get started with Apache Spark. Feel free to visit our earlier sessions as part of this YouTube Playlist - https://www.youtube.com/playlist?list=PLf0swTFhTI8rMmW7GZv1-z4iu_-TAv3bi As part of this session, we will see the details about setting up of development environment on Mac or Linux based environment. * Pre-requisites * Using Virtual Environment on Windows * Setup Spark on Linux or Mac * Validate Spark Here is the link for the material covered as part of the session - https://github.com/dgadiraju/itversity-books/blob/master/Data%20Engineering%20Bootcamp/40%20Big%20Data%20ecosystem%20-%20Overview/04%20Setup%20Development%20Environment.md Here is the complete playlist about Spark for Certifications: https://www.youtube.com/playlist?list=PLf0swTFhTI8rMmW7GZv1-z4iu_-TAv3bi Here is the complete playlist about Free Data Engineering Bootcamp: https://www.youtube.com/playlist?list=PLf0swTFhTI8pBe2Vr2neQV7shh9Rus8rl * Join our Meetup group - https://www.meetup.com/itversityin/ * Enroll for our labs - https://labs.itversity.com/plans * Join this channel to get access to perks: https://www.youtube.com/channel/UCakdSIPsJqiOLqylgoYmwQg/join * Subscribe to our YouTube Channel for Videos - http://youtube.com/itversityin/?sub_confirmation=1 * Access Content via our GitHub - https://github.com/dgadiraju/itversity-books * Lab and Content Support using Slack