INSTALL SPARK DOCKER ON MAC HOW TO

The linux guides essentially try to upgrade your system to a compatible version (for example upgrading to Ubuntu 16.04). Mac and Windows users can download it from from the Docker website. Installing Docker should be straightforward for Windows and Mac OS users. We recommend you use some sort of version control such as git. Make sure your work is secure at all times. If you delete the mounted directory containing your work it will be deleted from the host system. Your homework notebook is mounted in the directory /home/jovyan/work. When you work within the provided container (interactively or not) you are automatically logged in as a user named jovyan.If you develop within the container you are at risk of losing your work.

Obtained results should be stored locally as well.

INSTALL SPARK DOCKER ON MAC HOW TO

The following guides show you how to do that. We highly recommend you develop your solutions locally and only use docker to compile and run. Docker containers are not intended to store data.We will expect your results to match ours. Make sure you follow the instructions given below. If you are not able to use the provided container, you can install Python and Pyspark on your own.Using the provided Docker container requires installing Docker, 5-6 GB of free space and root access on the host machine (admin rights for windows).

Install spark docker on mac