Before anything is posted here, you can download virtualbox or VMware & also download Cloudera image for BigData practise on your local.
Then you can deploy that image on your virtualbox or VMWare, and you are ready to do some hands-on for Hadoop/bigdata.
Like as suggested above to have cloudera image & virtualbox in your local machine to start using Hadoop/Spark on fly, but will suggest to use it if you have 8GB RAM & enough diskspace & I am using 2.8GHz QuadCore I7 processor with 16GB RAM. You might be using & exploring Hadoop/Spark like this, but many times we need to share the files between our local machine & VM. So below are the steps which I followed to share the files between my local machine & VM on virtualbox, hope it will help you to work -
Then you can deploy that image on your virtualbox or VMWare, and you are ready to do some hands-on for Hadoop/bigdata.
Like as suggested above to have cloudera image & virtualbox in your local machine to start using Hadoop/Spark on fly, but will suggest to use it if you have 8GB RAM & enough diskspace & I am using 2.8GHz QuadCore I7 processor with 16GB RAM. You might be using & exploring Hadoop/Spark like this, but many times we need to share the files between our local machine & VM. So below are the steps which I followed to share the files between my local machine & VM on virtualbox, hope it will help you to work -
Select 'Insert Guest Additions CD image' and execute the autorun.sh file from the image created on desktop as shown in above image.
Now in windows or host OS, create one folder which will be shared with VM or guest OS.
And give the access to the shared folder to everyone.
Create shared folder from Devices -> Shared Folders. It is the same ‘Devices’ menu option as you selected above. And select the folder which you created in Windows & gave access to everyone.
Make the folder as permanent and auto mount by selecting the options at above window.
Then in guest os, open terminal & execute below command to add the current user to vboxsf group.
sudo usermod -aG vboxsf $(whoami)
Now restart or logout/login the guest OS.
Now you will get & access the shared folder on desktop of guest OS.
So now, you can check using below URLs, if you can access them successfully -
http://localhost:50070/
The default port number to access Hadoop is 50070.
http://localhost:8088/
The default port number to access all applications of cluster is 8088.
Like shown in below image, you can check if the required services are running using - sudo jps
on terminal.
Below are few URLs which I think can be helpful & will keep on adding here as I get-
www.bigdataanalyst.in/spark-advanced-interview-questions/
Now in windows or host OS, create one folder which will be shared with VM or guest OS.
And give the access to the shared folder to everyone.
Create shared folder from Devices -> Shared Folders. It is the same ‘Devices’ menu option as you selected above. And select the folder which you created in Windows & gave access to everyone.
Make the folder as permanent and auto mount by selecting the options at above window.
Then in guest os, open terminal & execute below command to add the current user to vboxsf group.
sudo usermod -aG vboxsf $(whoami)
Now restart or logout/login the guest OS.
Now you will get & access the shared folder on desktop of guest OS.
So now, you can check using below URLs, if you can access them successfully -
http://localhost:50070/
The default port number to access Hadoop is 50070.
http://localhost:8088/
The default port number to access all applications of cluster is 8088.
Like shown in below image, you can check if the required services are running using - sudo jps
on terminal.
Below are few URLs which I think can be helpful & will keep on adding here as I get-
www.bigdataanalyst.in/spark-advanced-interview-questions/
