Repository files navigation

Withthis image, you will have aHadoop 2.7.1 Single Node container ready for development / testing / debug porpuse.

The first time, will take few minutes downloading the image.

docker run --name hadoop-2.7.1 -it -P angelcervera/docker-hadoop:2.7.1-single

After this, you will be inside of the hadoop docker container terminal.

Basically:

• Hadoop installation folder :/opt/hadoop
• Hadoop tmp folder (data folder) :/var/lib/hadoop
• Hadoop config folder :/opt/hadoop/etc/hadoop

If you want to execute a hadoop example, for example:

/opt/hadoop/bin/hadoop jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar pi 16 100000

Where "username", put your username :)

mkdir /home/username/hadoopdocker run --name my-new-hadoop-2.7.1 \  -v /home/username/hadoop/logs:/opt/hadoop/logs \  -v /home/username/hadoop/shared:/root/shared \  -p 50070:50070 \  -p 50075:50075 \  -p 50060:50060 \  -p 50030:50030 \  -p 19888:19888 \  -p 10033:10033 \  -p 8032:8032 \  -p 8030:8030 \  -p 8088:8088 \  -p 8033:8033 \  -p 8042:8042 \  -p 8188:8188 \  -p 8047:8047 \  -p 8788:8788 \  -it angelcervera/docker-hadoop:2.7.1-single

After this, you will be inside of the hadoop docker container terminal.

Basically:

• Hadoop tmp folder (data folder) is in/var/lib/hadoop
• Hadoop logs folder is in/opt/hadoop/logs but you can access throw your mapped local folder/home/username/hadoop/logs
• Useful folder to share files:/root/shared mapped to your local folder/home/username/hadoop/shared
• There is a big list of ports exposed, so you can map only ports that you are going to use or you can expose all replacing-p local_port:exposed_port by-P You can check the full list of ports in theDockfile

Because the best idea is not to use this image directly and create your own. In my blog, you can read a step by step article about how I implemented this images:Full article!

Enjoy!!!