Repository files navigation

Follow the instructions fromGet Docker CE for Ubuntu page.

Follow the instructions fromPost-installation steps for Linux page.

• Go to your terminal.
• Clone this repository and go inside it

   git clone https://github.com/mjaglan/docker-hadoop-pseudo-distributed-mode.git cd docker-hadoop-pseudo-distributed-mode

• Run the following script

   . ./restart-all.sh

Thescripts/hadoop-services.sh is running following commands after starting Hadoop System -

• Java Virtual Machine Process Status Tool (jps)

  <pid>   <process name> 266    org.apache.hadoop.hdfs.server.datanode.DataNode 142    org.apache.hadoop.hdfs.server.namenode.NameNode 428    org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode 678    org.apache.hadoop.yarn.server.nodemanager.NodeManager 579    org.apache.hadoop.yarn.server.resourcemanager.ResourceManager

• Basic Hadoop filesystem information and statistics

    Configured Capacity: 37912903680 (35.31 GB) Present Capacity: 8332066816 (7.76 GB) DFS Remaining: 8332042240 (7.76 GB) DFS Used: 24576 (24 KB) DFS Used%: 0.00% Under replicated blocks: 0 Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks (with replication factor 1): 0  ------------------------------------------------- Live datanodes (1):  ...

• Hadoop Terasort Benchmark Test

• (Optional) Hadoop NNBENCH Test

• (Optional) Hadoop MRBENCH Test

• NameNode can be accessed on browser athttp://CONTAINER-IP:8088/

• Resource Manager can be accessed on browser athttp://CONTAINER-IP:50070/

• Secondary can be accessed on browser athttp://CONTAINER-IP:50090/

Docker version 17.06.0-ceUbuntu Trusty 14.04 Host OSEclipse IDE for Java EE Developers Oxygen (4.7.0)Eclipse Docker Tooling 3.1.0

• Apache Hadoop 2.7.3 docs
• core-default.xml
• hdfs-default.xml
• mapred-default.xml
• yarn-default.xml
• DeprecatedProperties.html