Ubuntu Hadoop Install & Demo

I’m putting together a small Hadoop proof-of-concept on my own laptop and need a specialist to get everything running smoothly on Ubuntu virtual machines. The cluster must include HDFS, YARN and MapReduce, and I’d like it configured in a way that mimics a two-node client/server setup even though both VMs will live on the same physical machine.

Here’s what I expect from you:

• A clean installation of Hadoop on two Ubuntu guests (VirtualBox, VMware, or any other free hypervisor you prefer).
• Proper configuration of HDFS, YARN and MapReduce so that basic administrative commands (start-dfs.sh, start-yarn.sh, etc.) work without manual intervention after reboot.
• A simple demo application that proves the client can submit a MapReduce job to the server and retrieve the results. WordCount or similar is fine as long as I see input go in, computation run, and output come back.
• A concise, step-by-step report (text or PDF) that documents everything you did: VM setup, prerequisite packages, configuration edits, commands executed, and any troubleshooting tricks. I should be able to rebuild the environment from this document alone.
• Either a live walk-through or a screen-recorded video showing the cluster starting up and the demo job completing successfully.

Acceptance criteria
1. Both VMs boot with no errors and Hadoop daemons start automatically.
2. HDFS reports healthy datanodes, and a sample file can be written and read.
3. YARN resource manager shows the demo MapReduce job finishing without failures.
4. The report reproduces all steps clearly and accurately.

If you already have handy shell scripts or Ansible playbooks to automate the install, feel free to use them—just include them in the hand-off package.