Hadoop Development Environment

Back to Blog

Hadoop Development Environment

We always talk about Big Data processing using Hadoop framework. By leveraging distributed cluster computing programming, now a days it is possible to process and analysis huge volume of data probably in exabytes or more than that. Giant cloud providers like Amazon, Microsoft Azure provides hosting as well as development environment with multi-node cluster according to hardware requirements on Pay Per Use model.  They usually charge on hourly basis. But the main concern is, to open an account a valid credit card detail is mandatory and it’s challenging for the students who are inspired to learn and develop proof of concept.  Here is the video to demonstrate how can we use single node cluster for Hadoop/Map-Reducing programming including Eco System.  A virtual machine has been created with Ubuntu (ALinux-based operating system)on Windows and installed Hadoop 2.x on top of it.

Development environment of single node Hadoop cluster where Map/Reduce programming can be practised as well as play around with other components of Eco-System. We can effectively use this virtual machine on top of Windows operating system

Back to Blog