User Tools

Site Tools


building_a_cluster

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

building_a_cluster [2017/11/28 15:58] (current)
david created
Line 1: Line 1:
 +Temptation is a strange thing.
  
 +For learning how to develop on a platform, all one needs is Docker (or a stand alone VM). Just get docker, and then download the latest [[https://github.com/bigdatafoundation/docker-hadoop|Hadoop Docker Image]]. More notes from [[https://www.quora.com/I-want-to-build-Hadoop-Cluster-at-home-for-learning-purpose-Is-there-any-cheap-way-to-build-one-Should-I-look-at-new-or-old-Dell-servers|here]].
 +
 +Failing that (I'm the person who got a VPS for a blog and wiki):
 +  * Virtual Server: Digital Ocean: About £60 a month per host.
 +    * [[https://www.digitalocean.com/community/tutorials/an-introduction-to-hadoop|An Introduction to Hadoop]]
 +    * [[https://www.digitalocean.com/community/tutorials/how-to-install-hadoop-in-stand-alone-mode-on-ubuntu-16-04|How to Install Hadoop in Stand-Alone Mode on Ubuntu 16.04]]
 +  * Using AWS:
 +    * [[http://gethue.com/hadoop-tutorial-how-to-create-a-real-hadoop-cluster-in-10-minutes/|How to create a real Hadoop cluster in 10 minutes?]]
 +  * Cheap PCs:
 +    * eBuyer, £210 for 8GB RAM: [[https://www.ebuyer.com/store/Computer/cat/Desktop-PC?456=8GB&sort=price+ascending]]
 +    * Build your own custom, £250 each machine: [[http://www.oneillscrossing.com/home-built-hadoop-analytics-cluster/#Hardware_310_per_node|home built hadoop analytics cluster]]
 +
 +Not a heavy lifting in any way:
 +  * [[https://medium.com/@jasonicarter/how-to-hadoop-at-home-with-raspberry-pi-part-1-3b71f1b8ac4e|How to Hadoop at home with Raspberry Pi — Part 1]]
building_a_cluster.txt · Last modified: 2017/11/28 15:58 by david