This shows you the differences between two versions of the page.

Link to this comparison view

building_a_cluster [2017/11/28 15:58] (current)
david created
Line 1: Line 1:
 +Temptation is a strange thing.
 +For learning how to develop on a platform, all one needs is Docker (or a stand alone VM). Just get docker, and then download the latest [[https://​github.com/​bigdatafoundation/​docker-hadoop|Hadoop Docker Image]]. More notes from [[https://​www.quora.com/​I-want-to-build-Hadoop-Cluster-at-home-for-learning-purpose-Is-there-any-cheap-way-to-build-one-Should-I-look-at-new-or-old-Dell-servers|here]].
 +Failing that (I'm the person who got a VPS for a blog and wiki):
 +  * Virtual Server: Digital Ocean: About £60 a month per host.
 +    * [[https://​www.digitalocean.com/​community/​tutorials/​an-introduction-to-hadoop|An Introduction to Hadoop]]
 +    * [[https://​www.digitalocean.com/​community/​tutorials/​how-to-install-hadoop-in-stand-alone-mode-on-ubuntu-16-04|How to Install Hadoop in Stand-Alone Mode on Ubuntu 16.04]]
 +  * Using AWS:
 +    * [[http://​gethue.com/​hadoop-tutorial-how-to-create-a-real-hadoop-cluster-in-10-minutes/​|How to create a real Hadoop cluster in 10 minutes?]]
 +  * Cheap PCs:
 +    * eBuyer, £210 for 8GB RAM: [[https://​www.ebuyer.com/​store/​Computer/​cat/​Desktop-PC?​456=8GB&​sort=price+ascending]]
 +    * Build your own custom, £250 each machine: [[http://​www.oneillscrossing.com/​home-built-hadoop-analytics-cluster/#​Hardware_310_per_node|home built hadoop analytics cluster]]
 +Not a heavy lifting in any way:
 +  * [[https://​medium.com/​@jasonicarter/​how-to-hadoop-at-home-with-raspberry-pi-part-1-3b71f1b8ac4e|How to Hadoop at home with Raspberry Pi — Part 1]]