building_a_cluster

no way to compare when less than two revisions

Differences

This shows you the differences between two versions of the page.


Last revision
building_a_cluster [2017/11/28 15:58] – created david
Line 1: Line 1:
 +Temptation is a strange thing.
  
 +For learning how to develop on a platform, all one needs is Docker (or a stand alone VM). Just get docker, and then download the latest [[https://github.com/bigdatafoundation/docker-hadoop|Hadoop Docker Image]]. More notes from [[https://www.quora.com/I-want-to-build-Hadoop-Cluster-at-home-for-learning-purpose-Is-there-any-cheap-way-to-build-one-Should-I-look-at-new-or-old-Dell-servers|here]].
 +
 +Failing that (I'm the person who got a VPS for a blog and wiki):
 +  * Virtual Server: Digital Ocean: About £60 a month per host.
 +    * [[https://www.digitalocean.com/community/tutorials/an-introduction-to-hadoop|An Introduction to Hadoop]]
 +    * [[https://www.digitalocean.com/community/tutorials/how-to-install-hadoop-in-stand-alone-mode-on-ubuntu-16-04|How to Install Hadoop in Stand-Alone Mode on Ubuntu 16.04]]
 +  * Using AWS:
 +    * [[http://gethue.com/hadoop-tutorial-how-to-create-a-real-hadoop-cluster-in-10-minutes/|How to create a real Hadoop cluster in 10 minutes?]]
 +  * Cheap PCs:
 +    * eBuyer, £210 for 8GB RAM: [[https://www.ebuyer.com/store/Computer/cat/Desktop-PC?456=8GB&sort=price+ascending]]
 +    * Build your own custom, £250 each machine: [[http://www.oneillscrossing.com/home-built-hadoop-analytics-cluster/#Hardware_310_per_node|home built hadoop analytics cluster]]
 +
 +Not a heavy lifting in any way:
 +  * [[https://medium.com/@jasonicarter/how-to-hadoop-at-home-with-raspberry-pi-part-1-3b71f1b8ac4e|How to Hadoop at home with Raspberry Pi — Part 1]]
  • building_a_cluster.txt
  • Last modified: 2021/01/12 21:08
  • by 127.0.0.1