This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Next revisionBoth sides next revision |
| spark:windows_dev_environment [2017/11/27 13:38] – [Run it] david | spark:windows_dev_environment [2017/11/27 14:53] – david |
|---|
| Inspiration stolen/taken from: [[https://jaceklaskowski.gitbooks.io/mastering-apache-spark/spark-tips-and-tricks-running-spark-windows.html|Running Spark Applications on Windows - Jacek Laskowski]] | Inspiration stolen/taken from: [[https://jaceklaskowski.gitbooks.io/mastering-apache-spark/spark-tips-and-tricks-running-spark-windows.html|Running Spark Applications on Windows - Jacek Laskowski]] |
| |
| | ====== Download ====== |
| Download: | Download: |
| * Spark: [[https://spark.apache.org/downloads.html]] | * Spark: [[https://spark.apache.org/downloads.html]] |
| <code> | <code> |
| cd C:\APPLICATIONS\Spark\spark-2.2.0-bin-hadoop2.7\bin | cd C:\APPLICATIONS\Spark\spark-2.2.0-bin-hadoop2.7\bin |
| C:\APPLICATIONS\Spark\spark-2.2.0-bin-hadoop2.7\bin>spark-shell2.cmd | spark-shell2.cmd |
| </code> | </code> |
| |
| spark.range(1).withColumn("status", lit("All seems fine. Congratulations!")).show(false) | spark.range(1).withColumn("status", lit("All seems fine. Congratulations!")).show(false) |
| </code> | </code> |
| | |
| | exit: |
| | <code> |
| | sys.exit |
| | </code> |
| | |
| | ---- |
| | * Web Interface: [[http://localhost:4040/jobs/]] |
| | * Configuration: [[http://localhost:4040/environment/]] |