spark:windows_dev_environment

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revisionBoth sides next revision
spark:windows_dev_environment [2017/11/27 13:35] – [Install/Configure WinUtils] davidspark:windows_dev_environment [2017/11/27 13:38] – [Run it] david
Line 45: Line 45:
 ===== Run it ===== ===== Run it =====
 <code> <code>
 +cd C:\APPLICATIONS\Spark\spark-2.2.0-bin-hadoop2.7\bin
 C:\APPLICATIONS\Spark\spark-2.2.0-bin-hadoop2.7\bin>spark-shell2.cmd C:\APPLICATIONS\Spark\spark-2.2.0-bin-hadoop2.7\bin>spark-shell2.cmd
 +</code>
 +
 +Output:
 +<code>
 Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
 Setting default log level to "WARN". Setting default log level to "WARN".
Line 67: Line 72:
 Type in expressions to have them evaluated. Type in expressions to have them evaluated.
 Type :help for more information. Type :help for more information.
 +</code>
 +
 +Test command:
 +<code>
 +spark.range(1).withColumn("status", lit("All seems fine. Congratulations!")).show(false)
 </code> </code>
  • spark/windows_dev_environment.txt
  • Last modified: 2021/01/12 21:08
  • by 127.0.0.1