Differences
This shows you the differences between two versions of the page.
Next revision | Previous revision Next revisionBoth sides next revision | ||
spark:windows_dev_environment [2017/11/27 13:32] – created david | spark:windows_dev_environment [2017/11/27 13:43] – david | ||
---|---|---|---|
Line 13: | Line 13: | ||
* Copy '' | * Copy '' | ||
+ | Set paths: | ||
< | < | ||
set HADOOP_HOME=c: | set HADOOP_HOME=c: | ||
Line 19: | Line 20: | ||
echo %HADOOP_HOME% | echo %HADOOP_HOME% | ||
- | |||
- | winutils.exe chmod -R 777 C:\tmp\hive | ||
- | |||
</ | </ | ||
**Note:** Path settings should be set in control panel for persistence. | **Note:** Path settings should be set in control panel for persistence. | ||
Line 34: | Line 32: | ||
- Paste in: '' | - Paste in: '' | ||
+ | Configure & Test: | ||
+ | < | ||
+ | winutils.exe chmod -R 777 C:\tmp\hive | ||
+ | winutils.exe ls -F C:\tmp\hive | ||
+ | </ | ||
====== Install/ | ====== Install/ | ||
Line 42: | Line 45: | ||
===== Run it ===== | ===== Run it ===== | ||
< | < | ||
+ | cd C: | ||
C: | C: | ||
+ | </ | ||
+ | |||
+ | Output: | ||
+ | < | ||
Using Spark' | Using Spark' | ||
Setting default log level to " | Setting default log level to " | ||
Line 65: | Line 73: | ||
Type :help for more information. | Type :help for more information. | ||
</ | </ | ||
+ | |||
+ | Test command: | ||
+ | < | ||
+ | spark.range(1).withColumn(" | ||
+ | </ | ||
+ | |||
+ | ---- | ||
+ | * Web Interface: [[http:// |