spark:windows_dev_environment

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revisionBoth sides next revision
spark:windows_dev_environment [2017/11/27 13:32] – created davidspark:windows_dev_environment [2017/11/27 13:35] – [Install/Configure WinUtils] david
Line 13: Line 13:
   * Copy ''winutils.exe'' to: ''C:\APPLICATIONS\hadoop\bin''   * Copy ''winutils.exe'' to: ''C:\APPLICATIONS\hadoop\bin''
  
 +Set paths:
 <code> <code>
 set HADOOP_HOME=c:\APPLICATIONS\hadoop set HADOOP_HOME=c:\APPLICATIONS\hadoop
Line 19: Line 20:
  
 echo %HADOOP_HOME% echo %HADOOP_HOME%
- 
-winutils.exe chmod -R 777 C:\tmp\hive 
- 
 </code> </code>
 **Note:** Path settings should be set in control panel for persistence. **Note:** Path settings should be set in control panel for persistence.
Line 34: Line 32:
     - Paste in: ''C:\APPLICATIONS\hadoop\bin''     - Paste in: ''C:\APPLICATIONS\hadoop\bin''
  
 +Configure & Test:
 +<code>
 +winutils.exe chmod -R 777 C:\tmp\hive
  
 +winutils.exe ls -F C:\tmp\hive
 +</code>
 ====== Install/Configure Spark ====== ====== Install/Configure Spark ======
  
  • spark/windows_dev_environment.txt
  • Last modified: 2021/01/12 21:08
  • by 127.0.0.1