This was required in my system since my disk utilization was 95% and the default value for this is 90%. This tells yarn to continue operations when disk utilization is below 98.5. Note the use of disk utilization threshold above. JAVA_HOME, HADOOP_COMMON_HOME, HADOOP_HDFS_HOME, HADOOP_CONF_DIR, CLASSPATH_PREPEND_DISTCACHE, HADOOP_YARN_HOME, HADOOP_MAPRED_HOME Modify various hadoop configuration files to properly setup hadoop and yarn. export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_121.jdk/Contents/Home usr/libexec/java_home /Library/Java/JavaVirtualMachines/jdk1.8.0_121.jdk/Contents/HomeĬopy the output of the command and use it to configure JAVA_HOME variable in etc/hadoop/hadoop-env.sh.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |