首页 > 其他 > 详细

hadoop内存分配方案

时间:2017-02-16 13:05:33      阅读:142      评论:0      收藏:0      [点我收藏+]

Configuration File

  Configuration Setting Value Calculation        8G VM (4G For MR)   
yarn-site.xml yarn.nodemanager.resource.memory-mb = containers * RAM-per-container 4096
yarn-site.xml yarn.scheduler.minimum-allocation-mb = RAM-per-container 1024
yarn-site.xml yarn.scheduler.maximum-allocation-mb = containers * RAM-per-container 4096
mapred-site.xml mapreduce.map.memory.mb = RAM-per-container 1024
mapred-site.xml         mapreduce.reduce.memory.mb = 2 * RAM-per-container 2048
mapred-site.xml mapreduce.map.java.opts = 0.8 * RAM-per-container 819
mapred-site.xml mapreduce.reduce.java.opts = 0.8 * 2 * RAM-per-container 1638
yarn-site.xml (check) yarn.app.mapreduce.am.resource.mb = 2 * RAM-per-container 2048
yarn-site.xml (check) yarn.app.mapreduce.am.command-opts = 0.8 * 2 * RAM-per-container 1638
tez-site.xml  
tez.am.resource.memory.mb  
= RAM-per-container
1024
tez-site.xml  
tez.am.java.opts  
= 0.8 * RAM-per-container
819
tez-site.xml  
hive.tez.container.size  
= RAM-per-container
1024
tez-site.xml  
hive.tez.java.opts  
= 0.8 * RAM-per-container
819

hadoop内存分配方案

原文:http://www.cnblogs.com/jackchen001/p/6404897.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!