Hadoop运维记录系列(九)
2013-07-22 12:51
302 查看
Linux操作系统针对Hadoop的参数和命令调优。对于Hadoop本身的参数调优,写的已经不少了,操作系统方面的不多,记录一下我用的系统参数。先写一点,想起哪个再往里面加。
一、系统内核参数调优sysctl.conf
二、命令参数调优
本文出自 “实践检验真理” 博客,谢绝转载!
一、系统内核参数调优sysctl.conf
net.ipv4.ip_forward = 0 net.ipv4.conf.default.rp_filter = 1 net.ipv4.conf.default.accept_source_route = 0 kernel.sysrq = 0 kernel.core_uses_pid = 1 net.ipv4.tcp_syncookies = 1 kernel.msgmnb = 65536 kernel.msgmax = 65536 kernel.shmmax = 68719476736 kernel.shmall = 4294967296 net.ipv4.tcp_max_tw_buckets = 60000 net.ipv4.tcp_sack = 1 net.ipv4.tcp_window_scaling = 1 net.ipv4.tcp_rmem = 4096 87380 4194304 net.ipv4.tcp_wmem = 4096 16384 4194304 net.core.wmem_default = 8388608 net.core.rmem_default = 8388608 net.core.rmem_max = 16777216 net.core.wmem_max = 16777216 net.core.netdev_max_backlog = 262144 net.core.somaxconn = 262144 net.ipv4.tcp_max_orphans = 3276800 net.ipv4.tcp_max_syn_backlog = 262144 net.ipv4.tcp_timestamps = 0 net.ipv4.tcp_synack_retries = 1 net.ipv4.tcp_syn_retries = 1 net.ipv4.tcp_tw_recycle = 1 net.ipv4.tcp_tw_reuse = 1 net.ipv4.tcp_mem = 94500000 915000000 927000000 net.ipv4.tcp_fin_timeout = 1 net.ipv4.tcp_keepalive_time = 1200 net.ipv4.tcp_max_syn_backlog = 65536 net.ipv4.tcp_timestamps = 0 net.ipv4.tcp_synack_retries = 2 net.ipv4.tcp_syn_retries = 2 net.ipv4.tcp_tw_recycle = 1 #net.ipv4.tcp_tw_len = 1 net.ipv4.tcp_tw_reuse = 1 #net.ipv4.tcp_fin_timeout = 30 #net.ipv4.tcp_keepalive_time = 120 net.ipv4.ip_local_port_range = 1024 65535
二、命令参数调优
echo 512 > /proc/sys/net/ipv4/neigh/default/gc_thresh1 echo 2048 > /proc/sys/net/ipv4/neigh/default/gc_thresh2 echo 10240 > /proc/sys/net/ipv4/neigh/default/gc_thresh3 ulimit -SHn 65535
本文出自 “实践检验真理” 博客,谢绝转载!
相关文章推荐
- Hadoop运维记录系列(十四)
- Hadoop运维记录系列(三)
- Hadoop运维记录系列(十)
- Hadoop运维记录系列(十八)
- Hadoop运维记录系列(十六)
- Hadoop运维记录系列(十三)
- Hadoop运维记录系列(一)
- Hadoop运维记录系列
- Hadoop运维记录系列(十七)
- Hadoop运维记录系列(五)
- Hadoop运维记录系列(七)
- Hadoop运维记录系列(二)
- Hadoop运维记录系列(二十)
- Hadoop运维记录系列(十五)
- Hadoop运维记录系列(一)
- Hadoop运维记录系列(二十一) 推荐
- Hadoop运维记录系列(二)
- Hadoop运维记录系列(四)
- Hadoop运维记录系列【收集整理】