Poor performance running Hadoop on RHEL 6.2 or later when transparent hugepage compaction is enabled
2013-03-29 09:24
627 查看
RHEL 6.2 and 6.3 include a feature called "transparent hugepage compaction" which interacts poorly with Hadoop workloads. This can cause a serious performance regression compared to other operating system versions on the same hardware.
Symptom: top and other system monitoring tools show a large percentage of the CPU usage classified as "system CPU". If system CPU usage is 30% or more of the total CPU usage, your system may be experiencing this issue.
Bug: https://bugzilla.redhat.com/show_bug.cgi?id=805593
Severity: Medium (up to 3x performance loss)
Anticipated Resolution: Currently working with Red Hat to resolve for a future RHEL update
Workaround: Add the following command to /etc/rc.local to disable transparent hugepage compaction:
解决方法:
Symptom: top and other system monitoring tools show a large percentage of the CPU usage classified as "system CPU". If system CPU usage is 30% or more of the total CPU usage, your system may be experiencing this issue.
Bug: https://bugzilla.redhat.com/show_bug.cgi?id=805593
Severity: Medium (up to 3x performance loss)
Anticipated Resolution: Currently working with Red Hat to resolve for a future RHEL update
Workaround: Add the following command to /etc/rc.local to disable transparent hugepage compaction:
解决方法:
echo always > /sys/kernel/mm/redhat_transparent_hugepage/enabled
echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
相关文章推荐
- I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
- unbuntu_16.04+Mongodb 启动报错:"/sys/kernel/mm/transparent_hugepage/enabled is 'always'"
- Windows 10 host where Credential Guard or Device Guard is enabled fails when running Workstation (2146361)
- WARNING: /sys/kernel/mm/transparent_hugepage/enabled is
- Mongodb 启动报错:"/sys/kernel/mm/transparent_hugepage/enabled is 'always'"
- FTP not working on Java 7 on Windows 7 and VISTA when Windows Firewall is enabled
- Slow network performance when you open a file that is located in a shared folder on a remote network computer
- "redhat_transparent_hugepage" can hurt Java performance
- Why do people use Hadoop or Spark when there is ElasticSearch?
- hadoop slf4j-api 1.6.x (or later) is incompatible with this binding
- hadoop slf4j-api 1.6.x (or later) is incompatible with this binding
- Unable to start debugging on the web server. The web server is not configured correctly. See help for common configuration errors. Running the web page outside of the debugger may provide further information.
- Determine which guest is running on XEN: HVM or PV guest
- "CURLOPT_FOLLOWLOCATION cannot be activated when safe_mode is enabled or an open_basedir is set" 问题
- JSR 356 WebSocket (Java WebSocket 1.0) support is not available when running on Java 6.
- vs2005下出现“Session state can only be used when enableSessionState is set to true, either in a configuration file or in the Page directive”的解决方法
- Examining Huge Pages or Transparent Huge Pages performance
- JSR 356 WebSocket (Java WebSocket 1.0) support is not available when running on Java 6. To suppress
- Gets or sets whether drilling down to a page/chart/summary is enabled.
- How to troubleshoot slow-running queries on SQL Server 7.0 or on later versions [ZT-from MS]