oracle真实案例之oem大量占用cpu与内存问题的解决方法
2012-06-28 11:36
766 查看
一、介绍
由于dba离职,所以公司所有的oracle数据库服务器我先兼职管理,今天登陆某省的数据库,发现ssh登陆30秒左右才进入,之后查看了一下负载与内存,具体情况如下图: 负载: 没有见过这样高的负载,以前见过最多的就是负责1000多,java的问题 内存: 连交换内存都使用完了,物理内存就剩下71m了,太危险了 top: 发现了6个僵尸进程与大量的perl进行 现在查看一下僵尸进程 发现都是[sh] <defunct>进程,以前遇到过这样的问题,都是由于cron里启动脚本的时候,没有加入错误输入到空设备里导致,解决方法是在cron里运行脚本后,添加>>/dev/null 2>&1,查看一下cron,查看是否与我的想法一致 果然是没有错误的输出,添加完>>/dev/null 2>&1在重启cron服务器就解决了 在查看perl进程 发现2726个进程,占用了大量的cpu与内存 去metalink里查看,发现这个问题是oem的故障导致,oracle给的问题的描述与解决方法为:- Server Has 100% Of Cpu Because Of Dbresp.pl [ID 764140.1]
- ________________________________________
- Modified:07-Feb-2012 Type:PROBLEM Status:MODERATED Priority:3
- Comments (0)
- To Bottom
- In this Document
- Symptoms
- Cause
- Solution
- References
- ________________________________________
- This document is being delivered to you via Oracle Support's Rapid Visibility (RaV) process and therefore has not been subject to an independent technical review.
- Applies to:
- Enterprise Manager Base Platform - Version: 10.2.0.1 and later [Release: 10.2 and later ]
- Information in this document applies to any platform.
- ***Checked for relevance on 07-Feb-2012***
- Symptoms
- Server has 100% of CPU because of dbresp.pl . There are more than 50 process from this script
- emagent.trc shows:
- 2009-01-21 10:19:50 Thread-4099931040 WARN engine: Missing Properties : [limitSwitch]
- 2009-01-21 10:19:50 Thread-4099931040 ERROR engine: [oracle_database,orcl, alertLog] : nmeegd_GetMetricData failed : Missing Properties : [limitSwitch]
- 2009-01-22 06:54:33 Thread-4105165728 ERROR fetchlets.oslinetok: Metric execution timed out in 600 seconds
- 2009-01-22 06:54:33 Thread-4105165728 ERROR command: failed to kill process 4793 running perl: (errno=3: No such process)
- 2009-01-22 06:54:33 Thread-4105165728 ERROR engine: [oracle_database,orlc, Response] : nmeegd_GetMetricData failed : Metric execution timed out in 600 seconds
- Cause
- The Response metric is making a timed out then the Agent starts other process to take the Response metric. The process to kill the PID taking the Response metric is failing increasing the process running dbresp.pl
- Before the Response metric starts to do the timed out there is other error:
- 2009-01-21 10:19:50 Thread-4099931040 WARN engine: Missing Properties : [limitSwitch]
- 2009-01-21 10:19:50 Thread-4099931040 ERROR engine: [oracle_database,orcl,alertLog] :
- nmeegd_GetMetricData failed : Missing Properties : [limitSwitch]
- Solution
- 1. Stop DBConsole
- emctl stop dbconsole
- 2. Kill any running process.
- ps -ef | grep /opt/app/oracle/<hostname>_<sid>
- Kill any returned process.
- 3. Follow fix
- Note.361612.1 Ext/Mod Problem Performance Agent High CPU Consumption Gen
- 4. Start DB Console
- emctl start dbconsole
- oracleserver:~ # cat /etc/SuSE
- SuSE-release SuSEconfig/
- oracleserver:~ # cat /etc/SuSE-release
- SUSE Linux Enterprise Server 10 (x86_64)
- VERSION = 10
- PATCHLEVEL = 3
- SQL> select * from v$version;
- BANNER
- ----------------------------------------------------------------
- Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - 64bi
- PL/SQL Release 10.2.0.1.0 - Production
- CORE 10.2.0.1.0 Production
- TNS for Linux: Version 10.2.0.1.0 - Production
- NLSRTL Version 10.2.0.1.0 - Production
- oracleserver:~ # su - oracle
- oracle@oracleserver:~> id
- uid=1000(oracle) gid=1000(oinstall) groups=1000(oinstall),1001(dba)
- oracle@oracleserver:~> emctl stop dbconsole
- TZ set to Asia/Shanghai
- Oracle Enterprise Manager 10g Database Control Release 10.2.0.1.0
- Copyright (c) 1996, 2005 Oracle Corporation. All rights reserved.
- http://oracleserver.site:1158/em/console/aboutApplication
- Stopping Oracle Enterprise Manager 10g Database Control ...
- ... Stopped.
相关文章推荐
- oracle真实案例之oem大量占用cpu与内存问题的解决方法
- w3wp.exe占用CPU和内存问题过高的解决方法
- 黄聪:MYSQL使服务器内存CPU占用过高问题的分析及解决方法
- IIS中死循环的解决方法 dllhost占用大量内存,cpu占用100%
- Windows Server 2003中的w3wp.exe进程大量占用cpu资源的各种问题解决方法
- (转)Windows Server 2003中的w3wp.exe进程大量占用cpu资源的各种问题解决方法
- doscan.exe进程占用了大量的CPU和内存的解决方法
- 关于RUNDLL32.exe占用大量CPU的问题以及解决方法
- win2003中的w3wp.exe进程大量占用cpu资源的各种问题解决方法
- cisvc.exe进程占用大量内存和CPU的解决方法
- OEM大量占用cpu解决方法
- Oracle DBMS占用大量内存的解决方法
- 【转】解决Firefox占用CPU、内存资源大的问题
- 解决 w3wp.exe 占用内存和 CPU 的问题(2003 系统)
- 解决WordPress被利用xmlrpc.php导致VPS CPU内存占用过高问题
- 解决并分析mysqld-nt.exe大量占用CPU问题
- Oracle诊断案例----如何捕获问题SQL解决过度CPU消耗问题
- win7开机后svchost..exe占用CPU和内存很高的解决方法
- 解决IIS占用CPU和内存大的问题
- Oracle诊断案例----如何捕获问题SQL解决过度CPU消耗问题