Zombie Hazard!
Hi all, I recently got a new server but some how it's having problem starting from yesterday.There are a lot of zombie processes and keep increasing. It was once more than 5000 before the kernel was upgraded and rebooted. However after the server reboot the same problem happened again.
Other than that, process "init" is taking 100% of CPU and causing high load.
Server specs is as below:
Dual Xeon 2.80 w/ HT
2GB RAM
CentOS 3.3 (kernel v2.4.29)
cPanel
Here is the copy of "top"
05:19:46 up 54 min, 3 users, load average: 1.09, 1.08, 1.03
414 processes: 98 sleeping, 2 running, 314 zombie, 0 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 12.8% 0.0% 94.4% 0.0% 0.0% 0.0% 292.4%
cpu00 11.9% 0.0% 87.1% 0.0% 0.0% 0.0% 0.9%
cpu01 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 100.0%
cpu02 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 100.0%
cpu03 0.9% 0.0% 7.3% 0.0% 0.0% 0.0% 91.7%
Mem: 2069208k av, 411020k used, 1658188k free, 0k shrd, 47784k buff
115096k active, 82908k inactive
Swap: 2048276k av, 0k used, 2048276k free 150100k cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
1 root 15 0 8692 8692 452 R 100.5 0.4 53:11 0 init
4789 root 14 0 1472 1472 912 R 7.3 0.0 0:03 3 top
2 root 9 0 0 0 0 SW 0.0 0.0 0:00 2 keventd
3 root 18 19 0 0 0 SWN 0.0 0.0 0:00 0 ksoftirqd_CPU0
4 root 18 19 0 0 0 SWN 0.0 0.0 0:00 1 ksoftirqd_CPU1
5 root 19 19 0 0 0 SWN 0.0 0.0 0:00 2 ksoftirqd_CPU2
6 root 18 19 0 0 0 SWN 0.0 0.0 0:00 3 ksoftirqd_CPU3
7 root 9 0 0 0 0 SW 0.0 0.0 0:00 2 kswapd
8 root 9 0 0 0 0 SW 0.0 0.0 0:00 0 bdflush
9 root 9 0 0 0 0 SW 0.0 0.0 0:00 1 kupdated
10 root 9 0 0 0 0 SW 0.0 0.0 0:01 1 kjournald
519 root 9 0 0 0 0 SW 0.0 0.0 0:00 0 kjournald
520 root 9 0 0 0 0 SW 0.0 0.0 0:00 2 kjournald
949 root 9 0 572 572 492 S 0.0 0.0 0:00 0 syslogd
953 root 9 0 472 472 408 S 0.0 0.0 0:00 0 klogd
963 root 9 0 440 440 384 S 0.0 0.0 0:00 1 irqbalance
992 root 9 0 404 404 348 S 0.0 0.0 0:00 3 mdadm
1056 nobody 9 0 2128 2128 1944 S 0.0 0.1 0:00 0 proftpd
1069 root 9 0 1912 1912 1420 S 0.0 0.0 0:00 2 cupsd
1128 root 8 0 1572 1572 1432 S 0.0 0.0 0:00 3 sshd
1142 root 9 0 836 836 724 S 0.0 0.0 0:00 3 xinetd
1160 root 8 0 2712 2712 1428 S 0.0 0.1 0:00 1 chkservd
1220 mailnull 8 0 1908 1908 1568 S 0.0 0.0 0:00 0 exim
1225 mailnull 9 0 1896 1896 1560 S 0.0 0.0 0:00 0 exim
1229 mailnull 9 0 1872 1872 1536 S 0.0 0.0 0:00 0 exim
1234 root 9 0 1424 1424 1148 S 0.0 0.0 0:00 1 antirelayd
1249 root 9 0 2180 2180 1884 S 0.0 0.1 0:01 3 sshd
1259 root 9 0 1356 1356 1132 S 0.0 0.0 0:00 0 bash
1309 root 9 0 1428 1428 896 S 0.0 0.0 0:43 2 top
414 processes: 98 sleeping, 2 running, 314 zombie, 0 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 12.8% 0.0% 94.4% 0.0% 0.0% 0.0% 292.4%
cpu00 11.9% 0.0% 87.1% 0.0% 0.0% 0.0% 0.9%
cpu01 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 100.0%
cpu02 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 100.0%
cpu03 0.9% 0.0% 7.3% 0.0% 0.0% 0.0% 91.7%
Mem: 2069208k av, 411020k used, 1658188k free, 0k shrd, 47784k buff
115096k active, 82908k inactive
Swap: 2048276k av, 0k used, 2048276k free 150100k cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
1 root 15 0 8692 8692 452 R 100.5 0.4 53:11 0 init
4789 root 14 0 1472 1472 912 R 7.3 0.0 0:03 3 top
2 root 9 0 0 0 0 SW 0.0 0.0 0:00 2 keventd
3 root 18 19 0 0 0 SWN 0.0 0.0 0:00 0 ksoftirqd_CPU0
4 root 18 19 0 0 0 SWN 0.0 0.0 0:00 1 ksoftirqd_CPU1
5 root 19 19 0 0 0 SWN 0.0 0.0 0:00 2 ksoftirqd_CPU2
6 root 18 19 0 0 0 SWN 0.0 0.0 0:00 3 ksoftirqd_CPU3
7 root 9 0 0 0 0 SW 0.0 0.0 0:00 2 kswapd
8 root 9 0 0 0 0 SW 0.0 0.0 0:00 0 bdflush
9 root 9 0 0 0 0 SW 0.0 0.0 0:00 1 kupdated
10 root 9 0 0 0 0 SW 0.0 0.0 0:01 1 kjournald
519 root 9 0 0 0 0 SW 0.0 0.0 0:00 0 kjournald
520 root 9 0 0 0 0 SW 0.0 0.0 0:00 2 kjournald
949 root 9 0 572 572 492 S 0.0 0.0 0:00 0 syslogd
953 root 9 0 472 472 408 S 0.0 0.0 0:00 0 klogd
963 root 9 0 440 440 384 S 0.0 0.0 0:00 1 irqbalance
992 root 9 0 404 404 348 S 0.0 0.0 0:00 3 mdadm
1056 nobody 9 0 2128 2128 1944 S 0.0 0.1 0:00 0 proftpd
1069 root 9 0 1912 1912 1420 S 0.0 0.0 0:00 2 cupsd
1128 root 8 0 1572 1572 1432 S 0.0 0.0 0:00 3 sshd
1142 root 9 0 836 836 724 S 0.0 0.0 0:00 3 xinetd
1160 root 8 0 2712 2712 1428 S 0.0 0.1 0:00 1 chkservd
1220 mailnull 8 0 1908 1908 1568 S 0.0 0.0 0:00 0 exim
1225 mailnull 9 0 1896 1896 1560 S 0.0 0.0 0:00 0 exim
1229 mailnull 9 0 1872 1872 1536 S 0.0 0.0 0:00 0 exim
1234 root 9 0 1424 1424 1148 S 0.0 0.0 0:00 1 antirelayd
1249 root 9 0 2180 2180 1884 S 0.0 0.1 0:01 3 sshd
1259 root 9 0 1356 1356 1132 S 0.0 0.0 0:00 0 bash
1309 root 9 0 1428 1428 896 S 0.0 0.0 0:43 2 top
Any help would be much appreciated! Thanks in advance!