Apache slow, but low load
It is now a network issue, because it is also slow when doing a wget locally.
I have tried enabling and disabling keepalive in apache with no luck.
top:
10:54:02 up 1:56, 1 user, load average: 5.22, 8.77, 6.05
209 processes: 207 sleeping, 2 running, 0 zombie, 0 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 28.5% 0.0% 16.9% 0.0% 0.1% 1.4% 52.7%
cpu00 20.9% 0.0% 12.3% 0.0% 0.7% 3.1% 62.7%
cpu01 22.6% 0.0% 14.5% 0.0% 0.0% 0.3% 62.4%
cpu02 35.9% 0.0% 21.2% 0.0% 0.0% 1.5% 41.2%
cpu03 34.6% 0.0% 19.8% 0.0% 0.0% 0.7% 44.7%
Mem: 906320k av, 896920k used, 9400k free, 0k shrd, 15804k buff
375472k active, 488516k inactive
Swap: 2040212k av, 20628k used, 2019584k free 571828k cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
16223 mysql 0 -19 560M 132M 2064 R < 5.1 14.9 0:01 1 mysqld
15967 nobody 15 0 12864 8552 3552 S 1.2 0.9 0:00 0 httpd
15959 nobody 15 0 12216 7956 3604 S 0.9 0.8 0:00 0 httpd
15944 nobody 15 0 13696 9412 3584 S 0.6 1.0 0:00 0 httpd
16129 mysql 0 -19 560M 132M 2064 S < 0.6 14.9 0:15 3 mysqld
16187 mysql 0 -19 560M 132M 2064 S < 0.6 14.9 0:02 2 mysqld
16130 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:12 2 mysqld
16133 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:11 0 mysqld
16135 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:12 3 mysqld
16138 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:11 2 mysqld
16141 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:08 3 mysqld
16145 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:08 3 mysqld
16148 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:07 3 mysqld
16149 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:07 3 mysqld
16152 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:06 3 mysqld
16154 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:06 0 mysqld
16157 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:05 1 mysqld
16158 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:04 2 mysqld
16162 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:04 2 mysqld
16168 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:09 2 mysqld
16170 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:03 2 mysqld
16176 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:03 2 mysqld
16177 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:03 2 mysqld
16178 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:02 3 mysqld
16185 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 3 mysqld
16188 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 2 mysqld
16189 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 2 mysqld
16193 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 2 mysqld
16197 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 2 mysqld
16199 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 2 mysqld
16201 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:00 3 mysqld
16206 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:00 2 mysqld
16210 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:00 2 mysqld
209 processes: 207 sleeping, 2 running, 0 zombie, 0 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 28.5% 0.0% 16.9% 0.0% 0.1% 1.4% 52.7%
cpu00 20.9% 0.0% 12.3% 0.0% 0.7% 3.1% 62.7%
cpu01 22.6% 0.0% 14.5% 0.0% 0.0% 0.3% 62.4%
cpu02 35.9% 0.0% 21.2% 0.0% 0.0% 1.5% 41.2%
cpu03 34.6% 0.0% 19.8% 0.0% 0.0% 0.7% 44.7%
Mem: 906320k av, 896920k used, 9400k free, 0k shrd, 15804k buff
375472k active, 488516k inactive
Swap: 2040212k av, 20628k used, 2019584k free 571828k cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
16223 mysql 0 -19 560M 132M 2064 R < 5.1 14.9 0:01 1 mysqld
15967 nobody 15 0 12864 8552 3552 S 1.2 0.9 0:00 0 httpd
15959 nobody 15 0 12216 7956 3604 S 0.9 0.8 0:00 0 httpd
15944 nobody 15 0 13696 9412 3584 S 0.6 1.0 0:00 0 httpd
16129 mysql 0 -19 560M 132M 2064 S < 0.6 14.9 0:15 3 mysqld
16187 mysql 0 -19 560M 132M 2064 S < 0.6 14.9 0:02 2 mysqld
16130 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:12 2 mysqld
16133 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:11 0 mysqld
16135 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:12 3 mysqld
16138 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:11 2 mysqld
16141 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:08 3 mysqld
16145 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:08 3 mysqld
16148 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:07 3 mysqld
16149 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:07 3 mysqld
16152 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:06 3 mysqld
16154 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:06 0 mysqld
16157 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:05 1 mysqld
16158 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:04 2 mysqld
16162 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:04 2 mysqld
16168 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:09 2 mysqld
16170 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:03 2 mysqld
16176 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:03 2 mysqld
16177 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:03 2 mysqld
16178 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:02 3 mysqld
16185 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 3 mysqld
16188 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 2 mysqld
16189 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 2 mysqld
16193 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 2 mysqld
16197 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 2 mysqld
16199 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:01 2 mysqld
16201 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:00 3 mysqld
16206 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:00 2 mysqld
16210 mysql 0 -19 560M 132M 2064 S < 0.5 14.9 0:00 2 mysqld
current httpd.conf settings:
Timeout 35
KeepAlive On
MaxKeepAliveRequests 100
KeepAliveTimeout 15
MinSpareServers 5
MaxSpareServers 55
StartServers 50
MaxClients 250
apache status:
Server uptime: 6 minutes 34 seconds
Total accesses: 2504 - Total Traffic: 10.6 MB
CPU Usage: u24.78 s3.38 cu.67 cs.2 - 7.37% CPU load
6.36 requests/sec - 27.7 kB/second - 4457 B/request
41 requests currently being processed, 27 idle servers
_WWW_WWWKW___WW___W____WW_WWWW_W__KWW__WKWWW__W_WW_WWWW____WWW_W
WWWW............................................................
................................................................
Total accesses: 2504 - Total Traffic: 10.6 MB
CPU Usage: u24.78 s3.38 cu.67 cs.2 - 7.37% CPU load
6.36 requests/sec - 27.7 kB/second - 4457 B/request
41 requests currently being processed, 27 idle servers
_WWW_WWWKW___WW___W____WW_WWWW_W__KWW__WKWWW__W_WW_WWWW____WWW_W
WWWW............................................................
................................................................
