Htdig / Server Load

Hello, does anyone out there have any experience with htdig. I have a client who is using it and it seems to use a lot of resources. It's been running for days and the inbound bandwidth is now huge compared to what it is normally. Server load high. Anywhere from 3.00 up to 12.00. I'm assuming it's out spidering and building databases.

I've included a snip of top. Anyway, this has been going on for three days now. Running a P4 1.8 w1gb ram. RH Linux 3.

Any input would be appreciated,
Blair

09:18:54 up 3 days, 14:23, 2 users, load average: 3.30, 3.94, 3.71
101 processes: 96 sleeping, 3 running, 0 zombie, 2 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 0.0% 64.2% 2.7% 0.3% 0.0% 29.7% 2.7%
Mem: 1019396k av, 1000504k used, 18892k free, 0k shrd, 213396k buff
750728k actv, 150312k in_d, 20912k in_c
Swap: 2097136k av, 27048k used, 2070088k free 520212k cached

PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
17840 root 37 19 35760 34M 1920 S N 66.6 3.5 139:47 0 htdig
13 root 15 0 0 0 0 SW 0.1 0.0 3:27 0 kjournald
27361 kovn 19 4 1056 1056 784 R N 0.1 0.1 0:01 0 top
1 root 15 0 508 472 448 S 0.0 0.0 0:04 0 init
2 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 keventd
3 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kapmd

 

 

 

 

Top