spider crashes server
I'm getting hit two or three times a day by what I think is a spider or search engine bot. from 63.148.99.228 (and a few ip's either side)0474 nobody 20 1 387M 386M 7140 R N 75.5 43.9 5:56 httpd
30205 nobody 15 1 767M 332M 4224 R N 0.7 37.7 12:57 httpd
From the log files it looks like it's hitting about 20 domains at a time on the server and taking the load to over 10.
Can someone take a peak for this IP in their logs and see if they're getting similar activity each day and work out which engine it is. At the moment I've had to drop the \24 via the firewall because it's making the server crash a couple of times a day.