Enabling caching for dynamic pages

We have over 10,000 pages served dynamically. The scripts which serve these pages behave well. But everytime some robots come calling, they fire rapid fire requests for hundreds of pages at a time. I wonder if I will save server resources by adopting some kind of caching in the server.

Do I need some special modules in Apache or I play around with the CGI scripts ? Which is the best method ?

Thanks for your replies.

 

 

 

 

Top