Server Headers: How important are server headers for robots?
We are running some resource intensive scripts on our website and were thinking about using Squid to cache some of the pages instead of regenerating them with Perl every time a user / robot access our site.We have done some testings locally and we found that Squid adds 2 lines to server headers:
Age: 493
X-Cache: HIT from somedomain.com
Age means that squid cached the page 493 seconds ago while X-Cache displays the host.
Is it a problem for robots to see these 2 lines in Server Header? Any comment?