how to ban Yahoo! Slurp
and I can't do it via robots or html (longer story 
)I have this,
<Directory /my-dir/www>
AllowOverride AuthConfig FileInfo
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^Yahoo!\ Slurp [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Slurp [NC]
RewriteRule /* http://www.phony-namekhuygyugfgf.com/ [R,L]
</Directory>
but I just saw that slurp took the /robots.txt and the / this morning. Code 200 too.
66.196.65.35 - - [13/Mar/2004:05:46:13 -0500] "GET /robots.txt HTTP/1.0" 200 782 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
66.196.73.51 - - [13/Mar/2004:05:46:13 -0500] "GET / HTTP/1.0" 200 12615 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
How can I make it so it index anything? Thank you
