Ask Jeeves wants your Robots.txt!
David Naylor from Bronco, who was one of the speakers at the Organic Listings Forum session at the Search Engine Strategies conference, advised site owners to have a robots.txt file, even if it's just an empty file, because Ask Jeeves' spider seems to favor web sites that have one.
Anyone noticed an improvement with your presence in Ask Jeeves after creating a robots.txt file?
Of course there's also the side benefit that you'll eliminate all those "File Not Found" error messages for robots.txt in your server error log, which tend to overwhelm the error log, making it harder to spot more concerning error messages. That assumes of course that you actually examine your error log on occasion. ;-)
2 pingbacks
-
[...] passend dazu die Meldung auf Business Blog Consulting: I heard at the Search Engine Strategies conference earlier this month in Chicago that the Ask Jeeves spider doesn’t cope well with websites that don’t have robots.txt. So if you don’t have a robots.txt file hosted on your blog’s document root, create a blank one. weitere Artikel zu: askjeeves, it news, suchmaschinen [...]
Pingback by Basic Thinking Blog » Aks Jeeves nun auch in Deutschland verfügbar [Visitor] — 12/20/05 @ 07:26
-
[...] I heard at the Search Engine Strategies conference earlier this month in Chicago that the Ask Jeeves spider doesn’t cope well with websites that don’t have robots.txt. So if you don’t have a robots.txt file hosted on your blog’s document root, create a blank one. [...]
Pingback by Business Blog Consulting » Favicon and Robots.txt – Must-Haves for your Blog [Visitor] — 01/06/06 @ 18:15
Comment feed for this post