Stephan Spencer's Scatterings

The Scattered Wisdom of a scientist turned web marketing virtuoso

May 2008
S M T W T F S
 << <   > >>
        1 2 3
4 5 6 7 8 9 10
11 12 13 14 15 16 17
18 19 20 21 22 23 24
25 26 27 28 29 30 31

Critique of Red Envelope's Site

In an article I had co-authored for Multichannel Merchant entitled, "Red Envelope's Website Critique," I had gone into detail about the site's functionality and came across this interesting discovery at the time I looked at their site.

The category and subcollection pages are not making it into the search engines at all — not because of their spider unfriendly URLs, but because they are being specifically blocked through “disallow” directives in the site’s robots.txt file. Robots.txt is the place where you can give commands to Googlebot and the other spiders, such as “stay away from this directory” or “stay away from this file type.”

For more interesting details on this site critique co-written with Amy Africa, just follow the link above.

Posted by Stephan Spencer on 11/19/2007 | Permalink

Comments (0)| Comments RSS | Filed under: Ecommerce website critique            

No feedback yet

Leave a comment


Your email address will not be revealed on this site.

Your URL will be displayed.
(Line breaks become <br />)
(Name, email & website)
(Allow users to contact you through a message form (your email will not be revealed.)