Tag: Spiders

  • Summer 2011 Plan of Attack

    Looking  at the changes and trend of Google and the other search engines, I thought it might be a good time to plot a new plan of attack. Sure, many things remain as they were… But there are also many new things we are looking at more deeply, as well as things we no longer…

  • Blocking Indexing of Pages

    Blocking my page in robots.txt will prevent indexing.. This is just not true, your robots.txt is a tool used to prevent crawling… not indexing. While blocking a page in robots.txt will prevent well behaved spiders from crawling these pages, it will not prevent indexing, remove a page from the index, nor block the flow of…

  • Great Navigation Pays the Bills!

    One of the singular most important things you can do for your online store is define a clear easy to follow navigational structure. The benefits are really astounding.