Tag: Misconception

  • Blocking Indexing of Pages

    Blocking my page in robots.txt will prevent indexing.. This is just not true, your robots.txt is a tool used to prevent crawling… not indexing. While blocking a page in robots.txt will prevent well behaved spiders from crawling these pages, it will not prevent indexing, remove a page from the index, nor block the flow of…