Knowledgebase: CDSEO Pro
|
Do you have a recommended robots.txt file for use with CDSEO Pro?
Posted by Nick Poindexter on 04 March 2010 04:23 PM
|
|
|
A robots.txt file is a plain text file placed in your root website directory, that gives instructions to search engines when they are visiting to index your website. We recommend the following in a robots.txt file for use with CDSEO. If your x-cart installation is in a subdirectory, you will want to change occurrences of "Disallow: /" to "Disallow: /path-to-your-store/": User-agent: * Disallow: /*printable=Y Disallow: /*js=* Disallow: /*sort=* Disallow: /product.php* Disallow: /home.php?cat=* Disallow: /catalog/ Disallow: /search.php Disallow: /cart.php Disallow: /help.php Disallow: /giftcert.php Disallow: /product.php Disallow: /orders.php Disallow: /register.php Disallow: /icon.php Disallow: /image.php Disallow: /error_message.php Disallow: /offers.php Disallow: /product_image.php | |
|
|
Comments (0)