User-agent: * # following entries tell spiders to ignore folders Disallow: /Admin/ Disallow: /App_Browsers/ Disallow: /bin/ # Disallow: /Category/ - Commented out as this causes issues when URL rewriting is enabled Disallow: /Common/ Disallow: /controls/ Disallow: /font/ Disallow: /GiftRegistryTemplate/ Disallow: /images/ Disallow: /javascript/ Disallow: /Product_Compare/ # Disallow: /Products/ - Commented out as this causes issues when URL rewriting is enabled Disallow: /SQLJob/ Disallow: /Styles/ Disallow: /supplyimages/ Disallow: /Templates/ Disallow: /uploadfiles/ Disallow: /UserAccount/ Disallow: /vendorproductuploadfiles/ Disallow: /WebService/ Disallow: /XSLT/