# small robots.txt # more information about this file can be found at # http://www.robotstxt.org/wc/robots.html # if case your drupal site is in a directory # lower than your docroot (e.g. /drupal) # please add this before the /-es below User-agent: * Crawl-Delay: 10 Disallow: /aggregator Disallow: /tracker Disallow: /comment/reply Disallow: /node/add Disallow: /user Disallow: /files Disallow: /search Disallow: /book/print Disallow: /node$ Disallow: /node/ Disallow: /node?from Sitemap: http://www.clonlara.org/gsitemap