User-agent: * # Directories Disallow: /admin/ Disallow: /cache/ Disallow: /docs/ Disallow: /fck/ Disallow: /includes/ Disallow: /logs/ Disallow: /themes/ Disallow: /axs/ Disallow: /mapgen/ Disallow: /js/ Disallow: /language/ Disallow: /uploaded/ # Files Disallow: /batch.php Disallow: /cron.php Disallow: /csseditor.php Disallow: /csseditor_.php Disallow: /csssyntax.inc Sitemap: http://www.auctionsnorthwest.co.uk/sitemap.xml