# Robots.txt file from http://www.bsearch.be # # All robots will spider the domain User-agent: WebAlta Crawler Disallow: / User-agent: * Disallow: /Connections/ Disallow: /Trend/ Disallow: /VNU/ Disallow: /Vacature/ Disallow: /RSS/ Disallow: /Refscripts/ Disallow: /B2BTop50/ Disallow: /Searchbox/ Disallow: /Sales/ Disallow: /errorpages/ Disallow: /Pickup/ Disallow: /xyiznwsk/ Disallow: /CRXDQWHFA/ Disallow: /Drop/ Disallow: /Queue/ Disallow: /bsearch/RefImages/ Disallow: /bsearch/rotateLogo/ Disallow: /bsearch/CRM/ Disallow: /bsearch/Livestat/ Disallow: /bsearch/livestats/ Disallow: /bsearch/graphics/ Disallow: /bsearch/Redir/ Disallow: /bsearch/Docs/ Disallow: /bsearch/CRXDQWHFA/ Disallow: /bsearch/contact/ Disallow: /bsearch/images/ #Disallow: /bsearch/Display/ Disallow: /bsearch/CpyUpdate/ Disallow: /bsearch/ShowNaceTree.asp #Disallow: /bsearch/doorway.asp Sitemap: http://www.bsearch.be/sitemap.xml