# /robots.txt file for http://webcrawler.com/ # mail webmaster@webcrawler.com for constructive criticism User-agent: * Disallow: /adm-bv Disallow: /adm-cu Disallow: /adm-cy Disallow: /adm-dolphin Disallow: /adm-hr Disallow: /adm-pb Disallow: /adm-sd Disallow: /adm-svv Disallow: /adm-svr Disallow: /admin Disallow: /bwplaza Disallow: /cgi-bin Disallow: /dcruise/holland/ Disallow: /dlreports Disallow: /himge/ Disallow: /images Disallow: /log Disallow: /media Disallow: /newsreleases/ Disallow: /process Disallow: /p1305 Disallow: /p3105 Disallow: /ramada/ Disallow: /rescenter Disallow: /RadissonPrkwy/info.htm Disallow: /tour2000 Disallow: /tour2000 Disallow: /travelodge