# /robots.txt file for http://webcrawler.com/ # mail webmaster@webcrawler.com for constructive criticism User-agent: * Disallow: /adm-bv Disallow: /adm-cu Disallow: /adm-cy Disallow: /adm-dolphin Disallow: /adm-hr Disallow: /adm-pb Disallow: /adm-sd Disallow: /adm-svv Disallow: /adm-svr Disallow: /admin Disallow: /bwplaza Disallow: /cgi-bin Disallow: /dcruise/holland/ Disallow: /dlreports Disallow: /himge/ Disallow: /log Disallow: /media Disallow: /newsreleases/ Disallow: /process Disallow: /p1305 Disallow: /p3105 Disallow: /ramada/ Disallow: /rescenter Disallow: /RadissonPrkwy/info.htm Disallow: /tour2000 Disallow: /tour2000 Disallow: /travelodge Disallow: /celebration Disallow: /category/ Disallow: /tag/ Disallow: /type/ Disallow: /test Disallow: /author Disallow: /blog/ Disallow: /sample Disallow: /2013/ Disallow: /2014/ Disallow: /beautiful-gallery-post/ Disallow: /audio-without-image/ Disallow: /standard-post-with-no-featured-image/ Disallow: /reservations/PCC6_02.cfm Disallow: /courtyard/