# Robots.txt file # # All robots will spider the domain # Exclude all Spiders from directory User-agent: * Disallow: /Pages/PassgenJavaHelp/ Disallow: /Pages/thanks.html Disallow: /Pages/e3sciencesPrivacy.html