# Robots.txt file for http://webafsNN.cern.ch # User-agent: CERN Search Crawler Disallow: User-agent: FAST Enterprise Crawler 6 used by CERN (project-search@cern.ch) Disallow: User-agent: FAST Enterprise Crawler for Sharepoint used by CERN (project-search@cern.ch) Disallow: User-agent: Googlebot Allow: /geant4 User-agent: * Allow: /geant4 User-agent: * Allow: /mad User-agent: * Disallow: /