########################################################################## # http://www.chami.com/tips/internet/010198I.html # ########################################################################## # 1. Remover o indicador de comentário "#" nas linhas seguintes para # indicar conde um robot pode entrar. User-agent: * Disallow: /cgi-bin/ Disallow: /crp/ Disallow: /img/ Disallow: /cso/ Disallow: /anat/ Disallow: /admin/ Disallow: /orion/ # 2. O asterisco informa que o "WWW_Robot_Name" está inibido no site # conforme indicado abaixo. Um para cada robot. User-agent: WebCrawler Disallow: * User-agent: WebReaper Disallow: * #User-agent: Googlebot #Disallow: * # 3. Following two lines indicate that robots named "WWW_Wanderer_Name" # should not index files in the /private/ folder. #User-agent: WWW_Wanderer_Name #Disallow: /private/