# DocuCiencia Robots.txt # by Wis_Alien [16/01/09] # Wildcards solo para algunos crawlers User-agent: Googlebot Disallow: /*/*/*/trackback Disallow: /*.js$ Disallow: /*.css$ Disallow: /?s* Disallow: /etiquetas/* Disallow: /tags/* User-agent: Slurp Disallow: /*/*/*/trackback Disallow: /*.js$ Disallow: /*.css$ Disallow: /?s* Disallow: /etiquetas/* Disallow: /tags/* User-agent: msnbot Disallow: /wp-admin/ Disallow: /logs/ Disallow: /etiquetas/ Disallow: /tags/ # Para todos los robots # Zonas irrelevantes User-agent: * Disallow: /wp-admin/ Disallow: /logs/ Disallow: /etiquetas/ Disallow: /tags/ Disallow: /wp-includes/ # Sitemaps Sitemap: http://www.docuciencia.es/sitemap.xml.gz