[cpif] r419 - in trunk: . frontend-web

[svn at argo.es]

Author: jcea
Date: Tue Oct 23 19:42:06 2007
New Revision: 419

Log:
Afinamos el 'robots.txt'

Modified:
   trunk/TODO
   trunk/frontend-web/url_robots_txt.py

Modified: trunk/TODO
==============================================================================
--- trunk/TODO	(original)
+++ trunk/TODO	Tue Oct 23 19:42:06 2007
@@ -467,3 +467,6 @@
   debe poder crear el fichero que comprueba google, via
   configuracion del administrador CPIF.
 
+- 20071023: FRONTAL WEB: Soporte de peticiones condicionales y
+  compresion en "robots.txt".
+

Modified: trunk/frontend-web/url_robots_txt.py
==============================================================================
--- trunk/frontend-web/url_robots_txt.py	(original)
+++ trunk/frontend-web/url_robots_txt.py	Tue Oct 23 19:42:06 2007
@@ -10,5 +10,24 @@
   if len(path)!=1 : return None
 
   return (200,{"Content-Type":"text/plain"},
-    "Sitemap: %s/sitemap.xml\r\n" %base_url)
+    "Sitemap: %s/sitemap.xml\r\n
+\r\n
+User-agent: *\r\n
+Disallow: /INVALIDA\r\n
+Disallow: /LOGIN\r\n
+Disallow: /edit_config\r\n
+Disallow: /edit_metatags\r\n
+Disallow: /email_confirmation\r\n
+Disallow: /get_msg_source_AJAX\r\n
+Disallow: /logout\r\n
+Disallow: /new_user_confirmation\r\n
+Disallow: /nuevo_hilo_POST\r\n
+Disallow: /nuevo_hilo_privado_POST\r\n
+Disallow: /nuevo_post_POST\r\n
+Disallow: /nuevo_usuario_POST\r\n
+Disallow: /perfil\r\n
+Disallow: /perfil_POST\r\n
+Disallow: /stop\r\n
+Disallow: /todo_leido\r\n
+Disallow: /toggle\r\n" %base_url)