- URL:
- http://www.que.es/robots.txt 🔗
- Replay URL:
- https://web.archive.org/web/20160501161040/http://www.que.es/robots.txt 🔗
- Resource Name:
- robots.txt
- Host:
- que.es
- Institution:
- Web Archives for Historical Research Group
- Collection:
- #panamapapers
- Crawl Date:
- 2016-05-01T16:48:23Z
- Source File:
- WEB-20160501163855568-00004-9949~rho.library.yorku.ca~9191.warc.gz
- General Content Type:
- text
- Content Language:
- it
- Length:
- 800
- Content:
- Sitemap: http://www.que.es/sitemap.xml Sitemap: http://www.que.es/sitemap-incremental.xml Sitemap: http://www.que.es/sitemap_directos.xml Sitemap: http://www.que.es/sitemap.videos.index.xml User-agent: * Disallow: /deportes/multi/ Disallow: /Quepapel/ Disallow: /tmp/ Disallow: /comentarios/// DisalloW: /api.old/ Disallow: /backend.old/ Disallow: /css.old/ Disallow: /includes/ Disallow: /js.old/ Disallow: /js_gestor/ Disallow: /php/ Disallow: /private/ Disallow: /pruebas/ Disallow: /publicidades/ Disallow: /tmp/ Disallow: /twitter/ Disallow: /xml/ Disallow: /xml_hoycinema/ Disallow: /xml_laguiatv/ Disallow: /hemeroteca/buscador/ultimas-noticias? Disallow: /sitemap_general_index.xml Disallow: /sitemap_index.xml Disallow: /comentarios/ Disallow: /comentarios// Disallow: /pruebasComscore/