User-agent: Baiduspider User-agent: AhrefsBot User-agent: ComprarAquiBot User-agent: VoilaBot User-agent: YandexBot User-agent: MJ12bot User-agent: 360Spider User-agent: Ezooms User-agent: heritrix User-agent: bingbot User-agent: BLEXBot User-agent: JobdiggerSpider User-agent: kulturarw3 User-agent: XoviBot User-agent: SiteExplorer User-agent: Vagabondo User-agent: EccolaBot User-agent: SEOkicks User-agent: DotBot User-agent: ltx71 User-agent: Scrapy User-agent: worldwebheritage User-agent: SemrushBot User-agent: SemrushBot-SA User-agent: ProoXiBot User-agent: Applebot User-agent: spbot User-agent: nekstbot Disallow: / User-agent: bingbot Crawl-delay: 30 Disallow: /admin/ Disallow: /application/ Disallow: /css/ Disallow: /data/ Disallow: /feeds/ Disallow: /imgs/ Disallow: /js/ Disallow: /lib/ Disallow: /plugins/ Disallow: /scripts/ Disallow: /templates/ Disallow: /corp/links Disallow: /rtp.php Allow: / # Google ignores this, but in case... # User-agent: Googlebot User-agent: Googlebot-News User-agent: Googlebot-Image User-agent: Googlebot-Video User-agent: Googlebot-Mobile User-agent: Mediapartners User-agent: Mediapartners-Google User-agent: AdsBot-Google Crawl-delay: 1 Disallow: /admin/ Disallow: /application/ Disallow: /data/ Disallow: /feeds/ Disallow: /lib/ Disallow: /plugins/ Disallow: /scripts/ Disallow: /templates/ Disallow: /corp/links Disallow: /rtp.php Allow: / User-agent: * Crawl-delay: 30 Disallow: /admin/ Disallow: /application/ Disallow: /css/ Disallow: /data/ Disallow: /feeds/ Disallow: /imgs/ Disallow: /js/ Disallow: /lib/ Disallow: /plugins/ Disallow: /scripts/ Disallow: /templates/ Disallow: /search/ Disallow: /corp/links Disallow: /rtp.php Allow: / Sitemap: https://www.miscota.es/xmls/sitemap.xml