User-agent: Scrapy
Allow: /

User-agent: *
Crawl-delay: 10
Disallow: /*?tomail
Disallow: /*?job
Disallow: /*?region
Disallow: /wp-admin/


Sitemap: https://www.telit.com/sitemap_index.xml