User-Agent: Googlebot User-Agent: Bingbot User-Agent: Slurp User-Agent: DuckDuckBot User-Agent: YandexBot User-Agent: Baiduspider Allow: / User-Agent: facebookexternalhit User-Agent: Twitterbot User-Agent: LinkedInBot User-Agent: WhatsApp Allow: / User-Agent: * Allow: /*.css$ Allow: /*.js$ Allow: /*.png$ Allow: /*.jpg$ Allow: /*.jpeg$ Allow: /*.webp$ Allow: /*.svg$ Allow: /*.woff$ Allow: /*.woff2$ Disallow: /api/ Disallow: /admin/ Disallow: /_next/ Disallow: /private/ Disallow: /404 Disallow: /500 Disallow: /*?* Disallow: /booking/ Crawl-delay: 10 Sitemap: https://www.srilankanholidays.com/sitemap.xml