# This robots.txt file controls crawling of URLs under https://www.arbeidsrettsadvokater.no/ sitemap: https://www.arbeidsrettsadvokater.no/sitemaps-1-sitemap.xml User-agent: * Disallow: /cpresources/ Disallow: /vendor/ Disallow: /.env Disallow: /cache/ Disallow: /sitemap/ Disallow: /*?*search= Disallow: /*?*keyword= #custom user agent User-agent: SiteAuditBot Allow: /