# disallow all User-agent: * Disallow: / Disallow: /contract # but allow only important bots User-agent: DuckDuckBot Disallow: /contract Allow: / User-agent: Googlebot Disallow: /contract Allow: / User-agent: Googlebot-Image Disallow: /contract Allow: / User-agent: Mediapartners-Google Disallow: /contract Allow: / User-agent: msnbot Disallow: /contract Allow: / User-agent: msnbot-media Disallow: /contract Allow: / User-agent: Slurp Disallow: /contract Allow: / User-agent: Yahoo-Blogs Disallow: /contract Allow: / User-agent: Yahoo-MMCrawler Disallow: /contract Allow: / User-agent: FacebookExternalHit Disallow: /contract Allow: / User-agent: Twitterbot Disallow: /contract Allow: / User-agent: LinkedInBot Disallow: /contract Allow: / User-agent: HubSpot Crawler Disallow: /contract Allow: / Sitemap: https://www.accepted.com/sitemap.xml User-agent: AhrefsSiteAudit Disallow: /contract Allow: /