# Block all crawlers from /extension/alpha User-agent: * Disallow: /extension/alpha Disallow: /extension/alpha/ # Specific rules for major search engines User-agent: Googlebot Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: Bingbot Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: Slurp Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: DuckDuckBot Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: Baiduspider Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: YandexBot Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: facebookexternalhit Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: Twitterbot Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: LinkedInBot Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: WhatsApp Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: Applebot Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: AhrefsBot Disallow: /extension/alpha Disallow: /extension/alpha/ User-agent: SemrushBot Disallow: /extension/alpha Disallow: /extension/alpha/ # Allow other pages to be crawled User-agent: * Allow: / Sitemap: https://www.skippr.ai/sitemap.xml Sitemap: https://www.skippr.ai/blog/sitemap.xml