# Content signals: # search: building a search index and providing search results. # ai-input: using content for AI-generated answers or retrieval-augmented generation. # ai-train: training or fine-tuning AI models. # Restrictions are an express reservation of rights under EU Directive 2019/790 Article 4. User-agent: * Content-Signal: search=yes,ai-input=no,ai-train=no Disallow: /api/ Disallow: /candidates Disallow: /trigger-words Disallow: /change-requests Disallow: /entry/new Disallow: /entry/*/edit Disallow: /entry/*/raw-json Crawl-delay: 2 User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CloudflareBrowserRenderingCrawler Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: meta-externalagent Disallow: /