# stabilize.video: crawl rules # Every page here is about steadying shaky footage, and all of it may be indexed. # Model-training crawlers (allowed) User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: meta-externalagent Content-Signal: search=yes, ai-input=yes, ai-train=yes Disallow: /api/ Allow: / # Assistants fetching pages to answer a user's question User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User Content-Signal: search=yes, ai-input=yes, ai-train=yes Disallow: /api/ Allow: / # Search engines and all other bots User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Disallow: /api/ Allow: / Sitemap: https://stabilize.video/sitemap.xml