# robots.txt — Youibot Robotics # Official corporate website (Umbraco CMS) # https://developers.google.com/search/docs/crawling-indexing/robots/robots_txt # # Production canonical host: https://www.youibot.com # Prefer absolute Sitemap URL in production. User-agent: * Allow: / Disallow: /umbraco/ Disallow: /App_Plugins/ Disallow: /App_Data/ Disallow: /install/ Disallow: /api/ Disallow: /InternalServerError.html User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Google-Extended User-agent: Bytespider User-agent: DeepSeekBot User-agent: ChatGLM-Spider User-agent: PanguBot User-agent: PetalBot User-agent: Baidubot User-agent: CCBot User-agent: Amazonbot User-agent: meta-externalagent User-agent: FacebookBot User-agent: Applebot-Extended User-agent: cohere-ai User-agent: Diffbot User-agent: YouBot User-agent: ImagesiftBot User-agent: Omgilibot Allow: / Disallow: /umbraco/ Disallow: /App_Plugins/ Disallow: /App_Data/ Disallow: /install/ Disallow: /api/ Disallow: /InternalServerError.html Sitemap: https://www.youibot.com/sitemap.xml # LLM / GEO curated summary (https://llmstxt.org/) — not a robots.txt directive: # https://www.youibot.com/llms.txt