# Curio — see https://designbycurio.com
# Catalog metadata is intentionally open. AI agents are first-class users —
# crawl freely; we do not gate /llms.txt or the public gallery behind auth.
# /account/ pages stay out of the index via per-page noindex, not a robots
# block (a block would hide the noindex tag from crawlers).
#
# Content-Signal (Cloudflare content-signals proposal): we explicitly OPT IN to
# AI use of our PUBLIC content. Being searched, quoted into AI answers, and
# trained on all grow Curio's presence in generative engines — that is the
# whole point of the library. Paid design tokens live behind auth in Supabase
# Storage and are never crawlable regardless of this signal.
#
# Welcomed answer-engine / AI crawlers — GPTBot, OAI-SearchBot, ChatGPT-User,
# ClaudeBot, anthropic-ai, PerplexityBot, Google-Extended, Applebot-Extended,
# CCBot, Bytespider, cohere-ai, Meta-ExternalAgent — are all covered by the *
# group below. We deliberately do NOT give them named groups: a named group
# would NOT inherit the * Content-Signal (robots groups are matched most-
# specific-only, not additively), which would silently drop the opt-in for
# exactly the bots we most want to signal.

User-agent: *
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /
# /theme-asset/ is the gated download API (JWT-only, answers 401 to crawlers,
# no page content). Detail-page download links point at it; keep bots off it.
Disallow: /theme-asset/

Sitemap: https://designbycurio.com/sitemap.xml
Sitemap: https://designbycurio.com/sitemap-static.xml
Sitemap: https://designbycurio.com/sitemap-themes-en.xml
Sitemap: https://designbycurio.com/sitemap-themes-zh.xml
Sitemap: https://designbycurio.com/sitemap-themes-ja.xml
Sitemap: https://designbycurio.com/sitemap-themes-ko.xml
Sitemap: https://designbycurio.com/sitemap-themes-es.xml
Sitemap: https://designbycurio.com/sitemap-learn-en.xml
Sitemap: https://designbycurio.com/sitemap-learn-zh.xml
Sitemap: https://designbycurio.com/sitemap-learn-ja.xml
Sitemap: https://designbycurio.com/sitemap-learn-ko.xml
Sitemap: https://designbycurio.com/sitemap-learn-es.xml
Sitemap: https://designbycurio.com/sitemap-seo-en.xml
Sitemap: https://designbycurio.com/sitemap-seo-zh.xml
Sitemap: https://designbycurio.com/sitemap-seo-ja.xml
Sitemap: https://designbycurio.com/sitemap-seo-ko.xml
Sitemap: https://designbycurio.com/sitemap-seo-es.xml