# Robots.txt for Licensy AI # https://licensy.ai/robots.txt # Default policy for traditional search crawlers and unnamed bots. User-agent: * Disallow: /dashboard Disallow: /admin Disallow: /profile Disallow: /reports Disallow: /overview Disallow: /login Disallow: /signup Disallow: /forgot-password Disallow: /reset-password Disallow: /email-confirmation Allow: / Allow: /platform Allow: /developers Allow: /mcp Allow: /use-cases Allow: /enterprise Allow: /company Allow: /docs Allow: /api-docs Allow: /contact Allow: /individuals Allow: /privacy-policy Allow: /terms Allow: /llms.txt Allow: /llms-full.txt # ---- AI bot policy ------------------------------------------------------ # Posture: OPEN. Every crawler — including AI model-training crawlers # (GPTBot, ClaudeBot, Google-Extended, CCBot, Applebot-Extended, # meta-externalagent, Bytespider) and answer-time retrieval bots # (ChatGPT-User, OAI-SearchBot, PerplexityBot, Claude-User, etc.) — follows # the single "User-agent: *" policy above: all public marketing pages are # allowed, and only the authenticated app paths (/dashboard, /admin, /login, # …) are disallowed. # # We deliberately do NOT list these agents in their own blocks. In robots.txt # a named User-agent block does NOT inherit the "*" disallows, so a per-bot # "Allow: /" would expose the app paths to that bot. Leaving them unlisted # means each one inherits the "*" rules — public open, app blocked — which is # exactly the open-for-training / protect-the-app posture we want. # # Goal: maximize Licensy's presence in LLM training data AND in live AI # answers. The public site is physician + PA licensing-infrastructure # marketing content with nothing sensitive. # Sitemap + LLM discovery files Sitemap: https://www.licensy.ai/sitemap.xml # LLM/agent index: https://www.licensy.ai/llms.txt (see also /llms-full.txt)