# Allow AI to access public content for discovery User-Agent: * Allow: / # Explicit AI bots User-Agent: GPTBot Allow: / User-Agent: Google-Extended Allow: / User-Agent: ClaudeBot Allow: / User-Agent: PerplexityBot Allow: / # Block sensitive / private areas Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/ Disallow: /customer-data/ Disallow: /medical-records/ Disallow: /backend/ # Optional: block staging or test pages Disallow: /staging/ Disallow: /test/