User-agent: * Allow: / Disallow: /admin Disallow: /dashboard Disallow: /login Disallow: /register Disallow: /forgot-password Disallow: /reset-password Disallow: /checkout # LLM / AI crawler guidance # https://www.careermedia.ai/llms.txt Sitemap: https://www.careermedia.ai/sitemap.xml