User-agent: * Allow: / Allow: /api/wire Allow: /api/wire/ Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: GPTBot Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: OAI-SearchBot Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: ChatGPT-User Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: PerplexityBot Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: ClaudeBot Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: Claude-Web Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: anthropic-ai Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: Google-Extended Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: Googlebot-News Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: meta-externalagent Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: Applebot-Extended Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: YouBot Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: CCBot Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: Diffbot Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: Bytespider Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: cohere-ai Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: AI2Bot Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: Omgilibot Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ User-agent: Kangaroo Bot Allow: / Allow: /wire/ Allow: /api/wire Allow: /api/wire/ Allow: /feed Allow: /rss Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /news-sitemap.xml Disallow: /admin Disallow: /admin/ Disallow: /login Disallow: /portal Disallow: /portal/ Disallow: /api/ Sitemap: https://729f6259-159c-4ef7-9945-b3b359be0070-00-31tdn5sje0ob7.worf.replit.dev/sitemap.xml Sitemap: https://729f6259-159c-4ef7-9945-b3b359be0070-00-31tdn5sje0ob7.worf.replit.dev/news-sitemap.xml # LLM and AI discovery # llms.txt: https://729f6259-159c-4ef7-9945-b3b359be0070-00-31tdn5sje0ob7.worf.replit.dev/llms.txt # llms-full.txt: https://729f6259-159c-4ef7-9945-b3b359be0070-00-31tdn5sje0ob7.worf.replit.dev/llms-full.txt # RSS Feed: https://729f6259-159c-4ef7-9945-b3b359be0070-00-31tdn5sje0ob7.worf.replit.dev/feed