Robots.txt - Web Crawler Policy

Version 1.0
Last Updated: November 12, 2025

User-agent: * Allow: / Allow: /agent.txt Allow: /agents.txt Allow: /llm.txt Allow: /llms.txt Allow: /ai.txt Allow: /humans.txt

User-agent: GPTBot Allow: /

User-agent: ChatGPT-User Allow: /

User-agent: CCBot Allow: /

User-agent: anthropic-ai Allow: /

User-agent: Claude-Web Allow: /

Sitemap: https://gtcode.com/sitemap.xml Sitemap: https://gtcode.com/news-sitemap.xml