Liplyn Information GroupInformation Group
    Back to tools

    Robots.txt Generator for AI

    Create a robots.txt file that allows AI models like ChatGPT, Claude, Perplexity, and Gemini to crawl your website. This helps AI models understand your business and recommend your pages.

    Website settings

    AI Crawlers

    GPTBot
    ChatGPT-User
    Claude (Anthropic)
    Claude-Web
    PerplexityBot
    Google-Extended
    CCBot (Common Crawl)
    Cohere AI
    Meta-ExternalAgent
    Applebot-Extended

    Want your AI visibility professionally optimized?

    Get a free AI Search Audit

    Curious about the possibilities?

    We'd love to explore how you can get more out of your data, AI and digital visibility.

    Book a meeting