Allow AI crawlers in Shopify robots.txt
Shopify serves robots.txt from the theme — avoid blanket Disallow rules that block GPTBot-style agents. Follow the steps below on your stack, then re-check the live URL.
Shopify serves robots.txt from the theme — avoid blanket Disallow rules that block GPTBot-style agents.
We remember this on this browser so the next guide opens with the same CMS.
At a glance
| Time | ~15 min |
|---|---|
| Category | Platform |
| Steps | 4 |
| Stacks | WordPress, Shopify, Webflow, Next.js, HTML, more |
Steps
View the live /robots.txt on your storefront domain.
Edit robots.txt.liquid only if you understand Shopify’s default rules.
Add Allow rules for GPTBot, ClaudeBot, and PerplexityBot if they are blocked.
Re-check a product or landing URL after changes.
In HTML / static
Serve /robots.txt at the origin with Allow rules for retrieval crawlers.
Snippet
User-agent: * Allow: / Sitemap: https://yoursite.com/sitemap.xml User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: /
FAQ
- What does “Allow AI crawlers in Shopify robots.txt” fix?
- Shopify serves robots.txt from the theme — avoid blanket Disallow rules that block GPTBot-style agents.
- How long does this usually take?
- About 15 minutes on most CMS and code stacks when you already have access to edit the page.
- Where do I start?
- Start with: View the live /robots.txt on your storefront domain. Then use the platform picker on this page for placement notes.