Add Content Signals in robots.txt
A Content-Signal line tells crawlers your preferences for search, AI input, and AI training. Follow the steps below on your stack, then re-check the live URL.
A Content-Signal line tells crawlers your preferences for search, AI input, and AI training.
We remember this on this browser so the next guide opens with the same CMS.
At a glance
| Time | ~10 min |
|---|---|
| Category | GEO |
| Steps | 3 |
| Stacks | WordPress, Shopify, Webflow, Next.js, HTML, more |
Steps
Open the live /robots.txt file.
Add a Content-Signal line (adjust yes/no to match your policy).
Re-fetch /robots.txt to confirm the line is live.
In HTML / static
Serve /robots.txt at the origin with Allow rules for retrieval crawlers.
Snippet
Content-Signal: search=yes, ai-input=yes, ai-train=no
FAQ
- What does “Add Content Signals in robots.txt” fix?
- A Content-Signal line tells crawlers your preferences for search, AI input, and AI training.
- How long does this usually take?
- About 10 minutes on most CMS and code stacks when you already have access to edit the page.
- Where do I start?
- Start with: Open the live /robots.txt file. Then use the platform picker on this page for placement notes.