Deep archives, one policy
Thousands of URLs accumulate over years. A scan gives you a page inventory and an AI exposure score so decisions cover the archive, not just the homepage.
PUBLISHING & MEDIA
Your archive is your business. Decide who gets to read it.
Publishers sit on years of editorial work that is fully public by design. AI Shield scans your site, reports which crawlers are referenced or observed, and helps you set one clear access policy across the whole archive — without touching robots.txt yourself.
FREE SCAN · NO CARD REQUIRED · RESULTS IN UNDER 60 SECONDS
- CONTENT THAT DESERVES A POLICY
- Article & story pagesHIGHEST VOLUME
- Archive & tag indexesDISCOVERY PATHS
- Newsletter landing pagesGATED PREVIEW
- Opinion & analysisORIGINAL WORK
- Multimedia transcriptsOFTEN OVERLOOKED
WHAT'S AT STAKE
Where automated access matters most.
Observation and evidence — not assumptions about intent.
Search vs. AI answers
Discovery traffic and answer-generation systems are different categories. Keep search engines allowed while making a separate, deliberate choice about AI search and training.
Paywall and preview edges
Free previews, AMP variants and syndicated copies often expose more than the canonical page. The page-level scanner surfaces which paths are publicly reachable.
Licensing conversations
Reporting on observed automated access gives your business team evidence when discussing terms with AI platforms.
Newsletter and premium content
Public landing pages for gated content can reveal more than intended. Review each category and set the policy you actually want.
Change awareness
Once your own infrastructure is connected, baselines and alerts report deviation from normal access patterns — described as observation, never as an attack.
A SENSIBLE STARTING POLICY
Your website. Your rules.
A suggested starting point for this industry. You decide every category, and rules only take effect once you connect and verify your own infrastructure.
- Search EnginesALLOW
- AI SearchYOUR CHOICE
- AI TrainingBLOCK / CHOOSE
- AI AgentsBLOCK / CHOOSE
- Web ScrapersBLOCK / CHOOSE
- Unknown AutomationMONITOR
WHAT YOU GET
- A full page inventory of your editorial catalogue with categories.
- A deterministic AI exposure score with a plain-language explanation of each factor.
- Crawler configuration read from robots.txt, kept strictly separate from observed traffic.
- Policy suggestions you can simulate before anything is deployed.
- Plan recommendation based on your page count — never per page.
You can see the exposure. Now control it.
Start with a free scan of your publication. No card, no DNS changes, no code.
SCAN MY PUBLICATION →