Meta AI: Make Your Documentation Discoverable by AI
AI Can't Find Your Documentation on Meta AI? Here's why it happens, the fix, and how to prevent it.
Meta AI Context
Position your brand to be recommended by Meta AI across Facebook, Instagram, WhatsApp, and Messenger.
Allow Meta-WebIndexer in robots.txt for Meta AI search (Meta-ExternalAgent only governs training)
Create content that performs well on social platforms
Include shareable statistics and insights
Why This Problem Matters
Users ask AI for help with your product but it can't find or cite your documentation. Get your docs into AI knowledge.
Why This Happens in Meta AI
Documentation is only usable if Meta AI can reach it through Meta AI search, which Meta-WebIndexer crawls for. Docs behind a login, on a blocked subdomain, or rendered client-side are invisible however good they are.
Signs You Have This Problem in Meta AI
Meta AI answers questions about your product without citing your docs
Meta AI gives generic answers instead of citing your docs
Users report AI couldn't help them with your product
Technical questions get wrong or incomplete answers
Competitor documentation gets cited instead of yours
How to Fix This in Meta AI
Follow these Meta AI-specific solutions:
Allow Meta-WebIndexer in robots.txt, on your docs subdomain too
Serve docs as server-rendered HTML with one task per page
Make documentation publicly accessible without login
Publish docs as HTML pages, not just PDFs or apps
Implement proper heading hierarchy in docs
Link documentation prominently from your main site
Add TechArticle and HowTo schema to doc pages
Meta AI Technical Details
Meta documents separate agents: Meta-WebIndexer improves Meta AI search results, Meta-ExternalAgent collects training data, and Meta-ExternalFetcher fetches pages on a user's request and may bypass robots.txt.
Meta-WebIndexer
Search / answers
Used to improve Meta AI search result quality.
Meta-ExternalAgent
Model training
Crawls for training foundation AI models.
Meta-ExternalFetcher
User-requested fetch
Fetches a link a user shares with Meta AI; may bypass robots.txt.
robots.txt rule to stay eligible for Meta AI answers:
User-agent: Meta-WebIndexer
Allow: /Source: developers.facebook.com
Prevent This Problem in Meta AI
Design documentation for both humans and AI
Test AI's ability to answer questions from your docs
Maintain clear documentation structure
Monitor documentation crawling in server logs
Helpful Resources
How-To Guides
Checklists
Need Help Fixing Meta AI Issues?
Get expert help resolving this and other Meta AI visibility problems.
Get Your AI Visibility AuditFrequently Asked Questions
Why is this happening in Meta AI?
Documentation is only usable if Meta AI can reach it through Meta AI search, which Meta-WebIndexer crawls for. Docs behind a login, on a blocked subdomain, or rendered client-side are invisible however good they are.
What is the first fix to prioritize in Meta AI?
Allow Meta-WebIndexer in robots.txt, on your docs subdomain too