AI Crawlability
The ability of LLM agents and AI crawlers to access, parse, and understand a website's content for use in training or real-time retrieval.
This term is part of the 3LA EntityMap → /entitymap.html
Related terms
llms.txt
L3A proposed standard file (similar to robots.txt) that communicates to AI crawlers which content should or should not be indexed by large language models.
Crawlability
L2The ability of search engine and AI crawlers to access and index a website's content. JavaScript-heavy pages often have poor crawlability.
L3 AI Layer
coreThe third layer in the Three-Layer Approach framework. Measures 12 metrics including Structural Proof Gap, Citation-Worthiness, Citation Readiness, Answer-First Format, LLMs.txt, and Chunk Optimization. Citation rate measured across ChatGPT (GPT-5.2), Claude Sonnet 4.6, Gemini 3.1 Pro in every audit. Weight: 30% of LayerScore. Platform average L3: 68/100. Typical lift after optimisation: +28 points.
Retrieval-Augmented Generation
coreA technique used to improve the quality, accuracy, and freshness of AI responses by grounding them in retrieved source documents. RAG systems retrieve relevant content from indexed sources before generating a response. EntityMap improves RAG output quality by providing structured, pre-verified entity relationships and evidence chunks rather than requiring the model to infer relationships from unstructured prose.
