How to Read a Site Optimization Report: A Guide to All Metrics
What Is a Site Optimization Report?
The AURA Site Optimization report measures how well your website is understood and represented by AI models. Unlike traditional SEO, this report evaluates your site from an AI's perspective.
The report consists of multiple metrics, each analyzing a different aspect of your site. Let us now examine each metric in detail.
1. Overall AI Readiness Score
Range: 0-100
This score is the main metric showing your site's overall compatibility with AI. It is calculated as a weighted average of all other sub-scores.
What Does It Mean?
- 80-100: Your site is very well optimized for AI. AI crawlers can easily understand your site.
- 60-79: Good level but there are areas for improvement. A few adjustments can significantly increase the score.
- 40-59: Medium level. AI crawlers can partially understand your site but there are gaps.
- 0-39: Low level. Your site is largely not ready for AI crawlers. Serious improvement is needed.
What Affects It?
Factors affecting the overall score: robots.txt configuration, llms.txt file, structured data, content clarity, and bot access status.
2. Robots.txt Score
Range: 0-100
The robots.txt file tells crawlers visiting your website which pages they can visit. Proper configuration of this file for AI crawlers is critically important.
Common Mistakes
- Blocking all bots: If you are blocking all crawlers with "Disallow: /", AI models cannot read your site.
- Specifically blocking AI crawlers: Separately blocking AI crawlers like GPTBot, ClaudeBot, GoogleBot directly reduces your AI visibility.
- Blocking important pages: Pages like About Us, Services, Contact are critical for AI to understand you.
- Missing robots.txt file: If the file does not exist, all pages are generally considered accessible, but explicitly granting permission is better.
Ideal Configuration
To be open to AI crawlers: allow GPTBot, ClaudeBot, Google-Extended, PerplexityBot, Applebot, and other AI crawlers. Only block pages that truly need to be private (such as admin panels, user data).
3. LLMS.txt Score
Range: 0-100
llms.txt is an "introduction file" prepared for AI models about your website. While robots.txt tells crawlers where they can go, llms.txt tells AI what your company does.
What Is Evaluated?
- File existence: Do you have an
llms.txtfile? - Content quality: Does it include basic information like company name, services, location?
- Format compliance: Does it follow the standard
llms.txtformat? - Currency: Is the information up to date?
If Your Score Is 0
Do not worry, most websites do not have an llms.txt file yet. This is a new standard and provides a significant advantage for early adopters. AURA automatically generates an llms.txt file for you.
4. Structured Data Score
Range: 0-100
Structured data allows you to present your website content in a format that machines can easily understand. JSON-LD and Schema.org standards are extremely important for AI models to correctly understand your site.
What Is Checked?
- JSON-LD presence: Do your pages have structured data?
- Schema types: Are appropriate schema types like Organization, LocalBusiness, Product, FAQ being used?
- Data completeness: Are the fields within the schema fully populated?
- Validity: Is the structured data technically correct?
Why Is It Important?
AI models can directly process structured data. If your address, business hours, and services are clearly defined in a LocalBusiness schema, AI uses this information directly. This significantly reduces the risk of hallucination.
5. Content Clarity Score
Range: 0-100
This score measures how easily your website content can be understood by AI models. Clear, structured, and well-organized content ensures that AI represents you correctly.
What Is Evaluated?
- Heading hierarchy: Are H1, H2, H3 tags used in a logical order?
- Paragraph structure: Is content divided into readable paragraphs?
- List usage: Are services, features, and similar information presented in list format?
- Meta information: Are title, description, and Open Graph tags properly defined?
- Content length: Is there sufficient and meaningful content?
6. Bot Access Table
This section shows the access status of 8 different AI crawlers to your site:
- GPTBot (OpenAI): ChatGPT's web crawler
- ClaudeBot (Anthropic): Claude's web crawler
- Google-Extended: Google's AI training crawler
- PerplexityBot: Perplexity's search crawler
- Applebot: Apple's AI and Siri crawler
- Bytespider (TikTok): ByteDance's crawler
- FacebookBot: Meta's crawler
- Amazonbot: Amazon's crawler
For each crawler, an "Access Granted" or "Blocked" status is shown. Ideally, access should be open to all AI crawlers.
7. Generated Files
AURA automatically generates files for your site as a result of the analysis. You can quickly increase your AI visibility by using these files:
llms.txt File
An introduction file prepared for AI models about your company. Upload this to the root directory of your website (for example, yoursite.com/llms.txt).
JSON-LD Structured Data
Structured data code to be added to your website's main page. Paste this code into the <head> section of your homepage.
Robots.txt Recommendations
Lines to be added to or updated in your existing robots.txt file. Apply these recommendations to grant access permission to AI crawlers.