Issue 199

This issue checks whether a website publishes an llms-full.txt file at the root domain, which is an extended version of llms.txt that provides complete page content for AI ingestion. This emerging standard helps AI systems understand and cite website content more effectively.

A passing implementation means:

• An llms-full.txt file is accessible at https://example.com/llms-full.txt
• The file contains structured content from the website in a format optimized for LLM consumption
• The file is kept up-to-date with the site's current content

Example location:

https://example.com/llms-full.txt

AI Content Ingestion: Unlike llms.txt which provides a summary, llms-full.txt provides complete content, allowing AI systems to have full context about your website.

Improved AI Citations: When AI systems have complete content access, they can provide more accurate citations and references to your pages.

Emerging Standard: As AI search engines and LLMs become more prevalent, having structured content files demonstrates technical sophistication and forward-thinking SEO.

Content Control: By providing an llms-full.txt file, you control exactly what content AI systems see, rather than relying on their crawlers to interpret your pages.

Competitive Advantage: Early adoption of this standard may provide advantages as AI search becomes more prominent.

SEO Health Score: Publishing llms-full.txt demonstrates comprehensive AI optimization and improves the technical SEO score.

1. Understand the format - The llms-full.txt file should contain structured, complete content from your website in a format optimized for LLM parsing (typically markdown or plain text with clear structure).

2. Create the file - Generate an llms-full.txt file that includes:

   • Complete page content (not just summaries)
   • Clear headings and structure
   • Important metadata (publication dates, authors, etc.)
   • Clean, parseable formatting

3. Place at root domain - Upload the file to your website's root directory so it's accessible at:

   https://example.com/llms-full.txt
   

4. Reference from llms.txt - If you have an llms.txt file, you can reference the full version:

   # Website Name
   > Summary description
   
   ## Full Content
   - [Complete Content](llms-full.txt)
   

5. Keep updated - Ensure the file is regenerated when site content changes significantly.

6. Validate accessibility - Verify the file is accessible and returns proper content-type headers.

Example 1: Basic llms-full.txt

Problematic State (Fails): No llms-full.txt file exists. AI systems must crawl individual pages to understand content.

Corrected State (Passes): Create llms-full.txt at root domain:

# My Website

## Homepage

Welcome to my website. We provide SEO services...

## About Us

Our company was founded in 2020...

## Services

### SEO Audit

We provide comprehensive SEO audits...

### Content Marketing

Our content marketing services...

Example 2: Referencing from llms.txt

Problematic State (Fails): llms.txt exists but doesn't reference the full version.

Corrected State (Passes): Add reference in llms.txt:

# My Website

> Complete SEO services and resources

## Full Content

- [Complete Site Content](llms-full.txt)

## Key Pages

- [Services](/services)
- [Blog](/blog)

Example 3: Keeping Content Updated

Problematic State (Fails): llms-full.txt is outdated and doesn't reflect recent content changes.

Corrected State (Passes): Set up automated generation to keep llms-full.txt updated when content changes:

• Integrate with CMS to regenerate on publish
• Schedule weekly regeneration
• Include latest blog posts and pages

PixyScan performs the following checks:

1. Attempts to fetch the file - The crawler requests https://example.com/llms-full.txt (and common variations like llmsfull.txt).

2. Validates existence - PixyScan checks if the file returns a 200 OK status.

3. Validates content - The system performs basic validation to ensure the file:

   • Contains actual content (not empty)
   • Is in a text-based format (not binary)
   • Has reasonable file size (not just a placeholder)

4. Checks format - While the format is still emerging, PixyScan may check for basic structure (markdown headings, clear sections, etc.).

5. Reports status - The issue passes if a valid llms-full.txt file is detected at the root domain; otherwise, it's flagged as needing attention.