What is llms.txt and llms-full.txt?

llms.txt is a standardized Markdown file proposed by llmstxt.org to serve structured site manifests to AI models (like ChatGPT, Claude, and Perplexity). llms-full.txt extends the manifest by appending full extracted text content for offline LLM indexing.

Where should I host the llms.txt file?

Place your llms.txt file in the root directory of your domain (e.g., https://yourdomain.com/llms.txt) or inside your framework static public directory.

Do search engines and AI web crawlers use llms.txt?

Yes. AI assistants and RAG search engines parse llms.txt to fetch precise documentation URLs without wasting context window capacity on unneeded site layout elements.

How often should I regenerate my llms.txt file?

Regenerate your llms.txt whenever you add major new documentation pages, API endpoints, or product guides to ensure AI crawlers receive updated links.

[llms.txt]Static Developer Tool

llms.txt & llms-full.txt Generator

Generate canonical, spec-compliant (llmstxt.org) Markdown manifests from XML sitemaps, website URLs, or custom links to optimize AI indexing.

SELECT INPUT MODE:

Enter Sitemap XML URL:

1. Project & Links Config

Project / Site Name (H1)

One-Line Summary (> Blockquote)

Additional Free-Text Context (Optional)

Mapped Resource Links (5)

# RankLLMs

> Student-first AI decision platform helping students and beginners compare models, tools, and free credits.

RankLLMs provides noise-free AI tutorials, verified student cloud credit guides, and browser-based developer utilities.

## Primary Resources

- [Blog & Practical Guides](https://rankllms.com/blog): Evergreen AI guides, model explainers, and daily news for students.
- [Student Offers & Cloud Credits](https://rankllms.com/student-offers): Verified student discounts, free cloud credits, and education packs.

## Documentation

- [Zero-Latency Browser Tools](https://rankllms.com/tools): Browser-based prompt utilities, token counters, and manifest generators.

## Guides

- [AI Release Timeline](https://rankllms.com/timeline): Chronological activity stream of AI releases & site updates.

## Optional

- [A-Z AI Glossary](https://rankllms.com/glossary): Simple, jargon-free explanations of core artificial intelligence terms.

ONE-CLICK DEPLOYMENT INSTRUCTIONS:

Save llms.txt into your project's public/ folder (e.g. public/llms.txt). Astro will serve it automatically at yourdomain.com/llms.txt.

Canonical Spec Compliance (llmstxt.org)

Our generator adheres strictly to the official llmstxt.org standard formatting:

# H1 Project Title

Required primary title identifying your application or platform.

> Blockquote Summary

One-line high-level overview explaining what the site provides.

## H2 Categorized Sections

Structured Markdown link lists formatted as - [Page Title](url): description.

## Optional (Context Truncation)

Lower-priority links that LLMs can safely drop under tight context limits.

Frequently Asked Questions

What is the difference between llms.txt and llms-full.txt?

llms.txt is a lightweight Markdown index file listing curated links and concise page descriptions. llms-full.txt appends the complete extracted text content for each page, allowing LLMs to digest your entire documentation offline without follow-up HTTP requests.

Is llms.txt an official web standard?

It is an open community specification (proposed by llmstxt.org) adopted by developer platforms, framework builders, and AI search engines to simplify LLM site indexing.

Do search engines and AI assistants use llms.txt?

Yes. AI search bots (like ChatGPT, Claude, and Perplexity) read llms.txt to discover structured documentation paths without wasting context window tokens on navigation menus or footers.

Where should I place the llms.txt file?

Host the file at your site's root URL (e.g. https://yourdomain.com/llms.txt). For Astro, Next.js, or static sites, place the file inside your public/ folder.

How often should I update or regenerate my llms.txt file?

Regenerate llms.txt whenever you publish new major guides, API endpoints, or documentation updates to keep AI assistants synchronized with your site.