Skip to content
BlogRainbow AI Ready

llms.txt · llms-full.txt · Markdown

Make your website easier for AI assistants to understand.

BlogRainbow AI Ready crawls your site, writes an accurate llms.txt and clean Markdown, publishes it, and keeps it current. No code, no guesswork, no invented facts.

Checks your homepage, robots.txt and sitemap. No signup needed. Limited to a few analyses per hour.

acme.example/llms.txtExample output
# Acme Widgets

> Acme Widgets designs and manufactures durable steel widgets for home workshops and small factories.

Official website: https://acme.example

- Primary language: en
- Contact email: hello@acme.example

## Main pages

- [About Acme Widgets](https://acme.example/about): Family workshop building repairable widgets from recycled steel.
- [Contact](https://acme.example/contact): Opening hours, phone and workshop address.

## Products

- [Blue Widget](https://acme.example/products/blue-widget): Powder-coated steel widget for heavy daily use.

## Optional

- [Full content (llms-full.txt)](https://files.blograinbow.com/k3x9…/llms-full.txt)

How it works

From URL to published llms.txt in four steps

  1. 01

    Add your website

    Enter your URL. We check robots.txt, find your sitemaps, detect your platform and produce a first readiness report.

  2. 02

    Verify ownership

    Add a DNS TXT record, upload a small file, or paste a meta tag. You can preview your files before verifying.

  3. 03

    We crawl and generate

    Allowed pages are fetched politely, converted to clean Markdown, and turned into llms.txt, llms-full.txt and JSON files.

  4. 04

    Publish and stay current

    Files go live on your hosted URL (or your domain via the plugin) and refresh on your schedule.

Features

Everything AI systems need to read your site accurately

Built for accuracy first: every fact is traceable to a page you published, and every AI-written sentence is labelled.

llms.txt that follows the proposal

A concise H1/summary/sections file that follows the llmstxt.org proposal, with every link checked against pages we actually crawled.

llms-full.txt and clean Markdown

The full text of your important pages as clean Markdown, one file per page, plus an llms-full.txt companion that is split automatically when it gets large.

Facts, never fabrications

Prices, SKUs, availability and contact details only come from what your pages publish (structured data, meta tags, visible links). AI text is labelled and source-linked.

Kept up to date automatically

Weekly crawls by default (daily or monthly on request), with incremental fetching so unchanged pages are not processed again.

Hosted or on your own domain

Every site gets hosted URLs instantly. The WordPress plugin serves the files from your own domain root, and guides cover other platforms.

Versions and one-click rollback

Each generation is validated and kept as an immutable version. A failed run never replaces a good published file, and you can roll back at any time.

AI-Agent Ready badge

A lightweight SVG badge that reflects your real status: verified ownership, a valid published llms.txt and a recent successful crawl.

Readiness report

Checks for HTTPS, robots.txt, sitemaps, structured data, meta descriptions and JavaScript-only content, with a score and concrete fixes.

Private by design

Generation runs on our own server with a local AI model. Your content is never used to train models, and external AI providers are never required.

Why it matters

AI assistants read the web differently

Assistants and agents work best with concise, well-structured text. Navigation menus, scripts and pop-ups get in the way.

  • A curated index tells AI tools which pages matter and what each one covers.
  • Clean Markdown removes layout noise so your actual content is read correctly.
  • Published facts (products, prices, policies, contacts) stay consistent with your site.
  • Automatic refreshes mean AI tools never see last year's prices or retired pages.

We don't claim that any AI company will index, cite or rank your website. This is infrastructure for being read accurately, not an SEO guarantee.

Dashboard (illustration with sample data)acme.example

Status

Published

Pages

48

Next crawl

Mon 03:00

llms.txt · v12 · valid

llms-full.txt · v12 · 214 KB

pages/*.md · 48 files

products.json · 31 items

AI-Agent Ready badge

Show visitors your site is AI-ready

A tiny SVG served from our server that reflects your real status: verified ownership, a valid published llms.txt and a recent successful crawl. If something breaks, it stops saying 'Verified'.

AI-Agent Ready badge, light styleAI-Agent Ready badge, dark styleAI-Agent Ready badge, horizontal styleAI-Agent Ready badge, compact style

Not an official certification from any AI company.

Pricing

Simple, honest pricing

Start free. Upgrade when you want automatic weekly updates and AI-written descriptions.

Free

$0/month

  • 1 website
  • Up to 25 pages per crawl
  • Automatic monthly crawling
  • 2 manual crawls per day
  • llms.txt + llms-full.txt + Markdown pages
  • Hosted public files
  • AI-Agent Ready badge
  • Descriptions from your meta tags
  • Crawl history & readiness report
Start free
Recommended

Starter

$9/month

  • 1 website
  • Up to 100 pages per crawl
  • Automatic monthly, weekly, daily crawling
  • 5 manual crawls per day
  • llms.txt + llms-full.txt + Markdown pages
  • Hosted public files
  • AI-Agent Ready badge
  • AI-written page descriptions (local model)
  • JavaScript rendering for JS-only pages
  • Crawl history & readiness report
Start with Starter

FAQ

Questions, answered honestly

All questions

Give AI assistants an accurate picture of your website

Set up in a few minutes. Your first llms.txt is generated right after you add your site.