AgentReady
Your website, fluent in AI.
When AI agents request your pages, they receive clean, structured markdown instead of raw HTML. Automatic content negotiation via the Accept: text/markdown header. No Cloudflare dependency. Works with any hosting.
At a Glance
The Problem
AI agents are becoming the primary way your content gets consumed. But they're choking on your HTML.
Token Waste
AI agents spend up to 80% of their context window parsing navigation menus, footers, cookie consent banners, and JavaScript that adds zero information value.
Extraction Errors
When agents try to extract content from complex HTML layouts, they misinterpret structure, lose formatting, and return incomplete or garbled information to users.
Invisible to AI
Without structured data delivery, your expertise is effectively invisible to AI search engines like Perplexity, ChatGPT Browse, and Claude — the interfaces your future clients are already using.
How It Works
Standard HTTP content negotiation. No client-side changes required. Human visitors see HTML; AI agents receive markdown.
Content Negotiation
The agent sends Accept: text/markdown. nginx detects this header and routes the request to the markdown service instead of serving HTML.
Smart Conversion
The service strips navigation, headers, footers, scripts, and presentational markup. Extracts metadata (title, description, canonical URL, language) into structured frontmatter.
Clean Delivery
The agent receives a YAML frontmatter block followed by pure markdown content. Token count headers included. Same URL, same content, agent-optimised format.
curl -H "Accept: text/markdown" https://example.com/en/about.html
# Response
---
title: "About Us"
description: "Our story and background"
url: "https://example.com/en/about.html"
language: "en"
---
# About Us
Clean, structured content without navigation, footers, or scripts...
Features
Everything needed to make your website speak fluent AI.
YAML Frontmatter
Every response includes structured metadata: title, description, canonical URL, language, keywords, and conversion timestamp. Agents can parse context without reading the body.
Content Negotiation
Standard HTTP Accept header detection at the nginx level. Zero changes to your existing pages. Human visitors are completely unaffected.
Pre-generated Static
Static pages are converted to markdown ahead of time and served directly from disk. No conversion overhead on request. Sub-millisecond response times.
Real-time Blog Posts
Blog posts are converted dynamically from the database. Always current, always in sync. Category, tags, author, and publication date included in frontmatter.
Token Estimation
Every response includes an X-Markdown-Tokens header with an approximate token count. Agents can budget context windows before reading the body.
Nightly Regeneration
Automated nightly regeneration ensures markdown files stay in sync with page changes. Admin endpoint available for on-demand regeneration after major updates.
AgentReady vs Cloudflare
Cloudflare's Markdown for Agents is a CDN-level toggle. AgentReady is a full implementation you own and control.
| Capability | AgentReady | Cloudflare |
|---|---|---|
| Works with any CDN/hosting | ✓ | ✗ Cloudflare only |
| Self-hosted, data stays on your infra | ✓ | ✗ CDN edge |
| Customisable conversion rules | ✓ Full control | ✗ One-size-fits-all |
| YAML frontmatter with metadata | ✓ | ✗ |
| Pre-generated static + dynamic hybrid | ✓ | ✗ Real-time only |
| Token count estimation | ✓ | ✗ |
| Includes implementation consulting | ✓ | ✗ Toggle switch |
| Vendor lock-in | None | Cloudflare |
Architecture
A lightweight middleware layer that sits between your web server and your existing content. No changes to your site required.
nginx Content Negotiation
A map directive detects the Accept: text/markdown header and conditionally routes requests to the markdown service. Standard HTTP, no middleware required.
Conversion Pipeline
BeautifulSoup parses and cleans the HTML (strips nav, footer, scripts, cookie banners). markdownify converts the cleaned content to structured markdown with proper heading hierarchy.
Hybrid Delivery
Static pages are pre-generated and served from disk (zero latency). Dynamic content (blog posts, CMS pages) is converted in real-time from the database. Best of both approaches.
Service Tiers
From a one-time setup to fully managed service. Choose the level of support that fits your organisation.
One-Time
Assessment + Setup
Full audit of your site's AI readiness, followed by implementation of the markdown delivery pipeline.
- Site audit and content mapping
- nginx configuration for content negotiation
- Conversion pipeline deployment
- llms.txt and llms-full.txt generation
- Content-Signal header configuration
- Testing with major AI agents
Monthly
Managed Service
We host and maintain the markdown service container. You focus on content; we ensure agents always receive clean output.
- Hosted conversion container
- Nightly auto-regeneration
- Monitoring and uptime guarantees
- Markdown index maintenance
- Agent compatibility updates
- Monthly analytics report
Custom
Enterprise
Deep integration with your CMS, multi-language support, custom metadata schemas, and dedicated SLA.
- CMS plugin development (WordPress, Drupal, custom)
- Multi-language markdown generation
- Custom JSON-LD and metadata schemas
- API integration for dynamic content
- Dedicated support SLA
- On-premise deployment option
Use Cases
Every organisation with a website needs to think about how AI agents consume their content. Here's who benefits most.
AI Search Visibility
When Perplexity, ChatGPT, or Claude Browse fetches your pages, they get clean structured content instead of HTML noise. Your expertise surfaces in AI-generated answers.
Developer Documentation
API documentation, technical guides, and knowledge bases become instantly consumable by coding assistants and developer tools that integrate LLM capabilities.
SEO for AI
As AI-mediated search grows, structured markdown delivery becomes the equivalent of what SEO was for Google. Early adopters gain the same advantage that early SEO adopters had in 2005.
Ready to speak the language of AI?
Your content deserves to be understood — by humans and agents alike. AgentReady makes your website fluent in AI without changing a single page of your existing site.