Make the internet
machine-readable.
robots.txt tells machines where not to go. flyweb.json tells them what you have.
The problem
The web wasn't built for machines
And it's breaking everything AI tries to do.
HTML Soup
Every website is a unique snowflake of divs, classes, and JavaScript. Machines can't tell a product price from a footnote.
Scrape & Guess
AI agents scrape raw HTML, guess what's content vs. navigation, and hallucinate when they get it wrong. Fragile. Error-prone.
No Discovery
There's no standard way for a machine to ask: "What content do you have?" Every API is bespoke. Every integration is custom.
The result? AI that hallucinates, publishers that get scraped, and a web that no machine can reliably read.
The solution
One file. Your whole site, structured.
Add /.well-known/flyweb.json to your website.
It tells every AI agent on earth exactly what content you have and how to read it.
{
"flyweb": "1.0",
"entity": "TechCrunch",
"type": "news",
"resources": {
"articles": {
"path": "/.flyweb/articles", // where to find them
"format": "jsonl", // one JSON per line
"fields": ["title", "author", "date",
"summary", "content", "tags"], // what's available
"query": "/.flyweb/articles?tag={tag}" // how to search
},
"authors": {
"path": "/.flyweb/authors",
"format": "json"
}
}
} Any AI. Any website. One standard.
How it works
Three layers. One protocol.
Discovery
Every website publishes /.well-known/flyweb.json.
AI agents check this file first — like robots.txt but the opposite.
Instead of "stay away," it says "here's what I have."
Structure
Content is served as clean, structured data — JSON, JSONL, or any machine-readable format. No more parsing HTML. No more guessing what's a headline vs. a sidebar ad. Just data.
Query
Standard URL-based queries any AI agent can construct. No SDK. No API key.
Just GET /.flyweb/articles?tag=ai&limit=10.
Learnable in 5 minutes.
Comparison
Before & After
Same content. Completely different experience for machines.
<div class="post-container mx-4">
<div class="flex items-center gap-2">
<img src="/avatars/sarah.jpg" />
<span class="text-sm">Sarah Chen</span>
</div>
<h2 class="font-bold mt-4">
AI Agents Need Structure
</h2>
<div class="prose mt-2">
<p>The web was built for...</p>
<div class="ad-banner">...</div>
</div>
</div>
// Which part is the article?
// Where does content end?
// Is "Sarah Chen" the author? {
"title": "AI Agents Need Structure",
"author": "Sarah Chen",
"date": "2026-02-15",
"tags": ["ai", "web", "standards"],
"summary": "The web was built for...",
"content": "The web was built for...",
"url": "https://example.com/posts/42"
}
// Clean. Structured. Unambiguous.
// Zero parsing. Zero guessing. Who benefits
Everybody wins.
For Publishers
- ✓ Content discoverable by every AI agent on earth
- ✓ You control what's exposed — choose your fields, your format
- ✓ Built-in attribution — AI must cite its source
- ✓ One JSON file — add in minutes, no code changes
For AI Companies
- ✓ Clean, structured data instead of HTML soup
- ✓ Universal discovery — one protocol for every website
- ✓ Less hallucination — structured data means fewer errors
- ✓ Cooperative access — no more scraping legal battles
For Developers
- ✓ One standard to learn — works across every FlyWeb-enabled site
- ✓ No more reverse-engineering APIs or building scrapers
- ✓ Simple URL-based queries — no SDK required
- ✓ Open source spec — contribute, extend, build on it
Roadmap
The road ahead
Open standard. Open source. Open to everyone.
The Spec
Publish the flyweb.json specification.
Open source everything. Define the standard for how websites describe their content to machines.
Tools & Plugins
Reference implementations. WordPress and Shopify plugins. A validator tool. Make it trivially easy to add FlyWeb to any site in minutes.
Adoption
1,000+ sites FlyWeb-enabled. First AI company integration. Leaderboard of FlyWeb-ready sites. Prove the standard works at scale.
The Structured Web
Every website speaks machine. AI agents discover, read, and cite content reliably. No more scraping. No more guessing. The web becomes intelligent infrastructure.
Join the movement
Make your website
speak machine.
The web was built for human eyes. It's time to give machines a way in — a structured way.