Blog
How AI crawlers actually behave, what to serve them, and how to tell whether any of it is
working. Every post is also available as markdown at
/blog/<slug>.md.
-
Edge · August 1, 2026
Doing AEO at the edge, without rewriting your application
Why answer engine work keeps stalling in the backlog, and how a reverse proxy in the request path delivers structured data, llms.txt, and crawler control without an application change.
-
Measurement · July 25, 2026
Tracking AI referral traffic in GA4 and beyond
The referrers to segment on, why the numbers look small, why they undercount, and how to connect a referral back to the page the model actually cited.
-
AEO · July 18, 2026
An AEO checklist for SaaS companies
Twenty-two checks across access, content, structure, and measurement — ordered so the diagnostic work happens before the writing, and grouped by who on your team actually owns each one.
-
Crawlers · July 11, 2026
robots.txt for AI crawlers: a directive-by-directive reference
Every AI user agent worth naming, what each one controls, the precedence rules that decide which directive wins, and the wildcard mistake that quietly removes sites from AI answers.
-
Measurement · July 2, 2026
How to measure AI crawler traffic (and why your analytics shows zero)
Google Analytics cannot see GPTBot. Here are the four ways to capture AI crawler traffic, what each one costs you, and the five metrics worth reporting once you have the data.
-
AEO · June 24, 2026
llms.txt: what it is, what it is not, and how to write one that earns its place
A practical guide to the llms.txt format — the correct structure, the mistakes that make it useless, and an honest account of what adoption actually looks like today.
-
Crawlers · June 12, 2026
GPTBot vs ChatGPT-User vs OAI-SearchBot: which one is reading your site
OpenAI operates three distinct crawlers with three different purposes. Blocking the wrong one costs you citations; allowing the wrong one costs you leverage. Here is how to tell them apart in your logs.
-
AEO · June 3, 2026
What is answer engine optimization (AEO)?
Answer engine optimization is the practice of making your content retrievable, parseable, and quotable by AI systems that answer questions directly instead of returning a list of links.