AI Bot UA Classifier
Real-time bot classification engine for AI crawler traffic.
Forged from real client work, proof attached. Pick a piece or take the whole system.
Browse the full catalog → Browse ready-made kits → Build your own set →Build and maintain `/llms.txt` + `/llms-full.txt` discovery files (Jeremy Howard 2024 proposed…
Builds and maintains the /llms.txt and /llms-full.txt discovery files that let AI crawlers like GPTBot, ClaudeBot, and PerplexityBot find your content hierarchy without parsing HTML. It generates both files from a single CMS or MDX source at build time, wires up cache purge on content change, and runs conformance checks so your site stays AI-discoverable.
Prices include 20% VAT. · Forged on real agency work · one-time, no lock-in
Inside the run · no black box
The skill generates /llms.txt (short index, 500KB cap) and /llms-full.txt (full content, 5MB cap) from one canonical CMS source at build time, then wires the validation and cache purge chain around them. It is positioned honestly: a cheap side benefit for Perplexity and agent tools, never sold as a Google ranking lever.
llms-txt-builder · core
core active · 6 lines
Making a large multilingual site discoverable to AI crawlers
Increasing AI citation odds for ChatGPT, Perplexity, and AI Overviews
Signaling content priority with grouped sections and an Optional tier
Rapidly exposing new content to AI bots after a deploy
Resolving 'ChatGPT isn't reading or citing us' complaints
Keeping llms.txt in sync with sitemap.xml via drift detection
Drag time forward. Watch what stays.
Forever
That's what owning means.
ai writing tool: subscription
expired · access lostanalytics suite: subscription
expired · access lostdesign platform: subscription
expired · access lost(nothing left)
Get AI engines to see new content in hours instead of weeks
license: perpetualSteer crawl budget toward your highest-value pages first
license: perpetualPrevent admin and staging URL leaks with a built-in validator
license: perpetualKeep AI discovery files in sync automatically on every content change
license: perpetualsubscriptions expire · deeds don't
Pick a piece up. Watch it work.
Build-time generators for Astro and Next.js from a CMS or MDX source
6 parts · one working system · ships instantly by email
From the field · a real case
SEO engineers and developers who want their content reliably discovered and cited by AI search engines.
then this was forged for you.Universal by design: these run in any AI. Delivered in the open Agent Skills + MCP format (native in Claude); ChatGPT, Gemini, Cursor and Copilot adapt the same files their own way.
The build-time generators target Astro 5 and Next.js 15 with a Sanity or MDX single source. On another stack you can borrow the file structure, the conformance validator logic, and the sync discipline, but you would wire the generation step into your own build yourself.
Because it goes stale the moment content changes. The pipeline regenerates both llms.txt and llms-full.txt from your CMS or MDX source at build time, purges the CDN cache on content change, and runs drift detection against sitemap.xml so the file never silently falls behind your site.
No. llms.txt is a proposed standard (llmstxt.org) and crawler adoption varies. What it does is remove the discovery barrier: GPTBot, ClaudeBot, and PerplexityBot get a clean content hierarchy instead of HTML soup. Whether you get cited still depends on the engine and your content.
By email right after purchase: ready to run, downloaded instantly, no setup wait.
A one-time purchase; no subscription or hidden fees. VAT (20%) is included.
As a digital product, it can’t be refunded once downloaded. That’s why we show exactly what’s inside and who it’s for, right here.