Changelog

Notable product changes. Current package: 0.1.0 (15 August 2026).

All notable changes to RobotsLLM for AI-SEO are recorded here.

[0.1.0] - 2026-08-15

Initial release

P0 MVP for CS-Cart 4.18+ (verified on 4.18.3), PHP 8.1+. Seven modules:

  1. AI Crawl Policy - RFC 9309-aware robots.txt compiler with Growth / Open / Strict / Custom presets, protected CS-Cart paths, live preview, before→after diff, version ledger, one-click rollback, and a bot URL simulator. Policy is applied only by Publish; install does not change the live robots.txt.
  2. Bot Registry - seed of 31 bots, per-storefront allow/block/default overrides, optional sync from ai-robots-txt into pending_review (apply is manual).
  3. AI Discovery - /llms.txt and per-language maps with pin/exclude/order curation and a token budget (default 15 000).
  4. Markdown Mirrors - .md pages for categories, CMS pages, and products; atomic publisher; dirty queue; hash reconciliation worker; full rebuild with checkpoint.
  5. SEO Robots Tweaks - critical-path Disallows copied into dedicated groups, Sitemap: line, X-Robots-Tag: noindex on mirrors and llms.
  6. AI Analytics - PHP bot logger, optional access-log parser, IP/rDNS verification, AI-referral sessions/orders/revenue, daily aggregation, admin dashboard.
  7. Security & Self-Audit - DOM sanitizer (not regex), PII/secret scanner (critical secrets block publish), HTTP / content / parity self-audit.

Serving (honest): /llms.txt and *.md are delivered through PHP serve (dispatch=robots_llm.serve) because CS-Cart denies web access to var/. Responses include ETag / Last-Modified and 304; X-Robots-Tag: noindex. Zero-PHP static delivery is a later optimisation.

Cron (recommended panel jobs): queue (every 5 min), logparse (every 15 min), aggregate (nightly), audit (nightly), llms (nightly), registry_sync (daily). Admin languages: Ukrainian, English. No CS-Cart core patches. Install via zip.