Dynamic llms.txt Generator – Free WordPress Plugin
Dynamic llms.txt Generator dynamically creates a structured file in the root of your WordPress website. The file includes page-level metadata, heading structure, and main content for posts, pages, products, or any custom post types. It is fully configurable via an admin UI and optimized for efficient performance through caching.
The plugin is built to make your site AI-friendly: it helps language models or AI-based tools parse your content more reliably by offering clean, structured text formats, delivering what might be considered the “AI-equivalent” of a sitemap or content feed. With support for SEO plugins, WooCommerce, and customizable settings, Dynamic llms.txt Generator aims to be the go-to free solution for online publishers who want to gain visibility not just with search engines, but with modern AI-driven discovery systems.
Benefits of ColorWhistle’s Free Dynamic llms.txt Generator
AI-friendly content output
The plugin outputs a well-structured that contains metadata, headings, and full content for each page/post/product, making it easier for AI crawlers or LLM-based tools to understand and process your site content.
Automatic & configurable generation
Admin UI allows you to select which post types to include, set word limits, include meta/excerpt/taxonomy, choose update frequency (on post change, daily, weekly), or trigger it manually.
Performance optimized
Caching via a custom DB table ensures the generation process is fast and efficient even for large sites with many pages.
SEO & content-management compatibility
Works alongside popular SEO plugins (e.g., RankMath / Yoast SEO) and can optionally add a “noindex” header or integrate with sitemaps.
WooCommerce support
For e-commerce sites, product SKUs and price data are included (if WooCommerce is active), making product pages AI-ready as well.
Free and open source
As a free plugin on WordPress.org, it’s accessible to everyone and open for contributions, making adoption risk-free.
What’s the Difference between robots.txt vs llms.txt
Feature / File | robots.txt | llms.txt |
|---|---|---|
| Primary purpose | Controls what search engine crawlers (like Googlebot, Bingbot) can access, permissions to crawl or index. | Provides AI-friendly structured content: summaries, metadata, link structure, guiding AI models on which content to ingest and how. |
| Audience | Traditional search engines / web crawlers | AI systems / Large Language Models (LLMs) / AI-based crawlers / agents |
| Format | Simple directive-based text (e.g. User-agent, Allow, Disallow, Sitemap) | Usually Markdown or structured text: includes headings, metadata, page summaries, organized links/contextual info. |
| Content included | No page content, only crawl/index instructions | Rich content: metadata, headings structure, main content, optionally product info (SKUs/prices), post/page content, where applicable |
| Use cases | Manage SEO crawl/indexing, prevent indexing of certain pages, manage crawl budget, block bots | Make site “AI-ready”, help AI models read and understand content structure, enable AI-based summarization or reference generation |
| Complementarity | Essential for traditional SEO and crawler control | Optional but increasingly valuable for AI-driven content discovery and future-proofing content visibility |
How to Create an llms.txt Using Dynamic llms.txt Generator
- Install the plugin: Upload the plugin folder to /wp-content/plugins/dynamic-llms-txt-generator/.
- Activate it through the WordPress “Plugins” menu.
- Navigate to Tools → Dynamic llms.txt in the WordPress admin dashboard.
- Configure plugin settings:
- Choose which post types to include (pages, posts, products, custom post types)
- Set word limits, choose to include meta/excerpts/taxonomies, control inclusion in sitemap or “noindex” as needed.
- Choose update frequency: on content change, daily, weekly, or manually.
- Once configured, the plugin will generate llms.txt at your site’s root
- (Optional) If you use a sitemap plugin (RankMath/Yoast), you can enable integration so the llms.txt link appears in sitemap or is indirectly discoverable.
Popular Use Cases for ColorWhistle’s Free Dynamic llms.txt Generator
AI-Ready Content Publishing
Agencies, bloggers, or content-heavy sites that want their material to be AI-discoverable, to increase chances of being used by chatbots, AI search assistants, or AI-powered content platforms.
E-commerce Stores (WooCommerce)
When product SKUs, descriptions, and pricing matter, ensuring product pages are structured for AI ingestion, so future AI-powered shopping assistants can understand and surface products.
Websites with Custom Post Types / Dynamic Content
Sites featuring portfolios, knowledge bases, custom content types, where structured metadata and content hierarchy aid AI systems in understanding the site beyond regular pages.
SEO & Future-Proofing Strategy
As AI-driven search and discovery become more mainstream, having a clean, machine-readable content map could help with visibility on AI-powered platforms, not just traditional search engines.
Content Migration / Archival / Documentation
For agencies or developers who want to export site content in a clean, structured text format, useful for backups, static site generation, or AI-based summarization tasks.
Internal AI Training & RAG Systems
Export website content in a structured format for use with internal AI tools, chatbots, or RAG pipelines, without needing manual scraping or cleanup.
FAQ for ColorWhistle’s Free Dynamic llms.txt Generator
The file is written to the root directory of your WordPress installation (same directory as wp-config.php).
Depending on your configuration: immediately on post/page updates, on a daily or weekly schedule, or manually via the admin page.
No – the plugin uses caching and is optimized to avoid performance hits. Also, you have control whether to expose the llms.txt in sitemap or add a noindex header, so standard SEO behaviour remains unaffected.
It supports pages, posts, products (if WooCommerce is active), and any custom post types, with metadata, content, taxonomies, as per your configuration.
While robots.txt guides search engine crawlers on what to index, and sitemap.xml lists all URLs for search engines, llms.txt offers a structured, content-rich roadmap designed for AI systems (LLMs) — enabling more intelligent content ingestion, summarization, and referencing by AI-based tools. It serves a different but complementary purpose.
Dynamic llms.txt Generator is free and open source on WordPress.org.