SEO Indexation Rules for Magento 2
Deterministic robots control for Magento
- Route Rules By full action name
- Path Patterns Wildcards supported
- Staging Safe Hostname noindex policy
- Dual Output Meta and X-Robots-Tag
Precision robots control
Parameterized and staging URLs can waste crawl budget or leak non-production pages. SEO Indexation Rules applies noindex, nofollow, and related robots directives by route, path pattern, and hostname.
- Rules by full Magento action name
- Path pattern rules with wildcards
- Parameterized URL noindex with ignored params
- Automatic noindex for staging hostnames
Built for your store
Built for Magento 2.4.4+ with PHP 8.1+. Requires Search Intelligence Core and Toweringmedia Base; outputs meta robots and X-Robots-Tag.
- Requires Search Intelligence Core and Base
- Configure under SEO Indexation Rules
- Meta robots and X-Robots-Tag output
- Hostname and 404 policies can still apply when disabled
Precision Robots Directive Control for Every Magento URL
SEO Indexation Rules gives you deterministic control over which pages Google indexes from your Magento store. Configure rules in Stores → Configuration → Towering Media → SEO Indexation Rules, targeting URLs by query parameter, Magento full action name, or path pattern. The resolved directive is applied both as a <meta name="robots"> tag in the page head and as an X-Robots-Tag HTTP response header.
Layered indexation control prevents crawl budget waste, keeps faceted navigation and internal search out of Google's index, and ensures staging environments are never accidentally indexed.
NOINDEX,FOLLOWfor search results, faceted nav, and paginationNOINDEX,NOFOLLOWfor preview, checkout, and cart pages- Rule targeting by Magento full action name (e.g.
catalogsearch_result_index) - Rule targeting by URL path pattern with wildcard support (e.g.
/search/*) - Query parameter-based rules for parameterised URL variants
- Applied as both
<meta robots>andX-Robots-Tagheader
Automatic Staging Noindex & Hostname Policy
Every DDEV and staging hostname is automatically set to noindex — even when the module is disabled. This built-in safety net prevents staging content from appearing in Google search results, regardless of configuration errors or deployment mistakes.
Configure additional Noindex Hostnames in admin (one per line) to extend this protection to other pre-production environments, QA servers, or client preview domains. The hostname policy applies before rule evaluation, ensuring no staging URL ever reaches a live index.
- Built-in noindex for all
*.ddev.sitehostnames - Configurable noindex hostname list for staging/QA servers
- Hostname policy active even when module is disabled (failsafe)
- Unit-tested rule parsing and resolution for safe staging validation
- Pairs with the Search Intelligence suite (noindex exclusion from Sitemaps Plus is not implemented yet)
Requirements
- Magento 2.4.4+ · PHP 8.1+
- Requires Search Intelligence Core (
toweringmedia/module-search-intelligence-core) - Requires Toweringmedia Base (
toweringmedia/module-base) - Composer:
toweringmedia/module-seo-indexation-rules
Key Features
Request-based robots directives for parameterized URLs, routes, paths, and staging hostnames.
- Full action rules Match Magento routes such as catalogsearch_result_index.
- Path pattern rules Target URL paths with wildcards like /search/*.
- Parameterized URL noindex NOINDEX,FOLLOW for significant query strings, with ignored params.
- Meta and header output Applies the directive as meta robots and X-Robots-Tag.
- Builtin DDEV noindex *.ddev.site hosts forced to NOINDEX,NOFOLLOW.
- Configurable host list Add staging and QA hostnames in admin, one per line.
- Works when disabled Hostname and 404 policies still apply if Enable is No.
- Fallback directive Optional default when no route or path rule matches.
Frequently Asked Questions
Does this module set canonical tags?
No. It only resolves and applies robots directives (meta robots and the X-Robots-Tag header). Canonical tags and CMS 404 page content stay with your theme or CMS noroute page.
Where do I configure indexation rules?
Go to Stores → Configuration → Towering Media → SEO Indexation Rules. You can also open the same section from Intelligence SEO Suite → Indexation Rules. Set Noindex Hostnames, Enable, parameterized URL options, route rules, and path rules there.
Does it require Search Intelligence Core?
Yes. Composer requires toweringmedia/module-search-intelligence-core (and toweringmedia/module-base). Storefront robots application is also gated by the Search Intelligence suite enable switch.
Do you offer support?
Yes. Email support@toweringmedia.com or call (773) 466-2454. Updates and support continue while your subscription is active.
Can I try a demo?
Yes. Use the View Demo button on this page. For a guided walkthrough, email support@toweringmedia.com.
What happens when I don’t renew?
Uncheck auto-renew at purchase, or cancel later. You keep access until the end of the paid period. After that, updates and support stop.
Compatible with your Magento 2 store
Built for Magento 2.4.4+ with PHP 8.1+. Install via Composer as toweringmedia/module-seo-indexation-rules. Requires toweringmedia/module-search-intelligence-core and toweringmedia/module-base (Composer pulls them in).
-
Magento 2.4
Open Source & Adobe Commerce
Hyvä compatibleBuilt for modern storefronts
Updates & supportKeep your store running smoothly