Precision Robots Directive Control for Every Magento URL

SEO Indexation Rules gives you deterministic control over which pages Google indexes from your Magento store. Configure rules in Stores → Configuration → Towering Media → SEO Indexation Rules, targeting URLs by query parameter, Magento full action name, or path pattern. The resolved directive is applied both as a <meta name="robots"> tag in the page head and as an X-Robots-Tag HTTP response header.

Layered indexation control prevents crawl budget waste, keeps faceted navigation and internal search out of Google's index, and ensures staging environments are never accidentally indexed.

NOINDEX,FOLLOW for search results, faceted nav, and pagination
NOINDEX,NOFOLLOW for preview, checkout, and cart pages
Rule targeting by Magento full action name (e.g. catalogsearch_result_index)
Rule targeting by URL path pattern with wildcard support (e.g. /search/*)
Query parameter-based rules for parameterised URL variants
Applied as both <meta robots> and X-Robots-Tag header

SEO Indexation Rules config — Rule-based noindex/nofollow configuration — targeting actions, paths, and parameters

GSC coverage after indexation rules — Correct indexation dramatically improves GSC coverage quality and crawl efficiency

Automatic Staging Noindex & Hostname Policy

Every DDEV and staging hostname is automatically set to noindex — even when the module is disabled. This built-in safety net prevents staging content from appearing in Google search results, regardless of configuration errors or deployment mistakes.

Configure additional Noindex Hostnames in admin (one per line) to extend this protection to other pre-production environments, QA servers, or client preview domains. The hostname policy applies before rule evaluation, ensuring no staging URL ever reaches a live index.

Built-in noindex for all *.ddev.site hostnames
Configurable noindex hostname list for staging/QA servers
Hostname policy active even when module is disabled (failsafe)
Unit-tested rule parsing and resolution for safe staging validation
Compatible with Sitemaps Plus — noindexed URLs excluded from sitemap builds

Requirements

Magento 2.4.4+ · PHP 8.1+
Composer: toweringmedia/module-seo-indexation-rules

SEO Indexation Rules for Magento 2

See It In Action

Precision Robots Directive Control for Every Magento URL

Automatic Staging Noindex & Hostname Policy

Requirements