Skip to content
SemmeshSemmesh

Metered Own-Server Check

HTTP SEO Header & X-Robots-Tag Inspector

Inspect canonical Link headers, X-Robots-Tag, Cache-Control, and HSTS.

How to use this tool

  1. 01

    Enter the public URL of a page, PDF or other file.

  2. 02

    Check the X-Robots-Tag value first: a noindex here removes the URL from results even when the HTML looks correct.

  3. 03

    Review the Link, Strict-Transport-Security and Cache-Control headers returned.

What to know

  • A noindex header left behind by a staging configuration is easy to miss because it never appears in the page source.
  • X-Robots-Tag is the way to keep non-HTML files such as PDFs out of search results.

Common questions

What if the meta robots tag says index but the X-Robots-Tag header says noindex?
Google applies the more restrictive rule, so the URL is treated as noindex.

Turn single-page checks into continuous verified SEO progress

Connect Google Search Console free inside Semmesh to prioritise technical fixes on pages that actually receive impressions and clicks.

See how the Action Engine works