Metered Own-Server Check
HTTP SEO Header & X-Robots-Tag Inspector
Inspect canonical Link headers, X-Robots-Tag, Cache-Control, and HSTS.
How to use this tool
- 01
Enter the public URL of a page, PDF or other file.
- 02
Check the X-Robots-Tag value first: a noindex here removes the URL from results even when the HTML looks correct.
- 03
Review the Link, Strict-Transport-Security and Cache-Control headers returned.
What to know
- A noindex header left behind by a staging configuration is easy to miss because it never appears in the page source.
- X-Robots-Tag is the way to keep non-HTML files such as PDFs out of search results.
Common questions
What if the meta robots tag says index but the X-Robots-Tag header says noindex?
Google applies the more restrictive rule, so the URL is treated as noindex.
Related guide
How to run a technical SEO audit that earns measurable clicks
In Semmesh
First-Party Technical Site Audit & Fix Verifier
More free tools
Turn single-page checks into continuous verified SEO progress
Connect Google Search Console free inside Semmesh to prioritise technical fixes on pages that actually receive impressions and clicks.