Free indexing checks work best in a fixed order: first confirm the URL really is missing from Google, then rule out the technical reasons it might be blocked, and only then think about crawling, links and content. Skipping straight to an indexing service is how people pay to submit pages that tell Google to stay away.
Step 1: confirm the URL is really not indexed
A site: search is a rough signal, not a verdict. For your own site, the URL Inspection tool in Search Console is the reference. For backlinks and other pages you don't own, use an index checker. On the SpeedyIndex Google index checker page you can check up to five URLs for free without creating an account, and larger lists in bulk.
Step 2: check the status code
Google doesn't index URLs that return a 4xx code, and pages that keep returning 5xx errors are eventually dropped (Google on HTTP status codes). A page that opens fine in your browser can still fail for a crawler, for example behind a bot challenge or under load.
Validates status codes for a whole list with a Googlebot user agent.
Finds 500, 502, 503 and 504 responses and Retry-After headers.
Step 3: look for noindex and robots.txt blocks
Two different mechanisms, often confused:
- noindex (meta robots tag or
X-Robots-Tagheader) lets Google fetch the page but asks it not to index it. - robots.txt Disallow stops crawling. Google notes that if robots.txt blocks a page, it never sees a noindex rule on it. See also Google's introduction to robots.txt.
Reads both the HTML tag and the response header for every URL in your list.
Step 4: follow redirects to the end
A submitted URL that redirects gets indexed, if at all, under its destination. Long chains and 302s used for permanent moves send weak or mixed signals. Trace the chain and submit the final URL.
Shows every hop between the URL and its final destination.
Step 5: make sure the page is in your sitemap
Sitemaps help Google discover URLs, especially new or deep ones. Pull the URL list from the sitemap and compare it with the pages you expect to rank. Pages missing from the sitemap and linked from nowhere are easy for Google to overlook.
Turns any sitemap into a plain URL list for checking.
If everything passes
A page can be open, error-free and in the sitemap and still not be indexed. At that point the question is no longer technical: does the page add something that other indexed pages don't, and is it linked from pages Google already crawls? Internal links from strong pages often help more than any submission.
Save the results with a date. If the page is still missing a month later, you can compare and see what changed instead of starting over.
FAQ
Can I check if a page is indexed without Search Console?
Yes. An index checker queries Google for the exact URL, so it works for pages on sites you don't own, such as backlinks.
Is a site: search reliable?
It is useful as a quick signal, but results can be incomplete. Use URL Inspection for your own pages and an index checker for lists.
Which check should I run first?
Index status, then status codes. There is no point in checking noindex on a page that returns 404.
Sources
- Google Search Central: HTTP status codes and network errors
- Google Search Central: Block indexing with noindex
- Google Search Central: Introduction to robots.txt