Check If URL Is Indexed in Google: Find and Fix Indexing Problems
When you check if URL is indexed in Google, you need to answer two questions: whether Google is able to index the page, and whether it has actually chosen to. Our free Google Index Checker answers the first question for up to 20 URLs at once by fetching each page as Googlebot and testing every technical reason it could be excluded: status codes, redirects, noindex tags and headers, robots.txt rules, canonical tags and soft 404s. It also gives you one-click site: searches in Google and Bing for a quick view of the second question.
This guide explains how indexing works, how to confirm a page is indexed, why pages get left out and exactly how to fix each problem.
Key takeaways
- A page must be crawlable, return 200, have no noindex and point its canonical at itself to be indexed.
- The only definitive answer for your own site is URL Inspection in Google Search Console.
- robots.txt blocks crawling, not indexing; use noindex to keep a page out of Google.
- Indexable pages can still be skipped if they’re new, thin, duplicate or poorly linked.
What does “indexed” mean?
Google finds pages by following links and reading sitemaps (crawling), processes their content (rendering) and stores eligible pages in its index. Only indexed pages can appear in search results. If a page isn’t indexed, it gets no organic traffic from Google, no matter how good it is.
Crawling vs indexing vs ranking
- Crawling: Googlebot downloads the page.
- Indexing: Google analyses it and decides whether to store it.
- Ranking: Google decides where an indexed page appears for each search.
A problem at any stage stops the next one. Our tool focuses on the technical blockers that prevent crawling and indexing.
Check if URL is indexed in Google: three methods
Method 1: URL Inspection in Search Console (definitive)
For sites you own, Google Search Console’s URL Inspection tool tells you whether a URL is on Google, when it was last crawled, which canonical Google chose and why a page isn’t indexed. It’s the only fully reliable answer.
Method 2: the site: search (quick but approximate)
Search Google for site:example.com/your-page/. If the page appears, it’s indexed. If it doesn’t, it may not be indexed, but site: results are not complete or guaranteed, so treat a missing result as a clue rather than proof. Our tool creates these searches for each URL with one click.
Method 3: our Google Index Checker (indexability)
Use our tool to check whether pages can be indexed, including pages on sites you don’t own, such as competitors or link prospects, and to diagnose problems in bulk before you open Search Console.
How to use the Google Index Checker
- Paste up to 20 URLs, one per line. Pages from different sites are fine.
- Run the check. We fetch each URL with Googlebot’s user agent and follow redirects.
- Read the verdict for each URL: indexable, not indexable or warning.
- Expand any result to see the exact reason, such as the robots.txt rule and line number that blocks it.
- Click the site: links to see what Google and Bing show.
- Fix the issues, then request indexing in Search Console.
What the index checker tests
HTTP status code
Google only indexes pages that return 200 OK. Pages returning 404 or 410 are dropped, 5xx errors stop crawling, and redirects (301, 302) pass indexing to the destination. Trace redirect chains with our redirect checker.
noindex in the robots meta tag
A tag such as <meta name="robots" content="noindex"> tells Google not to index the page. Google explains this in its guide to blocking indexing with noindex. We also check Googlebot-specific tags.
noindex in the X-Robots-Tag header
The same instruction can be sent as an HTTP header, which is invisible in the page source. It’s common on PDFs and sometimes set accidentally by server or plugin settings.
robots.txt rules
If robots.txt disallows a URL, Googlebot won’t crawl it. We show the exact rule and line. Test and edit rules with our robots.txt tester, and read Google’s introduction to robots.txt.
robots.txt doesn’t remove pages
A URL blocked by robots.txt can still be indexed without its content if other pages link to it, appearing with no description. To keep a page out of Google, allow crawling and use noindex.
Common robots.txt mistake
Adding Disallow: / on a staging site and copying the file to production blocks the entire live site. Always check robots.txt after a launch or migration.
Canonical tag
A canonical tag pointing to a different URL tells Google that the other URL is the main version. The page you checked will usually not be indexed itself. That’s correct for duplicates, but a mistake if the canonical points to the wrong page. Google explains how to consolidate duplicate URLs.
Soft 404s
A soft 404 is a page that returns 200 but looks like an error or empty page, for example “no products found” or a page with almost no content. Google treats these like 404s and leaves them out. We flag pages with very little content or error-like wording.
JavaScript-rendered content
Sites built with JavaScript frameworks sometimes deliver an almost empty HTML page and load the content in the browser. Google can render JavaScript, but rendering may be delayed, and if important content or links only appear after scripts run, pages can be indexed slowly or incompletely. Server-side rendering or pre-rendering key pages removes that risk. URL Inspection’s “View crawled page” shows the HTML Google actually saw.
Why isn’t my page indexed? Reasons and fixes
| Reason | How to spot it | Fix |
|---|---|---|
| noindex tag or header | Our checker flags it | Remove the tag; check SEO plugin and CMS settings |
| Blocked by robots.txt | Rule and line shown | Remove or narrow the Disallow rule |
| Canonical to another URL | Canonical mismatch warning | Point the canonical at the page itself |
| Error or redirect | Non-200 status | Fix the error or update links to the final URL |
| Soft 404 / thin content | Low word count warning | Add useful content or return a real 404 |
| Not discovered yet | Indexable but not in site: | Add internal links and include it in your sitemap |
| Crawled, not indexed | Search Console status | Improve quality and uniqueness |
“Discovered – currently not indexed”
Google knows the URL exists but hasn’t crawled it yet, often because the site is new, the server is slow or there are many low-value URLs competing for crawl attention. Improve internal linking, speed up the server and remove or noindex low-value pages.
“Crawled – currently not indexed”
Google crawled the page but decided not to index it, usually because it’s thin, very similar to other pages or not useful enough. Make it more valuable, merge it with a similar page or improve its internal links. Our content quality checker highlights thin content and weak structure.
“Duplicate, Google chose different canonical”
Google decided another URL is the main version. Make the content clearly unique, align your canonical tags and internal links, and redirect true duplicates.
Search Console’s Page indexing report lists every one of these statuses for your site.
How to get a page indexed faster
- Fix any technical blocker flagged by our checker.
- Link to the page from your home page, menus or relevant, well-visited pages.
- Add it to your XML sitemap and make sure the sitemap is submitted in Search Console. Validate it with our XML sitemap checker.
- Request indexing with URL Inspection in Search Console.
- Make it worth indexing: unique, useful content that answers a real search.
- Keep the server fast and reliable so Google can crawl efficiently.
How long does indexing take?
Anything from a few hours to several weeks. Pages on established, frequently updated sites with good internal links are usually indexed fastest. New sites and pages buried deep in the site structure take longer. If a page still isn’t indexed after a few weeks and our checker shows it as indexable, focus on internal links and content quality.
Indexing issues after a website migration or redesign
Migrations are the most common cause of sudden indexing drops. Check these immediately after launch:
- robots.txt doesn’t block the live site.
- No sitewide noindex left over from staging (check “Discourage search engines” in WordPress settings).
- Old URLs redirect with a 301 to the right new pages.
- Canonical tags use the new domain and HTTPS.
- The new sitemap is submitted in Search Console.
Paste your most important URLs into the index checker after launch to catch problems in minutes. For complex migrations, our technical SEO services can plan and monitor the move.
Checking indexing for WordPress sites
Search engine visibility setting
WordPress has a “Discourage search engines from indexing this site” option under Settings › Reading. If it’s ticked, your whole site may be noindexed. Untick it on live sites.
SEO plugin settings
Yoast, Rank Math and similar plugins can noindex individual pages, post types, categories, tags and archives. Check both the page’s own settings and the global content-type settings.
Tag and archive pages
Many sites deliberately noindex tag and date archives to avoid thin, duplicate pages. That’s fine, as long as important pages aren’t affected.
Bulk index checks: auditing a whole section
Checking one page at a time is fine for a new blog post, but sometimes you need to check if URL is indexed in Google for dozens of pages, such as every product in a category or every location page. Here’s an efficient approach.
1. Export your URLs
Take the URLs from your XML sitemap, your CMS or a crawl. Prioritise pages that matter most for revenue and leads.
2. Run them through the checker in batches
Paste up to 20 URLs at a time. Sort the results by verdict so blockers rise to the top. A pattern, such as every product page carrying the same canonical or noindex, usually points to one template or plugin setting that fixes them all at once.
3. Compare with Search Console
In the Page indexing report, filter by your sitemap to see which submitted URLs are indexed and which aren’t, with a reason for each. Pages that our checker shows as indexable but Search Console lists as “Crawled – currently not indexed” need better content or stronger internal links, not technical fixes.
4. Fix by template, not page by page
Most indexing problems on larger sites come from templates: a category page with no unique text, product variants that duplicate each other, or filtered URLs that create thousands of near-identical pages. Fix the template and the problem disappears across hundreds of URLs.
5. Re-check and monitor
After fixing, re-run the checker, resubmit your sitemap and watch the indexed count rise in Search Console over the following weeks. Check again after every major site update, plugin change or migration, because indexing settings are easy to break by accident.
Index checklist
- Returns 200 OK (no errors or redirects).
- No noindex in the meta tag or X-Robots-Tag header.
- Not blocked by robots.txt.
- Canonical tag points to the page itself.
- Has substantial, unique content.
- Linked from other pages on your site.
- Included in your XML sitemap.
- Checked and requested in Search Console URL Inspection.
Related free SEO tools
- robots.txt tester: test which URLs your rules block.
- XML sitemap checker: validate the sitemap Google uses to find pages.
- Redirect checker: trace redirect chains and status codes.
- Broken link checker: find links that lead to errors.
- Free SEO checker: audit on-page SEO for any URL.
Ready to diagnose your pages? Use the Google Index Checker above.