E-commerce
September 17, 2026
Are you wondering how to tell Google which pages not to crawl? The answer lies in a single tag: the noindex. By adding it to your low-value-added pages, you prevent them from appearing in search results and focus Google's crawl on your product sheets and pages that convert.
It's a strategic decision: not all of your pages deserve to be indexed. Thank you pages, internal search results, or privacy policy pages can hurt your overall authority. By excluding them, you improve the perceived quality of your site and potentially your organic traffic.
So how do you tell Google which pages not to crawl? On the agenda:
Why exclude certain pages from Google's index?
Which pages should you not index?
How to use the meta robots noindex tag?
What is the difference between noindex and robots.txt?
How does Qstomy help manage your store's crawl?
Let's go.
Summary
Why exclude certain pages from Google's index?
The goal of SEO is generally to have all your pages indexed by Google. But not all of them deserve this visibility. Some pages, such as thank you pages or privacy policy pages, bring nothing to the user looking for specific information. Leaving them indexed dilutes your authority and wastes Google's crawl budget.
By removing these pages from the index, you send a clear signal: your site consists of useful and relevant content. Google can then focus on your product pages, categories, and blog posts, which are the ones that generate conversions. This is a winning approach for your overall SEO.
Think of your shop like a physical store: you don't put your administrative documents in the window, but your best products. The same goes for your e-commerce site. By cleaning up your index, you improve the perceived quality of your site and give Google the means to better understand your offering.
Convert over 2,000 customers on average per month with Qstomy.
The world’s 1st Shopify AI dedicated to customer conversion
Empowering 200+ e-commerce merchants
Which pages should you not index?
Some pages are obvious to exclude. Thank you pages, displayed after a form or a purchase, have no interest in search results. Privacy policy pages, often copy-pasted from a provider, are redundant and without added value. Internal search result pages, which display dynamic results, offer a poor user experience if they appear on Google.
Landing pages for advertising campaigns, designed for paid traffic, should not be indexed either. They risk cannibalizing your keywords and creating confusion for users. Finally, automatically generated tag or filter pages, which are often duplicates, are ideal candidates for noindex.
Do an audit of your site and identify these pages. You will quickly see which ones are harming your SEO. Also think about login pages or shopping cart pages, which are not intended to be seen by search engines.
The benefits of a clean index for your SEO
Google evaluates the overall quality of your site by analyzing all your pages. If you have hundreds of low-value-added pages, this can reduce your perceived authority. Case studies show impressive results: after removing thousands of duplicate pages, an e-commerce site saw its organic traffic increase by 22% and its revenue by 7%.
Similarly, Moz removed 75% of its pages from the index in 2017, mainly member profiles without unique content. Result: a 13.7% increase in organic traffic. These examples show that fewer indexed pages can mean more qualified traffic.
By cleaning up your index, you show Google that your site is a reliable and relevant source. This can improve the ranking of your strategic pages. Don't be afraid to clean up: it's a long-term investment for your visibility.
How to use the meta robots noindex tag?
The meta robots noindex tag is the simplest tool to prevent a page from being indexed. Inserted into the <head> section of your HTML, it tells Googlebot not to index the page. Here is an example: <meta name="robots" content="noindex">.
This tag is respected by all search engines. As soon as Googlebot encounters it, it removes the page from its index during its next crawl. It is a reliable and easy-to-implement method, especially if you use a CMS like Shopify.
You can add it manually on specific pages or via a script for automatically generated pages. This is the recommended solution for policy pages, internal search results, and thank you pages. Make sure not to use it on important pages.
The X-Robots-Tag HTTP Header: An Effective Alternative
The X-Robots-Tag HTTP header is an alternative to the meta tag. It is a header that your server sends to the browser or crawler when it requests a page. For example: X-Robots-Tag: noindex.
This method is particularly useful for dynamically generated pages or for non-HTML files like PDFs. It has the same effect as the meta tag, but is applied at the server level.
The choice between the meta tag and the HTTP header depends on your infrastructure. If you are using a CMS, the meta tag is simpler. If you have a custom server, the HTTP header can be easier to automate. In any case, test your configuration to ensure it works.
Why robots.txt is not enough to prevent indexing?
Many merchants think that blocking a page in robots.txt prevents its indexing. This is a common mistake. robots.txt tells Googlebot which pages it can crawl, but it does not prevent it from indexing a page if it is accessible via an external link.
If another site links to your policy page, Googlebot can follow it and index it, even if it is disallowed in robots.txt. Additionally, if you block a page in robots.txt and also use a noindex tag, Googlebot will not see the tag and might continue to index the page.
robots.txt is useful for limiting crawling and avoiding overloading your server, but to remove pages from the index, use noindex. Do not confuse the two objectives.
What is the difference between noindex and robots.txt?
The difference is fundamental. noindex is a directive that asks Google not to show a page in search results. robots.txt, on the other hand, controls robot access to your site but does not prevent indexing.
In other words, noindex acts on indexing, while robots.txt acts on crawling. To remove pages from the index, noindex is the solution. To prevent Google from wasting resources on useless pages, robots.txt is useful.
It is important not to mix the two. Use noindex for pages you do not want to see in the results, and robots.txt for pages you do not want Google to crawl, such as administration pages. This distinction is crucial for an effective SEO strategy.
The pitfalls to avoid with noindex
The first pitfall is using noindex on pages that should be indexed, such as your product pages. Always verify that you are targeting the correct pages. The second pitfall is combining noindex and robots.txt, which can prevent Google from seeing the directive.
Another pitfall is forgetting to remove the noindex after fixing a page. If you have temporarily de-indexed a page to redesign it, remember to remove the tag once the page is improved.
Finally, do not noindex pages that generate traffic, even if they are not perfect. Analyze your data before making a decision. A page with good traffic can be optimized rather than de-indexed.
How to check the indexing of your pages?
Google Search Console is the essential tool for checking the indexing of your pages. You can see which pages are indexed, which pages are excluded, and why. The URL Inspection tool allows you to test a specific page and request its indexing.
Other tools like Screaming Frog or SEMrush can analyze your site in depth and identify pages with noindex tags. These tools are useful for a complete audit.
By using these tools, you can track the impact of your actions and adjust your strategy accordingly. Don't forget to regularly check the status of your index to ensure that everything is in order.
Integrating noindex into your global SEO strategy
Telling Google which pages not to crawl is a key step in your SEO strategy. It should be combined with other actions such as optimizing your category pages, internal linking, and improving user experience. By cleaning up your index, you allow Google to focus on what really matters.
Remember to update your sitemap to reflect the pages you want to index. A clean sitemap helps Google discover your important pages. Avoid including noindex pages in it.
Finally, regularly monitor your performance. SEO is an ongoing process, and your indexing strategy must evolve with your site. Stay tuned to algorithm changes and adapt.
How does Qstomy help manage your store's crawl?
Qstomy, as a Shopify AI agent, helps you improve customer experience and increase your conversions, which complements your SEO strategy. By guiding visitors to the right products, offering personalized recommendations, and managing the cart, Qstomy reduces exit pages and improves engagement.
Better engagement translates into positive signals for Google, such as a lower bounce rate and longer visit times. This can indirectly influence your ranking. Additionally, Qstomy can help you identify pages that drive conversions, so you can focus your crawl on those.
By integrating Qstomy, you optimize not only your sales funnel but also how Google perceives your site. This is an asset for your overall SEO.
Checklist before noindexing a page
Before noindexing a page, ask yourself these questions:
Does the page bring value to the user? If not, noindex it.
Is the page duplicate content? If yes, noindex it or redirect it.
Is the page intended for an advertising campaign? Noindex it to avoid cannibalization.
Is the page accessible via internal links? If yes, remove the links or noindex it.
In short, noindex is your best ally for cleaning up your index and improving your SEO. Use it wisely.
FAQ
Can I noindex a page and keep it accessible? Yes, noindex does not prevent access, it prevents indexing.
How long does it take for Google to remove a page? This can take from a few days to a few weeks, depending on the crawl frequency.
To go further: Integrating customer service answers into an e-commerce SEO strategy useful to customers - Qstomy, E-commerce SEO strategy for category pages - Qstomy, How to create a payment gateway for an e-commerce site? - Qstomy, How to optimize an e-commerce site for Google (step-by-step guide) - Qstomy, E-commerce CRO: how to transform traffic into sales - Qstomy, E-commerce internal linking strategy for SEO - Qstomy, How does SEO work for e-commerce sites? - Qstomy.
Enzo
September 17, 2026
