Robots.txt for Shopify: How to Edit It Correctly

Shopify used to be one of the few major platforms where robots.txt simply wasn't editable — the file was generated automatically, and store owners just had to accept whatever rules Shopify shipped with. A lot of outdated advice online still assumes that's true.

It hasn't been true since mid-2021. Every Shopify store can now override its default robots.txt through a template file called robots.txt.liquid. The catch is that editing it wrong — deleting the wrong line, blocking the wrong folder — can quietly choke off crawling to pages you actually want indexed. This guide walks through doing it safely.

What is robots.txt.liquid on Shopify?

It's a Liquid template, living in the same theme folder as your other layout files, that Shopify renders as the plain-text /robots.txt file every crawler checks before indexing your store.

• It starts pre-filled. The first time you add it, Shopify populates it with the platform's own default rules — blocking admin paths, cart, checkout, and a few known duplicate-content patterns — using Liquid groups you can extend.
• It's theme-specific. The file lives inside a theme, so duplicating or switching themes without carrying it over will quietly revert your store to Shopify's unmodified defaults.
• It supports Liquid logic. Because it's a template and not a static file, you can use Liquid tags and variables inside it, not just plain robots.txt syntax.
• Some rules can't be removed. Shopify still enforces certain baseline protections at the platform level regardless of what you write in the template, so this isn't a fully blank slate.

The practical shift is this: robots.txt on Shopify went from "fixed and untouchable" to "editable, but inside a template you have to treat carefully."

Why robots.txt matters for a Shopify store

Shopify stores generate an unusually large number of near-duplicate URLs on their own — which is exactly where a tuned robots.txt earns its keep.

• Crawl budget gets eaten by filters. Collection pages combined with sort and filter parameters can multiply one collection into dozens of crawlable URL variants that add little unique value.
• Cart and checkout don't need to be crawled. These paths are already blocked by Shopify's defaults, but understanding why matters if you're ever tempted to "clean up" the file.
• Internal search results shouldn't be indexed. Shopify's on-site search pages are thin, dynamic, and typically not worth exposing to crawlers.
• Sitemap discovery still needs to work. Whatever you add, the sitemap reference in the default file needs to stay intact so crawlers can find your XML sitemap.

Step-by-step: editing robots.txt on Shopify

1. Go to Online Store → Themes. Find your live (published) theme and click the "…" menu, then Edit Code.
2. Open or create robots.txt.liquid. Check the Templates folder first. If it isn't there, click Add a new template, select robots.txt from the type dropdown, and Shopify will generate the default starting content.
3. Read the existing groups before touching anything. The default file is organized into Liquid {% for %} blocks and comments — understand what each section already blocks before adding your own rules.
4. Add your custom rules below the defaults. Append new Disallow or Allow lines for the specific paths or parameters you want to control, rather than editing Shopify's existing groups.
5. Save the template. Changes to robots.txt.liquid take effect on the live file immediately after saving — there's no separate publish step.
6. Check the live output. Visit yourstore.com/robots.txt in a browser to confirm your additions rendered correctly and the file is still valid plain text.
7. Test key URLs in Search Console. Run the robots.txt Tester against a handful of important product, collection, and blog URLs to confirm they're still allowed.

Common mistakes to avoid

1. Deleting Shopify's default groups instead of adding to them

Removing the pre-filled Liquid blocks to "start clean" also removes the protections they provide, like keeping cart and checkout paths out of crawler reach.

2. Blocking collection or product paths with too broad a rule

A wildcard aimed at filter parameters can accidentally catch legitimate collection URLs if the pattern isn't scoped tightly enough, cutting off pages that were ranking fine.

3. Forgetting the file lives inside a specific theme

Switching to a new theme or duplicating one for a redesign doesn't carry robots.txt.liquid over automatically — it needs to be copied into the new theme manually or the store reverts to Shopify's defaults.

4. Assuming Disallow removes a page from search results

Blocking a URL in robots.txt stops crawling, not indexing — a blocked page that's linked elsewhere can still show up in results without a description, which surprises a lot of store owners.

Real-world examples

A few common ways store owners extend the default Shopify robots.txt for their specific catalog structure:

Each example builds on top of Shopify's existing default file rather than replacing it, which keeps the platform's baseline protections intact.

Ways to manage Shopify robots.txt compared

The main approaches to controlling crawler access on a Shopify store, and where each one fits.

Generate your robots.txt rules right now — free

The Rebrixe Robots.txt Generator builds correctly-formatted Disallow, Allow, and Sitemap rules you can paste straight into your Shopify theme's robots.txt.liquid template. No account, no watermark, and no risk of a stray syntax error.

Frequently asked questions