GMC "Product URLs Can't Be Found" or Blocked by robots.txt on Shopify: Complete Audit
Direct Answer Summary
When Google Merchant Center repeatedly rejects Shopify products with "Page not found (404)", "Unavailable desktop/mobile landing page", or "Blocked by robots.txt", the culprit is usually one of three things: a custom robots.txt.liquid rule accidentally blocking Googlebot or Googlebot-Image on /products/ or ?variant= query strings, unpublished products in the Online Store sales channel, or password protection left active.
No signup or OAuth required. Public pages only; does not guarantee GMC reinstatement. Zero-charge if 0 hard issues found.
Anonymized Case: SEO Snippet Blocking Query Parameters Needed by Variant Feed URLs
“User-agent: * Disallow: /*?*”
“https://example-store.com/products/leather-tote?variant=4419283712”
Why this fails review: Wildcard query-string blocks (Disallow: /*?*) prevent Googlebot and Storebot-Google from crawling canonical Shopify ?variant= URLs.
Applicable Scope & When NOT to Worry
- Shopify default robots.txt blocks internal cart/checkout/search paths (/cart, /checkouts, /search) intentionally—those default rules are 100% safe and never cause GMC disapprovals.
- Always evaluate specific User-agent groups (Googlebot, Storebot-Google, Googlebot-Image) per RFC 9309 rather than assuming User-agent: * applies.
Official Google Merchant Center References
Frequently Asked Questions
How does StorePolicyCheck test my Shopify robots.txt?
StorePolicyCheck parses your live /robots.txt following RFC 9309 longest-match precedence against your actual /products/ and /policies/ URLs for both Googlebot and Googlebot-Image.