Shopify Search & Discovery — Internal Review Research & Evidence

INTERNAL WORKING FILE. This is not the publishable review.

Review Record

• App: Shopify Search & Discovery (admin name: Search & Discovery)
• Developer: Shopify (Ottawa, ON, CA)
• Category: Search & Product Discovery
• Human reviewer / assignee: Rakibul H. Rocky (per src/lib/authorAssignments.ts)
• ClickUp task: not linked in this session
• Shopify App Store: https://apps.shopify.com/search-and-discovery
• Research date: 2026-10-14
• Last verified: 2026-10-14

Batch gate exception: docs/batch-3-validation.md removed this app from Batch 3 because its rating (2.7★) is below the 4.5★ floor. The review was written at the human reviewer’s explicit request on 2026-10-14. Editorial reason: free first-party category anchor already referenced as the baseline in three Search & Product Discovery reviews; the low rating is itself part of the merchant story and is disclosed in the article.

Human Testing & Evidence

Testing level

• Level 2 — Partial Hands-On Test

Merchant decision question: Is the free app still enough for a small store, or is it time to pay for a search app?

What was tested: Admin inspection on a development store with Shopify sample products: home guide and reports, Filters list, Add filter > Select source, Product boosts list, Recommendations table, Settings (filters + search relevance).

What was not tested: Storefront filters/search/recommendations, search quality, semantic search, creating a boost or custom filter, translations, support, the store’s Shopify plan.

Raw observations (from screenshots)

1. Home: “0 of 2 tasks complete”; Get started guide — Customize your filters (filter by attributes like color on collections and search results page), Translate filter content. Search performance Sep 13–Oct 13, 2026: Click rate 0%, Purchase rate 0%; Top searches / with no results / with no clicks — no data. Recommendation performance: Click rate 0%, Purchase rate 0%; Top products with low recommendation click rate — no data.
2. Filters: Availability (Availability, Standard), Price (Price, Standard); drag handles; View and Add filter buttons. App menu: Filters, Product boosts, Recommendations, Settings — no Synonyms.
3. Add filter > Select source: search field; Brand (Source: Vendor) Standard; Category Standard; Color Product option; Denominations Product option; More filters (Source: Tags) Standard; Okendo Reviews Review Count Product metafield; Product rating count Product metafield; Product type Standard. Behind the modal: Source, Filter label, Values, Save.
4. Product boosts: All / Boosts tabs; Products and Search terms columns (terms empty); Create product boost.
5. Recommendations: All / Custom tabs; Complementary products “No products” on every visible row; Related products populated with thumbnails marked by a purple sparkle icon (+2/+3 more); Add recommendations.
6. Settings: Empty values — Hide / Show at the end / Show in default order (selected). Search results — Products, Pages, Blog posts checked. Predictive search — Queries, Products, Collections, Pages checked; Blog posts unchecked. Out of stock products — first option “Not at all” visible, rest cut off.

Raw screenshots: review-projects/shopify-search-discovery/03-human-testing/screenshots/.

Evidence Inventory & Public Authenticity Plan

Official Sources

• Shopify App Store: https://apps.shopify.com/search-and-discovery (+ /reviews)
• Help Center: help.shopify.com/en/manual/online-store/search-and-discovery/filters; …/search-and-discovery/product-recommendations; …/storefront-search; …/storefront-search/search-and-discovery-modify-search; …/storefront-search/search-and-discovery-analytics

Baseline Research (seen 2026-10-14)

• Launched 2022-07-25; Free; developer Shopify; Built for Shopify badge not shown.
• Rating 2.7 from 509 reviews; 5★ 264 (52%), 4★ 58 (11%), 3★ 46 (9%), 2★ 38 (7%), 1★ 103 (20%).
• Listing categories: Search and filters; Upsell and cross-sell. 20 languages. Works with Shopify Admin.
• Filters: 25 per store, each source once; collections >5,000 products show no filters; search results >100,000 show none; 100 values shown max; theme must support filters; vendor/tag values not translatable; price filter hidden for non-default currencies; OR within a filter, AND across; tag/metafield list/metaobject list can switch to AND.
• Recommendations: up to 10 related + 10 complementary manual picks per product; related auto-generated from purchase history → product description (English only) → related collections; auto picks can’t be edited but can be hidden or supplemented; complementary needs a theme block.
• Boosts: up to 10 search terms per boost; only boosts products available for sale; bulk edit via Bulk Editor / metafield.
• Search result types: results page product/page/blog post; predictive product/page/blog post/collection/query; theme can override via type parameter. Out of stock: displayed / hidden / placed last (default last).
• Semantic understanding: automatic; <200,000 products; Grow, Advanced or Plus plans; not predictive search, not Japanese locale; no setting in app.
• Analytics: last 30 days in app; search reports exclude predictive search.
• Synonyms: not mentioned on the current modify-search help page; no Synonyms entry in app menu.

Merchant Feedback Patterns

Common positives: works as described; free; 52% five-star.

Common complaints (20 one-to-three-star reviews, Jun 29–Oct 7 2026): search relevance worse / unrelated results (~6); SKU or exact-match changes (~3); synonym groups dropped (1 review + Shopify Community threads Sep 2026); 25-filter / 25-tag limit (3); 10-product recommendation cap (1); Availability filter can’t be forced on (1); instability (2); translation quality (2); app installed without consent (1).

Shopify Community: threads from Sep 2026 report synonyms retired and loosely related results; no official Shopify staff response found.

Missing Evidence / Questions

• Whether Shopify officially retired synonyms (no changelog found) — article states only what was observed and reported.
• Rest of the Settings page below Out of stock products — not captured.
• Dev store’s Shopify plan (semantic search eligibility) — unknown.

Claims We Must Not Make

• That Shopify officially removed synonyms.
• That search quality got worse (merchant-reported only, untested).
• That semantic search was or wasn’t active on our store.
• Any storefront appearance, speed, or conversion effect.

Thumbnail Concept and Generation Prompt

Concept: A shopper walks into a large, open, sunlit market hall with no gate or ticket booth: the app is free and built into the house. Near the entrance, goods sit in tidy bays divided by low wooden partitions, which stand for filters and are easy to browse. Deeper in, the aisles lose their order and dissolve into warm haze. The shopper raises a small lantern toward them, but its light only reaches a short way. The image reads as “the basics are open and orderly, but you can’t steer the search any deeper.” Shopify Search & Discovery’s magnifying-glass icon becomes a soft periwinkle-to-lavender ring cloud with a short tail high in the sky.

Prompt:

Generate a single image and export it as a PNG file, 16:9 landscape, 1792×1024 pixels or larger.

This must look like a soft, hazy, atmospheric vintage oil painting — NOT a sharp digital illustration. The whole image must be visibly blurry and abstract, not just the background. Softness and abstraction are the most important requirement.

Style: an editorial fine-art impressionist oil painting on rough canvas, like a faded plate from an old art book. Thick, loose, visible impasto brushstrokes everywhere, including the foreground. Strong canvas texture, pigment variation and subtle stippling across the surface. Low contrast, high-key light. Palette: warm cream, ivory, beige, pale ochre, dusty yellow, muted sage, olive, soft terracotta and a little dusty blue. No pure blacks, no deep shadows, no saturated colour. Edges lost and found, silhouettes soft, forms suggested rather than drawn.

Scene: the inside of a vast, airy market hall with tall arched iron-and-glass bays, open to the viewer with no gate. In the left foreground, a small lone shopper stands slightly off-centre beside a few neat, low wooden partitions that divide simple goods into tidy, orderly bays, lit warmly by afternoon sun. The shopper holds up a small glowing lantern toward the depths of the hall. Beyond the first few bays, the aisles lose their order and dissolve into warm translucent haze and broad, indistinct colour masses; the lantern’s glow fades only a short way into it. The shopper and the first tidy bays are the single soft focal point, and the shopper is small in the frame.

Light: warm afternoon sunlight slanting through the high glass roof from the right, casting long soft shadows across the floor. Natural, painterly light, no dramatic rim lighting.

Sky emblem: through the open glass roof, in the upper right sky, a large soft cloud formation shaped like a simple ring with a short, thick tail angled downward, like a loose magnifying glass made of haze. It is roughly 20–25% of the image width, in a pastel periwinkle-blue blending into soft lavender, mixed with the painting’s cream light. Feathered, partially dissolved edges, varied opacity, low local contrast, painted with the same loose brushwork and canvas texture as the rest of the painting. It must look like it formed naturally in the atmosphere, never like a pasted logo, icon, badge or clean geometric circle.

Depth: foreground moderately soft with painterly definition, middle ground much softer with visible brush masses, background almost abstract fields of colour and light.

Composition: wide, asymmetrical, generous negative space in the upper sky and on the right so the image crops safely and reads clearly at small thumbnail size with one clear focal point.

Strict rules: no text, no letters, no numbers, no logos, no wordmarks, no signage, no price tags, no labels on goods, no UI elements, no screens, no phones, no watermark. No photorealism, no 3D render, no glossy digital painting, no fine detail, no sharp edges anywhere, no detailed faces. Reject the result if it looks sharp, detailed or easy to inspect object by object.

Output format: PNG.

Source colour note: The emblem’s shape and tint come from the official app icon shown in the reviewer’s admin screenshots: a dark magnifying glass on a rounded tile with a blue-to-violet gradient. The pastel version is an interpretation, not the official logo. Don’t let the image tool draw a crisp icon or the Shopify bag mark.

Status: done 2026-10-14. Reviewer-generated PNG saved as public/images/reviews/shopify-search-discovery/shopify-search-discovery-review-thumbnail.png; thumbnail_alt set in the review frontmatter to describe the delivered image. A faint painted signature squiggle sits in the bottom-right corner; it is not readable text.