Compare · Shopify's native split testing
Liftable vs Shopify Rollouts
Rollouts is Shopify's own way to test a theme change on a share of your traffic. It is free, it lives in the admin, and there is nothing to install.
Liftable is not a replacement for it. Rollouts splits traffic; Liftable is meant to do the work on either side of the split — finding the opportunity, writing the change, reading the result honestly — and to run theme tests through Rollouts where it can.
The scan is free · results in about a minute
What Rollouts does well
- Free, and included with Shopify.
- Native: no third-party script in the storefront, so no flicker and no app to trust.
- Lives in the admin you already use, with Shopify's own support behind it.
Choose Rollouts if
- You already know what to change and have someone to build it.
- You are comfortable reading the result and calling the winner yourself.
- You want nothing from a third party in your store.
Where Liftable is behind today
- Liftable is paid; Rollouts is free.
- Rollouts runs live tests today. Liftable's runtimes are being built and have not written to any store.
- Rollouts has Shopify behind it. Liftable has no published results and no live install yet.
Side by side, as of today
The Liftable column says what is built, what is built but has not run on a live store, and what is not built. Read the chips before the prose.
| Capability | Shopify Rollouts | Liftable today |
|---|---|---|
| CapabilityCost | Shopify RolloutsFree with Shopify. | Liftable todayNoFlat monthly plans priced on sessions: $125, $400 and $999 a month, 14 days free. The store scan is free for anyone. The free scan stays free. |
| CapabilityDecides what to test | Shopify RolloutsNo. You bring the hypothesis. | Liftable todayPartly builtA free crawl of your URL runs 35 of the 39 planned checks and prices each opportunity with a formula it prints on the report. Opportunities are ranked by value per day of testing. The pixel is built and ships as a Shopify web-pixel extension; until a store installs it, the evidence comes from the crawl rather than from real sessions. |
| CapabilityWrites the variant | Shopify RolloutsNo. You or your developer build the second version of the theme. | Liftable todayPartly builtDrafts theme change sets from 20 fix templates. The runtimes that put a draft on a duplicate theme, Shopify Rollouts or a Shopify Function are being built and have not written to any store. |
| CapabilityRuns the split | Shopify RolloutsYes, natively, on theme changes, without a storefront script. | Liftable todayNot built yetPlanned to run theme tests through Rollouts and everything else on a duplicate theme or a Shopify Function. None of these runtimes has run on a live store. |
| CapabilityCalls the winner | Shopify RolloutsReports the result in the admin. Liftable has not audited its statistical method and makes no claim about it. | Liftable todayBuilt, not run liveA sequential test (mSPRT) with a power check that refuses underpowered tests. Verified in simulation (2.3% false positives on A/A data at α = 5% over 1,000 runs); no live experiment has run yet. |
| CapabilityOffers, shipping, email flows | Shopify RolloutsTheme changes, as far as Shopify's public documentation shows. | Liftable todayNot built yetOffers and shipping are planned through Shopify Functions; Klaviyo, Gorgias, GA4 and the other connectors are planned for a later phase and are not built. |
| CapabilityApprovals, guardrails, rollback | Shopify RolloutsYour admin permissions. Ending a rollout is a manual step. | Liftable todayBuiltAn autonomy ladder per surface, guardrails, an approval modal, six reject reasons that become standing rules and a decisions log. Built and covered by tests. |
| CapabilityReceipt in verified revenue | Shopify RolloutsNot a feature of Rollouts. | Liftable todayNot built yetDesigned as verified revenue against a 10% holdback, measured on Shopify orders. Not built yet. |
| CapabilityTrack record | Shopify RolloutsShopify. | Liftable todayNoNo published merchant results. One design partner; no receipts to show. |
The difference is where the work happens.
Rollouts splits traffic between versions of your theme. It does not decide what to test, write the variant, or price what a opportunity costs. Liftable is built to do those three things and hand the split to Rollouts — or to a duplicate theme when Rollouts cannot carry the change.
How Liftable compares.
Replay tools show you what happened and testing tools split your traffic. Liftable does the work in between, and is new: the last column says what it does today.
| What you need | Replay tools | Testing tools | A CRO agency | Liftable |
|---|---|---|---|---|
| Shows where shoppers struggle | Yes: recordings and heatmaps | No: it splits traffic you point it at | Yes, by hand | Yes: a free scan, with evidence |
| Puts a number on what a leak costs | No | No | Varies by agency | Yes: an estimated range, with its inputs shown |
| Decides what to fix first | You do | You do | The agency | Liftable ranks it; you approve |
| Does the implementation | You do | You do | The agency | Our founding team, with you |
| Measures the result | No | Yes: split tests | Usually | With the founding team where traffic supports it; automated tests coming |
| What it costs | Free and paid tiers | Free and paid tiers | $2,500–25,000 a month | Scan free; programme $750–$1,500 a month |
Detail per product: Shopify Rollouts, Intelligems, Hotjar, a CRO agency.
Find what's holding your Shopify store back
ShopifyLiftable reads your storefront as a shopper would and shows what looks wrong on your own pages, desktop and mobile: friction, slow pages, missing trust and apps doing nothing, with the evidence for each. Free, in about a minute.
Questions about Shopify Rollouts
Does Liftable replace Rollouts?
No. Liftable is designed to use Rollouts as one of its test runtimes for theme changes. Where a change cannot run through Rollouts — a shipping rate, a discount function, an email flow — Liftable plans to run it on a duplicate theme or a Shopify Function. None of those runtimes has run live yet.
If Rollouts is free, what am I paying Liftable for?
The work either side of the split: finding and pricing the opportunity, writing the change, refusing tests that cannot read, and reporting the result in revenue rather than clicks. Whether that is worth a flat monthly fee depends on whether you would otherwise pay a person to do it.
Scan your store.
See where your store is losing revenue and what to fix first. It is free, takes about a minute, and needs no install.