1. State the hypothesis
Example: a story built around the ring’s meaning may generate more qualified store visits than the current demonstration. Treat this as a question to test, not a promised result.
Start with one question: does this story help the same product reach the campaign’s goal? Define that goal before choosing the winning video.
Example: a story built around the ring’s meaning may generate more qualified store visits than the current demonstration. Treat this as a question to test, not a promised result.
Keep the product, offer, landing page and audience conditions comparable. Use the platform’s experiment tools where suitable. Document any differences that remain.
For a format comparison, compare the story-led creative with the existing format. For a hook comparison, keep the story body and CTA fixed and change the opening. These answer different questions.
Agree a media budget ceiling, review period and primary metric. Check the platform’s current experiment requirements. Record an inconclusive result when there is too little evidence to choose a winner.
Save each creative version with its campaign links and results. Make the next variation address what the first test revealed.
| Layer | Record | Question it helps answer |
|---|---|---|
| Attention | Opening retention and watch time | Does the opening hold attention? |
| Interest | Outbound clicks and landing-page visits | Does the story create a reason to visit the store? |
| Purchase | Attributed orders, acquisition cost and revenue | Does the campaign meet the agreed business objective? |
| Evidence quality | Spend, dates, attribution window and sample size | Is the comparison sufficiently supported to guide the next test? |
Use consistent campaign names and distinguish the video variant in your tracking. For example:
utm_source=instagram
utm_medium=paid_social
utm_campaign=ring_drama_pilot
utm_content=story_hook_aThis is a naming example, not a tracking installation. Verify that the store’s analytics receives the parameters and records the intended events before spending on the comparison.
In the test log, keep: version ID, changed variable, destination URL, dates, spend, views, clicks, orders and the attribution model. Use the same definitions for the control.
That needs to be tested for the product, audience and offer. A story may hold attention without creating purchase intent. Use a comparable control and evaluate the business outcome you chose before launch.
Choose the number around a specific hypothesis and the resources available to evaluate it. If you test opening hooks, hold the body and call to action constant. An underfunded comparison with many variants can be inconclusive.
Review whether viewers can recognize the product, understand the offer and see a clear next action. Then inspect the destination page and tracking. Change one suspected cause at a time so the next result is interpretable.
No. Attribution assigns credit under a reporting rule. It does not by itself establish incremental sales. Keep the attribution model and window visible when comparing results.
Check the current platform guidance before launch: TikTok split-testing variables, TikTok Experiment Manager and Shopify campaigns.
Agree the product, story, control and finished versions, then budget production and media separately.