Google Ads

Video Experiment

Also called YouTube creative test

A YouTube creative test that divides one audience and budget between competing videos so the winner is clear.

Quick facts: Video Experiment

Category
Google Ads
Also called
YouTube creative test
Level
Intermediate
Affects
Creative decisions, cost per view, video conversion rate
Where to see it
Google Ads (Experiments, Video experiment); YouTube reporting
In this article4
  1. How a video experiment works
  2. Why video experiments matter
  3. Common mistakes with video experiments
  4. How to act on it

How a video experiment works

You build two or more arms inside a single experiment, each holding a different video or a different ad format. Google then divides the audience between the arms so that a viewer counts in one arm only and never sees both versions. Targeting, budget and dates are shared, so the creative is the only thing that differs.

Results come back per arm on the measures YouTube reports — view rate, cost per view, click-through and, where your tracking supports it, conversions. Where the campaign qualifies for a Brand Lift study, that can be layered on to measure recall and consideration rather than clicks. What the setup gives you is a comparison with the audience and the auction held constant, which is exactly what sequential testing never provides.

Why video experiments matter

On YouTube the creative carries most of the result. The targeting and bidding levers are comparatively blunt, and two ads shown to the same people with the same money behind them can perform very differently. That makes creative the highest-value thing to test, and the hardest thing to settle by argument, because everyone in the room has an opinion about a video.

Testing in parallel is also cheaper than testing in sequence. Running one video this month and another next month means paying twice for a comparison that the season, the news and the competition can spoil. Running them together costs one budget and answers the question once.

Common mistakes with video experiments

Arms that differ in more than one respect are the usual failure. If one version is shorter, has a different opening, a different presenter and a different call to action, the winner is a mystery you cannot reuse. Change the hook, or the length, or the offer — not all three.

Judging on the wrong measure is next. A video that entertains can hold viewers beautifully and sell nothing, so view rate alone is a poor verdict when the objective is enquiries. Spreading a modest budget across many arms is the third: each arm then gets too little to say anything, and in markets with narrow audiences — a specialist service in Nepal, a small city, a niche B2B segment — the test simply runs out of people before it runs out of doubt.

How to act on it

Pick one variable, build the arms to differ only in that, and use the same audience, placements and bidding across all of them. Fewer arms with adequate budget beats many arms starved of it. Run in whole weeks so viewing patterns even out, and do not read the result on the second day.

Judge against the objective you actually have. If the campaign exists to build awareness, view rate and cost per view are fair; if it exists to produce leads, the winner is the video that produced them, however few people watched to the end. Apply the winner to the live YouTube campaign, and write down the losing lesson too — knowing which hook failed shapes the next brief. Anyone new to this should read the mechanics of an experiment and of view rate before designing one.

Do and do not

Do

  • Differ the arms by one creative variable only
  • Give each arm enough budget to gather data
  • Judge on the objective the campaign was built for

Do not

  • Spread a modest budget across many arms
  • Call a winner on view rate for lead campaigns
  • Read the result in the first days

Questions people ask about this

How many videos should I test at once?

Fewer than you want to. Every arm you add divides the same budget and audience further, and arms that never gather enough data produce results nobody should act on. Two well-differentiated versions usually beat four vague ones. If you have many ideas, run them in successive tests rather than crowding them into a single experiment.

Which metric decides the winner of a video experiment?

The one that matches the campaign's purpose. For awareness work, view rate and cost per view are reasonable, and Brand Lift measures recall directly where the campaign qualifies. For lead generation, the deciding number is enquiries and their cost, even if the winning video held fewer viewers. Choose the metric before launching, not after seeing the results.

Can the same person see both versions of my ad?

No. The experiment divides the audience so that each viewer falls into one arm only, which is what keeps the comparison clean. That is different from simply launching two videos in one campaign, where the same person can meet both and the bidding system quietly favours whichever it prefers, leaving you with no fair test at all.

Related terms

Found this useful?

Share it, or ask an AI to summarise it

Back to the glossary

Knowing the term is the easy part

Applying it to your own site and budget is the work. Book a call and I will tell you what actually applies to you.