What Test & Compare won't let you test
Shorts, Made for Kids, private, and age-restricted videos cannot run Test & Compare. The eligibility matrix, what stops a live test, and workarounds.
YouTube's Test & Compare tool is not a channel-wide switch. It is a per-video feature with a published eligibility list, and a lot of the packaging people most want to test sits on the wrong side of that list. Shorts are ineligible. So are Made for Kids videos, private videos, mature-audience videos, and age-restricted videos. Scheduled livestreams and Premieres are ineligible until they convert. If you only find this out after you have cut three thumbnails, you have not run a test. You have made three images.
The source for every row below is YouTube Help on A/B testing titles and thumbnails. This post is the matrix, the traps that stop a test that already started, and the workarounds that do not require pretending an ineligible format is eligible.
The eligibility matrix
| Video state | Can you run Test & Compare? | What the Help Center says |
|---|---|---|
| Public long-form, desktop Studio, advanced features on | Yes | The default eligible case |
| Shorts | No | Not available. If a video becomes a Short, you also lose access to any previously created tests |
| Square or taller, up to 3 minutes | No (it is a Short) | Uploads in that shape and length are considered Shorts |
| Scheduled livestream | No | Not at this time |
| Premiere, while the Premiere is running | No | Eligible only after the Premiere ends and the video converts to long-form |
| Live archive (VOD of a past stream) | Yes | Explicitly allowed |
| Made for Kids | No | Content restriction |
| Mature audiences | No | Content restriction |
| Private | No | Content restriction |
| Age-restricted (18+) | No | A test on a video marked age-restricted will not run |
Two channel-level gates sit in front of all of that. The feature is desktop-only, inside YouTube Studio. And you need advanced features enabled on the channel. Phone Studio will not grow a missing button.
Read the Shorts row twice. Teams keep uploading a 2:30 vertical cut, intending it as "a YouTube video we can thumbnail-test," and it is classified as a Short because it is square or taller and under three minutes. Test & Compare then refuses it for a reason that looks like a bug and is actually the format. YouTube Shorts strategy and the Shorts brand funnel are the right planning docs for that runtime. They are not the right tool for a packaging A/B test inside Studio.
What stops a test that already started
Eligibility is not only a start-of-test check.
Changing the title or thumbnail while the test is live. YouTube states that if a video's title or thumbnail is changed during the test, the test automatically stops, and you have to restart it. The instinct to "nudge" a variant you do not like is the thing that kills the sample.
Age restriction. You cannot run a test on a video marked age-restricted. The Help Center's wording is that if you try to run an A/B test for a video marked age-restricted, the test will not run, but you can still use the tool on other videos later. Plan the 18+ mark before you spend the variants. Do not expect the tool to keep running on a video that is no longer in the eligible set.
There is a harsher sibling to that row. If you upload age-restricted (18+) content to the testing tool and do not mark it as age-restricted, YouTube says you will lose feature access. That is not a failed test. That is the tool being taken away. Do not use Test & Compare as a way to quietly circulate 18+ packaging.
Becoming a Short. If the video is later treated as a Short, previously created tests are no longer accessible and you cannot run a new one on that video. Aspect ratio and length are not cosmetic at the margin of three minutes.
Leaving the eligible audience settings. Made for Kids, mature audiences, and private are listed as content restrictions. If you need the video in one of those states, you do not have this tool on that video. There is no published "pause and resume after you flip the flag" path. Assume you need the video in an eligible state for the whole run.
If the object changes identity (Short, 18+, private, kids), the experiment is no longer the experiment YouTube agreed to run.
Workarounds that stay honest
Workarounds are not loopholes. They are other tests, on other objects, when this object cannot enter the tool.
Shorts, including vertical sub-3-minute uploads. You cannot A/B the packaging of a Short inside Test & Compare. The off-platform protocol is the one you would use on TikTok or Reels: isolate one variable, do not post the variants simultaneously, and pick the metric before you look. For Shorts that usually means two or three distinct Shorts with the same body and a different first-frame composition, posted at the same time of day on consecutive days, judged on average watch time or Viewed vs. Swiped Away at a fixed 24-hour checkpoint, not on views. That is a creative test, not Test & Compare. It will not give you a statistical "Winner" badge. It will tell you whether the opening frame is doing anything.
If what you actually needed was Test & Compare, do not upload the piece as a Short. Publish a long-form 16:9 (or at least not square-or-taller under three minutes) so the video is a video. Picking the format per platform is the decision; converting footage to Shorts is a different destination. You can still cut a Short from the same master later. You cannot thumbnail-test the Short.
Premieres. Wait. The Help Center says Premiere videos are eligible after the Premiere ends and the video converts to long-form. Do not burn three thumbnails on a countdown. Run the test on the VOD.
Scheduled livestreams. Same shape. Test the archive. Live archives are explicitly eligible. The live event is not.
Private. The tool is for videos that can receive the impressions a test needs. Private videos are named as ineligible. Unlisted is not named either way in the Help article, so this post does not claim it works. If you need a test, the video has to be in a state YouTube will actually distribute.
Made for Kids. If the designation is correct, you do not have this tool, and you should not remove the designation to get it. If the designation was applied in error to a video that is not made for kids, fixing the audience setting is a compliance correction, not a growth hack. There is no packaging workaround that makes a true Made for Kids video eligible.
Age-restricted and mature. Do not run the test on that asset. If the packaging question matters, test it on a similar unrestricted video in the same series, or accept that this title/thumbnail pair will be a judgment call. Do not upload unmarked 18+ content into the tool.
Desktop / advanced features. If the button is missing on your phone, that is expected. If it is missing on desktop, the channel-level gate is advanced features, not the video. Fix that once, not per upload.
For the variants you can run, produce them as genuinely different pictures. Thumbnail generation is for that. It does not make an ineligible video eligible.
Plan the format before you plan the test
The expensive mistake is producing three thumbnails for a video that cannot enter the tool. The cheap habit is a two-line gate at the top of the upload checklist:
- Is this a Short, a Premiere, a scheduled live, private, Made for Kids, mature, or 18+? If yes, Test & Compare is not in play. Pick the workaround from the list above, or skip the test.
- If it is long-form and public, is the channel on desktop Studio with advanced features? If yes, run the test. If you are going to age-restrict it later, restrict it first or do not test.
YouTube also recommends testing older videos first, so a bad variant does less damage to a channel's overall views, and choosing specific videos that will actually teach you something. That advice only applies inside the eligible set. Outside it, the tool will not save you from a format decision you already made.
FAQ
Can I test a 2:50 vertical video if I turn off "publish as a Short"?
YouTube's Help article says uploads up to three minutes that are square or taller in aspect ratio will be considered a Short, and that A/B testing is not available for Shorts. Do not plan a Test & Compare run on that file. If you need the native tool, change the format (widescreen long-form) rather than hunting for a toggle.
If I age-restrict a video after a test has finished, does the winner stay applied?
The Help Center addresses starting a test on an already age-restricted video (it will not run) and the penalty for putting unmarked 18+ content into the tool. It does not document what happens to a completed winner if you add a restriction later. Do not build a process on an undocumented edge. Apply the restriction on purpose, then live with judgment-call packaging on that asset.
Are unlisted videos eligible?
The published restriction names private, not unlisted. That is not the same as a guarantee that unlisted works. If the test needs impressions, unlisted is a poor environment even if the button appears. Use public long-form for a real run.
Does Test & Compare work on YouTube Studio mobile?
No. The Help Center says the feature is currently only available on computers through YouTube Studio. If you are trying to start a test from a phone, you are in the ineligible client, not an ineligible video.