Learning outcomes
Explore

Interested to understand the success potential of your project? Reach out to us to value your TV series, film, catalog or franchise. Learn more about our concept testing solution.


Executive Summary

Concept Testing is Parrot Analytics’ pre-release decision-intelligence system for film and television projects. It converts early creative materials into forecasts of audience demand and commercial performance.

Concept Testing can begin with a logline, synopsis, treatment, script, pitch deck, or structured set of concept fields. As the project develops, additional information such as cast, budget, format, intended market, streaming service, territory, and release strategy can be incorporated.

The system does not reduce a project to a genre label or treat the entire script as one undifferentiated block of text. It creates separate mathematical representations of dimensions such as storyline, characters, themes, tone, setting, genre structure, and relevant IP. These representations are combined with Parrot Analytics’ global content, audience, talent, IP, and economic datasets.

Concept Testing works like a GPS for unreleased content. It locates a project within the broader entertainment landscape, uses relevant historical patterns to estimate its likely audience and commercial routes, and recalculates as creative or commercial assumptions change.

Concept Testing should therefore be understood as decision support, not a deterministic greenlight score. It estimates a defensible range of outcomes under defined assumptions, identifies the decisions that materially change the commercial case, and makes uncertainty more visible before significant capital is committed.

1. What does Concept Testing evaluate?

Concept Testing estimates how an unreleased project may perform with audiences and within specific distribution models.

It can be used throughout the development lifecycle:

  • Concept stage: A logline, synopsis, treatment, format, or IP foundation can be evaluated.
  • Development stage: Script, narrative direction, intended audience, market, and format assumptions can be incorporated.
  • Packaging stage: Cast, director, budget, rating, and production assumptions can be added.
  • Financing and distribution stage: Streaming service, territory, theatrical footprint, release window, and deal assumptions can be tested.

The forecast becomes more commercially specific as the project develops. A logline-stage analysis primarily evaluates the underlying creative proposition. A later analysis can assess the complete package, including talent, budget, market, distribution, and release strategy.

Concept Testing is designed to answer three connected questions.

What is the project’s likely audience potential?

This may include expected demand, audience reach, geographic distribution, market travelability, momentum, and potential longevity.

How could that audience potential translate into economic value?

Depending on the use case, this may include subscriber acquisition, subscriber retention, streaming revenue contribution, domestic or international box office, and return scenarios under defined cost assumptions.

Which decisions materially change the commercial case?

Clients can compare cast configurations, budget levels, formats, markets, streaming services, territories, release strategies, and selected narrative alternatives while holding other assumptions as consistent as possible.

2. The data foundation

Concept Testing is not a general-purpose language model asked whether a script “sounds successful.”

Concept Testing's numerical forecasts are grounded in Parrot Analytics’ proprietary entertainment data infrastructure. The system does not learn from generic data. It learns from the precise demand and economic outcomes that Parrot Analytics has been measuring daily, across 200+ markets, for over a decade. 

The principal components are:

  1. The Content Supply Management System and Content Genome®.
  2. Audience Demand Measurement.
  3. Talent, IP, and audience intelligence.
  4. Streaming valuation and box-office prediction.

2.1 Content Supply Management System and Content Genome®

The Content Supply Management System identifies, reconciles, enriches, and maintains a global view of entertainment content.

It covers more than 1.2 million film and television titles, including more than 384,000 series and 815,000 movies. The system also indexes more than 2,000 distribution platforms and maintains detailed availability information across hundreds of services and markets.

The Content Genome® is the standardized taxonomy and enrichment layer within this system. It applies more than 200 potential attributes to entertainment content, covering areas such as storyline, themes, mood, genre, IP lineage, format, and release model.

[image]

The purpose of the Genome is to provide a common analytical language through which creative characteristics, audience behavior, talent, markets, and commercial outcomes can be compared.

2.2 Audience Demand Measurement

Parrot Analytics’ demand measurement system produces a standardized measure of audience attention for entertainment properties across markets and distribution environments.

Parrot Analytics measures audience demand by capturing behavior from more than 2 billion audiences every day. This includes proprietary consumption datasets covering hundreds of millions of households globally, generated through patented measurement technology.

The wider methodology combines several categories of observed audience behavior, including:

  • Consumption and downloading.
  • Search and research activity.
  • Social-video consumption and engagement.
  • Public social-media activity.
  • Informational, fan, and rating-site activity.

Signals are not treated equally. Behaviors that require greater time, intent, or effort receive greater importance than lower-effort interactions. This allows the methodology to measure more than conversation volume or social-media “buzz.”

Demand is measured daily at the title and country level. It can be expressed relative to the relevant market average through a standardized demand multiplier, with per-capita adjustments supporting comparison between markets of different sizes.

Demand is not intended to reproduce the internal viewership figure of a single streaming service. It provides a standardized measure of audience attention across the wider market.

For Concept Testing, historical demand supplies the audience outcome against which the creative and commercial characteristics of released titles can be modeled.

Parrot Analytics - Supply and Demand.png

2.3 Talent, IP, and audience context

The commercial potential of a project is not determined by its narrative alone.

Where relevant and available, the methodology can incorporate:

  • Market-specific demand for attached actors, directors, creators, and other talent.
  • Demand for underlying books, games, characters, franchises, or other IP.
  • Audience overlap between the concept, talent, genres, and related titles.
  • Audience composition and reach.
  • Historical travelability of related content.
  • Platform and catalog fit.
  • Budget, rating, market, and distribution assumptions.

These inputs allow the system to separate the audience potential of the underlying concept from the value contributed by talent, IP, or other packaging decisions.

They also support incremental analysis. For example, the system can estimate whether the additional audience and economic value associated with an actor is proportionate to the actor’s cost.

2.4 Streaming valuation and box-office prediction

Audience demand becomes commercially useful when it is connected to monetizable behavior.

Parrot Analytics’ valuation systems translate title- and market-level demand into estimates of the revenue a title generates, or could generate, for a specific streaming service in a specific market. Across major streaming services, Parrot Analytics has identified a relationship above 0.9 R-squared between catalog demand and reported subscriber levels across selected markets and periods. This provides empirical support for using demand as a major valuation input, although demand should not be interpreted as the sole causal driver of every title’s value.

For Concept Testing, the forecast demand for an unreleased title is passed into the same valuation framework used for released content. The resulting estimates can include subscriber acquisition, subscriber retention, and streaming revenue contribution. Learn more about Parrot Analytics' streaming economics system.

For theatrical use cases, separate models estimate domestic and international box-office performance using the concept representation alongside available cast, budget, rating, release timing, territory, theater count, and distribution assumptions.

3. End-to-end modeling methodology

Each stage in the analyticsl pipeline has a distinct role.

Concept Testing - Modeling Methodology.png

3.1 Creative input and normalization

A logline, synopsis, treatment, script, pitch deck, structured concept fields, or multiple concepts for comparative screening can be submitted to the system.

The ingestion layer normalizes the material into a consistent analytical format. Named entities and structured information, such as cast, format, IP, intended streaming service, or release strategy, can be matched to Parrot Analytics’ existing data systems where relevant.

3.2 Multi-dimensional concept representation

The system does not reduce a project to one genre label or a single block of text. It creates separate embeddings, or numerical representations, for dimensions such as storyline, characters, themes, tone, setting, genre structure, and relevant IP.

This allows the methodology to capture relationships that conventional tagging may miss and to examine how changes to one narrative dimension affect the forecast.

3.3 Positioning within the entertainment landscape

A proprietary reference-based process positions each narrative dimension within Parrot Analytics’ historical content landscape. This identifies the content neighborhoods and audience patterns most relevant to the project without treating any one title as its definitive comparable.

These relationships also support explainability by showing the historical evidence and narrative characteristics that contribute to the forecast.

3.4 Combining narrative and commercial features

The narrative representations are combined with structured information such as format, budget, talent, market, streaming service, territory, and release strategy.

The relative importance of these inputs changes as the project develops. Narrative information is more prominent at the earliest stage, while talent, budget, and distribution assumptions become increasingly relevant as the package takes shape.

3.5 Predictive modeling

The combined features are passed into an ensemble of predictive models trained against Parrot Analytics’ historical audience-demand and commercial outcomes. Using several models rather than one analytical approach helps improve forecast stability and reduces dependence on the assumptions of any single estimator.

3.6 Economic translation

The predictive layer estimates outcomes such as audience-demand potential, market distribution, demand trajectory, reach, travelability, and theatrical performance.

For streaming analysis, forecast demand is passed into Parrot Analytics’ Content Valuation system to estimate platform- and market-specific subscriber acquisition, retention, and revenue contribution. For theatrical projects, separate models estimate domestic and international box-office performance.

3.7 Scenario analysis

Once a baseline project has been evaluated, selected assumptions can be changed and the forecast rerun. Clients can compare alternative cast attachments, budgets, formats, streaming services, territories, release strategies, and narrative directions.

4. Conclusion

Entertainment cannot be made fully predictable, but the decisions surrounding an unreleased project can be evaluated with more consistent evidence.

Concept Testing connects the creative proposition to historical audience behavior, market-specific demand, talent and IP value, streaming-service economics, box-office performance, and alternative distribution scenarios.

It is designed to answer more useful questions than whether a project is simply “good” or “bad”:

  • What range of audience and economic outcomes is supported by the available evidence
  • Which creative, packaging, and distribution decisions materially strengthen or weaken the commercial case?
  • Where is the project best positioned to create value?

Concept Testing does not replace creative conviction. It gives decision-makers a clearer view of the opportunity, the uncertainty, and the routes available before the most expensive choices become difficult to reverse.

Explore demand Academy
Beginner
Understanding the attention economy
Understanding the Attention Economy
Beginner
Understanding the attention economy
What is demand? An introduction to global audience demand measurement
Beginner
Understanding the attention economy
Learn the methodology behind demand measurement
Beginner
Understanding the attention economy
Why demand? An introduction to audience demand applications
Beginner
Understanding the attention economy
How demand is a key measurement for streaming video-on-demand services
Beginner
Understanding the attention economy
Originals : The Critical "O" in SVOD
Beginner
Understanding the attention economy
Capturing global audience trends with the 2021 Global TV Demand Report
Beginner
Plotting content supply and demand
The Diversity Supply and Demand Gap: Part 1
Beginner
Plotting content supply and demand
The Diversity Supply and Demand Gap: Part 2
Beginner
Plotting content supply and demand
Analyzing supply and demand for content to find whitespace opportunities
Beginner
Globalization and the travelability of content
The effects of a borderless economy and the globalization of content
Beginner
Globalization and the travelability of content
Travelability case study: Measuring "Money Heist" with Alejandro Rojas
Beginner
Globalization and the travelability of content
From niche to mainstream: Anime’s journey around the world
Beginner
Globalization and the travelability of content
All about anime: A conversation between experts
Beginner
Globalization and the travelability of content
See it in action: Demand for anime content soars
Beginner
Globalization and the travelability of content
See it in action: Netflix’s Biggest Advantage Is Foreign Language TV
Beginner
Talent Demand
Introducing Talent Demand: The Power of Japanese and South Korean Talent
Beginner
Talent Demand
See it in action: How should talent be paid for streaming?
Beginner
Miscellaneous
Measuring the success of children’s content featuring "CoComelon"
Beginner
Movie Demand
The Future of Theatricality: How Movie Demand Can Drive Better Strategic Decisions
Beginner
Talent Demand
Talent Demand Whitepaper - FIFA World Cup Qatar 2022 Demand Trends
Beginner
MENA Trends
Rise Studios x Parrot Analytics Whitepaper: Beyond Borders - The Evolution of Non-English Content in MENA
Intermediate
Market shares and advanced platform analysis
Capturing corporate gains and losses with the Streaming Report Card- Q3 2023
Intermediate
Market shares and advanced platform analysis
Capturing corporate gains and losses with the Streaming Report Card- Q2 2023
Intermediate
Content Valuation
Learn how to apply content valuation to establish the true value of entertainment content
Intermediate
Market shares and advanced platform analysis
Capturing corporate gains and losses with the Streaming Report Card- Q4 2022
Intermediate
Affinity, longevity and advanced context analysis
Understand affinity as a means to uncover audience preferences
Intermediate
Market shares and advanced platform analysis
Using demand to determine who's winning the battle for audience attention
Intermediate
Market shares and advanced platform analysis
Measuring the power of original content for defined platforms
Intermediate
Market shares and advanced platform analysis
Measuring the power of original content for combined platforms
Intermediate
Market shares and advanced platform analysis
See it in action: The consolidation of two powerhouse content dealers
Intermediate
Market shares and advanced platform analysis
Editorial: Sr. Strategy Analyst on Disney+’s global success
Intermediate
Monetizing Talent Demand
Leveraging talent demand data to drive compensation conversations
Intermediate
Affinity, longevity and advanced context analysis
Understanding how affinity analysis unlocks audience insights
Intermediate
Market shares and advanced platform analysis
Capturing corporate gains and losses with the Streaming Report Card- Q1 2022
Intermediate
Monetizing Talent Demand
Representation in Hollywood in the Streaming Era
Intermediate
Market shares and advanced platform analysis
Capturing corporate gains and losses with the Streaming Report Card- Q3 2022
Intermediate
Market shares and advanced platform analysis
Capturing corporate gains and losses with the Streaming Report Card- Q4 2023
Intermediate
Market shares and advanced platform analysis
Capturing corporate gains and losses with the Streaming Report Card- Q1 2024
Intermediate
Market shares and advanced platform analysis
Capturing corporate gains and losses with the Streaming Report Card - Q2 2024
Intermediate
Market shares and advanced platform analysis
Capturing corporate gains and losses with the Streaming Report Card - Q4 2024
Advanced
Strategy
How to ensure title success by optimizing pre-release marketing
Advanced
Content Valuation
Streaming Economics: How Parrot Analytics Measures The Value of Content in the Streaming Era
Advanced
Strategy
How Hollywood can find its next global hit
Advanced
Strategy
The truth of binge vs. weekly release strategies
Advanced
Strategy
Streaming consolidation's next big problem: Strategies for integrating and expanding content libraries
Advanced
Strategy
Which metrics matter most when selling your content
Advanced
Strategy
How much is a global hit teen show worth to Netflix — and why it matters
Advanced
Strategy
One final linear strategy that Netflix and the SVOD industry can steal
Advanced
Strategy
Parrot Perspective: Part 1 - Biggest trends and lessons from 2022, and predictions for 2023
Advanced
Strategy
Parrot Perspective: Part 2 - Biggest trends and lessons from 2022, and Predictions for 2023
Advanced
Strategy
AVODs and The Impact of Netflix's Missing Titles
Advanced
Strategy
Learn about the value of broadcast TV
Advanced
Strategy
How to use franchises to win and retain customers
Advanced
Strategy
Gaming Adaptations: The recipe to success
Advanced
Strategy
Wise spending: Data, creative intuition and franchise-first thinking
Advanced
Strategy
The Rebundling Era: Learn how rapid consolidation has forced bundling innovation
Advanced
Release strategies, windowing & platform fit
Editorial: “Netflix invented the ‘binge watch’ - now it must die”
Advanced
Global Expansion
Creating sustainable growth using demand-driven pathways
Advanced
Demand and Investment
Harness global content supply and audience demand to deliver Alpha
Advanced
Strategy
Smart Streaming: Leveraging Global Demand Data to Capitalize on White Space
Advanced
Strategy
Deconstructing SVOD subscriber acquisition and retention metrics
Advanced
Strategy
Strategies for thriving a decentralized era of programming
Advanced
Strategy
Streamer strategies for audience retention without prestige linear series
Advanced
Strategy
What You Need to Know About Netflix's Shifting Movie Strategy
Advanced
Strategy
Theatrical & Streaming Strategies For Creating New Hollywood Franchises
Advanced
Pricing Power
Mastering Streaming Economics: Turning Global Demand Signals into Pricing Power
Advanced
Concept Testing
Concept Testing: How to Forecast Audience Demand and Economic Performance for Unreleased Film and TV Concepts