Skip to content
Idea Validation Playbook

Validate the product

52 plays

Hand drawn illustration of

Product Validation

Test whether the proposed experience helps people achieve their goal
Choose a test for the proposed product experience

Use Validation Patterns to compare prototypes, service trials and experiments for the uncertainty you need to investigate.

$129 · Printed deck + digital edition

Explore Validation Patterns
A/B Testing illustration
A/B Testing

Split test versions of the same design to test which performs better

Beta Launch illustration
Beta Launch

Release a feature-complete product, but with known or unknown bugs

Concierge illustration
Concierge

Personally deliver your service to test product satisfaction

Data Mining illustration
Data Mining

Crunch and combine data to discover trends in market and user behavior

Focus Group illustration
Focus Group

Ask a group of selected participants about their opinions and preferences

Impersonator illustration
Impersonator

Serve a competing product to your customers as if it was your own

LEGO prototype illustration
LEGO prototype

Quickly assemble and tweak a rough model of a physical product

Mashup illustration
Mashup

Assemble a product by piecing together third-party products

Micro Surveys illustration
Micro Surveys

Set up short and timely in-app surveys in context of the studied feature

Paper Prototype illustration
Paper Prototype

Rapidly sketch and lay out interaction design concepts on paper

Pinocchio illustration
Pinocchio

Create a fake artifact as a proxy for a real product

Pretend to Own illustration
Pretend to Own

Borrow or rent what's needed to test your product before investing in it

Provincial illustration
Provincial

Run a test on a very small sample before launching world-wide

Video Demo illustration
Video Demo

Simulate a working product through a recorded video walkthrough

Wizard of Oz illustration
Wizard of Oz

Use human power to fake automation of complex tasks

Dogfooding illustration
Dogfooding

Use your own product to surface bugs and test value

Data Sheet illustration
Data Sheet

Condense your value proposition to one page

Kano Analysis illustration
Kano Analysis

Classify product features into Must-Be, Performance, Attractive and other categories so you can rank roadmap items by their effect on customer satisfaction.

Important for this playbook

Product validation investigates whether a proposed solution helps a specific user achieve the intended outcome. It can begin with a sketch, prototype or manually delivered service, before a finished product exists.

Choose a method above for the uncertainty that matters now. A usable interaction, a useful outcome and a reliable service are related questions, but one successful task does not establish demand, payment or a viable business.

Choose a product-validation method

Question Possible method What it leaves uncertain
Can people understand and complete the proposed interaction? Clickable Prototype, Paper Prototyping Real-world use, delivery and payment
Does the service help with the actual task? Concierge or Wizard of Oz Whether manual support can scale
Can the key technical behavior work? Working Prototype Customer demand and the full production system
Does a change improve an existing product outcome? A suitable A/B test Effects outside the tested audience, conditions and observation period

Use the simplest representation that can answer the question, rather than the cheapest one regardless of its limitations. Prototype explains how to choose fidelity and what different prototypes can demonstrate.

Define a task and observe it

Nielsen Norman Group’s usability-testing guide describes observing relevant participants attempting tasks. Give enough context to make the task meaningful without instructing people which controls to use.

Record completion, difficulties, assistance and consequences. If you coach someone through a confusing screen, keep the assistance in the record; it is not equivalent to unassisted success. Qualitative sessions can expose problems without estimating a population success rate.

Product validation example: using a stock report

This example is hypothetical and contains no real test results. A team proposes a stock-report service for independent shops. The customer needs to decide what to order, not merely admire a report.

A proposed stock-report task moves from uploading data to reading the report to choosing a stock action, with a reminder to observe before helping.

The drawing is a simplified task sequence. A useful session might ask an eligible owner to decide what needs ordering for the next trading period using a sample report. Observe whether the information supports the decision, where it is misunderstood and what other information is needed. Check the input-data step separately if it is an important source of difficulty.

Even if the owner can complete the task, you still need evidence about whether the report fits the real workflow, produces useful outcomes over time and can be delivered reliably. Use a clearly described pilot when real service use is the next uncertainty; explain any manual operations and protect customer data.

Product validation is not the same as QA

QA and technical verification check requirements, reliability and defects. Customer-facing validation examines usefulness in context. A feature can meet its specification while solving the wrong problem; a promising prototype can still lack the safeguards required for release.

Do not replace necessary engineering checks with user enthusiasm. Conversely, do not assume that passing an automated test establishes that people can use or benefit from the product.

Decide what the evidence supports

Before testing, write the assumption, audience, method, observations and decision criterion. Afterward, separate what happened from possible explanations, document missing evidence and assign a next action. The Experiment Sheet helps make that plan explicit.

Investigate the problem when the need itself is unclear, the market when reaching buyers is uncertain, and willingness to pay when you need a purchase decision. Product Experimentation connects these investigations; the Validation Patterns overview helps you select the next method.

Choose a test for the proposed product experience

Use Validation Patterns to compare prototypes, service trials and experiments for the uncertainty you need to investigate.

$129 · Printed deck + digital edition

Explore Validation Patterns