Knowledge / Glossary
Test Prioritization
Ranking test ideas by expected impact, confidence and effort so teams run the most valuable experiments first.
1 min readUpdated 2026-11-15By Meridian Academy
Ranking test ideas by expected impact, confidence and effort so teams run the most valuable experiments first.
Summary
Prioritize to maximize learning.
What Is Test Prioritization?
Test prioritization uses frameworks such as ICE (impact, confidence, ease) or PIE (potential, importance, ease). It helps focus limited testing capacity.
People may also refer to this concept as:
- 1.ICE scoring
- 2.PIE framework
Purpose and Context
Why It Matters
Not all tests are equal.
Key Elements
| Element | What it means |
|---|---|
| Impact | potential gain |
| Confidence | evidence |
| Effort | resources |
| Scoring | ranking ideas |
How It Works
- 1.List ideas
- 2.Score
- 3.Rank
- 4.Run
List ideas
Backlog.
Score
Impact, confidence, effort.
Rank
Prioritize.
Run
Top tests first.
Examples
The ICE backlog
The ICE backlog
A team had 50 test ideas.
What they did
- 1.Scored with ICE
- 2.Ran top five
What happened
Results improved faster.
Comparisons and Boundaries
| Related term | Relationship | Why it matters |
|---|---|---|
| Experimentation | Used with | Prioritization manages experiments |
| A/B Testing | Used with | Tests are prioritized |
| Experimentation Culture | Used with | Culture uses prioritization |
| Hypothesis | Used with | Good hypotheses score higher |
Common Misconceptions
| Mistake | What to do instead |
|---|---|
| Scoring without data | Use evidence. |
| Ignoring effort | Big tests slow progress. |
Related concepts
Sources
- [1] Sean Ellis and Morgan Brown, Hacking Growth
- [2] Tim Ash, Maura Ginty, and Rich Page, Landing Page Optimization