How to pick a prioritisation framework – RICE, ICE, PIE or HIPE?
What is a prioritisation framework?
Prioritisation frameworks are used by product teams, growth teams and marketing teams to prioritise high impact work and projects. They work by taking into consideration a number of different factors relating to discrete pieces of work and generating a score which can be used to evaluate priorities.
In economics, one of the most important concepts is ‘opportunity cost’ – the idea that once you spend your money on something, you can’t spend it again on something else.Malcolm Turnbull
Why use a prioritisation framework?
There’s never a shortage of marketing ideas – from your team, your manager, colleagues, partners, even friends and family will tell you what you should be doing, and they all think their idea is good. This can be problematic for marketers, for a number of reasons:
- The vast majority of marketing ideas lead to no measurable improvement in business results, or value to the customer
- No one, no matter how senior or experienced, can predict which ideas will work and which won’t – there are just too many unknowns.
- Most companies use weak opinions and archaic decision-making processes to place bets on a handful of unproven ideas, leading to enormous amount of waste
As a result growth teams use frameworks in order to more accurately prioritise their work. Fast growing companies use a prioritisation framework to surface the ideas and activities, from the tens or hundreds of marketing ideas and initiatives the team has submitted, that are likely to have the biggest impact on the teams objectives and KPIs.
Prioritising for focus
What is the highest impact area that we can focus on right now given our limited set of resources?
A prioritisation process helps ensure teams are more intentional and intelligent about their efforts, and make the best use of the resources available to them. Evaluating marketing activities using a common scoring language ensures subjectivity is removed from the prioritisation process. The end result is an unambiguous, prioritised todo list for your marketing or growth team.
The goal is to find the 10% of ideas that will drive 90% of growth.
It doesn’t matter if the idea has come from a designer, an engineer, the CEO or the office cleaner, all ideas must be prioritised and acted on correctly. The process forces the team to think about the ideas ahead of time, and removes gut feelings and emotion from the process.
Implementing a prioritisation framework ensures team members have greater autonomy over their work. With a prioritised list of ‘next up’ projects, team members can have the flexibility to choose what they work on next.
The prioritisation matrix
Hunter Walk, the well-known Silicon Valley venture capitalist, famously explained the 4 different kinds of work using a simple 2 x 2 graph:
These four kinds of work can be categorised and thought of as follows:
|High impact, high effort||This reflects your key strategic items, the big wins you’re aiming to achieve.|
|High impact, low effort||This is what people often describe as “low hanging fruit”, it is everyone’s favourite area to work in. For newly formed growth teams there is often plenty to do here however as your team matures this category of work starts to diminish.|
|High effort, low impact||Most people are smart enough to avoid the low effort, low impact work.|
|Low effort, low impact||This area of work is like a magnet, it is easy to get pulled into but it dramatically reduces your chances of success. Hunter refers to work done here as “snacking”.|
Here is why low-effort, low impact work is such an easy trap to fall into:
This work is easy to justify because “it only took 30 minutes”. And when it achieves nothing useful, it’s easy to excuse because it “took us so little time”. However, this is not strategy – this is flapping. Do this enough times and you’ll grow a low impact team that doesn’t achieve anything.
The default position for a smart team without a clear plan is to snack.https://www.intercom.com/blog/first-rule-prioritization-no-snacking/
A rigorous prioritisation process is the antidote to this trap of low-effort, low impact work.
10X over 10%
Think about 10X improvements, not 10% improvements.
Perfecting content, fixing typos, updating social media, updating the website design. There is always something that can be done, there are always little things to tweak.
Separate the real impact opportunities from the little tweaks.
There is lots that we “could do”, what is it that we “should do”.
Scoring ideas with a prioritisation framework
Idea scoring is an ongoing exercise that continually and identifies the best opportunities to work on next.
It is important not to get bogged down in scoring process, it is used for relative prioritisation only and forms a guide as to what to work on next. Scores do not need to be perfect and coming up with accurate predictions just comes with gathering more learnings and data over time.
What are the key scoring frameworks?
Opportunity evaluation is an important skill for any high impact growth team that will improve over time. Working on the right projects instead of the wrong ones has a huge impact on team results.
A number of frameworks existing for evaluating opportunities and prioritising your marketing resources. The most popular are shown below.
|Framework||Developed by||Scoring factors|
|RICE||Sean McBride at Intercom||Reach, Impact, Confidence, Effort|
|ICE||Sean Ellis at GrowthHackers||Impact, Confidence, Effort|
|PIE||Chris Goward at WiderFunnel||Potential, Importance, Ease|
|HiPPO||n/a||Highest paid person’s opinion|
|BRASS||David Arnoux at Growth Tribe||Blink, Relevance, Availability, Scalability, Score|
|HIPE||Jeff Chang at Pinterest||Hypothesis, Investment, Precedent, Experience|
|DICET||Jeff Mignon at Pentalog||Dollars (or revenue) generated, Impact, Confidence, Ease, Time-to-money|
The ICE framework is often regarded as the original scoring mechanism for growth marketing teams.
|Impact||How impactful do I expect this test to be?|
|Confidence||How sure am I that this test will prove my hypothesis?|
|Ease||How easily can I get launch this test?|
Final score is calculated by: Impact * Confidence * Ease
2. The PIE prioritisation framework
Whilst originally intended for AB testing projects, the PIE prioritisation framework is relevant to general marketing and growth work.
|Potential||How big of an uplift do we estimate that the change will bring?|
|Importance||How much traffic does the page get and are you investing a lot to get those visitors?|
|Ease||How simple is it to implement the fix?|
3. The BRASS method
Originally developed by David Arnoux, co-founder at Growth Tribe, the BRASS Method was originally designed to answer the question “What should we try to drive users to our website?”
|Blink||The ‘Blink Score’ is your intuitive score, or gut feeling.|
|Relevance||Relvance focuses on product/channel fit. How relevant is this user acquisition technique to your target audience and to your product?|
|Availability||Focused on ease and cost. How easy is it to set up this channel? How long will it take? How much will it cost? Do we have the necessary human and technical resources?|
|Scalability||How scalable is this channel? If it turns out to be extremely effective, how easy will it be to scale it up?|
|Score||The overall score after multiplying the individual scores together.|
Used by the team at Intercom the RICE score framework adds an additional ‘Reach’ factor.
|Reach||How many people will this affect within a given period?|
|Impact||How much will this project increase conversion rate when a customer encounters it (Massive = 3x, High = 2x, Medium = 1x, Low = 0.5x, Minimal = 0.25x)|
|Confidence||The level of confidence for your estimates. 100% is “high confidence”, 80% is “medium”, 50% is “low”, or total moonshot.|
|Effort||The total amount of time a project will require to make live (design, development, product etc)|
Final score is calculated by: (Reach * Impact * Confidence) / Effort.
5. The HIPE Prioritisation Framework
Designed by Jeff Chang and the Pinterest growth team the HIPE prioritisation framework takes a more objective approach.
|Hypothesis||Why will this idea have a significant impact on metrics? What is the opportunity size?|
|Investment||How much time and effort will we have to invest in this project? How long will it take?|
“It is better to work on 10 1-day projects with an expected value of 1K than 1 10-day project with an expected value of 5K .”
|Precedence||Is there a precedent for this working in the past? Has this worked before, either for your company or another?|
|Experience||Is this change a good user experience?|
Using a prioritisation framework effectively
In Growth Method teams prioritise ideas using the ICE framework resulting in an overall score for individual projects and experiments.
- Effort (or Resource)
Growth = fx (Impact, Probability Of Success, Resources Required)
In a perfect world you focus only on those things that have high probability of success, high impact, and low resources required.
Predicted impact is the degree to which you believe the idea will improve a specific metric. What would your KPIs would look like assuming the variant/experiment delivers at 100%? Make an educated guess by using benchmarks and clues from past experiments where appropriate.
How much of an impact will this idea have if it’s successful? How many people will it reach?
The 3 options to choose from are:
- High Impact
- Medium Impact
- Low Impact
Remember, if the idea is to make changes to specific website pages, do those pages receive a significant percentage of your website traffic? A brilliant conversion rate optimisation improvement will have limited impact on pages that only receive a small amount of traffic.
Confidence (aka probability of success) is how likely the idea is to produce the expected result.
- Is there a precedent for this working in the past?
- Do you think the idea has a high chance of succeeding?
Where possible this rating should be based on empirical data, such as some data analysis, user research, a review of industry benchmarks, a case study, or data gathered from a previous experiment.
The 3 options to choose from are:
- High Confidence (aka Probable, 80%)
- Medium Confidence (aka Possible, 50%)
- Low Confidence (aka Long Shot, 20%)
High confidence is normally reserved for ideas that are an iteration of a previously successful idea. Early growth teams don’t have any previous experiment results to look at, so have to see what works in the industry, but over time you should rely mainly on your own past experiment results as the variance with industry benchmarks is usually very large.
Low confidence is where your team are exploring unknown areas, perhaps a marketing channel, tool or platform that hasn’t been used before.
For more in-depth confidence analysis Itamar Gilad designed a more in-depth tool below.
3. Resource / Effort
Resource is an estimate of the time and/or resource required to implement the idea. It provides a reality check on overly ambitious ideas, and helps to identify the “low hanging fruit” tests to run.
Consider if the idea can be executed in a couple of hours in-house or is this something that will take a week of 3rd party development time. In addition to technical implementation, team members should also take into account organisational or political barriers that may affect implementation of ideas.
Growth is all about making smart time investments. It is better to work on 10 1-day projects with an expected value of 1K <metric> than 1 10-day project with an expected value of 5K <metric>. One reason why growth is tough is that if your experiment fails, all that hard work gets undone and you are back to the previous state, plus some learnings.Jeff Chang, Growth Technical Lead, Pinterest
Resource required is typically categorised as:
- Half day
- One hour
Note: It is advisable for newer growth marketing teams to avoid resource-intensive activities where possible and instead prioritise the number of ideas being tested in order to establish a cadence and rhythm to the new growth process.
Recommended additional reading on the RICE scoring framework and prioritisation in general.
For marketing and growth teams, the specifics of the various different scoring frameworks, and their pros and cons matters far less than picking one and implementing it within your team.
Creativity combined with rapid iteration are the keys to making progress on user growth. Remember that you can get to 10X growth by a combination of 2Xing a few different metrics, hitting one out of the park, or getting 10% increases across the board. They all multiply together to be 10X. If you can brainstorm a lot of ideas, going for quantity over quality, you’ll have a lot of ideas to evaluate for impact versus cost.Andrew Chen
Other articles you might like
Here are some related articles and further reading you may find helpful.
- The PXL framework: a prioritisation framework for growth marketers
- The PIE framework: a prioritisation framework for growth marketers
- ICE Framework: The original prioritisation framework for marketers
- The RICE framework: a prioritisation for growth marketing
- How to pick a prioritisation framework – RICE, ICE, PIE or HIPE?