Home / Strategy / Reforge Growth Series: Retention & Engagement

Reforge Growth Series: Retention & Engagement

Article originally published in February 2024 by Stuart Brameld. Most recent update in April 2024.

Request a demo

Project management for growth and agile marketing professionals. Map your acquisition funnel, integrate analytics and run agile experiments.

Experiment results

Recent experiments results include competitor SEO, AI-driven content, exit-intent modals and AB testing homepage headlines.

Case study

"We are on-track to deliver a 43% increase in inbound leads this year. There is no doubt the adoption of Growth Method is the primary driver behind these results." 

Certified

We are vetted mentors with Growth Mentor and a partner with the Agile Marketing Alliance.

The article provides our notes from the excellent Growth Series Course on Reforge.

Module 1: Growth Wins

Why growth wins

Defensibility
Defensibility means the more distribution you have, the more you can leverage it into other products to drive even more distribution.
ResourcesThe idea here is growth attracts resources, which produces more growth.
LearningThe third reason growth wins is learning. Growth produces quicker and deeper learnings, which produces more growth.
Growth leads to more growth
One of the key concepts we will talk a lot about in the Reforge Growth Series is how the conventional wisdom of using funnels to think through growth is flat out wrong.

The distribution challenge

Whilst in the past you could get noticed and be successful with great technology, or great product, today it’s not enough and companies also need great distribution in order to be successful.

  • 1990s – Great tech = Success
  • Mid 2000s – Great tech + Great product = Success
  • Today – Great tech + Great product + Great distribution = Success
  • As technology risk decreases, distribution risk increases

“Poor distribution, not product, is the number one cause of failure”

Peter Thiel, Facebook & PayPal (Zero to One)

Loops not funnels

The fastest growing companies are built on loops, not funnels. A loop being where an output is reinvested back into an input. Just like in finance where your return is a function of the principal you have invested, in growth loops the “return” is typically a function of the existing user base.

Growth is feedback loop in and of itself, the more we learning, the higher our hit rate on experiments – we can increase our batting average.

CleanShot 2024-02-08 at 16.04.12
Image source

More growth (1) ….. leads to more data and users (2) ….. which leads to more experiments and feedback (3) ….. which leads to more and faster learnings (4) …. which leads to more growth (1) etc

The game has changed

ChangeDetail
Distribution is more competitive and expensiveAcquisition costs through content marketing, facebook ads, organic search click-through rates increasing dramatically. Overall CAC up around 50% according to Profitwell. Consolidation + tightening control + more competition.
The lifecycle of channels and tactics has acceleratedEvery tactic goes through a lifecycle where effectiveness decreases over time (see viral channel effectives, Jamies Currier). Lifecycles are accelerating due to competition.
Access to data has increased as costs have decreasedAnalytics software ecosystem has grown exponentially. Increased accessibility, more personalisation, machine learning.
The lines of product, marketing, engineering & sales have blurredAll play a role in influencing and enabling growth loop. Product, tech, data and design play much larger roles in acquisition and retention. No longer silo’d teams.

Building a system

Building a strong growth system:

  1. Systematic – not throwing stuff at the wall
  2. Deterministic – not based on luck or randomess
  3. Sustainable – sustainable over time
  4. Repeatable – can repeat the system to adapt to the constantly changing environment

Growth output = Acquisition, Monetisation and Retention & Engagement. The growth process = growth model + experiments + user psychology.

Image source

The goal is the drive towards the truth and remove human biases from the equation.

Module 2: Retention

Retention is the core of the growth engine

Retention is the core of the growth engine, it powers acquisition and monetisation, not the other way around.

Image source

Increases in retention and engagement improve the rest of the growth model.

Retention & engagement separates the top 1% of companies from the rest – this applies across the best social networking companies (Facebook lead with 92% retention with largest market cap), B2C subscription (Spotify lead with 80% retention and largest market cap) and B2C subscription boxes (Stitch fix retention of 80% and largest market cap). Also applies to B2B SaaS companies (see analysis from Tomasz Tunguz).

How does retention powers acquisition and engagment?

  1. Drives acquisition loops – The longer you retain a user, the more opportunities you have to engage that user in a viral acquisition loop (e.g. viral invite loop, user generated content loop, paid marketing loop, sales loop)
  2. Builds competitive muscle – Afford higher customer acqusition costs – can raise cost of customer acquisition cost – increase bits or afford new channels that were previously too expensive
  3. Accelerates payback period – cohort will retirn CAC cost faster, so can reinvest at a faster pace. get more money back a faster pace which can then be used for acqusition.

How does retention power monetisation?

  1. Longer retention leads to more monetisation touchpoints – more ad inventory, more subscribers, more transactions, more upgrades etc
  2. Engagement correlates with longer retention – as engagement increases results in longer retention and more monetisation touchpoints
  3. Increase engagement drives monetisation models – deeper engagement despite user base, as well as ability to trigger a new pricing tier (more money per month)

Why retention can be the silent killer

Companies such as Homejoy, Fab, BranchOut and viddy had incredibly strong growth but ultimately failed as businesses due to do the retention “silent killer”.

Why is retention the silent killer?

  1. Retention requires a long-term view to understand the impact, which is a challenge in companies that prioritise short-term goals.
  2. Easy to cover-up with the wrong metrics e.g. top-line numbers like monthly active users
  3. Can assume good retention (breadth) without the required engagement (depth)

Retention is the output

How many users remained active within a defined time period after signing up?

Brian Balfour, Reforge

Retention is the output, so we need to improve the inputs of Activation, Engagement and Resurrection. The first step therefore is to clearly define this retention metric.

Image source

Nurture v nature component

  • What is the natural usage behaviour and pattern around your product?
  • Nurture should amplify and encourage the natural behaviour, but must be aligned
  • The goldilocks point : too much feels spammy, too little and users forget about your product

The use case map (Qualitative)

The use case map is used to define the nature components as these inform our activation, engagement, retention and resurrection strategies.

Image source
  1. Problem – definition of the problem in the words of our users
  2. Persona – who has this problem?
  3. Why – why people choose your product to solve that problem?
  4. Alternative – what is the alternative to solving the problem? (not necessarily direct competitors)
  5. Frequency – how often do they encounter the problem (use the alternative)?

When considering multiple use cases these use cases will be very different so retention metrics will likely also differ. This can be simplified by focusing on the dominant use-case to start.

Measuring & analysing retention (Quantitative)

In order to define a good retention metric need to validate qualitative assumptions from the use-case map with quantitative data.

Image source

Aim to validate natural frequency, core behaviour and who:

  • Frequency – analyse active users in the last 28 days
  • Core behaviour – understand which actions indicates value delivery to the user and analyse e.g. sending survey once every 28 days
  • Who – provide clarity around the user and core action

3 mistakes to avoid when defining a good retention metric:

  1. Align with the natural frequency of the use case
  2. Keep things simple, avoid combining multiple actions into a simple metric
  3. Avoid using revenue, this is the output, not the input (retention)

The key to analysing retention is through cohorts with a predefined timeframe (one week, or one month etc) to answer questions such as ‘How many users are still left after X time? ‘ and ‘What % of users go dormant after X time?’. This data can then be visualised with retention curves to make them easier to understand retention over time.

Module 2: Engagement

Retention = Were they active or not within the time period? Engagement – How active were they? Engagement = bait has been established.

Image source

Building Habits

When we define a user as ‘Engaged’ this really means that a habit has been established with the product. Lots of research on habit building:

  1. Scientific Advertising, Claude Hopkins: Routine -> Reward -> Queue
  2. Hooked, Nir Eyal
  3. The Power of Habit, Charles Duhigg

The goal is to establish an organic habit loop with your users

Image source

There are two main ways to reinforce habits as below, note environment loops are typically more expensive and add additional friction:

  1. Manufactured loops – push a manufactured trigger
    • Types of trigger: Time trigger, Location trigger, Change trigger, Network (peer based) trigger and Programmatic triggers
    • Channels: Email, Mobile, In Product, Platform, Browser, Desktop, Paid Media, Direct Mail
  2. Environment loops – insert into the natural environment surrounding the trigger
    • Research – what are the places, products and people a user might touch?
    • Build/Buy/Partner – what are the opportunities to solve?
    • Costs
Image source

Your core organic habit loop can be added to and improved further with smaller supplemental loops over time.

Image source

Activation

Engagement – when the user has the habit established, Activation is about getting the user to establish that habit for the first time.

  • Activation bridges the (often huge) gap between your marketing and your product
  • Activation touches 100% of acquired users
  • “Your first impressions is your last impression” – where the first impression is formed
  • Activation influences (and improves) the first part of the retention curve (which in turn influences and improves acquisition, monetisation and virality)
  • Activation is typically the highest impact on improving retention
  • Activation is around establishing a habit

After all the testing, all the iterating, all this stuff, you know what the single biggest thing we realised was? Get any individual to seven friends in 10 days. That was it”

Chamath Palihapitiya, Head of Growth at Facebook
Image source

The habit moment

  1. Habits vary depending on the behaviour you are trying to establish the habit around e.g. drinking a glass of water per day is much easier that 50 sit-ups a day.
  2. On average it takes 66 days to build a new habit
Image source

What does an engaged user in your app look like? Work back from frequency and retention metric above.

Image source
  1. Manufactured loops – design activation experience to take from signup into manufactured habit loop
  2. Environment loops – design activation experience to take from signup into environment habit loop
  3. Use case transition – can’t use manufactured or environment loops for low natural frequency products hence shift to a related more frequent organic trigger (note this can be expensive)
  4. Grand exit – last resort option but requires creating a 10X experience and reward e.g. early days of Uber

The aha moment

The journey of activation ends with the habit moment. The aha moment is when the user has experienced the core value proposition for the first time e.g.

  • Pinterest – User has done the first pin within first 7 days
  • HubSpot – User has seen their first tracked notification within the first day
Image source
[Click here to view notes for Growth Method]
  • Core action = complete a successful experiment that can be shared
  • Warm start = starting he first experiment using a template from the gallery
  • Supporting actions = search functionality + ‘create growth idea’ button
  • Empty states = block dashboard & reporting and prompt core action (e.g. modal text ‘You will see your reports and performance here’, modal button ‘Create a growth idea!’)

Setup moment

The journey of activation ends with the habit moment. The aha moment is when the user has experienced the core value proposition for the first time. The setup moment is when the user has done the must-haves to experience the aha moment and get to the habit moment.

  • Pinterest – The user has chosen 5 topics of interest within the first day
  • HubSpot – the user has installed the extension and tracked at least 3 emails
Image source

Have a checklist of must-haves as part of the setup experience e.g.

Must haveExplanationExamples
User informationInfo about the user, company, credit card, location, preferencesAdd your name and email, Select your topics of interest (e.g. Quora, Pinterest, Surveymonkey)
PermissionsChannel, location, or device permissions for loops and re-engagementAdd an integration (e.g. Google Analytics)
SocialTo get value, do they need others in the experience?People you may know, Invite your colleagues etc

Notifications & incentives are a supporting strategy and shouldn’t be used alone. They are best used for dropout detection to bring back in to the app and complete activation.

Resurrection

Retention = (Activation, Engagement, Resurrection)

The goal of resurrection Dormant users – people that used to have the habit and have become unengaged at some point

Important:

How big is your pool or resurrectable users?

  • Most users will likely never have activated (lost before the habit moment)
  • Most companies have an activation problem, not a resurrection problem
  • The probability of being able to ressurect a user decays quickly over time (and cost to resurrect them increases)

What is the real potential lift from contacting these users?

  • No. of users x response rate x % retained = total lift from resurrection campaign
  • Users – total pool is likely much smaller than you think
  • Response rate – many are likely already tuned out (others wouldn’t be dormant)
  • % Retained – even if you get them to response, what % will re-establish the habit
  • However, we have nothing to lose

When is resurrection the right opportunity to focus on?

  • After focusing on activation and engagement
  • Understand the true opportunity and cost first
  • Capitalise on high psych time periods for your audience when people might come back
be aware of negative consequences

Involuntary dormant users

Users that disengage due to some reason that wasn’t a conscious choice. Involuntary dormant users are easier to resurrect than voluntary dormant users, hence start here.

  • Product issue e.g. technical bug, logged out, switching devices etc
  • Leaving e.g. left the company, market – particularly common in b2b
  • Payment failure – expired credit cards, address changes etc

How to prevent:

  • Persistent notifications – block usage until updates done
  • Email notifications – make it simple to update the required information
  • Payment strategies – optimise options, re-try, auto-update credit cards etc

Voluntary dormant users

Users that have made a conscious choice not to engage in the product anymore. May not have been using the product, ignoring notifications and likely formed an opinion on why they don’t need the product.

Image source

Module 3: Activation

Coming soon ……