Ultimate guide to cohort analysis: How to reduce churn and strengthen your product retention
Cohort analysis is one of the best ways product analytics can help you both acquire and retain customers. It’s one of your most valuable tools for personalization, higher customer engagement, deeper product insights, and less churn. By digging into actual behavioral data over time, instead of relying solely on interviews and feedback, you can get a crystal clear picture of a user journey—including where the value moments and roadblocks lay.
This guide will explain what cohort analysis is, how it relates to churn and customer segmentation, and how to conduct cohort analysis to get the most out of your insights, along with a few examples.
With this level of insight, you can both reduce churn and strengthen your overall product.
What is cohort analysis?
Cohort analysis is a method for tracking a group of users over time. A cohort is a user group that shares a common characteristic such as an acquisition date, product type, or behavior.
By analyzing a cohort—say, paying users—teams can adjust features of their website or app to cater to those individuals and increase their engagement.
Why is cohort analysis useful?
Customer cohort analysis makes user tracking simpler by grouping users by their behaviors and characteristics.
Cohorts are, simply, user segmentations that are saved and named for quick reference. Rather than setting new reporting filters each time they log into an analytics suite, teams can name cohorts things like “Power Users,” “Busy Brenda,” or “Week 7,” and check back repeatedly to see how that cohort is performing over time.
Cohorts allow teams to understand their users in a more meaningful way than if they simply looked at data for their entire user base. Broad averages often conceal the specific preferences of smaller groups.
If teams don’t understand and cater to those specific preferences, they can lose those users. Take, for example, a video streaming service that notices that a slim majority of its users—51%—love horror films. They’d make a big mistake by recommending horror flicks to all of their users, some of whom are not interested in horror films and are more likely to churn from the platform if they feel that the service doesn’t cater to them.
With insights into each cohort’s preferences, on the other hand, the video platform could send more relevant recommendations and increase retention for all users.
The connection between cohort analysis and customer churn
Retaining an existing customer is always cheaper than attaining a new one, which is why companies focus so much effort and resources on reducing churn.
One of the key ways to reduce churn is improving customer engagement: Engaged customers are more likely finding value in your product and therefore more likely to continue using it.
Using cohorts can help with personalization and improving messaging campaigns. With a dynamic analytics tool like Mixpanel, you can sync cohorts created from marketing and product usage with messaging tools to surface guidance for different users across their onboarding journey.
Cohorts also help you understand the behaviors of your most engaged users and leverage that information to nudge users in that direction. If you define a “power user” cohort, for example, you can track their behavior across the user journey to understand what actions they took before becoming power users. If you push more users to take those actions, you make it more likely that they will become power users—and decrease their likelihood of churning.
You can also use cohorts to analyze churn risk by defining actions (or lack of actions) that are most likely to lead to churn, creating a cohort that fits that criteria, and refining that criteria by analyzing what percentage of your cohort churns. Once you understand your “likely to churn” cohort better, you can make changes to impact their behavior.
Types of cohorts to consider
Cohorts are defined by common characteristics, experiences, or behaviors—so you can identify patterns of behavior across the user lifecycle. These characteristics can be, but aren’t limited to:
- Demographic (e.g., age or location)
- Behavioral (e.g., number of times a feature is used or amount of purchases made)
- Technographic (e.g., app or SDK version)
Taken together, you can narrow down your analysis to only those users you want to consider—say, how users aged 21-30 in California are using the app versus the web-based platform.
Common examples of cohorts include:
- Power users, users who made three or more purchases in the last seven days
- Recent upgrades, users who upgraded their plan in the last 30 days
- Inactive users, users who haven’t used your app in the last 14 days
- Acquisition cohort, users who have signed up for the product on the same day or the same week
These cohorts can also include criteria to include or disqualify users with specific characteristics (e.g., use an iPhone or log in on Chrome).
In short, using cohorts provides you with more insights by allowing you to be more particular in analyzing your users instead of relying on broad metrics that may be misleading.
Why you should consider behavioral cohorts
Considering acquisition cohorts and demographic information is good for getting a broad sense of where your product is performing well and how churn trends over time. But you can only prioritize features and take effective action by considering behavioral cohorts (like the power users and inactive users mentioned above).
“When we study user behavior, we gather data on what people do—and what they don’t do—so we can build products that people will value,” says Mixpanel’s Aaron Krivitzky. “After all, you wouldn’t build a product that no one would use, nor would you invest time, money, and energy in a feature set that has no observable demand.”
In our guide to behavioral analytics, we define the process as “sorting and counting behaviors to construct behavioral cohorts, and to analyze things like engagement, conversion, and retention—and to measure these things as they change over time.”
In turn, these behavioral cohorts give you the insight you need to both acquire new users and retain users. For example: You can look at which actions power users took early on and optimize onboarding to drive more users to those actions.
Cohort analysis vs. segmentation
While plenty of people use ‘segment’ and ‘cohort’ interchangeably, that’s not technically accurate.
Segmenting users in your product analytics tools usually gives you a quick view of a single action—say, the total number of users who have clicked the Upgrade button. Cohorts, in turn, combine events and time periods to ensure you’re looking at the same group of users—users who have signed up this week and clicked the Upgrade button within the first three days, for example.
A cohort, is a subset of segmentation—and a critical application of segments in your product analytics.
“Segmentation is the single most impactful thing product teams can do to improve their onboarding experience. And the only way to know that changes in the user onboarding are working is through cohort analysis. It allows you to see how actions users in the cohort took or take translate into changes into activation and retention metrics. Simply put, if you’re not leveraging cohorts in your analysis, you’re most likely just ‘spraying and praying’ in improving your onboarding.”
Limitations of cohort analysis in Google Analytics
For teams without a dedicated product analytics tool, Google Analytics is often the default for trying to assess what’s working and what’s not. While Google Analytics may work for some surface-level insights, it breaks down when teams try to use it for robust segmentation and cohort analysis.
For example, Google Analytics is unable to support the following queries for building out cohorts:
- Did not do “event”
- Did “event” X times across different days
- Aggregate properties (sum, average, distinct count, etc.)
- Event properties where “most frequent” = x
Even more importantly, Google Analytics doesn’t support a multi-criteria cohort breakdown. Instead, retention can only be measured with one criterion. In contrast, Mixpanel can measure retention on two criteria. A few examples of multi-criteria cohorts highlight why this is important across multiple industries:
- How many users came back after “app install” to do “deposit money”?
- How many users that “watch video” came back for “download video”?
- How many users searched your e-commerce site and then came back for checkout?
Finally, you can use a frequency report in Mixpanel to learn how frequently users return to use your product or service—something Google Analytics doesn’t have the capability to do. Frequency analysis plays a huge role in understanding how users repeat an action. This can be very useful to understand how often users use a certain feature in a timeframe, giving product managers a sense of where to prioritize features.
How to conduct cohort analysis
To analyze cohorts, teams will need a cohort analytics tool that tracks cohorts with enough informational granularity to be useful. As teased above, Mixpanel is a great option.
A cohort analytics tool should feature:
- Data ingestion and integrations with common systems like CRM
- Data storage and reporting
- Graphical interface
- Tracking and measurement
It isn’t enough to view vanity metrics such as page views or likes, which don’t offer much insight into why users do what they do. Teams need to correlate all user behaviors and characteristics across devices back to concrete metrics such as subscriptions or revenue.
Once you have the right tool, you can conduct cohort analysis with a few simple steps:
1. Select a question to answer
As with any journey, teams must know the destination before they begin. For instance, is the team most interested to know what factors drive retention, which group of users is most likely to upgrade, or what group of users is most likely to commit fraud?
As an example, the team behind a streaming music app could be curious about the users that continue to use its service after 30 days. A cohort could be created to track those users to understand how to prevent churn by attracting and retaining others like them.
Examples for questions you can use cohort analysis to answer:
- Who are my power users?
- Which users are not opting in to new features?
- How many high-value users use Chrome?
2. Define the metrics
Which metrics help answer the question the team has selected? In the case of the music app, the cohort would include any user who exhibits positive retention after 30 days. However, cohorts can be measured by all sorts of metrics, including:
- Timing, when users signed up
- Behaviors, whether users purchased once or repeatedly
- Characteristics, based on region, age, marketing source
Learn more about the most important user engagement metrics.
3. Define the cohorts
Within the cohort analytics tool, create a new cohort and filter for the behaviors and characteristics that define the cohort in question. Save the cohort and verify that the users gathered within the cohort report match the cohort’s parameters. Adjust if needed.
4. Analyze the results
Teams can run cohort reports as they need them, or periodically, and track the performance of cohorts against a range of factors such as:
- Retention
- Average order size
- Upgrades
- Usage
- Engagement
- Referrals
Teams can compare cohorts against one another or compare cohorts to the broader user population to understand any differences.
For example, cohorts that signed up for marketing software during a particular week may exhibit far higher usage and retention than normal, and the team can investigate that cohort’s behaviors to generate ideas for improving the service.
If the team finds that those users came from a particular marketing campaign, they know to repeat that campaign. If they note that an unusual percentage of the cohort completed the onboarding sequence, the team knows to promote the onboarding sequence more aggressively.
Setting up cohort analysis in Mixpanel
In Mixpanel, you can set up cohorts when you click on “users.” You can add filters that will show you users that fall into a given category.
For example, you can look at users who signed up for the first time in the last seven days and didn’t complete a purchase.
You can add as many filters as you like and get very granular when defining your cohort. Once you have your criteria in place, save and name your cohort. Once it’s created, you can access it at any time without having to set up the filters and redo the work again.
You can use the cohort in your analysis across your different reports.
When you go into an Insights Report (for example) you can select the cohort you just created and compare it to other cohorts. You can share and duplicate your cohorts, or use the cohorts that someone else created in your own analysis.
Use templates for cohort analysis
For example, this video shows you how to use Mixpanel’s lifecycle cohort analysis template, which teaches you about your active and inactive user base with just one input from you.
Cohort analysis examples
Here are three real-life examples of how to use cohort analysis to improve a product:
Cohort retention analysis
The children’s education software CodeSpark improved its retention by dividing users into cohorts based on acquisition sources.
The team A/B tested new features with each group separately and found that new users who joined from its Hour of Code program exhibited different behaviors than those who joined during a school program.
Knowing which groups liked which features allowed the team to retain students longer.
For more details, read the complete case study here.
Increased revenue
The entertainment ticket sales leader Ticketmaster used Mixpanel’s user analytics to segment its B2B user base and create separate cohorts for venues, artists, and promoters.
By sending personalized messaging and A/B testing marketing campaigns to each different cohort, the marketing team significantly improved its return on marketing spend.
Read Ticketmaster’s full story here.
Customized content
Streaming platform Joyn used cohorts to enable company-wide experimentation and make data-driven decisions.
They created cohorts to test different homepage presentations with a variety of “cards” displayed. By testing different displays to different cohorts and analyzing the results, they were able to find the optimal presentation for their product.
Read the full case study here.
Set up your cohort analysis today
Remember: With real (and nearly real-time) data, you can make better decisions for your product, your users, your onboarding experience, and more. Interviews and feedback loops can fill in the gaps, but product analytics give real-world actionability that no other approach can.
In short: Cohort analysis will help you improve both acquisition and retention. Try Mixpanel for free and start creating your own cohorts today.