AARRR! Mixpanel for Pirates (updated!)

Dave McClure's Startup Metrics for Pirates has become something of a bible for startups focused on collecting data and iterating quickly. His premise is simple - building a startup is hard! To succeed, you need to design and test constantly throughout both marketing and product. Marketers must design and test multiple channels, measuring effectiveness deep down the funnel rather than on the surface. Product designers should rigorously test new features through split testing and measuring impact on conversion.

For founders, less is more; the entire team should be focused on five key metrics: Acquisition, Activation, Retention, Referral, and Revenue.

Luckily for all of you pirates out there, Mixpanel is the perfect tool for tracking AARRR....

Acquisition

The key to understanding user acquisition is understanding which ad networks, widgets, campaigns, affiliates or SEO/SEM are sending you valuable traffic. Dave McClure calls these "best-performing conversion channels" and emphasizes that these are not channels sending you tons of pageviews, but channels sending you users that users that do something meaningful. This might mean viewing a movie, downloading a plug-in, playing a game, entering an email address - it's really up to you. All that matters is that you determine your meaningful events and judge your sources of traffic accordingly.

Mixpanel lets you easily track these meaningful events and segment them by source, campaign, medium, keyword, etc. Here is a sample Segmentation report. We are digging into an event that is more meaningful than a "pageview" - we're looking at a Browse, or search, event. Most likely, users that hit my landing page and actually browsed for an item are a good audience for me, and are much more likely to use my product than visitors who bounced after hitting the site. Breaking this out by ad source, we can see that HeyZap is the best source of traffic that performs this meaningful action.

An even more sophisticated approach to judging sources of traffic would be to run your retention reports by source to see not only which campaigns are sending you valuable traffic, but which campaigns are sending you traffic that returns over and over again. This is something unique to Mixpanel; I'll get more into this under Retention.

Dave McClure also mentions audience segmentation - who are these users? What age/gender/geography do they represent? Mixpanel Segmentation lets you drill deeply down into your conversion event, asking questions like, "Of the female visitors who came from Google, live in New Mexico, and purchased a pillow, what does their age distribution look like? What keywords did they search for?" It is imperative that you know who your customers/users are! No tool out there lets you dig as deep as Mixpanel.

Activation

So you've worked hard to get these valuable users to your website by optimizing your sources of traffic. Now, you need to make sure these users have a "happy first visit." Do they move through your app or website seamlessly? Are there certain pages or steps where you are losing or stalling a chunk of your traffic? McClure suggests constant A/B testing of your landing page as well as every added feature, with the key goal of increasing conversion.

Luckily for you pirates, it's a breeze to set up conversion split tests in Mixpanel. In the screenshot below, we are testing a sign-up form to see whether our alpha test has a greater conversion rate than our baseline. We can easily see that our test version outperformed our baseline, and we could drill down even further to see the impact by particular audience types as well as the impact on median time between steps.

Retention

So far, so good - you've optimized your traffic and created a happy first touch. Now, you need to keep your users coming back! You also need to be able to tell whether the changes you're making are impacting retention in a positive or negative way. The key to monitoring changes in retention is to view it by cohort groups.

Mixpanel uniquely gives you the ability to break your retention into cohort groups (birth classes) as well as to segment it by attributes like Source, Gender, Age, City, Device, Version, etc. This way, you can see not only whether your retention is getting better over time, but you can ask questions like "Are my changes increasing retention of my target audience - women who came to my site via Facebook?"

The question I'm frequently asked is, "This is all well and good, but how do I get my retention to go up?"

Well, Mixpanel gives you a great tool for this: Engage.

Engage lets you target your audience by very specific attributes and then test to see if the users you reach out to are reacting to your emails/notifications. For example, you could target users who have made multiple purchases in the past but haven't been to your site in two weeks to let them know about an event you're hosting in San Francisco, and then use funnels to see if these notifications are driving them back to your site or - even better - whether these notifications are impacting retention.

Referral

Once your product is battle-tested and beloved, it's time for viral marketing. This is your cheapest source of traffic, and one that bodes well for the success of your business - users like your product so much, they want to share the experience with others!

In Mixpanel, an easy way to start is by tracking shares, or even generation of shares, by adding tags in the URL. For example, we could easily segment an event called "share" by a property called "social network" -

You can take this even further to track conversion of these shares. We recently wrote a blog post on Tracking Virality with Funnels, which explains in detail how to track number of invites sent and percentage of those invites converted.

Tracking conversion of shares gives you two powerful tools: you can calculate your K-factor as well as see which users are contributing to your virality. Using mixpanel.people.increment, you can tally the number of share events fired by a user. Perhaps you'd like to thank them for their support directly via Mixpanel Engage? After all, it is certainly important to focus on the retention of your biggest evangelists!

Revenue

All of the previous four metrics were really teeing up the most important metric - revenue. Your revenue model is entirely up to you, and, of course, varies with each business. That said, measuring and tracking the lifetime value of a customer is an incredibly powerful tool to understand how much you can spend to acquire those customers while remaining profitable.

When you know who your most valuable customers are, you know who to focus on and where to focus development efforts. You'll be able to see if 18-24 year old men in San Francisco or 18-24 year old women in New York spend more money in your app. You can measure which acquisition channel delivers the most valuable customers and how this changes over time. In a nutshell, you can optimize your product and your marketing around the most important metric of all - dollars.

So...are YOU a pirate navigating formidable seas? Mixpanel can get you to your treasure. Ahoy, mates!

XO Group democratizes data to build a better product

XO Group Inc., parent company of The Knot, The Nest, and The Bump, democratizes data across their data science, product, and marketing teams to build a better product. Planning a wedding, cohabiting with your significant other, or expecting a newborn? If so, chances are you’ve already discovered XO Group. With The Knot , The Nest , and The Bump , XO Group brands help make these important lifetime milestones stress-free and enjoyable. XO Group has always emphasized the importance of analytics to ensure their apps continually provide the best user experience. As a leading lifestyle brand, XO Group has a very savvy development team, but this did not necessarily make choosing an analytics strategy an easier decision. As XO Group grew, they found clunky commerce focused analytics tools were not agile enough to provide instant insight to the team. As XO Group continuously expa...

Community Tip: Session length tracking

This Community Tip will explore the utility of session length tracking and describe how to add this metric to your iOS, Android, or JavaScript app. Mixpanel's Engagement Analytics is designed as an event-driven tracking tool for drawing actionable insights from your users' engagement. Traditionally, businesses tracked session lengths as a proxy for user engagement. As you get started with your Mixpanel implementation, you will notice that Mixpanel does not include a default built-in session calculation. Instead, we encourage you to focus on the actions that constitute engaged usage of your application, site, or other web-connected widget. For most businesses, session length is not the best proxy for engagement, but for some, session length is the best proxy. This Community Tip will describe the implementation of session length tracking in our client-side libraries. Additionally, w...

Join us for Office Hours with Cozi & learn how to evolve user experience

Come join us for Office Hours in San Francisco where Tara Pugh, Product Owner at Cozi, will take us through: Evolving user experience with small, data-driven steps — Thursday, June 25, 2015 What it's about For an evolving product, the path to achieving big things looks like this: make a series of small steps, each in the right direction. But where to focus? How do you know if you're headed the right way? Why not make giant leaps? Tara Pugh, Product Owner and user experience program manager at Cozi will describe an iterative, data-driven framework for product development. Tara will outline the approach Cozi uses to optimize important flows and touchpoints using Mixpanel and provide examples of tangible improvements to user experience across mobile, web, and email. Questions about your integration? Need help interpreting the story behind your data? Just want to talk analy...

Community Tip: Naming conventions to stay organized

This Community Tip will describe some useful naming conventions to organize events, properties, reports, and campaigns. Add prefixes to separate product components As your application matures, different teams may be accessing the same Mixpanel project to analyze completely different product and process-oriented user-behavior. This shared studying of a project can very well increase the complexity in reporting, as your Mixpanel implementation accommodates tracking of all products and processes within your application. This can lead to an increase in the number of events and properties deployed to capture key metrics and granularity of data. Using prefixes offers you and your team an invaluable way to distinguish different types of metrics for easy recognition and usage across your teams while maintaining a comprehensive and granular tracking scheme. Prefixes such as "Billing -" a...

Community Tip: Guide to Exporting Mixpanel Data

This Community Tip walks developers through the Mixpanel APIs for raw data and tips to set up an ETL (Extract, Transform and Load) configuration for both Event and People data. Exporting your Mixpanel data can serve a number of purposes whether you simply wish to use the data for raw analysis purposes, store a local copy in your own internal datastore, or pipe the data to another service. API Endpoints for raw Event and People data Mixpanel provides powerful processed API endpoints which provide the formatted Event data you see within the various Mixpanel reports like Segmentation, Funnels, and Retention. These endpoints query your raw data for insight analysis, but do not return the raw data you send to Mixpanel. The raw export API provides a full export of your raw project data so that you can utilize this data for purposes outside of Mixpanel. Instead of returning the nu...

Updated Live View: A more powerful tool to help you debug and integrate Mixpanel

Mixpanel's Live View report displays events coming into your Mixpanel project in real time. Live View is an extremely useful tool for testing changes to your implementation, debugging or QA testing, hypothesizing user stories before diving into deeper analyses, or confirming a hunch about product use. Look at the past actions of individual users By hovering over the icon to the left of the event name in the Live View report, you can see that we can view the profile activity for this user. Individual users are denoted by colored icons. Regardless of whether or not there is a People Profile associated with this user, you will be able to see their Activity Feed by clicking on this icon. Filtering by both events and properties By clicking on the Filter tab at the top left of Live View, you can select to filter your data by the event name or by the properties associated with th...

Community Tip: Personalizing Mixpanel Email Notifications

This Community Tip will explain how People Properties can be used within an email message to customize both the content and presentation. Use these tricks to add personalization and drive deeper creativity in your marketing or lifecycle emails. Mixpanel’s Notifications are specifically designed to give you a tool to engage with your users, and keep them coming back. A great way to ensure your users connect to the content is to tailor the notification, and message itself, with information useful to the person, and what he/she may need at a given point in the lifecycle of the product/service. To illustrate this, let’s imagine the following scenario: I have a mobile game, where you, an up-and-coming space cadet, are tasked with the quite unique and innovative concept of defending the earth against gnarly aliens! I want to set up a notification campaign that looks for people that hav...

Date property filters: Custom cohortize your events

Recent updates to date property filters allow enhanced segmentation and cohortization across all of Mixpanel's Engagement reports. Using date properties you can now create and analyze custom cohorts based entirely on important dates in your user lifecycle. New filters "on" and "between" When segmenting by a date property in Mixpanel reports, you will see two new filters, "on" and "between". These filters allow you to segment and cohortize your users into groups by date properties such as the date they signed up or a range of dates where users converted from free to paid. Using date filters in Mixpanel reports With these added abilities to cohortize users by their date properties, you can now more easily create cohorts of users and track their activity over time. For example, for an ecommerce site, you might wish to see how often users who were created 3 months ago return to ...

How Greenvelope Uses Mixpanel to Increase Sign-Up Conversion

Greenvelope strives to deliver the most elegant electronic invitation service by emulating the experience of opening a “traditional” printed invitation. Greenvelope uses Mixpanel's event based Engagement Analytics and People Analytics to gain actionable insights from how users' interact with their website. By creating a positive online experience, Greenvelope hopes more hosts will consider sending invitations electronically for formal events - to help save trees, time, and money. In 2014 Greenvelope received the coveted "Wedding Wire’s Couple Choice Award for Excellence.” Knowing this had the potential to elevate the brand, they wanted to share their success with potential customers. However, they were hesitant about how best to use this award to advertise their success. By measuring the conversion rates of various options with Mixpanel’s funnel report they were able to take all th...