AARRR! Mixpanel for Pirates (updated!)

Dave McClure's Startup Metrics for Pirates has become something of a bible for startups focused on collecting data and iterating quickly. His premise is simple - building a startup is hard! To succeed, you need to design and test constantly throughout both marketing and product. Marketers must design and test multiple channels, measuring effectiveness deep down the funnel rather than on the surface. Product designers should rigorously test new features through split testing and measuring impact on conversion.

For founders, less is more; the entire team should be focused on five key metrics: Acquisition, Activation, Retention, Referral, and Revenue.

Luckily for all of you pirates out there, Mixpanel is the perfect tool for tracking AARRR....

Acquisition

The key to understanding user acquisition is understanding which ad networks, widgets, campaigns, affiliates or SEO/SEM are sending you valuable traffic. Dave McClure calls these "best-performing conversion channels" and emphasizes that these are not channels sending you tons of pageviews, but channels sending you users that users that do something meaningful. This might mean viewing a movie, downloading a plug-in, playing a game, entering an email address - it's really up to you. All that matters is that you determine your meaningful events and judge your sources of traffic accordingly.

Mixpanel lets you easily track these meaningful events and segment them by source, campaign, medium, keyword, etc. Here is a sample Segmentation report. We are digging into an event that is more meaningful than a "pageview" - we're looking at a Browse, or search, event. Most likely, users that hit my landing page and actually browsed for an item are a good audience for me, and are much more likely to use my product than visitors who bounced after hitting the site. Breaking this out by ad source, we can see that HeyZap is the best source of traffic that performs this meaningful action.

An even more sophisticated approach to judging sources of traffic would be to run your retention reports by source to see not only which campaigns are sending you valuable traffic, but which campaigns are sending you traffic that returns over and over again. This is something unique to Mixpanel; I'll get more into this under Retention.

Dave McClure also mentions audience segmentation - who are these users? What age/gender/geography do they represent? Mixpanel Segmentation lets you drill deeply down into your conversion event, asking questions like, "Of the female visitors who came from Google, live in New Mexico, and purchased a pillow, what does their age distribution look like? What keywords did they search for?" It is imperative that you know who your customers/users are! No tool out there lets you dig as deep as Mixpanel.

Activation

So you've worked hard to get these valuable users to your website by optimizing your sources of traffic. Now, you need to make sure these users have a "happy first visit." Do they move through your app or website seamlessly? Are there certain pages or steps where you are losing or stalling a chunk of your traffic? McClure suggests constant A/B testing of your landing page as well as every added feature, with the key goal of increasing conversion.

Luckily for you pirates, it's a breeze to set up conversion split tests in Mixpanel. In the screenshot below, we are testing a sign-up form to see whether our alpha test has a greater conversion rate than our baseline. We can easily see that our test version outperformed our baseline, and we could drill down even further to see the impact by particular audience types as well as the impact on median time between steps.

Retention

So far, so good - you've optimized your traffic and created a happy first touch. Now, you need to keep your users coming back! You also need to be able to tell whether the changes you're making are impacting retention in a positive or negative way. The key to monitoring changes in retention is to view it by cohort groups.

Mixpanel uniquely gives you the ability to break your retention into cohort groups (birth classes) as well as to segment it by attributes like Source, Gender, Age, City, Device, Version, etc. This way, you can see not only whether your retention is getting better over time, but you can ask questions like "Are my changes increasing retention of my target audience - women who came to my site via Facebook?"

The question I'm frequently asked is, "This is all well and good, but how do I get my retention to go up?"

Well, Mixpanel gives you a great tool for this: Engage.

Engage lets you target your audience by very specific attributes and then test to see if the users you reach out to are reacting to your emails/notifications. For example, you could target users who have made multiple purchases in the past but haven't been to your site in two weeks to let them know about an event you're hosting in San Francisco, and then use funnels to see if these notifications are driving them back to your site or - even better - whether these notifications are impacting retention.

Referral

Once your product is battle-tested and beloved, it's time for viral marketing. This is your cheapest source of traffic, and one that bodes well for the success of your business - users like your product so much, they want to share the experience with others!

In Mixpanel, an easy way to start is by tracking shares, or even generation of shares, by adding tags in the URL. For example, we could easily segment an event called "share" by a property called "social network" -

You can take this even further to track conversion of these shares. We recently wrote a blog post on Tracking Virality with Funnels, which explains in detail how to track number of invites sent and percentage of those invites converted.

Tracking conversion of shares gives you two powerful tools: you can calculate your K-factor as well as see which users are contributing to your virality. Using mixpanel.people.increment, you can tally the number of share events fired by a user. Perhaps you'd like to thank them for their support directly via Mixpanel Engage? After all, it is certainly important to focus on the retention of your biggest evangelists!

Revenue

All of the previous four metrics were really teeing up the most important metric - revenue. Your revenue model is entirely up to you, and, of course, varies with each business. That said, measuring and tracking the lifetime value of a customer is an incredibly powerful tool to understand how much you can spend to acquire those customers while remaining profitable.

When you know who your most valuable customers are, you know who to focus on and where to focus development efforts. You'll be able to see if 18-24 year old men in San Francisco or 18-24 year old women in New York spend more money in your app. You can measure which acquisition channel delivers the most valuable customers and how this changes over time. In a nutshell, you can optimize your product and your marketing around the most important metric of all - dollars.

So...are YOU a pirate navigating formidable seas? Mixpanel can get you to your treasure. Ahoy, mates!

Geolocation Error on 7/9/2015

Incident Summary: No geolocation was being performed on events and people requests between 5:00PM PST 7/8/2015 to 1:30AM PST 7/9/2015. This affected all customers. Timeline: On 7/8/2015 at approximately 5:00 PM PST, a change was deployed to consumers that migrated our geolocation system from a Python module to a C replacement as part of our systems optimization plan. After this point, all geolocation requests made to the Maxmind DB began failing. Around 7/9/2015 1:00AM PST, Mixpanel began reverting the change and by 1:30AM, all consumers were reverted back to the Python Maxmind DB reader, which resolved the issue. Root Cause: The migration from a Python module to a C replacement proved not to be a direct drop-in replacement and generated errors (TypeError) when fed a value other than a string. We typically send IPs in the format we receive them, which can sometimes be a long...

A/B testing comes to Android

So you've got an idea. "We have all these awesome features most users just haven’t tried yet. I bet more people would use them if they couldn't skip the tutorial. " "I know more people would create an account if our button just said 'Get Started'." "Our game's too easy. People want a challenge. If it were a bit faster, it would keep users coming back." Great, but a good idea alone isn’t gonna cut it. Especially when opinions differ. What you really need is cold, hard data. You need to put that hypothesis to the test and see how it fares with real users in the real world. That's where A/B testing comes in. Previously, you've been able to use Mixpanel to experiment and improve your iOS app. And we've seen how useful it has been to our customers. Today, we're expanding Mixpanel A/B Testing to Android. All the capabilities that enable you to experiment and improve your iOS a...

Community Tip: Benefits & Best Practices for Cross-platform Apps

In this Community Tip, we highlight the benefits and best practices for accommodating all of your varied products, environments, and platforms under a single Mixpanel project. Using this guide, your team can decide how to best track your cross-platform app data within Mixpanel. If you're one of the many users working with cross-platform apps, you may have wondered whether it's best to combine everything into one Mixpanel project or split everything up and analyze it separately. We've found that creating separate Development and Production projects to avoid cluttering your Production data is a great best practice, but the question of what to do with cross-platform Production apps is a matter of preference. The good news: Mixpanel is flexible enough to handle cross-platform scenarios in any configuration you'd like to implement. The choice is yours, and each approach comes with its...

Introducing Codeless Mobile Analytics

Tracking how users are interacting with your app just got easier. Now you can get Mixpanel's advanced mobile analytics without writing a line of code. Let's face it, everyone's dealing with limited developer resources. If you've got to add a tracking request to the growing queue of dev needs, it'll probably take some time. With Codeless Mobile Analytics , you can focus your development time on what matters - making your app better. With a simple point and click setup, Codeless makes tracking events a breeze. Want to know if people are using a new feature? Skipping that tutorial? Changing a setting? After you've installed the Mixpanel SDK you can just fire up Codeless Mobile Analytics (it's that icon on the bottom of your sidebar). Select your platform - iOS or Android. Then connect to your app using either a phone or an emulator. That's it. From right there in your bro...

How Cozi got a 38% increase in signup completion

Tara Pugh, product owner of Cozi, stopped by our June Office Hours to explain the process for improving their UX through many small, data-driven steps. Cozi helps bring order to the chaos of modern family life with an app that gets the entire family on the same page with shared calendars, to-do lists, and shopping lists. Digging into their conversion funnel data with Mixpanel, they identified opportunities to improve user experience by streamlining the account creation flow. Testing hypothesis after hypothesis, Tara and the team at Cozi were able to incorporate bits of learning into the flow: lighter background, different calls to action, pre-populating name and email forms. No single change resulted in a huge increase in conversions, but all together, the improvements raised the signup completion rate from 55% to 76%—a 38% increase. Check out Tara's talk for all th...

Join us for Office Hours with Vandan Parikh (Product @ Capital One) & learn how to translate data into actions

Come join us for Office Hours in San Francisco where Vandan Parikh, Director of Product Management at Capital One, will take us through: Getting from information to action — Wednesday, July 29, 2015 What it's about Whether you are a product manager, growth hacker, data scientist, marketer, engineer, or founder, your role increasingly relies on turning data into action. The capacity to make this transformation consistently will determine the success of your team, product, and ultimately, your company. Vandan Parikh, Director of Product Management at Capital One and formerly Product Lead for Flickr at Yahoo, has developed tactics and strategies to create data-driven action and incredible success. Don't miss Mixpanel's Office Hours on July 29th when Vandan will detail the goals, principles, and environments necessary for you to bring actionable analytics into your company su...

AARRR! for People: Using Mixpanel Notifications to Grow your Business

This Community Tip will describe how to utilize Mixpanel notifications to engage users according to the AARRR analytics framework . By sending targeted notifications throughout the customer lifecycle, you can independently increase acquisitions, activations, retention, revenue, and referrals. Mixpanel Notifications are powerful tools for engaging with your user base. Through targeted push, email, SMS, and in-app messages, you can deliver effective calls to action to targeted groups of users. To determine who receives what call to action, Mixpanel uses targeting based off of people properties . There’s nothing worse than having a great call to action, but not having the right people properties to target the right group of users. This post will cover all of the tips and tricks you need to create effective campaigns throughout your user's lifecycle with Mixpanel notifications. We...

Community Tip: How to keep properties consistent across client and server libraries

To unlock the full power of Mixpanel reporting when using multiple integration libraries, super properties should be maintained across each Mixpanel library. In this Community Tip we discuss how to pass data from the client-side to your server for custom super properties and Mixpanel's default client-side properties. Passing custom super properties As a refresher, super properties are client-side properties that are automatically attached to every event that a user sends to your Mixpanel project. Super properties make working with Mixpanel data much more convenient because you can create custom global properties that are omnipresent on all of your events. These super properties will be attached to each and every event provided the memory location (cookies in a browser, device memory in a mobile phone) of the super properties is not cleared. However, since custom super properties ...

Now you can hide events and properties

Keep stale event and property names out of your dropdowns. Mixpanel has long offered you the ability to hide events that you've decided are irrelevant or maybe just were typos from the very beginning. We’ve recently extended this functionality to let you also clean up the list of properties that you see when segmenting reports or creating custom events. Say your application tracked an an event called "ate" with integer property called "tomatos". Later you decided to fix the pluralization of this property name and renamed it "tomatoes". Even though you stopped sending events with the "tomatos" property, you'd still see entries for both “tomatos” and “tomatoes” in the dropdown list of properties on your segmentation report. By marking the property name "tomatos" as hidden , you can keep it from showing up in this dropdown and any other dropdown that lists properties. How to h...