AARRR! Mixpanel for Pirates (updated!)

Dave McClure's Startup Metrics for Pirates has become something of a bible for startups focused on collecting data and iterating quickly. His premise is simple - building a startup is hard! To succeed, you need to design and test constantly throughout both marketing and product. Marketers must design and test multiple channels, measuring effectiveness deep down the funnel rather than on the surface. Product designers should rigorously test new features through split testing and measuring impact on conversion.

For founders, less is more; the entire team should be focused on five key metrics: Acquisition, Activation, Retention, Referral, and Revenue.

Luckily for all of you pirates out there, Mixpanel is the perfect tool for tracking AARRR....

Acquisition

The key to understanding user acquisition is understanding which ad networks, widgets, campaigns, affiliates or SEO/SEM are sending you valuable traffic. Dave McClure calls these "best-performing conversion channels" and emphasizes that these are not channels sending you tons of pageviews, but channels sending you users that users that do something meaningful. This might mean viewing a movie, downloading a plug-in, playing a game, entering an email address - it's really up to you. All that matters is that you determine your meaningful events and judge your sources of traffic accordingly.

Mixpanel lets you easily track these meaningful events and segment them by source, campaign, medium, keyword, etc. Here is a sample Segmentation report. We are digging into an event that is more meaningful than a "pageview" - we're looking at a Browse, or search, event. Most likely, users that hit my landing page and actually browsed for an item are a good audience for me, and are much more likely to use my product than visitors who bounced after hitting the site. Breaking this out by ad source, we can see that HeyZap is the best source of traffic that performs this meaningful action.

An even more sophisticated approach to judging sources of traffic would be to run your retention reports by source to see not only which campaigns are sending you valuable traffic, but which campaigns are sending you traffic that returns over and over again. This is something unique to Mixpanel; I'll get more into this under Retention.

Dave McClure also mentions audience segmentation - who are these users? What age/gender/geography do they represent? Mixpanel Segmentation lets you drill deeply down into your conversion event, asking questions like, "Of the female visitors who came from Google, live in New Mexico, and purchased a pillow, what does their age distribution look like? What keywords did they search for?" It is imperative that you know who your customers/users are! No tool out there lets you dig as deep as Mixpanel.

Activation

So you've worked hard to get these valuable users to your website by optimizing your sources of traffic. Now, you need to make sure these users have a "happy first visit." Do they move through your app or website seamlessly? Are there certain pages or steps where you are losing or stalling a chunk of your traffic? McClure suggests constant A/B testing of your landing page as well as every added feature, with the key goal of increasing conversion.

Luckily for you pirates, it's a breeze to set up conversion split tests in Mixpanel. In the screenshot below, we are testing a sign-up form to see whether our alpha test has a greater conversion rate than our baseline. We can easily see that our test version outperformed our baseline, and we could drill down even further to see the impact by particular audience types as well as the impact on median time between steps.

Retention

So far, so good - you've optimized your traffic and created a happy first touch. Now, you need to keep your users coming back! You also need to be able to tell whether the changes you're making are impacting retention in a positive or negative way. The key to monitoring changes in retention is to view it by cohort groups.

Mixpanel uniquely gives you the ability to break your retention into cohort groups (birth classes) as well as to segment it by attributes like Source, Gender, Age, City, Device, Version, etc. This way, you can see not only whether your retention is getting better over time, but you can ask questions like "Are my changes increasing retention of my target audience - women who came to my site via Facebook?"

The question I'm frequently asked is, "This is all well and good, but how do I get my retention to go up?"

Well, Mixpanel gives you a great tool for this: Engage.

Engage lets you target your audience by very specific attributes and then test to see if the users you reach out to are reacting to your emails/notifications. For example, you could target users who have made multiple purchases in the past but haven't been to your site in two weeks to let them know about an event you're hosting in San Francisco, and then use funnels to see if these notifications are driving them back to your site or - even better - whether these notifications are impacting retention.

Referral

Once your product is battle-tested and beloved, it's time for viral marketing. This is your cheapest source of traffic, and one that bodes well for the success of your business - users like your product so much, they want to share the experience with others!

In Mixpanel, an easy way to start is by tracking shares, or even generation of shares, by adding tags in the URL. For example, we could easily segment an event called "share" by a property called "social network" -

You can take this even further to track conversion of these shares. We recently wrote a blog post on Tracking Virality with Funnels, which explains in detail how to track number of invites sent and percentage of those invites converted.

Tracking conversion of shares gives you two powerful tools: you can calculate your K-factor as well as see which users are contributing to your virality. Using mixpanel.people.increment, you can tally the number of share events fired by a user. Perhaps you'd like to thank them for their support directly via Mixpanel Engage? After all, it is certainly important to focus on the retention of your biggest evangelists!

Revenue

All of the previous four metrics were really teeing up the most important metric - revenue. Your revenue model is entirely up to you, and, of course, varies with each business. That said, measuring and tracking the lifetime value of a customer is an incredibly powerful tool to understand how much you can spend to acquire those customers while remaining profitable.

When you know who your most valuable customers are, you know who to focus on and where to focus development efforts. You'll be able to see if 18-24 year old men in San Francisco or 18-24 year old women in New York spend more money in your app. You can measure which acquisition channel delivers the most valuable customers and how this changes over time. In a nutshell, you can optimize your product and your marketing around the most important metric of all - dollars.

So...are YOU a pirate navigating formidable seas? Mixpanel can get you to your treasure. Ahoy, mates!

Community Tip: All About Time

In this Community Tip we discuss all aspects of time in Mixpanel, including how to set your project timezone, send time properties, and handle timestamps when exporting or importing data. Using these directions, Mixpanel can help standardize how you handle time to ensure your data reflects accurate timestamps. In today’s connected world, a startup can be headquartered in Berlin, Germany, have a core user-base in Beijing, China, and be analyzing their data through an analytics company in San Francisco, California, USA. With all of these different locations in play, seamlessly handling time data being received from around the world can be intimidating. Luckily, with a few of the following best practices, you can ensure your Mixpanel data is time agnostic to the physical location of your users. Setting Your Mixpanel Timezone When you create a new Mixpanel project, your project timez...

Community Tip: Implement Mixpanel in Swift Apps

This Community Tip will describe how to implement the Mixpanel iOS SDK, written in Objective-C, within your Swift app. We will walk through integration using CocoaPods, library set-up, provide code samples, and ultimately save you development time. Requirements: CocoaPods This guide assumes you are using CocoaPods since that is the recommended way to integrate your app with the Mixpanel iOS library . For assistance integrating Mixpanel into Swift projects without CocoaPods, please follow the instructions to build the Mixpanel iOS library from source . Please note the below instructions for integration will only work for Swift apps targeting iOS 8.0 or higher — if you are targeting any versions below iOS 8.0 please jump to the final section of this guide. Integration with CocoaPods With any version of CocoaPods greater than 0.36, integration of Objective-C libraries within...

How HubSpot grows a product into something you can't live without

Did they even open my email? Did they check out my link? Marketers have had tools to answer these questions for a long time. Sidekick , a project from HubSpot, brings this kind of email tracking to one-on-one email communication. For HubSpot, it's a little outside their wheelhouse. Over the last nine years they’ve developed some of the largest and most popular software for marketers. Sidekick is part of a decision to broaden their scope and serve non-marketers. And it's built on the freemium model. "The whole idea from the beginning was to go for really big scale that millions of people could use for free," says Dan Wolchonok. "And then to have a seamless path for those who want to pay for power features." Dan is a senior product manager at HubSpot. It's his job to get those millions of users. Which is less about finding them and more about keeping them around. Being active ...

Mobile A/B Testing: Walkthrough & Best Practices

Using Mobile A/B testing, you can test changes to your app without writing code. You can measure the impact on any conversion, like signups or purchases. In this Community Tip, we'll provide a walkthrough and best practices for running A/B tests in your iOS or Android app. Setup To get started with Mobile A/B testing, all you need is the Mixpanel SDK installed and initialized in your app. If you haven’t done this step yet, you can jump over to our iOS Integration Docs or Android Integration Docs for instructions on installing Mixpanel. To work with complex A/B tests which go beyond modifying UI elements, such as changing view flows, modifying defined constants, and more, you will need to implement developer tweaks ( iOS / Android ) in your app. Tweaks allow you to adjust actual variables in your code from the comfort of your Mixpanel dashboard. Once you add a Tweak to your...

Geolocation Error on 7/9/2015

Incident Summary: No geolocation was being performed on events and people requests between 5:00PM PST 7/8/2015 to 1:30AM PST 7/9/2015. This affected all customers. Timeline: On 7/8/2015 at approximately 5:00 PM PST, a change was deployed to consumers that migrated our geolocation system from a Python module to a C replacement as part of our systems optimization plan. After this point, all geolocation requests made to the Maxmind DB began failing. Around 7/9/2015 1:00AM PST, Mixpanel began reverting the change and by 1:30AM, all consumers were reverted back to the Python Maxmind DB reader, which resolved the issue. Root Cause: The migration from a Python module to a C replacement proved not to be a direct drop-in replacement and generated errors (TypeError) when fed a value other than a string. We typically send IPs in the format we receive them, which can sometimes be a long...

A/B testing comes to Android

So you've got an idea. "We have all these awesome features most users just haven’t tried yet. I bet more people would use them if they couldn't skip the tutorial. " "I know more people would create an account if our button just said 'Get Started'." "Our game's too easy. People want a challenge. If it were a bit faster, it would keep users coming back." Great, but a good idea alone isn’t gonna cut it. Especially when opinions differ. What you really need is cold, hard data. You need to put that hypothesis to the test and see how it fares with real users in the real world. That's where A/B testing comes in. Previously, you've been able to use Mixpanel to experiment and improve your iOS app. And we've seen how useful it has been to our customers. Today, we're expanding Mixpanel A/B Testing to Android. All the capabilities that enable you to experiment and improve your iOS a...

Community Tip: Benefits & Best Practices for Cross-platform Apps

In this Community Tip, we highlight the benefits and best practices for accommodating all of your varied products, environments, and platforms under a single Mixpanel project. Using this guide, your team can decide how to best track your cross-platform app data within Mixpanel. If you're one of the many users working with cross-platform apps, you may have wondered whether it's best to combine everything into one Mixpanel project or split everything up and analyze it separately. We've found that creating separate Development and Production projects to avoid cluttering your Production data is a great best practice, but the question of what to do with cross-platform Production apps is a matter of preference. The good news: Mixpanel is flexible enough to handle cross-platform scenarios in any configuration you'd like to implement. The choice is yours, and each approach comes with its...

Introducing Codeless Mobile Analytics

Tracking how users are interacting with your app just got easier. Now you can get Mixpanel's advanced mobile analytics without writing a line of code. Let's face it, everyone's dealing with limited developer resources. If you've got to add a tracking request to the growing queue of dev needs, it'll probably take some time. With Codeless Mobile Analytics , you can focus your development time on what matters - making your app better. With a simple point and click setup, Codeless makes tracking events a breeze. Want to know if people are using a new feature? Skipping that tutorial? Changing a setting? After you've installed the Mixpanel SDK you can just fire up Codeless Mobile Analytics (it's that icon on the bottom of your sidebar). Select your platform - iOS or Android. Then connect to your app using either a phone or an emulator. That's it. From right there in your bro...

How Cozi got a 38% increase in signup completion

Tara Pugh, product owner of Cozi, stopped by our June Office Hours to explain the process for improving their UX through many small, data-driven steps. Cozi helps bring order to the chaos of modern family life with an app that gets the entire family on the same page with shared calendars, to-do lists, and shopping lists. Digging into their conversion funnel data with Mixpanel, they identified opportunities to improve user experience by streamlining the account creation flow. Testing hypothesis after hypothesis, Tara and the team at Cozi were able to incorporate bits of learning into the flow: lighter background, different calls to action, pre-populating name and email forms. No single change resulted in a huge increase in conversions, but all together, the improvements raised the signup completion rate from 55% to 76%—a 38% increase. Check out Tara's talk for all th...