Mixpanel Trends: What’s really happening with iOS in China?

alt text After months of anticipatory rumors and speculation, the iPhone finally launched on China Mobile this past January, and reception has been mixed. When Tim Cook announced at the end of February that both the iPhone 5s and the iPhone 5c had outsold all earlier iPhone models, we thought this deserved some interrogation, especially when it came to China. China is a huge opportunity for Apple – provided everyone plays their cards right. We dug into iOS data coming out of China to get to the bottom of some key observations.

alt text First and foremost, location is everything: about one third of the data comes from people on the country’s Eastern coast, and it’s clear that activity increases with proximity to major metropolitan areas. There’s also an extremely long tail of Chinese cities where iOS devices are used -- 40% of our data is generated by people in 783 cities. The concentration of data in major cities is likely most correlated to income, but may also be linked to Apple and China Mobile’s strategy for 4G: the 4G network is slowly being rolled out across the country, starting with urban areas. It’s already accessible to people living in Shanghai, Beijing, Guangzhou and Chongqing, who may have more incentive to move over to iOS. Chongqing is notably absent from the list of top iOS-generative cities. There are a few reasons why this may be the case: this is probably a geo-locational issue with our IP lookup database. Because Chongqing is so close to other major metropolitan areas, users may be identified as belonging to neighboring cities and regions.

Beijing, Shanghai, and Guangzhou are frontrunners in iOS activity; 4G accessibility may play into this, but it’s more likely due to the fact that these cities are the commercial, financial, and manufacturing centers of mainland China. The people living in and around these cities are wealthier than most and more likely to purchase high-end technology (for both utilitarian and status purposes) than their counterparts in smaller cities, towns, and rural areas.

alt text On a regional level, Guangdong sticks out as one of the most prominent and active areas for iOS users. Guangdong contains both Guangzhou and Shenzhen; the region is one of the most prosperous in China, with a robust manufacturing industry. The area is the closest region to Hong Kong, a city with a ton of money, high-tech, and many foreigners.Shenzhen is also home to Foxconn, an electronics manufacturing company that makes many of Apple’s mobile devices. While Foxconn employs somewhere around 500,000 people, many of whom live on-site at the factory, it’s hard to say whether this is the same population that’s generating iOS data. But it seems safe to assume that Foxconn’s presence can only serve to raise awareness of Apple and its latest offerings within Shenzhen as a whole.

Notably minor on the list of iOS-generative regions is Tianjin, which has the greatest GDP per capita in China but only sends about 2.5% of China’s iOS data. This may be more reflective of its modest population than purchasing power or interest in iOS devices; Tianjin has only about 13 million residents, which is close to 1/8 the population of Guangdong and less than half the population of Shanghai or Beijing.

That said, population and data usage don’t always correlate. Shanghai and Beijing are almost equal in population and have nearly parallel PPP – logically, their iOS usage is also neck-and-neck. About three times as many people live in Guangdong than do in Beijing or Shanghai, and the region’s iOS usage is comparable. This may be due to the fact that Guangdong is a less wealthy city, with GDP per person about 60% of what it is in Beijing or Shanghai (to say nothing of Tianjin).

alt text When it comes to the iOS devices themselves, people in China primarily use older iPhone models, with the iPhone 5 taking up significant real estate at 19%. All of the iPhones represented above are CDMA/GSM models, and are specific to a small number of networks within China; China-CDMA phones are usually not functional outside of their origin country. Despite the China Mobile release and marketing efforts for the newest iPhone models (more on that momentarily), preferences clearly lean toward older models such as the iPhone 4S (2011) and iPhone 5 (2012). There’s also a long tail of devices running iOS that don’t fall into the above categories; 22% of iOS data is generated by 25 different types of devices, none of which are represented in the chart above.

alt text When the iPhone 5s and 5c were released in December 2013, there was a jump in China’s iOS usage, but the devices pushing that increase weren’t the usual suspects. Even when Apple had a huge marketing campaign for the 5c and 5s, the greatest growth actually came from the older iPhone 5 -- which of course became cheaper as soon as the newer models came on the market. A similar trend was seen around the January China Mobile release: volume grew, but the devices driving the data spike still weren’t the 5s or the 5c. People still were drawn to the newly-cheapened iPhone 5, which drove most of the growth seen around that time. One notable area of growth was in iPad usage: this does suggest that when Apple calls attention to itself, people pay attention – interest in (and usage of) Apple products grows, even if that doesn’t translate directly into sales.

So what does this mean for the future of iOS in China? What’s clear is that extra awareness in the marketplace begets returns: this was seen during both the iPhone 5s/5c release, and during China Mobile’s rollout. Though Chinese consumers didn’t show an immediate interest in Apple’s latest iPhone models, interest in Apple devices overall did seem to grow with each new release. It will be fascinating to watch iOS activity in China as 2014 continues, and to see whether iOS usage increases as 4G becomes more widely available. We predict that the release of the iPhone 6 -- rumored to be shortly on its way -- will catalyze sales of the models it’s intended to replace, further growing Apple’s Chinese customer base.

Why most A/B tests give you bullshit results

By now, anyone in product or marketing knows what A/B testing is. What we don’t know, or at least won’t admit, is that too many A/B tests yield nothing. Too often they measure meaningless variants, produce inconclusive results, and nothing comes from them. Of course, some A/B tests yield real, meaningful, actionable results. Those are the ones you hear about. We've all seen the articles. Company X increases conversions 38% with this simple trick. Hell, I've written some of them. But those success stories have hidden the grey underbelly of testing and experimentation. AppSumo revealed that only 1 out of 8 tests produce results . Kaiser Fung estimates that 80 to 90 percent of the A/B tests he’s run yield statistically insignificant results . Yet many new testers walk into A/B testing thinking it'll be quick and easy to get results. After running a handful of simple tests, ...

Announcing Mobile Dashboards for iPhone

We've launched our Mixpanel mobile app so you can monitor your key metrics in one place, everywhere you go. With our iOS app, you can stay up to date on your company's trends, conversion rates, and retention all in one place. Available free in the App Store. Everywhere we look , the data shows that mobile is taking over . So we're putting the world's most powerful analytics into your pocket with Mixpanel's Mobile Dashboard app. Download our app for free , and log in with your Mixpanel account. Mixpanel's mobile app allows you to create a dashboard of your most important metrics, so you can easily check-in on your business anywhere you go. By easily adding key metrics to your dashboard, your data is available instantly for when you need it on the fly. When you need important stats for your team's daily standup meeting, during drinks with an investor, or wherever ...

Re-engage your users based on what they do, not just who they are

Mixpanel People is a powerful way to connect with your users and drive engagement. Now you can send notifications to your users based on all of the events you already send to Mixpanel. Available now for Push, Email, SMS, and Webhook notifications. Send targeted notifications to your users With Mixpanel’s People platform, you can target users based on the actions they take in your application. Here are some examples of how you can use this: Send a push if a user exercised 5 times in their first 30 days Send an email if a user has only logged in 1 time in the last 7 days Send a SMS if a user hasn’t chatted with another user yet Easy to Use It is extremely easy to use this functionality: you can retroactively use all the events that you send to Mixpanel. Start by going to the Notifications tab , then selecting your notification type and notification message. Now i...

Downtime: Ingestion API post-mortem

On January 20th, 4:05pm PST, Mixpanel’s ingestion API was intermittently unavailable until approximately 8:55pm PST. This incident was caused by two main factors: insufficient capacity in our backend queuing system and a bug in our Android SDK that produced a thundering herd . At 2:30pm, we rerouted traffic away from one of our datacenters due to planned network maintenance, placing double the load on our Washington, DC datacenter. At 4:00pm, a 10X spike in ingestion traffic occurred. Combined with the additional load from the maintenance, we started queuing data. We queued enough data to cause our queue servers to become disk IO bound. This lowered the enqueue throughput, causing some API requests to time out. Due to a bug, our Android client library responded to these timeouts by retrying every second instead of backing off. This triggered a thundering herd. The influx of retr...

How Breather built a network of spaces and succeeded where so many startups fail

Supplying peace and quiet while solving the on-demand economy. “Acquire users.” That's the common wisdom for consumer-facing startups. The more users, the better. Not unexpectedly, many of these companies focus all of their energy on driving demand, and often it makes sense. Just look at the tech giants that have built their businesses on a foundation of millions and millions of users, often acquiring masses before they even knew what their businesses really was. And if you're Facebook or LinkedIn, it makes sense. These companies aren't worried about supply. What are they going to do, run out of LinkedIn? (Ignore the dirty looks Ops folks are sending my way.) In fact, because of demand-side economies of scale and the network effect , LinkedIn's product actually gets better with more users. But there's a new breed of startups playing a different – and often lucrative – game. T...

A guide towards App Store Optimization

Let’s face it, getting your application discovered in the App Store or Google Play is a huge challenge but if you find a way to crack the algorithm, the payoff is huge! There are more than 1.5 million applications on the Apple App Store that have been downloaded more than 100 billion times. With the average number of downloads an app gets being around 62,000, App Store Optimization ends up being an important technique that can push you way past the average. What is App Store Optimization? App Store Optimization is a technique app makers use to improve the visibility of a mobile app in an app store. It’s similar to search engine optimization (SEO) for websites but optimizes for discoverability for a mobile app. The basic techniques of ASO encompass doing good keyword research, improving your app description, utilizing high quality screenshots, doing competitive research, and...

Why QuizUp turned the fastest-growing game in history into a social platform

Two years ago, QuizUp became the fastest growing game in the history of the App Store. But to stay relevant and to maintain its users, they knew it had to become more. With data-driven development, QuizUp has grown into an app that brings its users back time and time again, transforming from a trivia game into a social platform. Every week, somewhere in the ballpark of 15 thousand apps are submitted to the iOS App Store. About a quarter of those are games. A quick glance at the Featured screen shows a "Best New Games" list with a couple dozen games released in the past week or so. They're from names as big as Lego, and as small as Futureplay, a five-person shop out of Helsinki releasing their first game. It's a highly competitive landscape. And each can only dream of the success that Plain Vanilla Games had in the first week with QuizUp: over a million downloads. Five months after ...

Demystifying Predictive Analytics for Mobile and Web Apps

Predictive analytics is unfathomable to many of us. Terms like artificial intelligence, neural networks and deep learning just deepen the mystery. Yet predictive tools are already ubiquitous. Not in self-driving cars, or robots that look like humans. Rather, on your phone. Spotify looks at your past listening habits, and that of people who like similar music, and recommends new tracks to listen to. Youtube does the same with videos. Your email service predicts whether a mail message sent to you is spam by analyzing past emails sent to you and others. Siri and Google Now use predictive technology to understand your voice, and offer answers to your questions. Predictive analytics is the practice of using advanced statistics and historical data to predict future outcomes. For the most part, the use of predictive analytics in business is still shrouded in mystery and the domain of ...

Introducing Predict - see who will convert, before they do.

Predict lets you know which of your users are going to convert, or not, before they do. Just select an action and, based on users' previous behavior, you'll get a grade on how likely each user is to complete it. Then target users by their grade. Like reaching out to those less likely to convert and giving them a nudge in the right direction. And starting today, Mixpanel Predict is live for all customers using People Analytics . Use Predict to impact leading metrics Use Mixpanel's predictive analytics to learn whether your app’s users will convert. You can define what converting means for your company as any action or event in Mixpanel – even the number of times it was done. Pick an important action that leads to success for your app (commonly called a leading metric ). So if you have a photo sharing app, you probably want to know who is going to share a picture. Or who wo...