Previewing a full chapter of The Cold Start Problem — my upcoming book dropping in December

Hi readers,

In just a few weeks, I will be dropping new book, The Cold Start Problem!! If you haven’t gotten your copy — if you are in the US, here are the relevant links:

  • Amazon · Bookshop (support your local bookstore!)
  • Or if you are international, go to the coldstart.com website to find all the pages for Europe, Asia, and more.

Thanks to all of you for the tens of thousands of emails, tweets, and preorders in support of my work. If you’re reading about this book for the first time, you might be asking yourself — what is the Cold Start Problem about?

Let me set it up in a few bullets:

  • Many of tech industry’s most valuable products — Slack, Zoom, Instagram, Twitch, YouTube, and others — are at their core products that connect people to each other. People are connected for commerce, communication, collaboration, and more
  • I’ve come to believe this is the secret of much of Silicon Valley’s success. I saw it first-hand at Uber, which scaled to billions in revenue, and also within startups at Andreessen Horowitz, which has funded companies from Github, Coinbase, and Figma to Clubhouse and Airbnb
  • These types of products benefit from “network effects” — that they become more useful as more users engage. This is why they grow to be so powerful, and valuable. But also why they are impossible to get off the ground, because people won’t use products where their friends/colleagues aren’t already engaged
  • The Cold Start Problem is a book a collection of case studies, from Tinder, Twitch, credit cards, Dropbox, and others — about the lifecycle of these networked products. How to get them started, how to scale them, and what it’s like to compete
  • These frameworks are targeted at teams building new products, first and foremost. But it’s also for people who work in the business of commerce, travel, publishing, and many other industries that are getting reinvented by tech.

I hope that’s a good teaser :)

In previous posts about the book, I’ve hinted at its contents. But over the next few weeks, I’ll be more substance and previews of the content.

Today, for the first time, I’m going to provide a preview of the opening chapter of The Cold Start Problem — which is partially about my experience at Uber and Andreessen Horowitz, but also about why I began writing in the first place.

I hope you enjoy it!

Thanks,
Andrew
writing from Venice, CA

 

The Cold Start Problem

Introduction
It was 2015 in December, and on a Friday evening, the office was buzzing. Amid the vast, monochromatic corridors of Uber’s San Francisco headquarters at 1455 Market Street – two football fields worth of gleaming LED lights, light woods, concrete, and steel – the office was still mostly occupied at 8PM. Some sat at their desks quietly typing email while others debated energetically with colleagues over videoconference. Others were drawing on whiteboards, hosting impromptu jam sessions to tackle the tricky operational problems facing who-knows-what. And a few pairs of employees were walking up and down the main flow in 1-on-1 meetings, some in intense discussion and others just catching up.

Everywhere you looked, there were reminders of the global scale of Uber’s business as well as the international heritage of the team driving it. Colorful flags from every country hung from the ceiling. Conference room screens hosted videoconferences with colleagues from faraway offices in Jakarta, San Paulo, and Dubai – sometimes simultaneously! Flat screen TVs were scattered throughout the floor showing metrics, broken down by mega-region, country, and city, so that teams could monitor progress. The global culture seeped all into the naming conventions for conference rooms: Near the entrance, the names started with Abu Dhabi and Amsterdam, and at the far other end of the floor, ended with Vienna, Washington, and Zurich.

At first glance Uber might just look like a simple app — after all, the premise was always to hit a button and get a ride. But underneath its deceptively basic user interface was a complex, global operation required to sustain the business. The app sat on a vast worldwide network of smaller networks, each one representing cities and countries. Each of these networks had to be started, scaled, and defended against competitors, at all hours of the day.

It was in my role at Uber that I really came to viscerally understand networks, supply and demand, network effects, and their immense power to shape the industry. As you might imagine, the Uber experience had its ups and downs – it was a rocketship and a rollercoaster, rolled into one. I’ve come to call it a “rocketcoaster” experience, which is an appropriate description for a company that had went from an idea to a tiny startup to a massive global company with over 20,000 of employees in less than a decade.

The worldwide operations of the company was complex and intense, and much of the command and control radiated from the center of the of Uber’s San Francisco headquarters. In the middle of the main floor, built from gleaming surfaces of glass and metal, stood the War Room.

To many, it was a big mystery – the War Room didn’t share the normal naming convention of city names where Uber operated. It couldn’t be booked for meetings as the others could, and was sometimes attended to by security guards. That’s because it wasn’t a normal meeting room. Many companies (inside and outside of tech) have the notion of “war rooms” but they are typically conference rooms converted temporarily to dedicated use by a product team that works intensely to tackle an emergency project, and after the situation is resolved, is quickly converted back into normal use. For Uber, perhaps appropriate to its unique needs, this War Room was not temporary at all – it was built to operate 24 hours, around the clock. It was built as a huge, permanent room with dark wood walls, multiple flatscreen TVs, a large conference table that could fit a dozen people, with additional sofa seating. Red digital clocks gave the current times in Singapore, Dubai, London, New York, and San Francisco. Given the company’s global footprint, there was almost always some kind of emergency situation somewhere in the world that needed attention, and this was often the room where it was dealt with.

That December, the emergency was in San Francisco, the company’s hometown.

Scheduled to start at 7pm and run into the night, the urgent meeting was booked on everyone’s calendar as “NACS” – which stood for the North American Championship Series, an oblique reference to its agenda focusing on operations, product roadmap, and competitive strategy in the top markets in the US and Canada. This meeting was a key mechanism for the CEO of Uber, Travis Kalanick – called “TK” within the company – to review the entire business, city by city.

A small group of about a dozen executives and leaders attended the meeting, including myself and the heads of finance, product, and critically, the RGMs — short for “Regional General Managers.” The RGMs ran the largest teams at Uber, constituting the on-the-ground Operations city teams that engaged with drivers and riders. The RGMs were thought of as the CEOs of their markets, holding responsibility for revenues and losses, the efforts of thousands of Ops folks, and were always closest to the trickiest problems in the business. I was there to represent the Driver Growth Team — a critical team responsible for recruiting the scarcest asset in the entire business, Uber drivers. It was a big effort for Uber — we spent hundreds of millions just on driver referrals programs, and nearly a billion in paid marketing. Adding more drivers to the Uber network was one of the most important levers we had to grow the business.

The weekly NACS meeting opened with a familiar slide: A grid of cities and their key metrics — tracking the top two dozen markets. Each row represented a different city, with columns for revenue, total trips, and their week-over-week change. It also included operational ratios like the percentage of trips that hit “surge pricing,” where riders had to pay extra because there weren’t enough drivers. Too much surge, and riders would switch to competitors. Uber’s largest markets, New York, Los Angeles, San Francisco were always near the top as the list, representing billions of annual gross revenue each, with smaller cities like San Diego and Phoenix near the bottom.

TK sat closest to screen, dressed casually in a gray t-shirt, jeans, and red sneakers. At the sight of the numbers, he sprung up from his chair and walked up close to the screen. He squinted, staring intensely at the numbers. “Okay, okay…” he said, pausing. “So why did surge increase in San Francisco so much? And why is it up even more in LA?” He began to pace up and down the side of the War Room, the intensity of the questions increasing. “Have we seen referral signups dip in the last week? How’s the conversion rate in the funnel going? Were there a big events this week? Concerts?” Folks in the room began to chime in, answering questions and raising their own.

A network of networks
It was my first year at the company, and although many companies have weekly reviews, Uber’s were different. First, in the discussion about each city, the level of detail surprised me. For San Francisco, the group began to discuss the surge percentages in the city’s seven-by-seven versus East Bay, versus the Peninsula. This was a senior group of executives, but the granularity and level of detail was incredible. But this was a requirement to run a complex, hyperlocal network like Uber where supply and demand went down to popular neighborhoods and frequent “lanes” — like Marina and the Financial District — which tended to be poorly served by other transportation options.

In the weekly dashboard, each row represented a city — yes — but more importantly each city was an individual network in Uber’s global network of networks that needed to be nurtured, protected, and grown. It was deeply and uniquely ingrained in Uber’s DNA to talk about metrics at the hyperlocal network level. In my several years there, it was unusual to ever hear about an aggregate number — like total trips or total active riders — except as a big vanity milestone at a company all-hands. Those aggregate metrics were regarded as mostly meaningless. Instead, the discussion was always centered on the dynamics of each individual network, which could be nudged up or down independently of each other, with increased marketing budget, incentive spend for either drivers or riders, product improvements, or on-the-ground operational efforts.

The NACS meetings were used to evaluate the health of each of the networks and the global network as a whole — a central means of accounting for the 20 or so cities that represented the majority of revenue to the company. Furthermore, it was important to go even further in granularity and break the network into the two sides, both the rider side (demand) or the driver side (supply), to make sure each side was healthy but also that they were in balance with each other. Too much surge, and riders stop taking trips. Too little surge, and drivers start to go offline and head home after a long night.

The slides continued. Several of us on the NACS team, including myself, had been working on a hypothesis over the past few days. Ops teams had reported seeing large increases in driver referrals by our primary US competitor, Lyft, over the past few weeks, which was causing drivers to switch over in droves. Driver referrals typically structured as a give/get incentive — give $250 and get $250 when your friend signs up to drive. In conjunction with a dramatic rise in demand during the holiday season, it was causing a big undersupply of drivers in the key competitive markets on the West Coast, primarily SF, LA, and San Diego. For riders, this resulted in a terrible experience — if you request a ride, it would take far longer than usual, sometimes twenty minutes, which meant more riders were canceling their requests. They might even decide to check our competitor’s pricing and service level, and book there instead. These cancels were frustrating for Uber’s drivers, who might have already driven for a few minutes. Piss them off too many times, and it might cause a chain reaction as they’d have even more incentive to stop for the night, switch off to a competitor’s network.

TK grew more intense and agitated as the hypothesis was presented. “This is not good, guys. Not good.” He exhaled deeply. What was the right solution? With the years of experience from operating these networks, it was likely that one solution would be in quickly rebalance the sides of the market. The right solution would need to start on the supply side, to grow our base of drivers quickly and lower ETAs and the cancel rate, and that meant a driver incentive. “What if… we did a $750 / $750 referral bonus here in SF, LA, and San Diego?”

This would be a big move, a far bigger number than had ever been thrown out. But SF, LA, and San Diego needed the help. These were some of the most competitive markets that would need to be quickly rebalanced with more supply. TK looked around the room, pausing, and then answered his own question. “Yeah. That would get their attention. That’ll wake them up!” he said, smiling and nodding.

Others were not so quick to jump to incentives as the solution. The past year had been good for Uber in the US, turning it into a cashflow positive area as the competition in the new China business simultaneously generated both incredible trips growth as well as severe losses. Uber was in a vicious fight with Didi — its Chinese rideshare competitor — burning on the order of a billion dollars a year primarily because of incentive spend. We started to bat around other ideas, from improving how to display ETA estimates as well as ways to discourage riders from canceling. There were other ways to rebalance the various networks without using incentives, which is a powerful tool but not the only one. The conversation went in circles, and TK grew visibly frustrated.

TK paced around the room again. “No, no! Look, guys. Our network is collapsing. We need to stop the bleeding… now!“ He chopped his hand into the other. “Let’s do the other stuff and get it on the roadmap, but let’s get this email out over the weekend. Who can help me put it together?” This decisiveness was informed by years of fierce in-the-trenches competition — companies like Flywheel, Sidecar, Hailo, and many others that were vanquished — driven by lightning fast responses in situations like this. The Uber team monitored and responded to the health of their local city networks with speed and precision. And with that, the next step was clear.

The RGMs agreed to own it, and I would work with my team — which was accountable the product/engineering side of driver referrals — to make changes to the structure and amounts. We committed to ship the changes before Monday. We took note of a number of other follow-ups due from the meeting, and we all decided to reconvene the group again next week. It was Friday and almost 10pm, and many of us had been working since early morning to prep for this meeting. I walked home, just a few short blocks away in the Hayes Valley neighborhood of San Francisco, and started my “Netflix and email” routine to close out the day.

This was my first experience with the North American Championship Series, and it turned into a weekly briefing, usually Friday mid-morning. But sometimes it got scheduled at Tuesdays at 9pm, or Sundays at 2pm, when that was the only way to get everyone together. Although NACS was just one part of my role at Uber, it quickly became one of the most educational in how to think about starting and scaling network effects. For a multiyear span, I was lucky to embedded in this critical team that operated Uber’s biggest markets. Each week was different. At the NACS meetings, we shifted our attention nimbly each session from network rebalancing on the West Coast, to prioritizing product features to increase revenues, to launching new regions, and everything in between.

Uber was already hitting its stride when I joined but I had a front row seat to the team that took grew the business to 100 million active riders in 800+ markets worldwide, and $50B in gross revenue. It was an incredible experience, and am proud of the work that we did there. It didn’t happen automatically — there were tens of thousands of people working hard to deal with network dynamics in hundreds of markets around the world, and we learned all the hard lessons from competing with fearsome local competitors who have their own strong network effects too. I’m lucky to have been at Uber during a hypergrowth period, where I joined just at the base of the hockey stick curve when it was well under a billion trips, but saw it 10x over the next few years:

My time at Uber was an unforgettable experience. I got to see a startup scale to tens of thousands of employees, millions of customers, and billions in revenue. I saw new products start at zero and then rapidly scale up to dominate the market. It was a deeply educational journey, one that created many lifelong friendships — including people I still talk to every week. But by 2018, it was time for me to move on. The company had a tumultuous few years, a complete changing of the guard, and a new set of priorities that were less entrepreneurial than in the past. I wanted the opposite of that, and for my next chapter, I decided to go back to my roots: Working with entrepreneurs to build the next new thing, but this time, as a venture capitalist.

Foundational questions
In 2018, I began a new career after Uber, as a startup investor at Andreessen Horowitz. Started a decade earlier by entrepreneurs Ben Horowitz and Marc Andreessen, the firm made a splash when it launched, quickly making a series of notable investments in startups including Airbnb, Coinbase, Facebook, Github, Okta, Reddit, Stripe, Pinterest, Instagram, and others. The firm was built around a philosophy of hands-on operating expertise — this fit me perfectly as I would parlay my lessons from Uber into picking and building the next great technology startups.

Rejoining the startup world, this time as an investor, let me tap into a network of relationships and knowledge built over a dozen years in the San Francisco Bay Area. Pre-dating Uber, I had been writing and publishing nearly a thousands essays on topics like user growth, metrics, viral marketing — along the way, popularizing tech industry jargon like “growth hacking” and “viral loops.” My blog was would be read by hundreds of thousands, and due to this as well as the natural serendipity of the startup ecosystem, I came to become acquainted with a broad community of entrepreneurs and builders. I would come to serve as an advisor and angel investor to dozens of startups, including Dropbox, Tinder, Front, AngelList, and many others. All of this, combined with my expertise from Uber, would be the foundation to launch my career in venture capital.

Everything was different in the new role. Rather than commuting to Uber’s offices in the chaotic center of San Francisco, instead I headed to the firm’s idyllic offices near Stanford University. The a16z offices combine culture and invention — its hallways lined with artwork from Rauschenberg, Lichtenstein, and contemporary artists, while its conference rooms are named after great inventors and entrepreneurs like Steve Jobs, Grace Hopper, Ada Lovelace, and William Hewlett. The work was very different from Uber’s day to day as well — rather than going very deep into one sector, like rideshare, instead my purview was extremely broad.

Every day I was meeting with entrepreneurs to talk about their new ideas. In a given year, the firm might see thousands of startup ideas, many of which are new kinds of social networks, collaboration tools, marketplaces, and other new products — relevant to the examples to this book. Conversations with startups begin with a “first pitch” meeting, where the entrepreneurs introduce themselves, show the product, and talk through their strategy. These are pivotal meetings, because when they go well, the startup could eventually receive an investment in the millions or even hundreds of millions of dollars. It’s high stakes.

Jargon thrives in these presentations: “Network effects.” “Flywheel.” “Viral loops.” “Economies of scale.” “Chicken and egg.” “First mover advantage.” These are some of the buzzwords and jargon that get thrown around in pitch meetings. And they are often accompanied with diagrams full of arrows and charts going up and to the right. The term “network effect” has almost become a cliché. It’s a punchline to difficult questions, like “What if your competition comes after you?” Network effects. “Why will this keep growing as quickly as it has?” Network effects. “Why fund this instead of company X?” Network effects. Every startup claims to have it, and it’s become a standard explanation for why successful companies break out.

But with all of these discussions and pitches, I realized I was getting confused, and I wasn’t the only one. While “network effects” and its related concepts were often invoked, there was no depth to the idea. No metrics that could prove if it was really happening or not.

In my work with startups, and after a decade and a half of living in the San Francisco Bay Area, I’ve heard “the network effect” used a zillion of times in conversation. Sometimes over coffee, in meetings, or in investor discussions, but the concept was always discussed at a superficial level.

So how do you hear something thousands of times and still not quite understand it?

I argue that we don’t understand network effects well because if it were a straightforward concept to understand, we would be in strong agreement on which companies have network effects, and which ones don’t. We would know what numbers to look at to validate it was really happening. And we’d have a step-by-step understanding of how to create and build up network effects. And yet we don’t. And it bothers me to a great degree, because it is has become a critical topic in today’s technology landscape. This is the journey that brought me to writing this book.

I began to research and to write THE COLD START PROBLEM because I found my own understanding of the dynamics of networks to be unforgivably shallow for something so core to the technology industry. The network effect is something I’ve seen firsthand at Uber, and yet I lack the vocabulary and the frameworks to articulate the deep nuances.

There’s a gap between the practitioners and the rest of the business world. For practitioners who work on specific networked products, the focus is on improving the mechanics within their very particular domains. Within rideshare, the discussion revolved around riders and drivers, reducing pickup times, surge pricing, and an accumulated set of specialized vocabulary and concepts that only apply to on-demand transportation. For a workplace chat tool, it’s about channels and discovery and notifications and plug-ins. They feel unrelated, even though both product categories have deep network effects and are both ways to connect people. There should be a set of universal concepts and theories to talk about network effects, regardless of their product category.

We need to be able to answer the basics:

What are network effects, really? How do they apply to your business? How do you know if your product has them — and which other products don’t? Why are they so hard to create, and how do you create them? Can you add a network to your product after the fact? How do they impact your business metrics, at the tactical level? Is Metcalfe’s Law actually right, or should you apply something else to your strategy? Will your network fail and will it succeed? Does your competitor have network effects, and if so, what is the best way to compete with them?

Startup advice says, all that matters is to build a great product — after all, that’s what Apple does. But why has it also been so critical to launch products in the right way? To get your product in the hands of influencers, or high school students, or aspirational technology companies — if B2B — if all that matters is the product? What’s the right way to launch, and what’s the sequence of ways to expand?

How do you build network effects in your product? How do you know when network effects are kicking in, and if they are strong enough to create defensibility? How do you pick the right metrics to optimize to achieve viral growth, re-engagement, defensibility, and other desired effects? What product features do you build to amplify network effects?

When fraudsters, spammers, and trolls inevitably show up, what’s the proper recourse? What have we seen other networks do in the past to combat the negative effects of a large, thriving network? And more generally, how do you keep scaling a network that’s already working, especially in the face of saturation, competition, and other negative dynamics?

What happens when two networked products compete — what makes one player win over another? Why did we see big networks often succumb to smaller ones? How do you launch new networks across new geographies and product lines, particularly in competitive markets?

These are the most fundamental questions we can ask about network effects, and when you search for the answers — whether in books or online — there are only smatterings of actionable, pragmatic insights though there was plenty of high-level strategy. The best thoughts came from operators, at startups and bigger companies, who have done been in the trenches and so that’s where I started the process of writing my book.

I began by conducting more than a hundred interviews with the founders and teams that built Dropbox, Slack, Zoom, LinkedIn, Airbnb, Tinder, Twitch, Instagram, Uber, and many others. I asked them questions to learn about the earliest days, when it was just the co-founders and a handful of other people trying to take on the world. I also researched historical examples spanning hundreds of years — going back to chain letters, credit cards, and telegraph networks, and tying their success to modern innovations in Bitcoin, livestreaming, and workplace collaboration tools. All of this exposed a rich set of qualitative and quantitative data which forms the foundation of this book.

I found that people were repeating the same ideas and concepts, and observed that they were recurring throughout multiple sectors. You could talk to someone who spent their career working on social networks, and find that they had ideas that were equally applicable to marketplaces. Similarly, my time at Uber made me understand the dynamics in a network of riders and drivers, which informs my view of products like YouTube and its two-sided network of creators and viewers. Or Zoom, with its meeting organizers and attendees. Dozens of these recurring themes echo throughout the industry, whether we’re thinking about B2B or consumer products.

The definitive guide to network effects
THE COLD START PROBLEM is the culmination of hundreds of interviews, two years of research and synthesis, and nearly two decades of experience as an investor and operator. It takes much of the knowledge and core concepts swirling inside the technology industry and frames them in the context of the beginning, middle, and end of a network’s lifecycle. This is the core framework I’ll describe via the major sections of this book, along with examples and hopefully inspiring you to take actionable can apply to your own product.

This is a critical topic. I’ve come to see network effects — how to start them, and how to scale them — as one of the key secrets of Silicon Valley. There are just a few dozen software products with a billion active users on the planet, and many of them share lineages of founders, executives, and investors who have unique expertise. This knowledge, in turn has been developed in the tech community over decades of building social networks, developer platforms, payment networks, marketplaces, workplace apps, and so on. This community of elite talent collaborates and cross-pollinates, switching from one product category into another, bringing all of this knowledge together. I have seen this first hand, and my interviews with founders and experts in writing THE COLD START PROBLEM further illustrated the interconnectedness of these concepts.

Based on the foundational theories of network effects, I’ve taken these lessons and put skin in the game, focusing my venture capital investing at a16z towards products that have networks at their core. I find myself most captivated by new startups where connecting people lay at the heart of the product, whether for communication, socializing, work, or commerce. I’m now 3 years into the industry, and have invested over $400M into over two dozen startups in marketplaces, social apps, video and audio, and more. I’ve found my learnings about network effects to apply widely across the industry — everything from Clubhouse, which seeks to build a new audio social app, or Substack, which lets writers publish and monetize premium newsletters for their readers. And even video games, food pickup, or edtech.

My goal is to write the definitive book on network effects — one that was practical enough, and specific enough, to apply to your own product. You should be able to use its core framework to figure out where your product is on the journey, and what product efforts are needed to drive it forward. I’ve tried to lay out the entire lifecycle — from the underlying mechanics of how to create network effects, how to scale them, and the best way to harness them — all from a practitioner’s point of view, diving deep far beyond the buzzwords and high-level case studies that have been written.

The first phase of the core framework, naturally, is called The Cold Start Problem, which every product faces at its inception, when there’s no users. I’m borrowing a term here for something many of us have experienced during freezing temperatures — it’s extra hard to get your car started! In the same way, there’s a Cold Start Problem when a network is first launched. If there aren’t enough users on a social network and no one to interact with, everyone will leave. If a workplace chat product doesn’t have all your colleagues on it, it won’t be adopted at the office. A marketplace without enough buyers and sellers will have products listed for months without being sold. This is the Cold Start Problem, and if it’s not overcome quickly, a new product will die.

This is all in the service of helping you, the reader, whether you are a software engineer, designer, entrepreneur, or an investor. Perhaps you partner with one of these companies I reference throughout the book, or are seeing technology reinvent your industry in the form of networks. Network effects are a powerful and critical force in the technology sector — as the entire economy is increasingly reinvented, it will become even more important to understand.

But let’s not get ahead of ourselves — first, what’s a network effect, anyway?

Published by

Andrew Chen

Andrew Chen is a general partner at Andreessen Horowitz, investing in startups within consumer and bottoms up SaaS. Previously, he led Rider Growth at Uber, focusing on acquisition, new user experience, churn, and notifications/email. For the past decade, he’s written about metrics, monetization, and growth. He is an advisor/investor for tech startups including AngelList, Barkbox, Boba Guys, Dropbox, Front, Gusto, Product Hunt, Tinder, Workato and others. He holds a B.S. in Applied Mathematics from the University of Washington

Exit mobile version