Andrew Chen Archives

Subscribe · Featured · Recent · The Cold Start Problem 📘
Dear readers, I have moved to Substack and I will be writing here from now on:
👉 andrewchen.substack.com
In the meantime, I will leave andrewchen.com up for posterity. Enjoy!

Whenever ad networks talk about their “targeting” remember the Netflix prize

A quick rant:

Every time you talk to an ad network or leadgen network or whatever, if you ask what their differentiation is they will say “targeting.” That’s probably wrong, and let me tell you why, based on the recent announcement of the Netflix prize winners:

Netflix was able to wring three years of research to nudge its recommendation algorithm up 10.5 percent, at a cost of $1 million in prize money — a stunning feat on its own.

This means if you combine dozens of the best machine learning people in the world, some of the cleanest datasets, you get a measly 10.5% increase. Compare this to starting a new ad network where you end up with noisy datasets, lots of crappy traffic, and a small team looking at the problem – that’s not an easy path to disruptive change. In general, 10% is not a big enough number to counteract the other economic drivers in the ad market, which revolves around better deal terms, a larger selection of advertisers, better ad inventory, etc.

I would guess that you need a number closer to 50% lift or higher in order for an upstart to dramatically change the ad landscape and neutralize the weapons of the mass of ad network players.

I think disruptive change will come not from algorithms, but rather two other areas:

  • Better ad inventory: New websites and mechanics emerge all the time, and who knows what happens when you put ads on them? It was clear, until they tried it, that with the right ads search can be >30% clickthrough rates or more, which is unheard of.
  • Better data: The other big opportunity is in using specialized data to drive your algorithms – rather than basing everything off of domains, cookies, and ad impressions like everyone else, there may be ways to extend the targeting to unique datasets that no one has access to. This is what’s happening in the world of retargeting.

The Netflix prize also included people adding in additional data, and that’s factored into the 10.5% improvement. Anyway, the point is, increasing performance on stuff like this is very hard, so when an ad network tells you about their targeting, you should push them instead on their revenue split ;-)

PS. Get new updates/analysis on tech and startups

I write a high-quality, weekly newsletter covering what's happening in Silicon Valley, focused on startups, marketing, and mobile.

Views expressed in “content” (including posts, podcasts, videos) linked on this website or posted in social media and other platforms (collectively, “content distribution outlets”) are my own and are not the views of AH Capital Management, L.L.C. (“a16z”) or its respective affiliates. AH Capital Management is an investment adviser registered with the Securities and Exchange Commission. Registration as an investment adviser does not imply any special skill or training. The posts are not directed to any investors or potential investors, and do not constitute an offer to sell -- or a solicitation of an offer to buy -- any securities, and may not be used or relied upon in evaluating the merits of any investment.

The content should not be construed as or relied upon in any manner as investment, legal, tax, or other advice. You should consult your own advisers as to legal, business, tax, and other related matters concerning any investment. Any projections, estimates, forecasts, targets, prospects and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Any charts provided here are for informational purposes only, and should not be relied upon when making any investment decision. Certain information contained in here has been obtained from third-party sources. While taken from sources believed to be reliable, I have not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation. The content speaks only as of the date indicated.

Under no circumstances should any posts or other information provided on this website -- or on associated content distribution outlets -- be construed as an offer soliciting the purchase or sale of any security or interest in any pooled investment vehicle sponsored, discussed, or mentioned by a16z personnel. Nor should it be construed as an offer to provide investment advisory services; an offer to invest in an a16z-managed pooled investment vehicle will be made separately and only by means of the confidential offering documents of the specific pooled investment vehicles -- which should be read in their entirety, and only to those who, among other requirements, meet certain qualifications under federal securities laws. Such investors, defined as accredited investors and qualified purchasers, are generally deemed capable of evaluating the merits and risks of prospective investments and financial matters. There can be no assurances that a16z’s investment objectives will be achieved or investment strategies will be successful. Any investment in a vehicle managed by a16z involves a high degree of risk including the risk that the entire amount invested is lost. Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by a16z is available at https://a16z.com/investments/. Excluded from this list are investments for which the issuer has not provided permission for a16z to disclose publicly as well as unannounced investments in publicly traded digital assets. Past results of Andreessen Horowitz’s investments, pooled investment vehicles, or investment strategies are not necessarily indicative of future results. Please see https://a16z.com/disclosures for additional important information.