Andrew Chen Archives

Happy holidays everyone! I just wanted to make a brief return from a blogging vacation to show you a new Google search test where I’ve been randomly been assigned to the A/B test.

To summarize the main differences:

• Big blue buttons for everything
• Drill-down sidebar after a search
• Emphasis on filtering by time – so you can get the “latest”
• Search across their properties, including News, Blogs, Books, Forums, Shopping, etc.
• Features I haven’t seen (except in labs?) such as Timeline, Related Searches, Wonder wheel, etc.

Really a ton of changes!

Here are the photos: First, the homepage…

And here’s a search results page after an egosurf:

Here’s the expanded sidebar:

There are lots of changes, you can check out all the screencaps below:

UPDATE: Interesting – I’m noticing that the sidebar is switching between all text vs icons + large text, on a page-by-page basis. Plus they are changing the content around by quite a bit. Seems like they are still testing the exact nature of the sidebar.

Want more?
If you liked this post, please subscribe or follow me on Twitter. You can also find more essays here.

I had a recent quote in the NYT article on the Fitbit, and wanted to give a couple quick thoughts about using the device so far. (This isn’t a gadget blog so posts like this will be far and few between).

In general, I love the form factor and the fact I can clip it on and pretty much ignore it for the rest of the day. People that I show it to always remark on how small and cute it is, and I’ve gotten several tweets on how they’re jealous that I have on already. One funny thing is that I find myself checking it absent-mindedly the same why I check FML on my iPhone. In general, it has made me much more aware of my incredibly sedentary lifestyle, and the daily goal of 10,000 steps is a tough one to hit. I’m usually hovering around 5-6,000 steps at most, and have to actively work to get to 10,000.

The web integration is nice although I don’t find myself checking it that often. They just recently added some social features to it, and I’m sure when my friends, and family get these devices it will be fun to see how I am doing relative to them.

Anyway, it’s a basic device and does exactly what it’s supposed to do really well. I’m excited to see when it gets more gadgety and does more with the data.

For a more detailed review, check out the Engadget review or the CNet review.

What’s a minimum “test” of your product? And what are you testing?
A hypothesis-driven approach to product development dictates that you build as much as you need to test our your product, but not more and not less. But what are you “testing” your product for?

One possibility, as lean startups guru Eric Ries has stated, is to test your product for “viability.” He’s coined an important term, called Minimum Viable Product, and I’ll excerpt his excellent blog post below:

The idea of minimum viable product is useful because you can basically say: our vision is to build a product that solves this core problem for customers and we think that for the people who are early adopters for this kind of solution, they will be the most forgiving. And they will fill in their minds the features that aren’t quite there if we give them the core, tent-pole features that point the direction of where we’re trying to go.

So, the minimum viable product is that product which has just those features (and no more) that allows you to ship a product that resonates with early adopters; some of whom will pay you money or give you feedback.

He goes on to state that another example of this idea would be to set up a landing page and test for clickthrough rates and signup conversions, to see if there is any interest in the product. You could also stick a priced offer on the landing page to see how that affects peoples’ interest in registering for the site.

Viability is certainly one bar you can test for, but a related (and overlapping concept) is around testing product desirability. Let’s discuss this further.

Viable versus Desirable
In a previous post, I discussed an IDEO framework for how to think about desirability (user-focused) versus viability (business) and feasibility (engineering) – you can read that post here, called Does every startup need a Steve Jobs?

The idea here is that different companies often pursue products with different primary lenses – a business-driven company might try to assess viability upfront, thinking about metrics and revenue and market sizes. A feasibility (engineering) oriented organization might try to pick a super hard technology first (P2P! Mapreduce! Search!), then try to build a business around it. And a desirability-focused team might focus first and foremost on the target customer, their context and behavior, and build a product experience around that.

Thus, a Minimum Viable Product tends to center around the business perspective – what’s the minimum product I have to build in order to figure out whether or not I have a business? You might do that from testing signups on landing pages, try to sell products before they exist, etc. Putting up price points and collecting payment info is encouraged, because it helps assess the true viability of a product.

But what if you come from a human-centered perspective, and you want to build the Minimum Desirable Product? I think this is a subtle difference with big implications. A minimum desirable product (MDP) would focus primarily on whether or not you are providing an insanely great product experience and creating value for the end user.

Let’s define it as such:

Minimum Desirable Product is the simplest experience necessary to prove out a high-value, satisfying product experience for users

(independent of business viability)

To build an MDP, you will have to actually deliver the core of a product experience so that your customers can make a full assessment, rather than simply providing a landing page. Instead of measuring YOUR conversion rates and revenue generated, instead you might figure out the metrics of what benefits you are providing to the user. (I wrote about Benefit-Driven Metrics a while back) Similarly, you might make extensive use of qualitative research techniques such as the ones detailed by IDEO’s methodology card deck.

This also relates very much to Marc Andreessen’s definition of product/market fit, which he defines in purely market “pull” terms and not based on business ideas or viability. You could view the the Minimum Desirable Product as the simplest product that has a credible shot at providing that product/market fit.

Examples of MVP versus MDP
Let me make some quick distinctions about sites that might be Minimum Viable Products, but perhaps not Minimum Desirable Products, and vice versa.

• If you build a really viral social network that is profitable but has terrible user churn – you have built an MVP but not an MDP.
• If your profitable dating site gets lots of users to buy subscriptions at $20/month, but none of them find hot dates they were promised, you have built an MVP but not a MDP.
• If you build a magic box that spits out money whenever you hit a button, that is certainly desirable but not viable at all.
• If you create an amazing board game that your friends and family love and are addicted to, but you can’t get a game company to distribute it, you have created an MDP but not an MVP.
• If you have created a website with 20M+ uniques/month where people can tell each other what kind of sandwich they are eating, that has probably passed the desirability test but not the viability test.

(btw, I am writing this blog while drinking a soy latte at Cafe Epi in Palo Alto, but not eating a sandwich, for those who are curious)

Is desirability more important for consumer internet startups?
One of the key reasons why I began to think of this question is that it strikes me that consumer internet companies often don’t care much whether or not they have viable businesses in the short run. If you are building a large, viral, ad-support consumer internet property, you just want to go big! As soon as possible! This is particularly true for ad-supported sites where you need to break through a certain size to start talking to the brand ad agencies who can pay up on CPM. (More on that here) As a result of that, the goal becomes to hit product/market fit as soon as possible, and figure out the business model later.

Similarly, the key risk for consumer internet startups tends not to be technical risk or execution risk – it tends to be market risk. That risk may manifest itself as questions on whether or not there’s enough consumer value, or whether or not the market is big enough. These are things that may be proven purely based on desirability-oriented questions rather than getting into the business or technical side at all.

Minimum Feasible  Product?
The last though I will leave you with is, perhaps there are markets where the engineering portion is the most important – and thus the most important concept of Minimum Feasible Product.

For example, for a drug company curing cancer, the focus wouldn’t be on minimum viable product because if you have a cure for cancer, you’ll be viable. Similarly, you may not focus on desirability, because your product would clearly have pull from the market. You don’t need to do landing pages or user-centered research to figure out that curing cancer is a big deal from a business and user point of view.

Instead, the focus would be on Minimum Feasible Product – what is the smallest amount of work necessary to field a credible candidate for an “in lab” solution to the product?

For consumer internet, perhaps there are similar examples of this.

Want more?
If you liked this post, please subscribe or follow me on Twitter. You can also find more essays here.

Found this link and wanted to share it – thought it was an interesting argument. Quoted from Flurry, an iPhone analytics provider’s newsletter:

As all industry eyes look to the iPhone, the iPod Touch is quietly building a loyal base among the next generation of iPhone users, positioning Apple to corner the smartphone market not only today, but also tomorrow. In terms of Life Stage Marketing, the practice of appealing to different age-based segments, Apple is using the iPod Touch to build loyalty with pre-teens and teens, even before they have their own phones (think: McDonalds’ Happy Meal marketing strategy).

When today’s young iPod Touch users age by five years, they will already have iTunes accounts, saved personal contacts to their iPod Touch devices, purchased hundreds of apps and songs, and mastered the iPhone OS user interface. This translates into loyalty and switching costs, allowing Apple to seamlessly “graduate” young users from the iPod Touch to the iPhone.

An interesting thought, for sure.

Read more here.

David Shen, an Apple alum and now prolific angel investor, wrote me to chime in on my recent post on Steve Jobs.

UPDATE: I also heard from Kristee Rosendahl, who co-founded Apple’s Human Interface Group and worked directly on Hypercard, and posted her reply below as well.

I reposted David’s message below, with his permission, where he discusses the indirect effect that Steve Jobs has on the Apple design culture. He says Apple is still ruled by the business and engineering guys, but that his indirect effect is providing a central design vision as well as removing the politics around product design.

David writes:

great post, but i actually have a different viewpoint.

have you ever worked in a big org like apple? it’s filled with competing viewpoints, and is always run by business guys, never design guys. always design guys are relegated very far down the chain, and so thus engineering and business seem to drive the day on any decisions. this is often where we find “fake desirability”. [ed: fake desirability, which he defines “by this i mean that some people said they designed for users, but in actuality they only designed for themselves.”]

when i was at apple, it was certainly better than other companies. but still it was a guy who used to be at IBM germany who was CEO at the time from 1990-1993, after john sculley was removed. and design reported still a level or two below the CEO, but lucky for apple the culture itself supported UX and its products were consistently better.

when steve jobs came, he killed the political bullshit that made great products even better. everything runs through him and if he doesn’t like it, it’s too bad. so you have to suck it up to work at apple, doing steve’s bidding or else you will not survive in there.

he is a design dictator of the company. and it’s fortunate for apple and the world in general, that they have him because without his ironhand, the company would soon devolve back into a political, consensus driven company. it would still have great products from a certain point of view, but i doubt that they would ever have the game changing, superiority they exhibit now. committees would grow, politics would ensue, control battles would happen, and superior products would be hampered by all this. steve removes all that; he makes the final decision and pushes details that no one else would have the authority to push. and being at the top, you have to listen to him or else you’re fired. that’s it; end of story.

and thank god he is right most of the time.

so i would argue that benevolent dictatorships are the best form of govt in the world, including both for companies and for countries, where one person has both the right vision and the ironhand/cut-thru-the-bullshit attitude and style to do the right thing. think if obama ruled the US like steve jobs. he would just do the right thing, and nobody could do a single thing about it.

the probability of another steve jobs occurring is vanishingly small. i doubt that another startup could produce a steve jobs. it is a combination of intelligence, market savvy, strong personality, and ruthlessness that makes him successful. not many people can exhibit all those qualities to make it work.

believe me i have seen people try. but they just end up pissing everyone off and they fail when nobody can work for them, or they think they have supreme market savvy but really they are exhibiting “fake desirability”. remember that steve took decades to develop his ability to this day; a 20-30 year old is very very unlikely to have enough world experience to be able to match that. so maybe you could say that zuckerberg or larry/sergey are in that camp. but there are other tons of people out there who are not. so the probability of finding someone like that (or being someone like that) is pretty darn small….

Very interesting…

UPDATE: David added some additional thoughts in the comments.

I should clarify that I don’t think that Apple is run by business and engineering guys solely now. I think it’s probably one of the most balanced orgs, power-wise in any corporation I’ve seen. What other companies have their head of design reporting into their CEO? I can’t think of any!

But CTOs almost always report into the CEO, and certainly the business structures, like business units, general managers, etc. always do.

Authority and importance are often driven by how high in the org chart you are. Having a voice at the table as high up as possible means you get to be heard and your issues taken seriously, and your influence felt. It also means that the CEO has now told the company: “the guys who report to me are also the most important to me. That’s why they report to me.” If the design lead does not report to the CEO, then how can design truly have a voice in the strategic decisions of the company? It could only be translated through the voice of his manager, and so on, upwards until they get muddied and washed out by the time they reach the top…or just lost.

A clarifying point about indirect design influence: 

I actually think Steve has a direct influence on design on many products, and that the effect of this design influence creates what I’ll call “design philosophy inertia” which propagates through the org, across product lines and down product lines. This is where his indirect influence can be felt. But it is clear to me there are products that he cares most about, and these he will put his attention on all the time.

As I said in the post above, thank god we have Steve. I doubt we’d see the world be filled with such superior products without him.

UPDATE: Some thoughts from Kristee Rosendahl below on Apple and what startups can (and can’t) take away from process.

My comments about Apple have to be taken in the context of when I was there 1984-1990, as things continue to change there like any company. After 1990, I’ve been an external observer of Apple’s culture, just like the rest of us.

I think Steve is a design dictator when it comes to the products close to his heart. The good news is that his approach and sensibility is so baked into the culture of Apple that everyone inside Apple considers themselves design advocates. So other products get the advantage of that. It’s an amazing example of how leaders set tone, culture, and priorities. When I went to work for Apple, even as a consultant first, they gave me this little cubical with a Mac. Then the person said be prepared for Steve to walk in at any time and ask you what you are doing. The implication is that I better be able to defend my work at any moment. That set a tone from day one! He never showed up in my office, but talk about creating an environment based on that.

I also think Steve is in his own class, because he is not only a designer, he is an incredible marketer. I agree with you though that there is still lots of room to improve and elevate design within an organization. The issue will be that most CEOs can’t really talk about design. There are almost no classes in biz school that really address design – I sure hope that changes. So most biz or tech guys running the show are not apt to go there, its not their language, and not their safe zone. One of the major ways I have seen companies overcome this is with two partners as head – one who handles the biz side but totally appreciates and respects design, and the other is the creative lead who has respect and can partner with a business oriented person. The other option is to hire a really good design lead. Mostly, though, companies hire consultants, or agencies. When the job is done, there is no one in house to keep advocating from the top…design has got to be on the executive team and by the water cooler to make it work.

[…]

I would add that, in this discussion about design, remember Apple is a consumer products company. Most of what they are lauded for is their product design, ease of use, delight, coolness, etc. Designing real products people carry with them, work on, and use for entertainment purposes, is a far different design effort than creating a social media website. While both require design, their development time, designer’s skill sets and to-market time are not similar. Sometimes we need to make that distinction when we talk about design efforts in various different kinds of companies and start ups.

When a CEO who is starting up an online business says they want their product ” to be as simple as Apple”, we all know what that means. What start ups forget is how many people’s efforts and hours go into making Apple’s products that clean and simple. In my experience, it has been a real challenge to convey how much longer a simple solution takes over a complex one. A truly simple and elegant solution just demands more time and cycles than most people understand. So I’m delighted when you can hear designers talk about their process and the timeline. A simple product demands patience, lots of iterations and hence, additional expenditures.

At the same time, I’ve unfortunately seen small companies and many startups waste thousands of dollars and person hours spinning about the design of the product because they don’t have a clear idea of the core benefit. So in the end, they could have spent the same amount of money but had a very different outcome – a much better product. They need to get better at doing their homework… see attached Seth Godin post.

This is what Jobs understands and why removing the corporate bs is so important. The company politics or personal aesthetics can take down a good idea or product in no time, even in a tiny company. David also talks about “design by consensus” and I think that’s part of any startup. The group is typically so small, that to leave someone out of the design process early on doesn’t emphasize the “team” spirit of the start up. This can be a big mistake. Not everyone is involved in other parts of the processes – I don’t critique code, for instance. I leave that up to people who are experts at that function. But many people want or think that being part of the design decisions is part of their inherited right as an early team member – it’s fun, distracting and everyone has an opinion. My advice for a startup is to be very careful about how the process is handled. As a designer, this is part of my role as well – to design the process by which this can all happen smoothly. In the end you can get a mediocre design by consensus that looks cool to the internal team but does nothing for the potential customer.

A product’s design success also depends on whether you perceive design as merely a decorative skinning of the product once its developed or as an inherent part of the product development process. I get calls all the time from companies who are launching in 8 weeks, the product is in development, and they need a designer to come in to apply some look and feel to it. This is the antithesis of how Jobs works. And it shows. And it impacts the financial success of the product.

I think we designers also need to keep doing a better job at being part of the development teams. I’ve seen many a designer complain about having to attend development meetings – they just want wireframes and then they can do their magic. I think this is partially why developers have taken on some design roles. And I want to say here, I consider developers designers in their own right! Someone has to make choices early on, and if a designer isn’t there, the product gets developed either way. Designers need to get more agile, iterative, and more transparent in what they do. Today’s products demand that of us.

Lastly, I’m including my absolutely favorite post from Seth Godin. I think it sums up so well many points that would help both startups and existing businesses get a little shot of that Apple DNA. Seth’s observations are a good summary about how equally important fostering innovation is vs being an innovator. Steve Jobs does both pretty well. For now, pick one role and do it really well.

[Seth’s post on How to be a great client]

Thank you Kristee!

What does Steve Jobs really do for Apple?
I had a recent conversation on Apple’s incredible design culture and what it would take to create that in a startup. In many ways, it seems like an insurmountably difficult challenge to play the role of Steve Jobs, with his god-like sense of product aesthetics and interactions.

And yet, Apple has hundreds of products and experiences – hardware, software, HR materials, commercials, etc. Steve Jobs certainly doesn’t have time to work on the design of every Apple product, and of course has 35,000 employees to manage. So what does Steve Jobs really do, to create the amazing design culture at Apple?

And more importantly, can a startup hope to even start to capture the same kind of culture?

Well, let me give you my best guess :-)

IDEO’s product framework for Desirability, Feasibility, and Viability
First, let’s take a quick detour and talk about IDEO’s perspective on new product development – this is documented as part of their 100+ PDF on human centered design, but also recounted to me by a friend who works there.

The idea is that all products ultimately come from an epic struggle between three perspectives: Desirability, Feasibility, and Viability. IDEO focuses on new products from the desirability side, which means they think about how to make sexy products with clear value propositions, and think technology and business goals flow from that. Most of their Fortune 500 clients do not act this way, of course, which is why they have to hire IDEO.

Here’s the diagram included in their HCD toolkit:

The way this was retold to me is that these factors map into functional parts of a business:

• Viability = Business focus (marketing, finance)
• Feasibility = Engineering focus (technologies, agile process, etc.)
• Desirability = Design focus (customers, aesthetics, etc.)

Business-focused product perspective: Viability
For business-oriented products, the focus might be on any of the following:

• “hot markets”
• making money
• funding potential
• distribution
• metrics

The idea there is that you get to a product via one of these first-order items. A business-oriented entrepreneur might identify a market, then try to come up with a product within the market – for example, “wow, Zynga is making $250M/year, and fish games are big. I should come up with a social gaming product too.”

I would also argue that “corporate” thinking (including MBAs and biz plan competitions) fundamentally revolve around this approach – the most important thing becomes the analytical discussion around the business, rather than the core user experience itself. Financial metrics and market sizes become the dominating point of discussion – I would argue also that most venture capitalists fall into this bucket.

The big “religions” in this perspective are frameworks like Built to Last, Crossing the Chasm, Customer Development, Blue Ocean Strategy, even Efficient Market Hypothesis. You might also count Six Sigma, all the stuff in McKinsey quarterlies, etc.

Engineering-focused product perspective: Feasibility
For technology-oriented products, the focus might be on the following:

• programming language and development stack
• cool technologies or libraries
• engineering processes (agile or otherwise)

For people who use this as a first-order filter, you might end up with a line of thinking like, “BitTorrent is really cool, how do we build a business around it?”

I would also put engineering processes like agile into this, because that can easily become a first-order item in how to build a product as well. Agile won’t work for every team, for every product, in every situation, and yet it’s viewed as an all-purpose hammer – does that really make sense?

The big “religions” in this perspective are frameworks are agile, scrum, open source, etc. I might also count the “ecosystems” like Rails as a unique culture with its own set of beliefs and conventions. Frameworks like “Lean Startups” ultimately combine both Business and Engineering goals, via Customer Development plus Agile.

Design-focused product perspective: Desirability
For design-focused products, the focus might be on:

• context, culture, and goals
• customer goals and product experience
• design aesthetics and interactions

The first-order filter in this case might be “Sick people go to hospitals and have a terrible experience – how do we improve that?” The tools employed at this initial stage might include user research, development of personas and user goals, and rapid prototyping to explore many product concepts.

The big “religions” here are led by Apple and their aesthetics and standards. And of course folks like IDEO and their “design thinking” ideas.

How business and engineering goals encroach on the desirability of a product
Reading through the above, perhaps you have identified yourself as prioritizing one versus the other. And in general, the prioritization of the three different goals drives what kinds of product experiences you can build.

From the perspective of making a sexy, highly desirable product, you’ll find lots of objections from business or engineering:

• “spending money on visual design is too expensive”
• “polishing a product will make the process too slow”
• “this product is boring to implement”
• “can you redesign this product so we can build it in 1 week sprints?”
• “this target user is great, but we want the product to be more powerful and support more audiences”
• “but Zynga doesn’t do this, can you just copy them?”
• “why build so many prototypes that get thrown away? That’s costly and slow”
• “if you added X to this product, it would put us into strategic market Y”
• etc.

How do you handle questions like the above?

All of them are great questions, and of course the right answer means you have to find a balance in the approach. But what is the expense towards the core of your product experience?

Back to Steve Jobs – what does he really do?
Long story short, my hypothesis is that Steve Jobs is one of the rare CEOs who is very focused on product desirability. In battles with the business and technology goals, desirability will almost always win out.

So his role isn’t that of a designer, but rather Chief Design Advocate. This means:

• he makes it clear that products should be “insanely great”
• he recruits a top design team, and protects them from competing goals
• he is willing to spend money, adjust technology processes, all for the goal of highly desirable products
• he convinces financial analysts, industry pundits, etc. that product design is very important

To me, the amazing part about this is: Any company can do it.

Maybe not as good as Jobs, but they can decide to make it a priority – but few companies do. With the pressure of quarterly earnings, what competitors are doing, and employee aspirational desires, the focus moves off of killer experiences for customers – that’s no good.

If the above is true, then any of us can be the Steve Jobs of our team. Start by prioritizing design and desirability, and place it on a better footing relative to engineering and business goals. Learn the tools, develop your own religion, and start building great product experiences.

It almost sounds so easy!

Want more?
If you liked this post, please subscribe or follow me on Twitter. You can also find more essays here.