This week, we’ve been at The Lean Startup Conference out in San Francisco—getting inspired and learning a ton.

So of course, we wanted to share with you a few of our favorite talks. These are from Wednesday’s lineup and are mostly about experimentation. We’ve got a list of favorites from Thursday’s lineup, too.

Test Your Way to the Right Answer by Anita Newton

Brand-new startups begin with almost zero customer data—a risky position from which to build a new product. But when you have very little money, how can you acquire critical information quickly? Anita Newton advisor, investor, and marketer at Mighty Handle, reveals how her bootstrapped, non-technical startup did clever customer development online, and rapidly tested its way into the customer insights it needed to sell its consumer packaged goods to the largest retailer in the world.

Identify and Validate Your Riskiest Assumptions by Laura Klein

MVPs are great—unless you’re building them to test assumptions that aren’t really mission-critical. In this hands-on session, Laura Klein, author of UX for Lean Startups and head of product development for Hint Health, breaks down the kinds of assumptions you should look for and a process for developing hypotheses that reveal your true barriers to growth.

The Diesel Engine MVP: Cory Nelson in Conversation with Eric Ries

When you have long product cycles or you’re building big physical things–or both–you typically face significant risk, as a lot can go wrong between drawing board and customers. In theory, Lean Startup methods help you reduce that risk. But it’s not always obvious how you can apply them. Cory Nelson, Sr. Executive Product Manager at GE Distributed Power, talks with Eric Ries about how GE has used Lean Startup methods to develop a new diesel engine more quickly and with less risk than it had for similar products in the past.

How a 30-Year-Old Hardware Company Is Bringing Products to Market 3x Faster by Kevin Ellsworth

Hardware companies face particular challenges testing and iterating on their product ideas. It’s often cost-prohibitive to get an MVP in the hands of customers, and it can be seemingly impossible to ramp up production cycles. But you can push the boundaries of convention. Kevin Ellsworth, Product Manager at Cirris, explains how his team has built systems for consistent learning that have helped them release new products over a matter of months rather than years.


Get Comfortable Shipping Imperfect Products by Lauren Gilchrist

Top product managers must have great customer empathy–but too much of it can slow you down. On the one hand, you need empathy to understand your customers, so that you can build products that solve their problems. On the other hand, too much empathy can prevent you from releasing a product that doesn’t solve all of your customers’ needs at once. Lauren Gilchrist, Product Manager at Pivotal Labs, gives five tips for shipping less-than-perfect MVPs so that you can all learn from end users, fast.


Lessons from Experimentation at the Biggest Organization in the US by Todd Park

The US federal government is the country’s largest employer and does not have a reputation for moving quickly. But Todd Park, who served from 2012 to 2014 as United States Chief Technology Officer and Assistant to the President and is now a technology advisor to the administration in Silicon Valley, is bringing an entrepreneurial approach to government and continues to make real change. He and key U.S. technology leaders describe their most challenging projects and share advice for experimenting in large organizations.


By Lisa Regan   @mybldanube


Established companies are established. Which means they’re big, operate with layers of complexity, and have a set way of doing business.

And as these established—we call them enterprise—companies look toward new ways of working, and new products to create, it often happens that their company culture isn’t quite ready to support the transformation. Sure, leadership might be looking to make a change, but they get pushback from the product or business teams. Or self-starters on individual teams may be eager to experiment, but they get the sense leadership isn’t interested. To find out what works to shake up a big, entrenched culture, we spoke to Brant Cooper.

Brant is co-founder of Moves the Needle and author of The Lean Entrepreneur—in addition to his many years at startups—and helps large enterprise companies like Intuit, Capital One, and Hewlett-Packard shift traditional business practices toward innovative ones.

We also recently dove in with Brant to explore the role of leaders in continuous innovation in this webcast conversation with Carie Davis, Coca-Cola’s Global Director of Innovation and Entrepreneurship.

Lisa Regan: What are the obstacles to innovation in large corporations?

Brant Cooper: We actually hear the same story pretty often: A company has made a first foray into integrating Lean Startup practices, but they can’t move the new methods past a small product team or innovation group. That’s pretty much always because other parts of the business—legal, or regulatory compliance, or marketing—are worried about the risk to the brand. We start to hear, “What will our customers think about that? It might adversely affect our brand.” Or maybe there are legal and regulatory compliance considerations around accepting payments. And those are all valid concerns. Big companies have to protect their core business—it’s where they make all of their money. So while this idea of bringing startup practices to large enterprises is not really new, often it hasn’t worked because those companies are right when they say, “Listen, we can’t just become a startup.”

So then the question is: What can you do about that? And I think the first thing you have to do is: Ask. Talk to people. A lot of these innovation teams will just sit inside their work area, and they’ll go, “Oh, Legal will never allow us to do that.” And they don’t even ask! Pick up the phone, or go out for a cup of coffee, and just see what the response is. Like, maybe they’re worried that you’ll want to run an MVP that’s not fully baked, but they don’t know that an MVP is usually not going to be released to millions of people anyway—it’s for targeted early adopters. And once Legal finds out that you’re only interacting with a small handful of customers, they’re like, “Ugh, don’t bother me with this trivial stuff.”

But it’s also possible to actually get those operational teams—branding, sales, IT, legal, compliance, even HR—truly on board with new methods for creating products. In our training, we encourage people from those teams to join the innovation teams and the internal product teams so that they are able to experience first-hand what it’s like to run experiments. Then, they can understand why the teams are acting the way they are, and what these experiments mean, and what’s really happening when they’re interacting with customers. When I say “join,” I don’t mean that they’re sitting on the side and taking notes—they’re active participants. We ask them to provide ideas.

Another strategy we use is to train the business and operational teams to themselves act like an internal startup, where the employees are their customers. We ask them to think, “What are some products or services that we can roll out to our internal employees that will enable them to innovate better?” If legal or HR start re-framing their employees’ concerns as problems that they might be able to solve, then they can act like an internal Lean Startup and propose solutions. They can go and do customer development on their own employees, and then run experiments with employees to see which one of the ideas might actually work.


LR: At enterprise corporations, what’s the role of managers in guiding teams through entrepreneurial processes?

BC: This is a big question. How do you mentor internal innovation teams? It’s not the same thing as managing. A lot of managers have a lot of experience, and they’re very successful within large enterprises. But their skill set really is around managing known processes, versus mentoring teams to try to discover new processes. We’re finding that to be a very tough nut to crack. We do some “train the trainers” work, so that they can then do the workshops themselves and teach. But even beyond training the trainers, it’s: How do you teach leaders to mentor the teams, not just manage them?

Here’s an example: In one of the sessions that we did at Intuit, a senior manager said it was interesting that they actually had to teach the teams how to persevere, that teams were willing topivot too early. It was interesting because, in the startup world, I encounter something different. In startups, people push through no matter what the evidence might state, or they’re scared to even seek the real evidence. In large enterprises, it’s exactly the opposite. They get a little bit of evidence, and then they’re ready to pivot to the next idea.

Intuit’s senior managers were like, “Actually, there are all sorts of ways that you guys can test ideas.” You need that perseverance. The real innovation is not going to come easy, so you have to teach the internal entrepreneurs that they really need to iterate as much as they can before they “give up” and go off to a different idea.

To get there, you have to come up with new ways to measure these teams so that, on a week-by-week basis, they’re making significant progress. It’s, “You will go talk to 15 customers in the next week,” rather than just making promises like, “Oh, yeah. By the end of the month, we hope to have a dozen downloads.” The mentoring is really about teaching entrepreneurial teams to push aggressively.

LR: Why do you think it is that in the established companies, everybody gives up and goes, “Okay, let’s just pivot”?

BC: That’s a good question. Here’s another example of a client that we’re working with, a large consumer website. The President and CEO were urging the teams to move faster, so you had these teams running experiments, then they’d go, “Oh, I don’t know if we can do this.” And it was this senior leader that was going, “No, no. You have to do this. Push faster. Move faster.”

So it could just be that, when growing up inside larger, well-established organizations, you’ve been mentally trained to sort of resist failure. Or if you fail too quickly, you’d better do something else where you might be able to succeed. Maybe there’s even a fear of persevering, because, like, how far do I want to push on an idea that might not succeed? Is that going to come back and ding my career? So a lot of people inside these large enterprises are still trying to figure out, “Is senior leadership really on board with this whole idea of failing fast?”

That said, I’ve always been impressed that, when bringing these ideas to large enterprises, they have entrepreneurial people there. They have people that like chaos, that like wearing many hats and are problem solvers. And actually inside these large enterprises are pockets of agile programmers and design thinkers. So they already have these skill-sets at the grassroots. Those are the people that we can help identify, and teach them a little bit more about Lean Startup and how they can start running experiments. And then how they can teach it and how they can become mentors.

Real cultural transformation is going to take a while, and it’s going to be difficult. It’s not a linear journey. It’s not from here to there. It’s not short. Because you’re going to have ups and downs, and you’re going to come across these obstacles, and you have to go out and find mentors, and you have to go and find allies—all in order to overcome the obstacles.

But I think the rewards at the end are pretty big, especially if you’re the one that’s driving it, right? You’re sort of an internal hero. Hopefully what it does is help your organization create real value for their customers and discover new business opportunities that result in real revenue. I think there’s a lot of upside. And the bottom line: My hope is that employees feel empowered to create new value for customers. I think it’s necessary for these big companies to survive, but it’s probably also necessary for these big companies to keep their best employees, as they feel empowered to not just follow the process inside their known market but to go out and discover new value.


What about the person with an entrepreneurial spirit who’s working in a large company? Can they make a difference on their own?

Recently I presented at a startup conference where I met a lot of people at the practitioner level who were asking that question: How do you get buy-in?  What I tell them is: Don’t wait for permission. Just start running your experiments. I’m sure you can find something that you can work on. Maybe it’s after hours, and maybe it’s beyond your existing scope. But once you start having evidence, you’re in a position to start training leadership because you’re not just asking for resources and money, but you’re showing them evidence that there’s something here that they should be interested in. Pretty likely the leadership is going to look at that and say, “Yeah, okay, I think you should continue that experiment.” And so that’s starting down the path.

My other bit of advice is to go find like-minded people. Run a meet-up inside the company, do a lunch-and-learn, do a regular happy hour where you get together with entrepreneurially minded people and start asking, “What are some experiments that we can run?” And you can start churning out evidence. Again, the leaders will start to take notice. And as a matter of fact, it’s likely that, when you reach out like that, you will find leaders that buy into this approach as well.

Eventually, I do think you have to have that C-Suite executive that says, “Yes, we are going to do things differently,” to get it to spread and to really get a cultural transformation. But you can get the whole process started just by going and doing it.


Lisa Regan is a writer for The Lean Startup Conference and creates content for individual companies—tech startups to design firms. She divides her time between the San Francisco Bay Area and Vienna, Austria, where she also writes on art and travel.

See More than 120 Speakers and Mentors at The Lean Startup Conference

Guest post by Lisa Regan, writer for The Lean Startup Conference

The Lean Startup Conference is next week–and now that we can step back and see all the speakers and mentors, we have to say: Wow. When you look through the list, you’ll see big names that we’re very pleased we landed, epic companies we really want to hear from, and people we’re particularly excited to present because they have incredible stories to share–and you won’t hear them anyplace else.

Here are a few speakers to look out for–though with more than 80 speakers and 40+ mentors, there are far too many standouts for us to mention individually here. Another way to learn more about who’s speaking is to sort the conference program by category and find people addressing specific topics.

Experienced entrepreneurs

We’ve got speakers who are justifiably respected by a lot of entrepreneurs. For example:

  • Mitch Kapor invented the spreadsheet and was a founder of Lotus. Now he’s a leader in social impact investing and equality in education. He’ll talk about making a profit and making a difference in a conversation with New Media Ventures’ Christie George.

  • Todd Park convened the team that saved Obamacare. As the emeritus Chief Technology Officer of the United States, he still connects government and Silicon Valley. He and some of his key team members will share advice for working in large (very large) organizations.

  • Ben Horowitz’s book The Hard Thing About Hard Things is driving the conversation around startup management this year. He’s a founder of Andreessen Horowitz, which has backed Facebook, Skype, Jawbone, and dozens of other companies whose products you use. Eric Ries will interview him.

  • Bob Sutton is a Stanford professor and the author of several best-selling books on standout management, including Scaling Up Excellence, an investigation of high-growth companies. He’ll talk with Eric Ries about how companies successfully scale.

  • Bill Gross founded Idealab in 1996, making it the longest-running technology incubator alive today. He’ll use his experience starting 100 companies to talk about what makes a successful MVP.

Companies of note

Learn from companies that have been through the fire–and have lessons to share.

  • Aditya Agarwal has lived through startup hypergrowth–twice. He was a very early employee of Facebook, and engineering director there through the moment it blew up. Now he’s VP of engineering at Dropbox, where he’s seeing similar growth. He’ll bring us real-world advice.

  • Melissa Bell co-founded Vox.com, which opened for business earlier this year and immediately became one of the most important site launches in a year of big launches. And the whole site was developed in just 9 weeks. Melissa will talk with Lean Startup Productions CEO and co-founder Sarah Milstein about how experimentation continues on the site even with millions of eyes on it every day.

  • Blair Beverly from Google’s AdSense group will describe a stealthy method for convincing colleagues to get on board with Lean Startup.

  • Jocelyn Goldfein was most recently Engineering Director at Facebook and will talk about how different types of software allow for different types of experimentation.

  • Bill Grundfest is not what you usually expect from a startup conference. A comedian who founded NYC’s Comedy Cellar–an enduring business–Bill has written for TV sitcoms and media companies. He’ll be running a hands-on session on how to make a compelling business video. We gave him a night session so he’d feel in his element.

  • Dan McKinley will show the math he used to test new ideas as an engineer during the early days at Etsy.

  • Hugh Molotsi, an accomplished innovator at Intuit, will talk about recognizing good ideas in big organizations.

  • Cory Nelson will talk with Eric about how GE has applied the MVP method to its development of very large diesel engines.

  • Max Ventilla took Aardvark from startup to Google acquisition, a case study Eric described in The Lean Startup. Now Max is reinventing education through AltSchool, which creates local microschools.

Unique lessons

We go to great lengths to find stories you won’t hear elsewhere, and then we train those speakers so that they can tell their stories with impact. Some of the best lessons you’ll learn this year will come from people you’ve likely never heard of before: Sheena Allen, Tiffany Bell, Kevin Ellsworth, Seppo Halava, Margo Wright and many, many more.

Many Lean Startup experts under one roof

The conference features core Lean Startup experts helping you learn the most important ideas. That includes:

  • Hiten Shah, co-founder of KISSmetrics and Crazy Egg, talking about A/B testing

Great advice

Office Hours is your opportunity to sit down one-on-one with an expert and hash out the problems you’re facing. You can get direct advice from many of our speakers and from people like:

  • Farrah Bostic, founder of The Difference Engine and an expert in customer research

  • David Charron, serial entrepreneur and professor of entrepreneurship at UC Berkeley’s Haas School of Business

  • Kevin Dewalt, a pioneer in bringing Lean Startup ideas to Asia

  • Ame Elliott, a senior team leader at IDEO, where she brings products from design to production

  • Sharethrough co-founder and CTO Rob Fan

  • Learie Hercules, technical lead for a number of successful Lean Startup implementations

  • Jini Kim, key member of the team that saved Healthcare.gov and a healthcare startup entrepreneur

  • UX designer for Toyota ITC Matt Kresse

  • Alicia Liu, engineer at mobile startup Lift.do

  • Erin McKean, founder of content personalization platform Reverb Technologies

  • Tim O’Reilly, founder and CEO of O’Reilly Media

  • Nicole Sanchez, founder of Vaya Consulting and a leader in improving hiring and diversity

A program highly relevant to you

We’ve tagged all the conference sessions by category, so you don’t have to guess which will be of interest to you. Here are just a few things you might look for:

All conference passes are on sale right now, and you can compare them here. The conference is just a week away, so look over the entire program on our site, and then register today!