[@IndeedEng] Data-Driven Product Design

@IndeedEnd April: Wednesday, April 24, 2013 Video available: http://youtu.be/Y6NI8y21xhg Advertising pioneer John Wanamaker famously said, "Half the money I spend on advertising is wasted; the trouble is I don't know which half." At Indeed, our experience shows that more than half of product features are not only wasted but actually have a negative impact on user experience. Thanks to rigorous A/B testing we know precisely which half, so we can ensure that every feature we add delivers measurable value. With 100 million monthly unique visitors and 3 billion monthly searches, our data provides empirical answers to (nearly) all of our product questions. In this talk, we will cover: * a motivation for why we A/B test everything * the tools and systems we have developed to measure and analyze test results and the key metrics we focus on, and * multiple case studies illustrating how years of testing has shaped Indeed's design and product thinking. We will include specific examples of how small, overlooked changes have impacted our metrics in significant and unexpected ways, and how implementing simple "no-brainer" updates on our site decreased key business metrics and caused us to re-evaluate our solutions. This talk is for designers, product managers, and engineers from companies of any size who want to understand how data-driven design makes better products. Speakers J Christopher Garcia is the User Experience Lead at Indeed. Chris ensures Indeed's products are easy to use for millions of people all over the world. He has focused on user experience at Indeed for over 6 years. As the company has grown from start-up underdog to the world's leading job search engine, he has contributed to every major product Indeed offers. Chris Hyams is SVP of Product & Engineering at Indeed. Prior to Indeed, Chris was founder of B-Side, an Austin-based company that provided digital distribution, marketing, and analytics technology for the film industry. Prior to B-Side, he was VP of Engineering at Trilogy Software.