Working Papers
Evaluating for the Long Term: Learnings from Industry
Dean Eckles
|
Professor, MIT Sloan School of Management
Madhav Kumar
|
Assistant Professor, Harvard Business School
Leif Sigerson (Pinterest), Tom Cunningham (METR), Winston Chou (Netflix), Sana Pandey (MIT CSAIL), Jonathan Stray (UC Berkeley CHAI), Lo-Hua Yuan (Airbnb ), Eytan Bakshy (Meta), Timothy Chan (Statsig), Molly Davies (Pinterest), Maria Dimakopoulou (Uber), Simon Ejdemyr (Netflix), Kenneth Hung (Meta), Nathan Kallus (Netflix & Cornell University), Thu Le (Lyft), A. Demetri Pananos (Datadog), Lee Richardson (Google), Brennan Schaffner (Knight-Georgetown Institute), Rose Tan, Martin Tingley, Nadia Tomova (Booking.com), Panagiotis Toulis (University of Chicago Booth School of Business), Wenjing Zheng (Roblox), Zander Arnao (Knight-Georgetown Institute), Dean Eckles (MIT)
This paper collects and shares industry knowledge on how to make decisions from short-term experiments that are better aligned with long-term outcomes. Based on a daylong workshop with 26 experts from 15 online platforms and 4 universities, it formulates a series of propositions that reflect current industry knowledge.