A/B testing is rapidly establishing itself as a core tool in product development. In this talk, we will start with a recap of standard A/B testing, including best practices. We'll also explore cutting-edge, less-familiar but powerful methodologies which address well-known limitations of standard A/B Testing. These include Sequential Testing, Multi-Armed Bandits, Switchback Experiments, Stratified Sampling, Heterogeneous Effects Detection and Experimental meta-analysis. Designed for data professionals and product builders, this presentation aims to inspire the embrace of innovative approaches and provide insights into the frontiers of experimentation.
Timothy Chan is an experienced data science professional, currently serving as the Head of Data at Statsig. This cutting-edge platform provides product observability and experimentation services to top companies such as Notion, RecRoom, WhatNot, and OfferUp. Before joining Statsig, Timothy spent 5 years as a Data Scientist at Facebook (now Meta), where he was involved in projects across Facebook App and Reality Labs. Before venturing into the tech industry, Timothy worked in biotech, researching treatments for diseases such as Alzheimer’s, Multiple Sclerosis, Lupus, and Cancer. He holds a PhD in Chemistry and an MBA in Entrepreneurship.