In this in-person workshop, delivered by Leemay Nassery, Engineering Leader at Spotify, we’ll demonstrate A/B testing concepts through case studies from the lens of an analyst running experiments on a product. We’ll dive into example SQL queries to demonstrate real-world applications of how data analysis is key to understanding the impact of changes made to a product. This workshop is designed for anyone who wants to learn how to apply key concepts related to A/B testing in a real-world setting.
Key Topics:
- To further illustrate key concepts, such as user cohorts and proxy metrics, we’ll walk through use cases with mock datasets and apply them when analyzing an A/B test.
- Examine random sampling strategies to ensure test and control treatments are unbiased.
- Query mock datasets to derive insights for specific user cohorts.
- Examine A/B test definitions from the lens of an analyst responsible for ensuring test validity.