Log in

International Statistical Engineering Association

Upcoming events

    • 13 Jun 2024
    • 11:00 AM

    This is a joint ENBIS-ISEA webinar, hosted by ENBIS

    Title: Modern Statistical Challenges in A/B Tests and Recent Work in Metric Decomposition

    Presenter: Nathaniel Stevens

    Time: June 13, 2024, 17:00-18:00 CEST / 11:00 AM EST / 8:00 AM PST

    Abstract: The rise of internet-based services and products has brought about an unprecedented opportunity for online businesses to engage in large scale data-driven decision making. Over the past two decades, tech organizations have invested tremendous resources in online controlled experiments (colloquially referred to as A/B tests) to assess the impact of innovation on their customers and businesses. Running these experiments at scale has presented a host of novel statistical challenges and hence research opportunities. In this talk we review some of these challenges and present new work on one problem in particular, arising from an academia-industry collaboration with Airbnb. In particular, we’ll look at a new direction for sensitivity improvement whereby a target metric of interest is decomposed into components with high signal-to-noise disparity. Through both frequentist and Bayesian theory as well as real world applications, we’ll demonstrate the agility metric decomposition yields relative to an un-decomposed analysis.


    Nathaniel Stevens is an Assistant Professor in the Department of Statistics and Actuarial Science at the University of Waterloo. Prior to this Nathaniel held a faculty position at the University of San Francisco in the Department of Mathematics and Statistics. He is and has been Program Director of both university’s undergraduate data science programs. Having overseen 30+ data science internships at 20+ companies, Nathaniel is interested in using statistics to solve practical problems, and he has a passion for inspiring and training students to do the same. His research interests lie at the intersection of data science and industrial statistics; his publications span topics including experimental design and A/B testing, social network modeling and monitoring, survival and reliability analysis, measurement system analysis, and the design and analysis of estimation-based alternatives to traditional hypothesis testing.


    · Luke Hagar (University of Waterloo)

    · Alex Deng (Airbnb)

    · Tatiana Xifara (Airbnb)

    · Amit Gandhi (Airbnb)

    This is a joint ENBIS-ISEA webinar, hosted by ENBIS

    Register Here

Past events

28 Mar 2024 Unlocking the Power of Statistical Engineering
28 Feb 2024 Predictive and Prescriptive Analytics for Dynamically Targeting Customers.
7 Dec 2023 Teaching and Applying Statistical Engineering in Brazil
24 Oct 2023 Problem Framing: Essential to Successful Statistical Engineering Applications
4 Oct 2023 Statistical Engineering at the Fall Technical Conference 2023
20 Sep 2023 A case study of a mixed-level OMARS design
10 Sep 2023 Statistical Engineering at ENBIS 2023 Fall Conference
7 Aug 2023 The Past, Present, and Future of Statistical Engineering
8 Jun 2023 Statistical Engineering Synergies with Established Engineering Disciplines
25 Apr 2023 DATAWorks 2023
29 Mar 2023 The Statistical Engineering Framework: What It Is and How It Works in Practice
18 Jan 2023 Escalator Health Condition and Remaining Useful Life Modeling
8 Nov 2022 A Meander Through a 30 Year Career in Statistical Engineering
20 Sep 2022 Statistical Engineering toward Commercial Supersonic Flight: NASA'S Quest Mission
26 Aug 2022 INFORMS-QSR Webinar Series Presents: Dr. Peter Parker, Ph.D., P.E. National Aeronautics and Space Administration (NASA) Langley Research Center, Hampton, Virginia, USA
26 May 2022 An Overview of Quality, Statistics and Reliability Section of INFORMS and In-Process Quality Improvement
18 Nov 2021 ISEA 2021 Summit
27 May 2021 Statistical Engineering Applied to Variation Reduction
17 Feb 2021 My Journey Towards Becoming A Statistical Engineer
31 Mar 2020 DATAWorks 2020
23 Sep 2019 ISEA Fall Summit
3 Sep 2019 Invited Session: European Engineering Session - ENBIS-19
18 Jun 2019 Analytics Solutions Conference
13 Jun 2019 ENBIS Spring Meeting 2019
14 May 2019 ISEA is co-sponsoring a free webinar with ENBIS
14 May 2019 Monitoring Worker Fatigue using Wearable Devices
10 Apr 2019 Leveraging Statistical Engineering for Emerging Challenges
9 Apr 2019 ENBIS Webinar
9 Apr 2019 Statistical Engineering: What is It and Why is It important
1 Oct 2018 First Annual Fall Summit
3 Sep 2018 Statistical Engineering: A Glimpse Into the Future
3 Sep 2018 Setting Appropriate Fill Weight Targets: A Statistical Engineering Case Study
3 Sep 2018 Statistical Engineering: An Idea Whose Time Has Come?
16 Jul 2018 Statistical Engineering Quality and Competitiveness
16 Jul 2018 Big Data, Statistical Engineering, and the Future
16 Jul 2018 Approaches to Large, Unstructured, Complex Problems: Problem Solving Approach
16 Jul 2018 Approaches to Large, Unstructured, Complex Problems: The Big Picture
16 Jul 2018 Strategies for Solving Large, Complex, Unstructured Problems
16 Jul 2018 Leadership for Solving Complex Problems with Data
17 Oct 2017 2017 NASA - DoD DATAWorks Keynote Address Reflections on Statistical Engineering and Its Application by Geoff Vining

Copyright 2020 International Statistical Engineering Association

Join us on


Powered by Wild Apricot Membership Software