Menu
Log in

Upcoming events

    • 1 Dec 2026
    • 10:00 AM
    • Online

    Topic: Testing the Prediction Profiler with Disallowed Combinations: A Statistical Engineering Case Study

    Speaker: Yeng Saanchi

    Date: December 1st at 10:00 a.m. ET 

    Abstract

    Statistical software is increasingly used to support complex analytical decisions, yet validating that such software behaves correctly across the wide range of problems encountered by users presents a substantial challenge. This presentation describes a statistical engineering approach to validating a new capability in the JMP prediction profiler for handling design spaces constrained by disallowed combinations.
    The team adopted an experimental design approach to software testing, namely combinatorial testing. Strength-2 covering arrays were used to construct an efficient test suite that covered all two-way interactions among factors while keeping the number of test cases manageable. A novel aspect of the approach was combining the generation of synthetic data sets and the selection of profiler test cases as a single combinatorial testing problem. This allowed the team to systematically explore a diverse space of possible data characteristics while controlling the number of test cases to consider.  Equivalence partitioning was used to determine the levels of inputs with a wide range of possible values. The result was, in effect, a dataset of datasets designed to exercise the profiler enhancement across a wide variety of conditions.
    Particular attention was given to determining appropriate test oracles for the selected test cases to ensure that the software is working as intended. The presentation will show how design of experiments techniques can be adapted to software testing and other problems in which exhaustive testing is impractical. It will also demonstrate how statistical engineering can provide a framework for bringing statistical knowledge, software engineering, optimization, and other domain expertise together to solve complex validation problems. 

    Speaker Bio

    Yeng Saanchi is a Research Statistician Tester at JMP Statistical Discovery, LLC. She received her M.S. in Statistics from the University of Michigan, Ann Arbor, and her Ph.D. in Statistics from North Carolina State University. At JMP, her work focuses on the numerical verification and validation of statistical routines and methodologies implemented in software. Her research interests include stochastic optimization, applications of optimal experimental design to precision medicine, and statistical software validation. She also enjoys exploring new areas and finding opportunities to apply statistical thinking to challenging problems.

    Register Now

    • 31 Dec 2026
    • Online
    Register


    STATISTICAL ENGINEERING: PROBLEM FORMULATION FOR SUCCESSFUL DATA PROJECTS

    Register to watch recording.

    Don't start with the data. Start with the problem. Master the art of problem formulation in statistical practice.

    Many data science, analytics, and improvement projects fail—not because of poor statistical methods, but because the wrong problem was defined in the first place.

    This interactive short course introduces the principles of Statistical Engineering and teaches participants how to frame, structure, and formulate problems that lead to successful data-informed solutions.

    Who Should Attend?

    • Experienced statisticians and data scientists who want to enhance project results
    • Early-career professionals involved in data-driven decision making
    • Graduate students in statistics, data science, analytics, or related disciplines

    What You Will Learn

    Participants will learn how to:

    • Apply the Statistical Engineering problem-solving framework
    • Recognize strengths and weaknesses of problem statements
    • Formulate clear, actionable, and measurable problem statements
    • Avoid common project pitfalls and framing errors
    • Develop strategies for tackling large, complex, and unstructured problems

    Course Delivery Format

    The course is split into two online live sessions

    Session 1: September 10 at 10 am - 12 pm EST

    Session 2: September 24 at 10 am - 12 pm EST

    Each session will utilize interactive learning through:

    • Expert instruction
    • Individual reflection exercises
    • Group discussions
    • Real-world case studies
    • Practical problem-formulation activities

    Meet Your Course Instructors

    Roger W. Hoerl


    Roger W. Hoerl is Brate-Peschel Professor of Statistics at Union College, in Schenectady, NY. Previously, he led the Applied Statistics Lab at GE Global Research. Dr. Hoerl has been named a Fellow of the American Statistical Association and the American Society for Quality, and has been elected to the International Statistical Institute and International Academy for Quality.

    Caleb King


    Dr. Caleb King is a senior developer for the DOE & Reliability group at JMP Statistical Discovery LLC. He received his PhD in statistics from Virginia Tech. His research interests included design of experiments and reliability. Prior to joining JMP, he worked as a senior statistician at Sandia National Laboratories. Dr. King currently also serves as Past Chair for ISEA.

    Valeria Quevedo


    Dr. Quevedo is an Associate Professor and researcher at the University of Piura. She holds a Ph.D. and an M.S. in Statistics from Virginia Tech (USA) and an M.S. in Operations Research from the University of British Columbia (Canada). She has professional experience in research and consulting projects within the fields of statistics and operations research. She is the current Chair of the Board of the International Statistical Engineering Association (ISEA).

    Shilpa Gupta


    Shilpa Gupta is an award-winning engineering educator and former data science leader whose work focuses on applied AI, statistical engineering education, authentic assessment, and the responsible use of LLM-based tools in engineering curricula. Dr. Gupta is an Adjunct Professor of Industrial and Systems Engineering at San Jose State University. She holds a doctorate in Industrial Engineering from Arizona State University.

    Registration

    Course Fee: US$30

    Includes recording and course materials.

    For questions and general inquiry: info@isea-change.org







    • 22 Jan 2027
    • 10:00 AM
    • Online

    Topic: Discrete Choice Experimentation for Learning User Preferences

    Speaker: Dr. William Fisher

    Date: January 22 at 10:00 a.m. ET 

    Abstract

    The design of engineered products and services is a complex decision-making process where designers must often perform tradeoffs and select design features that align with user preferences. One way to simultaneously explore these tradeoffs and learn user preferences is by conducting a discrete choice experiment (DCE). In a DCE, users are presented with a sequence of questions, or choice sets, where in each choice set they are asked to pick their preferred option among a set of alternatives. The data collected from the DCE can then be used to estimate the relative importance of different design features and aid the designer in selecting a design that best aligns with user preferences.

        In this talk, we will begin by introducing DCEs, including their statistical design and analysis. Along the way, we will illustrate the statistical design and analysis concepts through an example involving laptop design. Then, we will present a case study on learning user preferences for tooltip text in JMP, a statistical software system, and demonstrate how incorporating demographic information into both the experimental design the analysis can allow us to model preference heterogeneity across different demographic groups, thus giving us the potential to tailor the tooltip to the user. Lastly, we will conclude with a brief overview of various interesting extensions and alternative preference learning approaches.

    Speaker Bio

    William Fisher is a Research Statistician Developer on the Design of Experiments and Reliability team at JMP Statistical Discovery LLC.  His work at JMP Statistical Discovery LLC focuses on doing research in experimental design and developing user-friendly software solutions to experimental design problems. Before joining JMP Statistical Discovery LLC, William was a student at Clemson University where he received his PhD in Mathematical Sciences in 2025.

    Register Now

Copyright 2020 International Statistical Engineering Association

Join us on

 


Powered by Wild Apricot Membership Software