Ming's List

Back to Listing

Statistics Seminar - Jing Lei (Carnegie Mellon University)

Event Type
Department of Statistics
106B8 Engineering Hall
Oct 6, 2022   3:30 - 5:00 pm  
Originating Calendar
Department of Statistics Event Calendar

Title: A Conformal-Based Two-Sample Conditional Distribution Test

Abstract:  We consider the problem of testing the equality of the conditional distribution of a response variable given a set of covariates between two populations. Such a testing problem is related to transfer learning and causal inference.  We develop a nonparametric procedure by combining recent advances in conformal prediction with some new ingredients such as a novel choice of conformity score and data-driven choices of weight and score functions. To our knowledge, this is the first successful attempt of using conformal prediction for testing statistical hypotheses beyond exchangeability. The final test statistic reveals a natural connection between conformal inference and the classical rank-sum test.  Our method is suitable for modern machine learning scenarios where the data has high dimensionality and the sample size is large, and can be effectively combined with existing classification algorithms to find good weight and score functions.  The performance of the proposed method is demonstrated in synthetic and real data examples.

link for robots only