Research Seminars @ Illinois

View Full Calendar

Tailored for undergraduate researchers, this calendar is a curated list of research seminars at the University of Illinois. Explore the diverse world of research and expand your knowledge through engaging sessions designed to inspire and enlighten.

To have your events added or removed from this calendar, please contact OUR at ugresearch@illinois.edu

Statistics Seminar - Tong Zhang (UIUC) - "The Impacts of Overparameterization under Distribution Shift"

Event Type
Seminar/Symposium
Sponsor
Department of Statistics
Location
1306 Everitt Lab
Date
Apr 11, 2024   3:30 pm  
Views
100
Originating Calendar
Department of Statistics Event Calendar

Title: The Impacts of Overparameterization under Distribution Shift

Abstract: Modern machine learning often relies on overparameterized models, typically trained to overfit the data. Recent studies have suggested that such overfitting can be "benign," leading to estimators with strong generalization performance. In this talk, we further examine the consequences of overparameterization under distribution shifts and present the following findings:

1. For adversarially perturbed data, benign overfitting can result in models that lack adversarial robustness, even when the true underlying model is robust.

2. On the other hand, when test data are perturbed non-adversarially but exhibit a distribution shift from the training data, overparameterization proves advantageous. As the model size increases, the out-of-distribution performance also improves. We support our theoretical results with experimental evidence.

link for robots only