题　目：A Theory of Feature Learning in Kernel Models

嘉　宾：Ruan Feng , Assistant Professor, Northwestern University

主持人：刘慧康，副教授，上海交通大学安泰经济与管理学院

时　间：2026年3月18日（周三）14:00-15:30

地　点：上海交通大学徐汇校区安泰浩然楼308室

内容简介:

We study feature learning in a compositional variant of kernel ridge regression in which the predictor is applied to a learnable linear transformation of the input. When the response depends on the input only through a low-dimensional predictive subspace, we show that all global minimizers of the population objective for the linear transformation annihilate directions orthogonal to this subspace, and in certain regimes, exactly identify the subspace. Moreover, we show that global minimizers of the finite-sample objective inherit the exact same low-dimensional structure with high probability, even without any explicit penalization on the linear transformation.

演讲人简介：

Feng Ruan is an Assistant Professor in the Department of Statistics and Data Science at Northwestern University. His research lies at the interface of machine learning, statistics, and optimization. Broadly speaking, he has two main research interests. The first is representation learning, where he studies how learning systems automatically discover low-dimensional predictive structures in data, with a particular focus on feature learning in kernel and compositional models. The second is nonsmooth optimization, where he develops variational and algorithmic foundations for nonsmooth and nonconvex problems arising in modern statistical learning.

欢迎广大师生参加!