Paper ID | MLSP-45.2 |
Paper Title |
TOWARDS AN INTRINSIC DEFINITION OF ROBUSTNESS FOR A CLASSIFIER |
Authors |
Théo Giraudon, Vincent Gripon, IMT Atlantique, France; Matthias Löwe, University of Münster, Germany; Franck Vermet, University of Brest, France |
Session | MLSP-45: Performance Bounds |
Location | Gather.Town |
Session Time: | Friday, 11 June, 13:00 - 13:45 |
Presentation Time: | Friday, 11 June, 13:00 - 13:45 |
Presentation |
Poster
|
Topic |
Machine Learning for Signal Processing: [MLR-PERF] Bounds on performance |
IEEE Xplore Open Preview |
Click here to view in IEEE Xplore |
Virtual Presentation |
Click here to watch in the Virtual Conference |
Abstract |
Finding good measures of robustness -- i.e. the ability to correctly classify corrupted input signals -- of a trained classifier is an important question for sensitive practical applications. In this paper, we point out that averaging the radius of robustness of samples in a validation set is a statistically weak measure. We propose instead to weight the importance of samples depending on their difficulty. We motivate the proposed score by a theoretical case study using logistic regression. We also empirically demonstrate the ability of the proposed score to measure robustness of classifiers with little dependence on the choice of samples in more complex settings, including deep convolutional neural networks and real datasets. |