Skip to Main content Skip to Navigation
New interface
Conference papers

Leveraging Influence Functions for Dataset Exploration and Cleaning

Abstract : In this paper, we tackle the problem of finding potentially problematic samples and complex regions of the input space for large pools of data without any supervision, with the objective of being relayed to and validated by a domain expert. This information can be critical, as even a low level of noise in the dataset may severely bias the model through spurious correlations between unrelated samples, and under-represented groups of data-points will exacerbate this issue. As such, we present two practical applications of influence functions in neural network models to industrial use-cases: exploration and cleanup of mislabeled examples in datasets. This robust statistics tool allows us to approximately know how different an estimator might be if we slightly changed the training dataset. In particular, we apply this technique to an ACAS Xu neural network surrogate model use-case[14] for complex region exploration, and to the CIFAR-10 canonical RGB image classification problem[20] for mislabeled sample detection with promising results.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03617649
Contributor : Agustin Picard Connect in order to contact the contributor
Submitted on : Wednesday, March 23, 2022 - 3:46:30 PM
Last modification on : Tuesday, October 25, 2022 - 11:58:11 AM
Long-term archiving on: : Friday, June 24, 2022 - 7:42:45 PM

File

Leveraging_Influence_Functions...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03617649, version 1

Citation

Agustin Martin Picard, David Vigouroux, Petr Zamolodtchikov, Quentin Vincenot, Jean-Michel Loubes, et al.. Leveraging Influence Functions for Dataset Exploration and Cleaning. 11th European Congress Embedded Real Time Systems (ERTS 2022), Jun 2022, Toulouse, France. pp.1-8. ⟨hal-03617649⟩

Share

Metrics

Record views

244

Files downloads

184