Axe 3: Apprentissage statistique au service d’une prise de décision fiable et robuste

Jean-Rémy Conti / Nathan Noiry (PhD financé par CIFRE et postdoc par la Chaire): Learning an Ethical Module for Bias Mitigation of pre-trained Models (ICML paper)

Abstract: In spite of the high performance and reliability of deep learning algorithms in broad range everyday applications, many investigations tend to show that a lot of models exhibit biases, discriminating against some subgroups of the population. This urges the practitioner to develop fair systems whose performances are uniform among individuals. In this work, we propose a post-processing method designed to mitigate bias of state-of-the-art models. It consists in learning a shallow neural network, called the Ethical Module, which transforms the deep embeddings of a pre-trained model in order to give more representation power to the disadvantaged subgroups. Its training is supervised by the von Mises-Fisher loss, whose hyperparameters allow to control the space allocated to each subgroup in the latent space. Besides being very simple, the resulting methodology is more stable and faster than most current bias mitigation methods. In order to illustrate our idea in a concrete use case, we focus here on gender bias in facial recognition and conduct extensive numerical experiments on standard datasets.
Keywords: Deep Learning, Bias, Fairness, Facial Recognition.

Voir le support de présentation