Fair EVA
Fairness EVAluation of Voice Technologies
Project Mission
Fair EVA is an open source project that is gathering resources and building tools
to help researchers and developers, technology activists and voice technology users
evaluate and audit bias and discrimination in voice technologies.
Enabled through the Mozilla Technology Fund Award!
We are proud to be part of Mozilla's first cohort of projects supported with a Mozilla Technology Fund Award.
News and Updates
The bt4vt library has been released!
After a year of hard work, the bias tests for voice tech python library is ready with bias evaluations for speaker verification. Check it out: https://github.com/wiebket/bt4vt
Dataset Audit: read the preprint
We have published the results of our dataset audit. Read it here: About Voice: A Longitudinal Study of Speaker Recognition Dataset Dynamics
INTERSPEECH '22: Design Guidelines for Speaker Verification Evaluation
We have published a technical analysis of design considerations for robust and inclusive speaker verification evaluation. Read it here: Design Guidelines for Inclusive Speaker Verification Evaluation Datasets
The Proposed EU AI Act and The Case of Biometrics
Fair EVA project lead, Wiebke Hutiri, shares her perspectives on voice biometrics and the proposed EU AI Act in the Mozilla Blog. Read it here: The Proposed EU AI Act and The Case of Biometrics
Presentation to the European Association on Biometrics (EAB)
The EAB invited us to present our work on voice recognition at the Artificial Intelligence Act Workshop 2022.
We'll be at ACM FAcct 2022 in Korea
The research that forms the foundation of the Fair EVA project will be presented at the ACM FAccT 2022 conference. Take a look:
Bias in Automated Speaker Recognition
Fair EVA Featured on the Mozilla Blog
Read more about Fair EVA and why we exist in this blog post: Access Denied! This Doesn’t Sound Like You
Seen at virtual MozFest 2022
We hosted a session on Fair Voice: What happens when your voice becomes your ID? at MozFest 2022, with panelists Halsey Burgund, Johann Diedrick, Kathleen Siminyu and Wiebke Toussaint Hutiri.