Fair EVA

Fairness EVAluation of Voice Technologies

Project Mission

Fair EVA is an open source project that is gathering resources and building tools
to help researchers and developers, technology activists and voice technology users
evaluate and audit bias and discrimination in voice technologies.

Enabled through the Mozilla Technology Fund Award!

We are proud to be part of Mozilla's first cohort of projects supported with a Mozilla Technology Fund Award.

News and Updates

We are at IEEE IJCB '23

to present Benchmark Dataset Dynamics, Bias and Privacy Challenges in Voice Biometrics Research

Research Summary

Our research on bias and privacy challenges in voice biometrics has been featured on the Montreal AI Ethics Blog.

Featured on Channel 4 News

How to we prevent AI from creating deepfakes? Wiebke weighs in on this question on Channel 4 News. Take a look.

The Computer Says Nah

Michaela and Anna are premiering a XR Prediction experience inspired by FairEVA in NYC. The Tale False Negative or The Computer Says Nah. Check it out!

The bt4vt library has been released!

After a year of hard work, the bias tests for voice tech python library is ready with bias evaluations for speaker verification. Check it out: https://github.com/wiebket/bt4vt

Dataset Audit: read the preprint

We have published the results of our dataset audit. Read it here: About Voice: A Longitudinal Study of Speaker Recognition Dataset Dynamics

INTERSPEECH '22: Design Guidelines for Speaker Verification Evaluation

We have published a technical analysis of design considerations for robust and inclusive speaker verification evaluation. Read it here: Design Guidelines for Inclusive Speaker Verification Evaluation Datasets

The Proposed EU AI Act and The Case of Biometrics

Fair EVA project lead, Wiebke Hutiri, shares her perspectives on voice biometrics and the proposed EU AI Act in the Mozilla Blog. Read it here: The Proposed EU AI Act and The Case of Biometrics

Presentation to the European Association on Biometrics (EAB)

The EAB invited us to present our work on voice recognition at the Artificial Intelligence Act Workshop 2022.

We're at ACM FAcct 2022 in Korea

The research that forms the foundation of FairEVA will be presented at the ACM FAccT 2022 conference. Take a read:
Bias in Automated Speaker Recognition

Fair EVA Featured on the Mozilla Blog

Read more about Fair EVA and why we exist in this blog post: Access Denied! This Doesn’t Sound Like You

Seen at virtual MozFest 2022

We hosted a session on Fair Voice: What happens when your voice becomes your ID? at MozFest 2022, with panelists Halsey Burgund, Johann Diedrick, Kathleen Siminyu and Wiebke Hutiri.

Page updated

Google Sites

Report abuse