MIT Scholar Finds Racial Bias in Commercial Facial Analysis Programs

A new study by researchers at the Massachusetts Institute or Technology and Stanford University finds that commercially released facial analysis programs demonstrate both skin-type and gender biases.

The study found that  the computer programs had a very low error rate when determining the gender of light-skinned men. But one program had an error rate of 20 percent in determining the gender of dark-skinned women. The other two programs had an error rate of more than 34 percent when asked to identify the gender of dark-skinned women. For women who had the darkest skin, the systems failed to accurately determine their gender nearly half the time.

The findings raise questions about how today’s neural networks, which learn to perform computational tasks by looking for patterns in huge data sets, are trained and evaluated. Joy Buolamwini, a researcher in the MIT Media Lab states that “what’s important here is the method and how that method applies to other applications. The same data-centric techniques that can be used to try to determine somebody’s gender are also used to identify a person when you’re looking for a criminal suspect.”

Buolamwini is a graduate of the Georgia Institute of Technology, where she majored in computer science. She earned a master’s degree at the University of Oxford as a Rhodes Scholar and is currently at work on a Ph.D. at MIT.

A video about the research can be viewed below.

Related Articles

1 COMMENT

  1. I found this video informative, but not surprising. I used to be a TV associate Producer many years ago and one of the problems in newly integrated stations was making sure the color balance showed dark skinned reporters to their advantage.

    Inexperienced white photographers sometimes did an entire news report with the reporter as a featureless sillohette because they had not balanced the color on their camera.

    Years have passed and now I am a Senior Lecturer in France where I teach English and do LanguageTesting.

    I was surprised by the new ETS (TOEIC, TOEFL…) rule that you must photograph test candidates on a light background which of course would make dark skinned people unrecognizable given the poor quality of the cameras.

    Am I correct in thinking that based on what you have said about present technology based décisions, the making of this regulation stems from ignorance?

Leave a Reply

Get the JBHE Weekly Bulletin

Receive our weekly email newsletter delivered to your inbox

Latest News

AI Teaching Assistants Are Coming to Morehouse College

The AI teaching assistant initiative aims to provide students with an office hours setting they can access at any time, even when their professor is unavailable. Over the next three to five years, Morehouse hopes to establish an AI teaching assistant for every professor at the college.

Five African American Scholars Appointed to New Faculty Positions

The new faculty appointments are Judith Byfield at Cornell University, Nikki Hoskins at Harvard University, Edda Fields-Black at Carnegie Mellon Universityin Pittsburgh, Shawn Utsey at Virginia Commonwealth University, and Gwendolyn DuBois Shaw at the University of Pennsylvania.

Wiley University Launches New Honors College for Fall 2024 Semester

The Heman Sweatt Honors College will provide students with access to a dedicated living community, specialized classes and research opportunities, faculty mentors, and financial aid for tuition, internships, and study abroad experiences.

Two Black Historians in Higher Education Receive Prestigious Dan David Prize

Keisha Blain of Brown University and Cécile Fromont of Harvard University have received 2024 Dan David Prizes for their outstanding achievements as academic historians.

Featured Jobs