Scholar Looks to Improve Data Science for Analyzing the Language Used by African Americans

Su Lin Blodgett, a graduate student in computer science at the University of Massachusetts, recently presented a paper at the annual meeting of the Association of Computational Linguistics in Melbourne, Australia. Her research is focused on improving English language parsing tools relating to words, phrases, and alternate spellings used by millions of African Americans on social media.

Current Natural Language Processing (NLP) tools “learn” and are trained on mainstream American English, and as a result don’t perform well on Twitter, where text deviates from this standard in many ways, including non-standard spelling, punctuation, capitalization, syntax and hashtags, the authors point out. They add that dialects such as African-American English, spoken by millions of individuals, contain language features not present in standard English.

By expanding the linguistic coverage of NLP tools to include minority and colloquial dialects, the thoughts and ideas of more individuals and groups can be included in areas such as opinion and sentiment analysis, Blodgett points out. For example, if a political campaign were to use a standard NLP tool to analyze opinions on Twitter, but did not capture what African-Americans are saying, the tools could be missing a significant portion of the electorate and could vastly misinterpret overall sentiment.

Related Articles

Leave a Reply

Get the JBHE Weekly Bulletin

Receive our weekly email newsletter delivered to your inbox

Latest News

Alcorn State University Recruited for Federal Student Pathway Program for Careers in Public Service

The Pathway Public Service Program was established in 2019 to develop the next generation of diverse, qualified, and motivated public health servants. Over the past five years, the program has hired over 100 student interns.

Five Black Scholars Selected for New Faculty Positions

The five Black scholars who aer taking on new roles are Khadene Harris at Rice University in Houston, Nakia Melecio at the Georgia Institute of Technology, Bettina Drake at Washington University in St. Louis, Arlette Ngoubene Atioky at Goucher College in Maryland, and Kandi Hill-Clarke at the University of Memphis.

Getty Images to Preserve Digital Photo Archives at Delaware State University

Currently, Delaware State University's photo archives contain thousands of photographs taken over the course of the university's 133 year history. Thanks to a new partnership with Getty Images, those images will be digitized and made available on

Porché Spence Recognized for Outstanding Commitment to Advancing Diversity in Ecology

Dr. Spence currently serves as an assistant professor of environmental studies at North Carolina A&T State University. Throughout her career, she has developed several educational programs geared towards introducing students of color to environmental science fields.

Featured Jobs