Scholar Looks to Improve Data Science for Analyzing the Language Used by African Americans

Su Lin Blodgett, a graduate student in computer science at the University of Massachusetts, recently presented a paper at the annual meeting of the Association of Computational Linguistics in Melbourne, Australia. Her research is focused on improving English language parsing tools relating to words, phrases, and alternate spellings used by millions of African Americans on social media.

Current Natural Language Processing (NLP) tools “learn” and are trained on mainstream American English, and as a result don’t perform well on Twitter, where text deviates from this standard in many ways, including non-standard spelling, punctuation, capitalization, syntax and hashtags, the authors point out. They add that dialects such as African-American English, spoken by millions of individuals, contain language features not present in standard English.

By expanding the linguistic coverage of NLP tools to include minority and colloquial dialects, the thoughts and ideas of more individuals and groups can be included in areas such as opinion and sentiment analysis, Blodgett points out. For example, if a political campaign were to use a standard NLP tool to analyze opinions on Twitter, but did not capture what African-Americans are saying, the tools could be missing a significant portion of the electorate and could vastly misinterpret overall sentiment.

Related Articles

Leave a Reply

Get the JBHE Weekly Bulletin

Receive our weekly email newsletter delivered to your inbox

Latest News

Three African Americans Appointed to New Academic Positions

Leon Prieto, Kofi Afrifah, and Andrea Moore have been appointed to new academic positions at Clayton University, Bowie State University, and Savannah State University, respectively.

Historic HBCU Landmark Revitalized Through National Park Service Grant

Through three restoration grants totaling $2 million, the Rosenwald Practice School and Principal House will be fully restored, becoming the new home for the Northeastern North Carolina African American Research and Cultural Heritage Institute.

Five Black Leaders Appointed to Administrative Positions

Here is this week’s roundup of African American who have been appointed to new administrative positions at colleges and universities throughout the United States. If you have news for our appointments section, please email the information to

North Carolina A&T University Establishes Research Partnership with Collins Aerospace

“There are direct relations to the research we do in the College of Engineering and the mission purpose of Collins Aerospace,” said Stephanie Luster-Teasley, interim dean of the College of Engineering at North Carolina A&T State University. “Being able to partner with Collins really gives our students the opportunities for hands-on research at each level – undergraduate and graduate.”

Featured Jobs