Social Bias

A Novel Method for Analysing Racial Bias: Collection of Person Level References
A person-based method for longitudinal analysis of racial representation and implicit bias in books.
Muhammed Yusuf Kocyigit, Anietie Andy, Derry Tanti Wijaya
Challenges in Measuring Bias via Open-Ended Language Generation
Why open-ended bias measurements can contradict one another, and how to report them more reliably.
Afra Feyza Akyurek, Muhammed Yusuf Kocyigit, Sejin Paik, Derry Tanti Wijaya
On Measuring Social Biases in Prompt-Based Multi-Task Learning
Semantically equivalent input formats can expose substantially different levels of social bias in prompt-trained models.
Afra Feyza Akyurek, Sejin Paik, Muhammed Yusuf Kocyigit, Seda Akbiyik, Serife Leman Runyun, Derry Tanti Wijaya