Angelie Kraft
Person
Angelie Kraft is an interdisciplinary researcher in the area of natural language processing and AI ethics with a training in computer science and psychology. As a fellow at the Weizenbaum Institute, she is working in the group "Digitalization and Opening up Science". In her project, she examines popular benchmarks that aim to measure the "knowledgeability" of large language models (LLMs). She analyzes these benchmarks with regards to their representativeness, assuming that they are biased and foster the optimization of language models towards the knowledge mainly relevant to a male, white and Western standard.
Angelie Kraft has been pursuing a PhD in Computer Science since October 2021 at University of Hamburg and has been working as a researcher at Leuphana University Lüneburg in the work group "Artifical Intelligence and Explainability". Her research focuses on the ethically relevant limitations of LLMs, particularly in relation to questions of fairness and factual fidelity. Her work shows that knowledge and knowledge bases are not objective and instead underrepresent the perspectives of marginalized groups. This can contribute to reinforcing existing power imbalances, as the knowledge of a dominant group in particular is perpetuated and disseminated by influential LLM technologies.
Positions at Weizenbaum Institut
Former Research Fellow
Research Group: Digitalization and Opening up Science
September and October 2024
Fields of research
Language models, factuality, bias & ethical harms
Publications
Selection
Angelie Kraft and Eloïse Soulier. 2024. Knowledge-Enhanced Language Models Are Not Bias-Proof: Situated Knowledge and Epistemic Injustice in AI. In Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency (FAccT '24). doi.org/10.1145/3630106.3658981
Angelie Kraft and Ricardo Usbeck. 2022. The Lifecycle of “Facts”: A Survey of Social Bias in Knowledge Graphs. In Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). aclanthology.org/2022.aacl-main.49