Measurement of Social Bias Fairness Metrics in NLP Models

In recent times, text-generation-based models have become more popular than ever. With the introduction of ChatGPT and similar models, the population has been using the NLP models daily. However, the use cases for NLP models are not limited to text generation; they include sentiment analysis, keyword extraction, named entity recognition, and more. These use cases predate the popularity of text generation models. Despite its popularity, bias can still exist in NLP model algorithms. According to the paper by <a href="https://arxiv.org/pdf/2202.08176.pdf" rel="noopener ugc nofollow" target="_blank">Pagano et al. (2022)</a>, machine learning models inherently need to consider the bias constraints of the algorithms. However, achieving full transparency is a huge challenge, especially considering the millions of parameters used by the model. <a href="https://medium.com/datadriveninvestor/measurement-of-social-bias-fairness-metrics-in-nlp-models-a55769f0f685">Read More</a>