Gender Bias in Large Language Models
Fascinating, but not surprising. We found that both GPT-3.5 and GPT-4 are strongly biased, even though GPT-4 has a slightly higher accuracy for both types of questions. GPT-3.5 is 2.8 times more likely to answer anti-stereotypical questions incorrectly than stereotypical ones (34% incorrect vs. 12%), and GPT-4 is 3.2 times more likely (26% incorrect vs 8%). An important thing to keep in mind is that Large Language Models like ChatGPT are not magic; they train on datasets which were created previously by humans. And humans have biases. And those biases are repeated in the outputs of the LLM. ...