Chatbots' Political Party Recommendations Are Also Biased

Researchers at the University of Copenhagen examined the political bias of major chatbots including ChatGPT and Gemini.

Using a candidate test based on Denmark's 2022 general election, the tested models were generally positioned at the center or center-left, clustering near the Social Democrats and The Alternative.

In a virtual voter recommendation experiment, Red–Green Alliance, Moderates, and Liberal Alliance were over-recommended, while Conservative People's Party, Venstre, and Denmark Democrats were never presented as the top choice by some models.

The researchers pointed out that the opacity of the reasoning behind recommendations and the training data makes the results hard to verify, and that since many models rely on English-language, US-centric data, their accuracy regarding Danish politics may also be lacking. In conclusion, this serves as a warning that chatbots should not be used for election-related advice.