How do AI political biases differ between English and French?

2 Yannael 1 5/21/2025, 2:27:41 PM huggingface.co ↗

Comments (1)

Yannael · 7h ago
I put together a small interactive tool on Hugging Face Spaces that lets you compare the political compass of four models (OpenAI GPT-4o, DeepSeek DeepSeek-chat-v3-0324, X-ai Grok-beta, MistralAI Mistral-large-2411) on a set of 62 political questions.

The interface scores models along economic and social axes using political quiz data (Libertarian/Authoritarian, Left/Right), aiming to reproduce works like https://davidrozado.substack.com/p/new-results-of-state-of-t... or https://trackingai.org/political-test.

The purpose of the interface is more pedagogical (I do trainings on AI for the public at large) than political, and to offer a way to raise awareness about political biases between models or languages for non expert crowds.

It is still interesting though to observe how current state-of-the-art LLMs often lean left-of-center, and that some models (notably OpenAI's and DeepSeek's) seem to display _stronger left polarization_ when prompted in *French* as opposed to English.

The project is open-source on GitHub, and it should be easy to adapt it to other languages or even other ideological scales. Contributions or feedback welcome! https://github.com/Yannael/ai-political-bias