{"id":15722,"date":"2025-08-20T18:47:08","date_gmt":"2025-08-20T08:47:08","guid":{"rendered":"https:\/\/rationalemagazine.com\/?p=15722"},"modified":"2025-08-20T18:47:08","modified_gmt":"2025-08-20T08:47:08","slug":"its-fantasy-to-think-ai-can-be-free-from-bias-and-ideology","status":"publish","type":"post","link":"https:\/\/rationalemagazine.com\/index.php\/2025\/08\/20\/its-fantasy-to-think-ai-can-be-free-from-bias-and-ideology\/","title":{"rendered":"It&#8217;s fantasy to think AI can be free from bias and ideology"},"content":{"rendered":"<p>In July, the United States government\u00a0<a href=\"https:\/\/www.ai.gov\/action-plan\">made it clear<\/a>\u00a0that artificial intelligence (AI) companies wanting to do business with the White House will need to ensure their AI systems are \u201cobjective and free from top-down ideological bias\u201d.<\/p>\n<p>In\u00a0<a href=\"https:\/\/www.whitehouse.gov\/presidential-actions\/2025\/07\/preventing-woke-ai-in-the-federal-government\">an executive order<\/a>\u00a0on \u201cpreventing woke AI in the federal government\u201d, President Donald Trump refers to diversity, equity and inclusion (DEI) initiatives as an example of a biased ideology.<\/p>\n<p>The apparent contradiction of calling for unbiased AI while also dictating how AI models should discuss DEI shows the notion of ideologically free AI is a fantasy.<\/p>\n<p><a href=\"https:\/\/doi.org\/10.3390\/socsci12030148\">Multiple<\/a>\u00a0<a href=\"https:\/\/doi.org\/10.1371\/journal.pone.0306621\">studies<\/a>\u00a0have shown most language models skew their responses to left-of-centre viewpoints, such as\u00a0<a href=\"https:\/\/arxiv.org\/abs\/2301.01768\">imposing taxes on flights, restricting rent increases, and legalising abortion<\/a>.<\/p>\n<p>Chinese chatbots such as DeepSeek, Qwen and others\u00a0<a href=\"https:\/\/www.theguardian.com\/technology\/2025\/jan\/28\/chinese-ai-chatbot-deepseek-censors-itself-in-realtime-users-report\">censor information<\/a>\u00a0on the events of\u00a0<a href=\"https:\/\/www.theguardian.com\/technology\/2025\/jan\/28\/we-tried-out-deepseek-it-works-well-until-we-asked-it-about-tiananmen-square-and-taiwan\">Tiananmen Square<\/a>, the\u00a0<a href=\"https:\/\/www.newsguardtech.com\/special-reports\/chinese-ai-models-60-percent-fail-rate-pro-china-claims\/\">political status of Taiwan<\/a>, and\u00a0<a href=\"https:\/\/www.independent.co.uk\/asia\/china\/deepseek-ai-china-uyghur-genocide-b2697425.html\">the persecution of Uyghurs<\/a>, aligning with the official position of the Chinese government.<\/p>\n<p>AI models are not politically neutral nor free from bias. More importantly, it may not even be possible for them to be unbiased. Throughout history, attempts to organise information have shown that one person\u2019s objective truth is another\u2019s ideological bias.<\/p>\n<p>Humans struggle to organise information about the world without distorting reality.<\/p>\n<p>Take cartography, for example. We might expect maps to be objective \u2013 after all, they reflect the natural world. But flattening a globe onto a two-dimensional map means having to distort it somehow. American geographer Mark Monmonier\u00a0<a href=\"https:\/\/open.lib.umn.edu\/mapping\/chapter\/7-lying-with-maps\/\">has famously argued<\/a>\u00a0maps necessarily lie, distort reality, and can be tools for political propaganda.<\/p>\n<p>Think of the classic world map that uses\u00a0<a href=\"https:\/\/www.britannica.com\/science\/Mercator-projection\">the Mercator projection<\/a>, hung in every primary school classroom. It converts the globe into a cylinder and then lays it flat. I grew up thinking Greenland must be massive compared to the rest of the world.<\/p>\n<p>In fact,\u00a0<a href=\"https:\/\/www.nature.com\/nature-index\/news\/data-visualisation-animated-map-mercater-projection-true-size-countries\">Africa is 14 times larger than Greenland<\/a>, despite appearing to be roughly the same size on this type of map.<\/p>\n<p>In the 1970s,\u00a0<a href=\"https:\/\/ideas.time.com\/2013\/11\/21\/a-history-of-the-world-in-twelve-maps\/slide\/arno-peters-world-map-1973\/\">German historian Arno Peters argued<\/a>\u00a0Mercator\u2019s distortions\u00a0<a href=\"https:\/\/borgenproject.org\/map-bias\/\">contributed to a skewed perception<\/a>\u00a0of the inferiority of the global south.<\/p>\n<p>Such distortions could be an analogy for the current state of AI. As Monmonier wrote in his book\u00a0<em><a href=\"https:\/\/www.google.com.au\/books\/edition\/How_to_Lie_with_Maps_Third_Edition\/XPSnswEACAAJ?hl=en\">How To Lie With Maps<\/a><\/em>: &#8220;a single map is but one of an indefinitely large number of maps that might be produced for the same situation or from the same data.&#8221;<\/p>\n<p>Similarly, a single large language model\u2019s response is one of an indefinitely large number of responses which might be produced for the same situation or from the same data.<\/p>\n<p>Think of the many ways a chatbot could formulate a response\u00a0<a href=\"https:\/\/theconversation.com\/what-makes-a-good-ai-prompt-here-are-4-expert-tips-260502\">when prompted<\/a>\u00a0about something like diversity, equity and inclusion.<\/p>\n<p>Other historic attempts at organising information have shown the bias of their designers and users too.<\/p>\n<p>The widely used Dewey decimal classification (DDC) system for libraries, published in 1876, has been known to be\u00a0<a href=\"https:\/\/bookriot.com\/racism-in-the-dewey-decimal-system\/\">racist<\/a>\u00a0and\u00a0<a href=\"https:\/\/overland.org.au\/2015\/07\/a-brief-history-of-homophobia-in-dewey-decimal-classification\/\">homophobic<\/a>.<\/p>\n<blockquote><p><strong>Throughout history, attempts to organise information have shown that one person\u2019s objective truth is another\u2019s ideological bias.<\/strong><\/p><\/blockquote>\n<p>Over the course of the 20th century,\u00a0<a href=\"https:\/\/www.stonewall.org.uk\/news\/silence-library-finding-lgbt-stories-library-catalogue\">LGBTQIA+ books have been categorised<\/a>\u00a0under Mental Derangements, Neurological Disorders, or Social Problems in the DDC, with more recent efforts being made to\u00a0<a href=\"https:\/\/ddc.typepad.com\/025431\/2018\/11\/updates-for-lgbt-community-and-transgender-people.html\">eliminate outdated and derogatory terms<\/a>\u00a0from the classification.<\/p>\n<p>Under Religion, roughly <a href=\"https:\/\/ddc.typepad.com\/025431\/2019\/11\/why-are-the-200s-so-heavily-focused-on-christianity-an-explainer.html\">65 sections out of 100 are dedicated to Christianity<\/a>\u00a0because the library where the classification was originally developed had a strong focus on Christianity. While\u00a0<a href=\"https:\/\/www.pewresearch.org\/religion\/2025\/06\/09\/how-the-global-religious-landscape-changed-from-2010-to-2020\/\">Islam has an estimated 2 billion followers<\/a>\u00a0to Christianity\u2019s 2.3 billion today, in the DDC Islam only has a single section dedicated to it.<\/p>\n<p>The large language models that power AI chatbots are trained on countless pieces of text, from historical works of literature to online discussion forums. Biases from these texts can unknowingly creep into the model,\u00a0<a href=\"https:\/\/doi.org\/10.1038\/s41586-024-07856-5\">such as negative stereotypes of African Americans from the 1930s<\/a>.<\/p>\n<p>Just having raw information is not enough. Language models must be trained how to retrieve and present this information in their answers.<\/p>\n<p>One way to do this is to have them\u00a0<a href=\"https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/hash\/b1efde53be364a73914f58805a001731-Abstract-Conference.html\">learn to copy how humans respond to questions<\/a>. This process does make them more useful, but studies have found it also makes them align\u00a0<a href=\"https:\/\/www.anthropic.com\/research\/towards-understanding-sycophancy-in-language-models\">with the beliefs<\/a>\u00a0of those\u00a0<a href=\"https:\/\/arxiv.org\/abs\/2212.09251\">who are training them<\/a>.<\/p>\n<p>AI chatbots also use system prompts: instructions that tell them how to act. These system prompts are, of course, defined by human developers.<\/p>\n<p>For example, the system prompts for Grok, the AI chatbot developed by Elon Musk\u2019s company xAI,\u00a0<a href=\"https:\/\/fortune.com\/2025\/07\/08\/elon-musk-grok-ai-conservative-bias-system-prompt\/\">reportedly instruct it to<\/a>\u00a0\u201cassume subjective viewpoints sourced from the media are biased\u201d and to not \u201cshy away from making claims that are politically incorrect, as long as they are well substantiated\u201d.<\/p>\n<p>Musk launched Grok to\u00a0<a href=\"https:\/\/theconversation.com\/how-elon-musks-chatbot-grok-could-be-helping-bring-about-an-era-of-techno-fascism-261449\">counter his perceived \u201cliberal bias\u201d<\/a>\u00a0of other products such as ChatGPT. However, the recent fallout when Grok\u00a0<a href=\"https:\/\/theconversation.com\/how-do-you-stop-an-ai-model-turning-nazi-what-the-grok-drama-reveals-about-ai-training-261001\">started spouting anti-semitic rhetoric<\/a>\u00a0clearly illustrates that attempts to correct for bias necessarily replace it with\u00a0<a href=\"https:\/\/doi.org\/10.1007\/s13347-025-00928-y\">a different kind of bias<\/a>.<\/p>\n<p>All this goes to show that for all their innovation and wizardry, AI language models suffer from a centuries-old problem. Organising and presenting information is not only an attempt to reflect reality, it is a projection of a worldview.<\/p>\n<p>For users, understanding whose worldview these models represent is just as important as knowing who draws the lines on a map.<\/p>\n<p>&nbsp;<\/p>\n<p><em><strong>This article was originally published in <\/strong><\/em><a href=\"https:\/\/theconversation.com\/ai-free-from-bias-and-ideology-is-a-fantasy-humans-cant-organise-data-without-distorting-reality-262523\"><strong>The Conversation<\/strong><\/a><em><strong>.<\/strong><\/em><\/p>\n<p><em><strong>Photo by <a href=\"https:\/\/unsplash.com\/photos\/a-hand-holds-a-smartphone-with-various-apps-P5sGqNT_Aj8\">Aerps.com <\/a><\/strong><\/em><em><strong>on Unsplash.<\/strong><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In July, the United States government\u00a0made it clear\u00a0that artificial intelligence (AI) companies wanting to do business with the White House<\/p>\n","protected":false},"author":838,"featured_media":15729,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[65],"tags":[562],"coauthors":[797],"class_list":["post-15722","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-science-health","tag-artificial-intelligence"],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/posts\/15722","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/users\/838"}],"replies":[{"embeddable":true,"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/comments?post=15722"}],"version-history":[{"count":4,"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/posts\/15722\/revisions"}],"predecessor-version":[{"id":15728,"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/posts\/15722\/revisions\/15728"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/media\/15729"}],"wp:attachment":[{"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/media?parent=15722"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/categories?post=15722"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/tags?post=15722"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/rationalemagazine.com\/index.php\/wp-json\/wp\/v2\/coauthors?post=15722"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}