{"id":32662,"date":"2025-04-14T16:24:17","date_gmt":"2025-04-14T14:24:17","guid":{"rendered":"https:\/\/www.codemotion.com\/magazine\/?p=32662"},"modified":"2025-04-14T16:24:18","modified_gmt":"2025-04-14T14:24:18","slug":"the-hidden-cost-of-ai-and-why-it-matters","status":"publish","type":"post","link":"https:\/\/www.codemotion.com\/magazine\/ai-ml\/the-hidden-cost-of-ai-and-why-it-matters\/","title":{"rendered":"The hidden cost of AI \u2013 and why it matters"},"content":{"rendered":"\n

\u201cCreate an image of what you think I look like based on what you know about me.\u201d<\/p>\n\n\n\n

The internet is flooded with AI-generated portraits\u2014some cartoon-like, some flesh-made\u2014of people’s appearances, often accompanied by comments on how little resemblance these pictures bear to their original subjects.\u200b<\/p>\n\n\n\n

My output was a not-so-good-looking male, which made me raise an eyebrow. How can ChatGPT not do a better job with all the information I provided? It should know I’m a woman, at the very least.\u200b<\/em><\/p>\n\n\n\n

Scrolling through LinkedIn, I stumbled upon a fellow female sharing the same sentiment. LLMs are biased toward male input and, therefore, are more likely to assume you’re male by default.<\/p>\n\n\n\n

It made me question. The technology that is being pitched as revolutionary, intuitive, and borderline human still leans into a worldview that is stubbornly unbalanced.\u200b<\/p>\n\n\n\n

The gender biases of Large Language Models (among others)<\/strong><\/h2>\n\n\n\n

Bias in AI isn’t new, but it takes on new shades when it shows up in tools millions of people interact with daily. The training data behind LLMs is vast and indiscriminate\u2014scraped from blogs, forums, news sites, Reddit threads, Wikipedia pages, and more. Unsurprisingly, this means the biases baked into our digital spaces are inherited and amplified by these models.\u200b<\/p>\n\n\n\n

Statistically, male perspectives dominate the online space. From the way questions are phrased to the examples provided, the model is simply reflecting its environment. That’s not an excuse\u2014it’s the root of the problem. If LLMs are being designed to assist, inform, and interact with humans of all kinds, their assumptions shouldn’t be shaped so strongly by one demographic’s voice.\u200b<\/p>\n\n\n\n

Research supports this observation. A study by University College London<\/a> found clear evidence of bias against women in content generated by several LLMs. Female names were strongly associated with words such as \u201cfamily,\u201d \u201cchildren,\u201d and \u201chusband,\u201d conforming to traditional gender roles. In contrast, male names were more likely linked<\/a> to terms like \u201ccareer,\u201d \u201cexecutives,\u201d \u201cmanagement,\u201d and \u201cbusiness\u201d.<\/p>\n\n\n\n

When technology that’s meant to serve a global population defaults to calling women \u201che,\u201d or assumes doctors are men and nurses are women, we’re not dealing with a futuristic tool. We’re just seeing old patterns dressed up in new code.\u200b<\/p>\n\n\n\n

Misinformation dressed as authority<\/strong><\/h2>\n\n\n\n

Then comes the issue of authority<\/a>. Because LLMs communicate in clean, confident prose, their outputs are often taken at face value\u2014even when they’re dangerously wrong.\u200b<\/p>\n\n\n\n

People turn to these tools for medical advice, legal information, and educational content. But unlike a professional with credentials, an LLM doesn’t \u201cknow\u201d anything<\/strong>. It patterns its answers from the statistical likelihood of certain word combinations appearing together.\u200b<\/p>\n\n\n\n

This makes them incredibly useful for drafting emails or brainstorming, but dangerously misleading when users assume factual correctness. When the tone is persuasive, but the content is flawed, who carries the responsibility for the fallout?\u200b<\/p>\n\n\n\n

Consider the case of Arve Hjalmar Holmen<\/a>, a Norwegian man who filed a complaint against OpenAI after ChatGPT falsely claimed he had murdered his two sons. ChatGPT’s fabricated response not only defamed Holmen but also highlighted the potential for AI to disseminate harmful misinformation.<\/p>\n\n\n\n

Similarly, during the 2024 U.S. elections, ChatGPT provided incorrect answers to questions about voting procedures in battleground states, raising concerns about the spread of misinformation<\/a> in critical democratic processes.<\/p>\n\n\n\n

Even seemingly harmless errors can have a compounding effect. For example, in academic settings, students using LLMs to research or summarize topics may unknowingly build essays on flawed foundations. When citations are invented, facts misrepresented, or nuance lost, the resulting output isn\u2019t just inaccurate; it\u2019s misleading in a way that feels trustworthy.<\/p>\n\n\n\n

The polished tone is part of the issue. It encourages trust where caution is needed. The more these tools are deployed in consumer-facing contexts, the more urgent it becomes to treat their content not as authoritative, but as drafts or suggestions, not truths.<\/p>\n\n\n\n

Privacy concerns: Your data isn’t as private as you think<\/strong><\/h2>\n\n\n\n

Conversations with LLMs can feel oddly intimate, but let’s not forget: interacting with these tools means feeding them your data. And while companies claim your inputs aren’t stored\u2014or are anonymized\u2014what \u201canonymized\u201d means in practice is often vague and difficult to audit.\u200b<\/p>\n\n\n\n

There are gray zones, especially in workplace applications or customer support tools powered by AI. If you type in sensitive personal or financial information, where does it go? Who sees it? Can it resurface later?\u200b<\/p>\n\n\n\n

The line between user input and training data is blurry. And it should make us all a bit uncomfortable.\u200b<\/p>\n\n\n\n

A blog post<\/a> by Sentra highlights that LLMs can be configured to allow users to provide inputs that may contain sensitive information. If these inputs are not adequately filtered or sanitized, they can be incorporated into the LLM’s training data, potentially leading to the disclosure of sensitive information.<\/p>\n\n\n\n

Moreover, discussions on platforms like Reddit<\/a> reveal growing concerns about privacy when using AI models. Users worry that everything inputted into an LLM might be stored and potentially exposed during data leaks or subpoenas.<\/p>\n\n\n\n

And as governments and regulatory bodies struggle to catch up, users are left navigating a minefield of terms and conditions that few truly understand. It raises the question: should we really have to think twice before asking a virtual assistant a personal question?<\/p>\n\n\n\n

So where do we go from here?<\/strong><\/h2>\n\n\n\n

We can’t uninvent <\/em>LLMs. They’re here, and they’re only getting more embedded into the tools we use and the systems that govern our daily lives. The question is not whether we move forward, but how.\u200b<\/p>\n\n\n\n

Some potential steps we can take to create better technology:<\/p>\n\n\n\n