AI has potential to revolutionise health care – but we must first confront the risk of algorithmic bias

Mangor Pedersen, Auckland University of Technology

Artificial Intelligence (AI) is moving fast and will become an important support tool in clinical care. Research suggests AI algorithms can accurately detect melanomas and predict future breast cancers.

But before AI can be integrated into routine clinical use, we must address the challenge of algorithmic bias. AI algorithms may have inherent biases that could lead to discrimination and privacy issues. AI systems could also be making decisions without the required oversight or human input.

An example of the potentially harmful effects of AI comes from an international project which aims to use AI to save lives by developing breakthrough medical treatments. In an experiment, the team reversed their “good” AI model to create options for a new AI model to do “harm”.

In less than six hours of training, the reversed AI algorithm generated tens of thousands of potential chemical warfare agents, with many more dangerous than current warfare agents. This is an extreme example concerning chemical compounds, but it serves as a wake-up call to evaluate AI’s known and conceivably unknowable ethical consequences.

AI in clinical care

In medicine, we deal with people’s most private data and often life-changing decisions. Robust AI ethics frameworks are imperative.

The Australian Epilepsy Project aims to improve people’s lives and make clinical care more widely available. Based on advanced brain imaging, genetic and cognitive information from thousands of people with epilepsy, we plan to use AI to answer currently unanswerable questions.

Will this person’s seizures continue? Which medicine is most effective? Is brain surgery a viable treatment option? These are fundamental questions that modern medicine struggles to address.

As the AI lead of this project, my main concern is that AI is moving fast and regulatory oversight is minimal. These issues are why we recently established an ethical framework for using AI as a clinical support tool. This framework intends to ensure our AI technologies are open, safe and trustworthy, while fostering inclusivity and fairness in clinical care.

So how do we implement AI ethics in medicine to reduce bias and retain control over algorithms? The computer science principle “garbage in, garbage out” applies to AI. Suppose we collect biased data from small samples. Our AI algorithms will likely be biased and not replicable in another clinical setting.

Examples of biases are not hard to find in contemporary AI models. Popular large language models (ChatGPT for example) and latent diffusion models (DALL-E and Stable Diffusion) show how explicit biases regarding gender, ethnicity and socioeconomic status can occur.

Researchers found that simple user prompts generate images perpetuating ethnic, gendered and class stereotypes. For example, a prompt for a doctor generates mostly images of male doctors, which is inconsistent with reality as about half of all doctors in OECD countries are female.

Safe implementation of medical AI

The solution to preventing bias and discrimination is not trivial. Enabling health equality and fostering inclusivity in clinical studies are likely among the primary solutions to combating biases in medical AI.

Encouragingly, the US Food and Drug Administration recently proposed making diversity mandatory in clinical trials. This proposal represents a move towards less biased and community-based clinical studies.

Another obstacle to progress is limited research funding. AI algorithms typically require substantial amounts of data, which can be expensive. It is crucial to establish enhanced funding mechanisms that provide researchers with the necessary resources to gather clinically relevant data appropriate for AI applications.

We also argue we should always know the inner workings of AI algorithms and understand how they reach their conclusions and recommendations. This concept is often referred to as “explainability” in AI. It relates to the idea that humans and machines must work together for optimal results.

We prefer to view the implementation of prediction in models as “augmented” rather than “artificial” intelligence – algorithms should be part of the process and the medical professions must remain in control of the decision making.

In addition to encouraging the use of explainable algorithms, we support transparent and open science. Scientists should publish details of AI models and their methodology to enhance transparency and reproducibility.

What do we need in Aotearoa New Zealand to ensure the safe implementation of AI in medical care? AI ethics concerns are primarily led by experts within the field. However, targeted AI regulations, such as the EU-based Artificial Intelligence Act have been proposed, addressing these ethical considerations.

The European AI law is welcomed and will protect people working within “safe AI”. The UK government recently released their proactive approach to AI regulation, serving as a blueprint for other government responses to AI safety.

In Aotearoa, we argue for adopting a proactive rather than reactive stance to AI safety. It will establish an ethical framework for using AI in clinical care and other fields, yielding interpretable, secure and unbiased AI. Consequently, our confidence will grow that this powerful technology benefits society while safeguarding it from harm.

Mangor Pedersen, Associate Professor of Psychology and Neuroscience, Auckland University of Technology

This article is republished from The Conversation under a Creative Commons license. Read the original article.

Similar Posts

81 Comments

  1. Hi Neat post Theres an issue together with your web site in internet explorer may test this IE still is the marketplace chief and a good component of people will pass over your fantastic writing due to this problem

  2. My brother suggested I might like this blog He was totally right This post actually made my day You can not imagine simply how much time I had spent for this info Thanks

  3. I have been browsing online more than three hours today yet I never found any interesting article like yours It is pretty worth enough for me In my view if all website owners and bloggers made good content as you did the internet will be a lot more useful than ever before

  4. Its like you read my mind You appear to know a lot about this like you wrote the book in it or something I think that you could do with some pics to drive the message home a little bit but instead of that this is fantastic blog An excellent read I will certainly be back

  5. I have read some excellent stuff here Definitely value bookmarking for revisiting I wonder how much effort you put to make the sort of excellent informative website

  6. Attractive section of content I just stumbled upon your blog and in accession capital to assert that I get actually enjoyed account your blog posts Anyway I will be subscribing to your augment and even I achievement you access consistently fast

  7. Hi my family member I want to say that this post is awesome nice written and come with approximately all significant infos I would like to peer extra posts like this

  8. Hey there You have done a fantastic job I will certainly digg it and personally recommend to my friends Im confident theyll be benefited from this site

  9. Somebody essentially lend a hand to make significantly articles Id state That is the very first time I frequented your website page and up to now I surprised with the research you made to make this actual submit amazing Wonderful task

  10. Usually I do not read article on blogs however I would like to say that this writeup very compelled me to take a look at and do so Your writing taste has been amazed me Thanks quite nice post

  11. Thanks I have recently been looking for info about this subject for a while and yours is the greatest I have discovered so far However what in regards to the bottom line Are you certain in regards to the supply

  12. Thank you for your sharing. I am worried that I lack creative ideas. It is your article that makes me full of hope. Thank you. But, I have a question, can you help me?

  13. Wow, amazing weblog format! How lengthy have you been blogging for?

    you made running a blog look easy. The entire look of your
    website is great, as well as the content material! You can see similar here dobry sklep

  14. Thank you for your sharing. I am worried that I lack creative ideas. It is your article that makes me full of hope. Thank you. But, I have a question, can you help me?

  15. Howdy! Do you know if they make any plugins to assist with Search Engine Optimization? I’m
    trying to get my blog to rank for some targeted keywords but I’m not seeing very good
    results. If you know of any please share. Appreciate it!

    You can read similar article here: Sklep online

  16. Hello! Do you know if they make any plugins to
    help with Search Engine Optimization? I’m trying to
    get my blog to rank for some targeted keywords but I’m not seeing very good gains.
    If you know of any please share. Kudos! You can read similar art here:
    Sklep internetowy

  17. Hello there! Do you know if they make any plugins to
    assist with SEO? I’m trying to get my blog to rank for some targeted keywords but I’m not seeing very
    good results. If you know of any please share. Appreciate it!
    You can read similar article here: Najlepszy sklep

  18. Hi i think that i saw you visited my web site thus i came to Return the favore Im attempting to find things to enhance my siteI suppose its ok to use a few of your ideas

  19. Good day! Do you know if they make any plugins to assist with SEO?
    I’m trying to get my blog to rank for some targeted keywords
    but I’m not seeing very good success. If you know of any
    please share. Thanks! You can read similar art here: GSA Verified List

  20. Hey! Do you know if they make any plugins to assist with SEO?
    I’m trying to get my site to rank for some targeted keywords but I’m not seeing very good results.
    If you know of any please share. Thanks! You can read similar text here: List of Backlinks

  21. Hello! Do you know if they make any plugins to help with Search Engine Optimization? I’m trying to
    get my site to rank for some targeted keywords but I’m not seeing very good gains.
    If you know of any please share. Many thanks! I saw similar
    blog here: List of Backlinks

  22. My brother suggested I might like this website He was totally right This post actually made my day You cannt imagine just how much time I had spent for this information Thanks

  23. Thank you for the auspicious writeup It in fact was a amusement account it Look advanced to more added agreeable from you By the way how could we communicate

  24. I do believe all the ideas youve presented for your post They are really convincing and will certainly work Nonetheless the posts are too short for novices May just you please lengthen them a little from subsequent time Thanks for the post

  25. I do trust all the ideas youve presented in your post They are really convincing and will definitely work Nonetheless the posts are too short for newbies May just you please lengthen them a bit from next time Thank you for the post

  26. Wow superb blog layout How long have you been blogging for you make blogging look easy The overall look of your site is magnificent as well as the content

  27. Fantastic goods from you, man. I’ve understand your stuff previous to and you are just too wonderful. I really like what you have acquired here, really like what you are saying and the way in which you say it. You make it enjoyable and you still care for to keep it sensible. I can not wait to read much more from you. This is actually a wonderful site.

  28. I am not sure where youre getting your info but good topic I needs to spend some time learning much more or understanding more Thanks for magnificent info I was looking for this information for my mission

  29. An impressive share, I just given this onto a colleague who was doing a little analysis on this. And he in fact bought me breakfast because I found it for him.. smile. So let me reword that: Thnx for the treat! But yeah Thnkx for spending the time to discuss this, I feel strongly about it and love reading more on this topic. If possible, as you become expertise, would you mind updating your blog with more details? It is highly helpful for me. Big thumb up for this blog post!

  30. What is Gluco6 Supplement? Gluco6 is a blend of doctor-formulated ingredients promising to help users develop healthy blood sugar ranges.

Leave a Reply

Your email address will not be published. Required fields are marked *