<![CDATA[Something a bit worrying to note about using Ai in healthcare.]]>Something a bit worrying to note about using Ai in healthcare.

Iโ€™ve had two specialist appointments recently, both using ai to transcribe. Both sent report letters with inaccuracies about my diagnoses and past medical history. Even my GP was like, โ€œhuh, that directly contradicts what I put in the referrals.โ€

I have followed up both and requested amendments (which were done) but if I hadnโ€™t, these inaccuracies could have significantly damaged ongoing care, further treatment or insurance claims.

Human error has always been a factor, but both doctors were clearly using the ai software and assuming what it spat out was correct. They made no other notes during the appointments to cross-reference and double check. This is how Very Bad Things can happen.

]]>https://forum.fedi.dk/topic/357ab14f-0bd5-44e5-9684-ecf0d61b8e57/something-a-bit-worrying-to-note-about-using-ai-in-healthcare.RSS for NodeMon, 06 Apr 2026 06:22:10 GMTFri, 27 Mar 2026 00:54:46 GMT60<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sun, 29 Mar 2026 08:54:48 GMT]]>@bloodflowersburning it's amazing NZ would authorise something worse than simple voice to text transcription for doctor notes. But I'm old school, I still do searches and visit sites like Cleveland for medical guidance.

]]>https://forum.fedi.dk/post/https://socialbc.ca/ap/users/116268351410231723/statuses/116311620889533518https://forum.fedi.dk/post/https://socialbc.ca/ap/users/116268351410231723/statuses/116311620889533518Sun, 29 Mar 2026 08:54:48 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sun, 29 Mar 2026 08:06:29 GMT]]>@bloodflowersburning god this was inevitable. It cant even narrate a reel on IG without entirely misreading whole words for others. Even official international accounts.
This is terribly dangerous. I hope you email your local goverment representative about this (cc in 'other' party representation in your area so they dont ignore it) and also file your concern with your medical ombudsman.

Thank you for sharing this.

]]>https://forum.fedi.dk/post/https://mastodonapp.uk/users/Silversnapples/statuses/116311430920530430https://forum.fedi.dk/post/https://mastodonapp.uk/users/Silversnapples/statuses/116311430920530430Sun, 29 Mar 2026 08:06:29 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sun, 29 Mar 2026 07:46:37 GMT]]>@bloodflowersburning Yikes! That's really bad.
It's a good reminder to always check the notes on record after every appointment.
I think our GP gave us the option to decline use of the AI scribe. That should be the standard for everyone and part of the normal consent process.

]]>https://forum.fedi.dk/post/https://mastodon.nz/users/ConnyChiwa/statuses/116311352755078464https://forum.fedi.dk/post/https://mastodon.nz/users/ConnyChiwa/statuses/116311352755078464Sun, 29 Mar 2026 07:46:37 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sun, 29 Mar 2026 06:54:35 GMT]]>@bloodflowersburning
Some of their lecturers are too.
The pharmacy school offers free medication reviews, The lecturer who I saw used ChatGPT to summarise a paper. Isn't that what the abstract is for?
@JD38

]]>https://forum.fedi.dk/post/https://mastodon.nz/users/RedRobyn/statuses/116311148191168535https://forum.fedi.dk/post/https://mastodon.nz/users/RedRobyn/statuses/116311148191168535Sun, 29 Mar 2026 06:54:35 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sun, 29 Mar 2026 03:04:32 GMT]]>@bloodflowersburning this has happened to me recently

]]>https://forum.fedi.dk/post/https://beige.party/users/MedeaVanamonde/statuses/116310243561234712https://forum.fedi.dk/post/https://beige.party/users/MedeaVanamonde/statuses/116310243561234712Sun, 29 Mar 2026 03:04:32 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sun, 29 Mar 2026 02:02:42 GMT]]>@bloodflowersburning thanks for the warning. My last couple appointments have used it too and I assumed providers would be double checking for errors, but maybe not. I'll be on the lookout. ๐Ÿ™ƒ

]]>https://forum.fedi.dk/post/https://mastodon.social/ap/users/115343278827848066/statuses/116310000462520760https://forum.fedi.dk/post/https://mastodon.social/ap/users/115343278827848066/statuses/116310000462520760Sun, 29 Mar 2026 02:02:42 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sun, 29 Mar 2026 01:09:47 GMT]]>@bloodflowersburning

We have a mutual aid fund for people who lost their livelihoods, guides to avoiding Gen AI, upcoming support groups for chatbot addicts, all kinds of stuff.

Share our website. Join us. There's lots of things you can do.

Why just let Gen AI's horrors happen, when you can join forces with us and push back?

https://stopgenai.com

]]>https://forum.fedi.dk/post/https://zeroes.ca/users/kimcrawley/statuses/116309792342819546https://forum.fedi.dk/post/https://zeroes.ca/users/kimcrawley/statuses/116309792342819546Sun, 29 Mar 2026 01:09:47 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sun, 29 Mar 2026 00:28:56 GMT]]>@kimcrawley interesting initiative. Is there any section in particular youโ€™d like me to focus on?

My plan going forwards is to refuse the use of ai when recording medical consultations and to record my own notes (as a disability accessibility need) and keep checking everything for inconsistencies/mistakes.

]]>https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116309631703907599https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116309631703907599Sun, 29 Mar 2026 00:28:56 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sat, 28 Mar 2026 23:02:21 GMT]]>@bloodflowersburning

Please check out https://stopgenai.com

]]>https://forum.fedi.dk/post/https://zeroes.ca/users/kimcrawley/statuses/116309291287473119https://forum.fedi.dk/post/https://zeroes.ca/users/kimcrawley/statuses/116309291287473119Sat, 28 Mar 2026 23:02:21 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sat, 28 Mar 2026 07:19:14 GMT]]>@MamaLake Unfortunately HIPPA doesn't apply in New Zealand law. But I think it's covered under the Health Information Privacy Code 2020 (HIPC) as Health NZ have authorised the use of specific tools (Heidi AI Scribe) in healthcare.

]]>https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116305582772727161https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116305582772727161Sat, 28 Mar 2026 07:19:14 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sat, 28 Mar 2026 06:59:18 GMT]]>@bloodflowersburning I also see this as a HIPAA violation

]]>https://forum.fedi.dk/post/https://beige.party/users/MamaLake/statuses/116305504371217924https://forum.fedi.dk/post/https://beige.party/users/MamaLake/statuses/116305504371217924Sat, 28 Mar 2026 06:59:18 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sat, 28 Mar 2026 00:25:34 GMT]]>@bloodflowersburning (I know that's not how NZ works, and I feel sad about it)

]]>https://forum.fedi.dk/post/https://mastodon.nz/users/nzJayZee/statuses/116303956167185938https://forum.fedi.dk/post/https://mastodon.nz/users/nzJayZee/statuses/116303956167185938Sat, 28 Mar 2026 00:25:34 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Sat, 28 Mar 2026 00:19:41 GMT]]>@bloodflowersburning When you help someone with their groceries/stairs/anything or call an ambulance when someone's hurt the most important thing shouldn't be "How am I compensated". David Graeber called this (deliberately provocative) "baseline communism" it's why when 2 people working in a repair shop go "pass me the wrench," ..""ok" instead of entering into a wrench contract

]]>https://forum.fedi.dk/post/https://mastodon.nz/users/nzJayZee/statuses/116303933054977343https://forum.fedi.dk/post/https://mastodon.nz/users/nzJayZee/statuses/116303933054977343Sat, 28 Mar 2026 00:19:41 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Fri, 27 Mar 2026 23:56:59 GMT]]>@bloodflowersburning I'd never! The market knows best.

]]>https://forum.fedi.dk/post/https://mastodon.nz/users/nzJayZee/statuses/116303843769489084https://forum.fedi.dk/post/https://mastodon.nz/users/nzJayZee/statuses/116303843769489084Fri, 27 Mar 2026 23:56:59 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Fri, 27 Mar 2026 21:00:37 GMT]]>@nzJayZee careful now, โ€œcommunityโ€ seems to be a dirty word in some circles. Donโ€™t be that radical lefty reminding people to be kind and care for others. ๐Ÿ˜‰

]]>https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116303150257425456https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116303150257425456Fri, 27 Mar 2026 21:00:37 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Fri, 27 Mar 2026 19:30:48 GMT]]>@bloodflowersburning I like the idea of applicant pushback. for something like $40 NZD /mth you can have all the "job application agents" via Claude. Totally agree about the snake.eating its tail . We should be building community resilience instead of data centers IMO.

]]>https://forum.fedi.dk/post/https://mastodon.nz/users/nzJayZee/statuses/116302797122217481https://forum.fedi.dk/post/https://mastodon.nz/users/nzJayZee/statuses/116302797122217481Fri, 27 Mar 2026 19:30:48 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Fri, 27 Mar 2026 16:01:19 GMT]]>@bloodflowersburning yeah, i was just too lazy to write multiple disciplines ๐Ÿ˜…

]]>https://forum.fedi.dk/post/https://mastodon.social/users/JD38/statuses/116301973369521044https://forum.fedi.dk/post/https://mastodon.social/users/JD38/statuses/116301973369521044Fri, 27 Mar 2026 16:01:19 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Fri, 27 Mar 2026 10:52:19 GMT]]>@theron29 Agreed. Not the worst case scenario. For me personally it could have caused issues with further treatment, getting reimbursed by insurance, and caused confusion when needing ongoing care with other providers. So more an avoidable inconvenience and extra paperwork rather than a dangerous outcome in this example. I hope thatโ€™s the worst possibility across the board, and that people check their notes carefully to catch any inconsistencies.

Mistakes in medical notes have always happened, unfortunately itโ€™s inevitable. Only time will tell if this becomes more of an issue if/when ai transcription is used in medical settings more frequently and if it generates a higher number of errors as opposed to human note taking. What I think is essential is that we still retain a human buffer to assess factual accuracy, rather than simply assuming (hoping?) the software can do it better.

For more info, the software Heidi AI Scribes has been endorsed for use within Health NZ. https://www.tewhatuora.govt.nz/health-services-and-programmes/digital-health/generative-ai-and-large-language-models#naiaeag-endorsed-tools

]]>https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116300758324986476https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116300758324986476Fri, 27 Mar 2026 10:52:19 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Fri, 27 Mar 2026 10:36:43 GMT]]>@bloodflowersburning Genuine question (from central EU). (AI Scepticism is expected to come a bit later on... ๐Ÿ™‚ ).
Doctors are not using AI here, yet. I guess this tech had to be certified and tested before it was admitted into doctor's realm?

Although this does not seem to be the worst usecase scenario where&how to use AI, your detailed explanation gives doubts whether the tech is actually ready now for anything *this* important.... ๐Ÿ˜

]]>https://forum.fedi.dk/post/https://witter.cz/users/theron29/statuses/116300697012559132https://forum.fedi.dk/post/https://witter.cz/users/theron29/statuses/116300697012559132Fri, 27 Mar 2026 10:36:43 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Fri, 27 Mar 2026 09:54:34 GMT]]>@JD38 I think most students of all disciplines are now.

]]>https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116300531293193521https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116300531293193521Fri, 27 Mar 2026 09:54:34 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Fri, 27 Mar 2026 09:53:15 GMT]]>@nzJayZee quoted from this article on RNZ: โ€œHe said jobseekers were using AI to generate their applications, while employers were using AI to read them.โ€
The snake is eating its own tail.

https://www.rnz.co.nz/news/business/590746/jobseekers-and-advocates-disturbed-as-companies-screen-applications-with-ai

]]>https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116300526094997858https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116300526094997858Fri, 27 Mar 2026 09:53:15 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Fri, 27 Mar 2026 09:48:48 GMT]]>@theron29 Genuine question or scepticism? Iโ€™m in Aotearoa NZ. Doctors were from two different specialist medical departments. Both used ai software to record consultation and take notes. The report letters sent to my GP contained multiple discrepancies about conditions discussed, and referenced in GP referrals. If they had checked before sending they would have realised mistakes had been made. My GP questioned the content, which was how I became aware. I can provide several specific examples but would rather not on a public forum to a stranger. However, both letters were re-assessed and sent again with corrections on request. Hope this helps.

]]>https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116300508563843859https://forum.fedi.dk/post/https://mastodon.nz/ap/users/116225329799481242/statuses/116300508563843859Fri, 27 Mar 2026 09:48:48 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Fri, 27 Mar 2026 09:40:41 GMT]]>@bloodflowersburning "your future doctor are studying using chat gpt". I don't think I've ever wanted more for something to collapse than AI.

]]>https://forum.fedi.dk/post/https://mastodon.social/users/JD38/statuses/116300476707354013https://forum.fedi.dk/post/https://mastodon.social/users/JD38/statuses/116300476707354013Fri, 27 Mar 2026 09:40:41 GMT<![CDATA[Reply to Something a bit worrying to note about using Ai in healthcare. on Fri, 27 Mar 2026 08:15:51 GMT]]>@bloodflowersburning Where are doctors using ai like this? And how did you check the transcribes?๐Ÿค”

]]>https://forum.fedi.dk/post/https://witter.cz/users/theron29/statuses/116300143074594668https://forum.fedi.dk/post/https://witter.cz/users/theron29/statuses/116300143074594668Fri, 27 Mar 2026 08:15:51 GMT