When we posted this a couple of weeks ago, we had some AI enthusiasts insist that this diagram was the result of poor prompting, or that the prompt that the original poster made was to generate a funny, bad diagram.
-
When we posted this a couple of weeks ago, we had some AI enthusiasts insist that this diagram was the result of poor prompting, or that the prompt that the original poster made was to generate a funny, bad diagram. So we decided to test ChatGPT's capability... https://masto.ai/@vagina_museum/115100134755954006
-
When we posted this a couple of weeks ago, we had some AI enthusiasts insist that this diagram was the result of poor prompting, or that the prompt that the original poster made was to generate a funny, bad diagram. So we decided to test ChatGPT's capability... https://masto.ai/@vagina_museum/115100134755954006
First, we wanted to test a very basic prompt, likely to be similar to something the original poster would have said. "Show me a diagram of the organs during pregnancy" returned this.
-
First, we wanted to test a very basic prompt, likely to be similar to something the original poster would have said. "Show me a diagram of the organs during pregnancy" returned this.
As you can see, the labelling is once again nearly all wrong. The vagina is kind of linked to the rectum. The heart, lungs and liver are depicted from a front view despite the diagram being a side view. The liver is inside the uterus. And once again, the foetus is in breech position.
-
As you can see, the labelling is once again nearly all wrong. The vagina is kind of linked to the rectum. The heart, lungs and liver are depicted from a front view despite the diagram being a side view. The liver is inside the uterus. And once again, the foetus is in breech position.
Next, we decided to test a more specific prompt: "create a diagram of the internal gynaecological organs during pregnancy, showing the uterus, cervix, ovaries and vagina". And we got this.
-
Next, we decided to test a more specific prompt: "create a diagram of the internal gynaecological organs during pregnancy, showing the uterus, cervix, ovaries and vagina". And we got this.
It has become a running theme at this point that the labelling is wrong. The position of the labels largely reflects where a label *saying* ovaries would go on the diagram, even if the ovaries are, for whatever reason, physically attached to the vagina and not where the label points.
-
It has become a running theme at this point that the labelling is wrong. The position of the labels largely reflects where a label *saying* ovaries would go on the diagram, even if the ovaries are, for whatever reason, physically attached to the vagina and not where the label points.
We hope we don't need to tell you that the gynaecological anatomy does NOT work like that. We also note, once again, there's no umbilical cord or placenta and the foetus is in breech position.
-
We hope we don't need to tell you that the gynaecological anatomy does NOT work like that. We also note, once again, there's no umbilical cord or placenta and the foetus is in breech position.
So next, we wanted to give ChatGPT every chance to use medical diagrams with the prompt "A saggital plane view of internal organs during pregnancy showing the foetus in the typical non-breech position. Include all organs pertinent to pregnancy (i.e. the uterus, placenta, umbilical cord and vagina). Include other pelvic organs." Here's what we got.
-
So next, we wanted to give ChatGPT every chance to use medical diagrams with the prompt "A saggital plane view of internal organs during pregnancy showing the foetus in the typical non-breech position. Include all organs pertinent to pregnancy (i.e. the uterus, placenta, umbilical cord and vagina). Include other pelvic organs." Here's what we got.
This one is the least bad of the bunch. Okay, so there's no bladder. Okay, so the rectum kind of peters out. And we're not going to touch whatever is going on with the intestines above the uterus. But the least bad of the bunch.
-
This one is the least bad of the bunch. Okay, so there's no bladder. Okay, so the rectum kind of peters out. And we're not going to touch whatever is going on with the intestines above the uterus. But the least bad of the bunch.
Despite the prompt specifically stating a non-breech position, it still returned breech. And furthermore, the umbilical cord is wrapped around the foetus's neck. This *would* appear in medical diagrams, because it's a complication of pregnancy. But it's definitely not *typical*.
-
Despite the prompt specifically stating a non-breech position, it still returned breech. And furthermore, the umbilical cord is wrapped around the foetus's neck. This *would* appear in medical diagrams, because it's a complication of pregnancy. But it's definitely not *typical*.
So in our final quest to see if by directing towards medical literature, ChatGPT could generate correct labels, we added to our last prompt "Include the rectum and bladder. Label the diagram with these labels." And... oh.
-
So in our final quest to see if by directing towards medical literature, ChatGPT could generate correct labels, we added to our last prompt "Include the rectum and bladder. Label the diagram with these labels." And... oh.
Once more unto the breech position, dear friends, once more. Also, we're pretty sure the anatomically incorrect "rectum" is in fact a retroverted uterus, which are depicted like that in diagrams. We also hope we don't need to tell you the vulva is NOT an umbilical cord.
-
Once more unto the breech position, dear friends, once more. Also, we're pretty sure the anatomically incorrect "rectum" is in fact a retroverted uterus, which are depicted like that in diagrams. We also hope we don't need to tell you the vulva is NOT an umbilical cord.
So to conclude our experiments, we tried "good prompts". But ChatGPT still proved incapable of generating correct labels, uncomplicated pregnancy, or putting all organs in the correct place.
But this points to a wider issue in using generative AI for anatomical or health education. It requires a mind with some level of subject knowledge to look at an image and say "that's wrong." But most people running these searches *don't* have the baseline expertise.
-
So to conclude our experiments, we tried "good prompts". But ChatGPT still proved incapable of generating correct labels, uncomplicated pregnancy, or putting all organs in the correct place.
But this points to a wider issue in using generative AI for anatomical or health education. It requires a mind with some level of subject knowledge to look at an image and say "that's wrong." But most people running these searches *don't* have the baseline expertise.
If you're a layperson looking to learn more about your own pregnancy, or someone whose job it is to prompt AIs, you might not know that what has been generated is incorrect. It doesn't require a huge amount of technical knowledge to know that something is wrong, but the general level of awareness of the gynaecological anatomy is low so not everyone can assess this information.
-
J jwcph@helvede.net shared this topic on
