Google’s medical AI chatbot is already being examined in hospitals

Google’s Med-PaLM 2, an AI software designed to reply questions on medical data, has been in testing on the Mayo Clinic analysis hospital, amongst others, since April, The Wall Road Journal reported this morning. Med-PaLM 2 is a variant of PaLM 2, which was introduced at Google I/O in Might this yr. PaLM 2 is the language mannequin underpinning Google’s Bard.

The paper additionally mentions analysis Google made public in Might (pdf) displaying that Med-PaLM 2 nonetheless suffers from a number of the accuracy points we’re already used to seeing in massive language fashions. Within the examine, physicians discovered extra inaccuracies and irrelevant data in solutions offered by Google’s Med-PaLM and Med-PalM 2 than these of different docs.

Nonetheless, in nearly each different metric, reminiscent of displaying proof of reasoning, consensus-supported solutions, or displaying no signal of incorrect comprehension, Med-PaLM 2 carried out kind of in addition to the precise docs.

WSJ experiences prospects testing Med-PaLM 2 will management their information, which will probably be encrypted, and Google received’t have entry to it.

In line with Google senior analysis director Greg Corrado, WSJ says, Med-PaLM 2 remains to be in its early phases. Corrado mentioned that whereas he wouldn’t need it to be part of his family’s “healthcare journey,” he believes Med-PaLM 2 “takes the locations in healthcare the place AI might be useful and expands them by 10-fold.”

We’ve reached out to Google and Mayo Clinic for extra data.