Our latest health AI research updates

We’ve spent the past several years researching artificial intelligence (AI) for healthcare — exploring how it can help detect diseases early, expand access to care and more. We’ve taken a “move slow and test things” approach to prove efficacy, equity, helpfulness and safety above all. Today, at our annual health event, The Check Up, we shared health AI updates including our progress on our medical large language model (LLM) research, partnerships that are bringing solutions into real-world settings, and new ways AI can help with disease detection. Here’s a look at what’s new.

Ongoing research on Med-PaLM 2, our expert-level medical LLM

Recent progress in large language models (LLMs) — AI tools that demonstrate capabilities in language understanding and generation — has opened up new ways to use AI to solve real-world problems. However, unlike some other LLM use cases, applications of AI in the medical field require the utmost focus on safety, equity, and bias to protect patient well-being. To work toward developing AI tools that can retrieve medical knowledge, accurately answer medical questions, and provide reasoning, we’ve invested in medical LLM research.

Last year we built Med-PaLM, a version of PaLM tuned for the medical domain. Med-PaLM was the first to obtain a “passing score” (>60%) on U.S. medical licensing-style questions. This model not only answered multiple choice and open-ended questions accurately, but also provided rationale and evaluated its own responses.

Recently, our next iteration, Med-PaLM 2, consistently performed at an “expert” doctor level on medical exam questions, scoring 85%. This is an 18% improvement from Med-PaLM’s previous performance and far surpasses similar AI models.

While this is exciting progress, there’s still a lot of work to be done to make sure this technology can work in real-world settings. Our models were tested against 14 criteria — including scientific factuality, precision, medical consensus, reasoning, bias and harm — and evaluated by clinicians and non-clinicians from a range of backgrounds and countries. Through this evaluation, we found significant gaps when it comes to answering medical questions and meeting our product excellence standards. We look forward to working with researchers and the global medical community to close these gaps and understand how this technology can help improve health delivery.

New partners for AI-assisted ultrasound

In recent years, sensor technology has evolved to make ultrasound devices more affordable and portable. But they often require experts with years of experience to conduct exams and interpret the images, and many low-resource areas have a shortage of ultrasound specialists. To help bridge this divide, we’re building AI models that can help simplify acquiring and interpreting ultrasound images to identify important information like gestational age in expecting mothers and early detection of breast cancer.

We’re partnering with Jacaranda Health, a Kenya-based nonprofit focused on improving health outcomes for mothers and babies in government hospitals, to research digital solutions that can help them reach their goal. In Sub-Saharan Africa, maternal mortality remains high, and there is a shortage of workers trained to operate traditional high-cost ultrasound machines. Through this partnership, we’ll conduct exploratory research to understand the current approach to ultrasound delivery in Kenya and explore how new AI tools can support point-of-care ultrasound for pregnant women.

We’re also partnering with Chang Gung Memorial Hospital (CGMH) in Taiwan to explore using ultrasound for breast cancer detection. Mammograms, which are X-rays of the breast, are typically used to screen for breast cancer and are a proven approach to reducing mortality. However, screening programs aren’t available in many regions due to high costs. Further, we know that mammograms can be less effective for certain populations, including those with higher breast density. With CGMH, we’re exploring whether our AI models can help with early detection of breast cancer using ultrasound.

AI for cancer treatment planning with Mayo Clinic

Over the past three years, we’ve partnered with Mayo Clinic to explore how AI can support the tedious, time-consuming process of planning for radiotherapy, a common cancer treatment used to treat more than half of cancers in the U.S. The most labor-intensive step in the planning process is a technique called “contouring”, where clinicians draw lines on CT scans to separate areas of cancer from nearby healthy tissues that can be damaged by radiation during treatment. This process can take up to 7 hours for a single patient.

We’ll soon publish research about the findings of our study and the radiotherapy model we developed. As of today, we’re formalizing our agreement with Mayo Clinic to explore further research, model development and commercialization. Taking these next steps with Mayo Clinic means that together we can extend the reach of our model, with the goal of helping more patients receive radiotherapy treatment sooner.

Bringing tuberculosis screening to thousands

Building on years of health AI research, we’re working with partners on the ground to bring the results of our research on tuberculosis (TB) AI-powered chest x-ray screening into the care setting. According to the WHO, TB is the ninth leading cause of death worldwide, with over 25% of TB deaths occurring in Africa. While TB is treatable, it requires cost-effective screening solutions to help catch the disease early and reduce community spread.

We’re partnering with an AI-based organization headed by Right to Care, a not-for-profit entity with extensive experience in TB care within Africa, to make AI-powered screenings widely available across Sub-Saharan Africa. Our partners have committed to donating 100,000 free AI-powered TB screenings during the collaboration to help with early detection and treatment of TB and reduce the spread of this disease.

In healthcare, there is enormous potential for AI to augment diagnostic and treatment planning processes, especially through partnership to help bring high-quality care to communities that need it most.