Google Smartphone Camera to Measure Heart & Respiratory Rate

Google Introduces Smartphone-Based Health Measurements

Google is developing capabilities that will empower users to obtain key health metrics utilizing only the camera integrated into their smartphones. This expands access to health and fitness tracking, traditionally limited to dedicated wearable devices, to a broader audience.

Starting next month, initially exclusive to Google Pixel phones, but planned for future availability on other Android devices, users will be able to measure both their heart rate and respiratory rate directly through their device’s camera.

Traditional Measurement Methods vs. Google’s Approach

Historically, acquiring these measurements necessitated specialized hardware. Devices like the Apple Watch or fitness trackers from Fitbit (a Google-owned company) employ red or green light-based heart-rate monitors.

Google’s hardware and software teams, including the Google Health unit under Director of Health Technologies Shwetak Patel, have pioneered computer vision-based techniques. These methods leverage smartphone cameras to achieve results comparable to clinical-grade measurement hardware.

A validation study supporting these findings is currently available in pre-print format, pending peer review through an academic journal.

How the Technology Works

The respiratory rate measurement utilizes a technique called “optical flow.” This monitors chest movements during breathing to accurately determine the breathing rate.

Clinical validation studies, encompassing both healthy individuals and those with existing respiratory conditions, demonstrate an accuracy of within 1 breath per minute across all participants.

For heart rate monitoring, Google initially detects “subtle color changes” in the fingertip. These changes indicate the flow of oxygenated blood from the heart throughout the body.

Validation data, awaiting external review, reveals an average accuracy within a 2% margin of error across diverse skin types. Further research explores utilizing facial color changes for this purpose, though this remains in the exploratory stage.

Availability and Future Plans

These measurement features will be integrated into the Google Fit app within the next month, initially for existing Pixel devices.

Expansion to other Android devices running Android 6 or later is scheduled for “the coming months.”

The Vision Behind the Technology

“My team has been working on unlocking the potential of everyday smart devices,” stated Patel during a press briefing. “This includes leveraging the sensors becoming increasingly common in these devices to support health and wellness.”

Patel, a computer science professor at the University of Washington and recipient of an ACM Prize in Computing Award for his work in digital health, emphasized the increasing accessibility of daily health monitoring due to powerful sensors and advancements in AI.

He noted that healthcare extends beyond hospital walls, encompassing a continuous journey of daily living and wellness tracking.

Important Considerations and Disclaimer

Google explicitly states that these features are intended for personal wellbeing tracking, not as diagnostic or medical tools.

This approach avoids the complexities of obtaining full FDA medical-grade device certification, common for general consumer use tools.

Google Fit provides a disclaimer clarifying the non-medical intent of the results and offers a general overview of the benefits of tracking these metrics.

Unlike some dedicated health trackers, such as the Oura ring, Google refrains from providing detailed guidance or actionable insights based on the measurements.

The company intends to empower users to utilize this information independently, potentially sharing it with their physicians if health concerns arise.

Future Development and Platform Expansion

Patel indicated Google’s interest in exploring sensor fusion to enhance tracking capabilities on existing devices.

Regarding potential availability on iPhones, he stated that while the initial focus is on Android, the ultimate goal is to reach “as many people as possible.”