NewBornCare

clinical monitoring based on vision

and spectroscopy
Prof. Pierre Vandergheynst EPFL
Dr Jean-Marc Vesin EPFL
Prof. Martin Wolf USZ
Prof. MD Fauchre USZ
Dr Mathieu Lemay CSEM
Dr Amina Chebira CSEM
Damien Ferrario CSEM
Fabian Braun CSEM
Sibylle Fallet EPFL
Lionel Martin EPFL
Virginie Moser CSEM
Daniel Ostojic USZ
Yann Schoenenberger EPFL
 2
Motivations

Premature births
9% of the infants in Switzerland are born prematurely
Brain lesions lead to long-term disabilities in ~25% infants
It is crucial to continuously monitor vital signals
Heart and respiratory rates, arterial oxygen saturation (SpO2)
Limitations of current monitoring systems:
Current monitoring systems prone to frequent motion artifacts
Inacceptable high rate of false alarms of 87.5% leading to personnel
desensitization
Brain, the most sensitive organ, is NOT yet monitored
Inappropriate location of SpO2 sensors
Monitoring-induced parent stress
Negative impact on

Current False alarms

monitoring systems
 3
Objectives

Higher quality in vital sign monitoring

Substantial reduction of false alarms
Absence of sensors on the chest and on the limbs
NewbornCare concept

Multisensor component Central component Communication component

Arterial and cerebral Heart and respiration rate
O2 saturation
 4
T1: Camera set-up & system specifications
Selected cams
NIR night vision (UI-3240CP-NIR-GL)
RGB day vision (UI-3240CP-C-HQ)

Selected illumination for night vision

abus TV6700 (12 LEDs 850nm)
with eye safety certification

Database
Video with gold standard physiological data (N=10)

T1: Completed
 5
T2: Skin area segmentation & tracking

Achievements

Algorithms segments and tracks ROI

Integration to heart/respiration rate

pipeline

Support for multi-ROI tracking

Feature highlights:

Fast algorithm by

histogram backprojection

Next steps:

Automatic segmentation
 6
T3: Heart rate estimation

Achievement: Optimal detection of heart rate in face determined

Which region of face and wavelengths to use?
Methods:

260 small regions of interest

Power at ECG heart rate
Results:

Forehead & cheekbones are best regions

Green channel optimal
 7
T3: Heart rate estimation

Achievement: Real-time estimation of heart rate from video

Visible Mean abs error [CI 95%] [bpm] 3.14 [-7.80 9.65]
Pearson correlation 0.93
Dark Average absolute error [bpm] 4.21 [-10.66 13.77]
Pearson correlation 0.86
T4: Respiratory rate estimation

Algorithm for Respiratory Rate Estimation

 9
T4: Respiratory rate estimation

Real-time estimation of respiratory signal from video

Example of estimated respiratory signal (red) and ground-truth (blue)
 1
T3 & T4: Heart & respiration rate estimation (live) 0
 11
T5: Arterial & brain tissue oxygen saturation

Datalogger Pulse oximetry sensor

USB electrically isolated Flexible PCB

(IEC 60601 compliant) Sensor and cables
biocompatible
Casing protected against water drop
LED current limitation (fuses)
 1
T5: Arterial & brain tissue oxygen saturation 2

Near-infrared spectroscopy cerebral tissue O2 saturation (StO2)

Re-useable sensor
Real-time graphical user interface
Power supply box
StO2, HHb, O2Hb headband
Acceleration data
 1
Clinical investigation: Regulatory Affairs Status 3

CLEARANCE BY ETHICAL COMMITTEE OBTAINED

CLEARANCE

LAB CONDITIONS REALITY

 1
Conclusions 4

Technical advances as planned

Specification of the cameras

Robust and efficient algorithms to track the heart and
respiration rates
innovative algorithms
other monitoring applications (car driver )
Design and prototyping of a compliant headband
Design of compliant pulse oximetry and NIRS sensors
new pediatric monitoring tools

Aims achieved as planned

Timing as planned
 1
Conclusions 5

Last and most important step

Test of the new technology in vital- & could-become-vital parameter
monitoring under realistic conditions
1
6
 1
T5: Arterial & brain tissue oxygen saturation 7

StO2

Timely coincidence
of StO2 & SpO2
Respiratory Rate

Algorithm for Respiratory Rate Estimation

 Respiratory Rate

Overall Algorithm Performance

8 healthy subjects for evaluation 2.1
hours of video recordings