A1 Refereed original research article in a scientific journal
End-to-end sensor fusion and classification of atrial fibrillation using deep neural networks and smartphone mechanocardiography
Authors: Mehrang Saeed, Jafari Tadi Mojtaba, Knuutila Timo, Jaakkola Jussi, Jaakkola Samuli, Kiviniemi Tuomas, Vasankari Tuija, Airaksinen Juhani, Koivisto Tero, Pänkäälä Mikko
Publisher: IOP Publishing Ltd
Publication year: 2022
Journal: Physiological Measurement
Journal name in source: PHYSIOLOGICAL MEASUREMENT
Journal acronym: PHYSIOL MEAS
Article number: 055004
Volume: 43
Issue: 5
Number of pages: 12
ISSN: 0967-3334
eISSN: 1361-6579
DOI: https://doi.org/10.1088/1361-6579/ac66ba
Web address : https://iopscience.iop.org/article/10.1088/1361-6579/ac66ba
Objective. The purpose of this research is to develop a new deep learning framework for detecting atrial fibrillation (AFib), one of the most common heart arrhythmias, by analyzing the heart's mechanical functioning as reflected in seismocardiography (SCG) and gyrocardiography (GCG) signals. Jointly, SCG and GCG constitute the concept of mechanocardiography (MCG), a method used to measure precordial vibrations with the built-in inertial sensors of smartphones.
Approach. We present a modified deep residual neural network model for the classification of sinus rhythm, AFib, and Noise categories from tri-axial SCG and GCG data derived from smartphones. In the model presented, pre-processing including automated early sensor fusion and spatial feature extraction are carried out using attention-based convolutional and residual blocks. Additionally, we use bidirectional long short-term memory layers on top of fully-connected layers to extract both spatial and spatiotemporal features of the multidimensional SCG and GCG signals. The dataset consisted of 728 short measurements recorded from 300 patients. Further, the measurements were divided into disjoint training, validation, and test sets, respectively, of 481 measurements, 140 measurements, and 107 measurements. Prior to ingestion by the model, measurements were split into 10 s segments with 75 percent overlap, pre-processed, and augmented.
Main results. On the unseen test set, the model delivered average micro- and macro-F1-score of 0.88 (0.87-0.89; 95% CI) and 0.83 (0.83-0.84; 95% CI) for the segment-wise classification as well as 0.95 (0.94-0.96; 95% CI) and 0.95 (0.94-0.96; 95% CI) for the measurement-wise classification, respectively.
Significance. Our method not only can effectively fuse SCG and GCG signals but also can identify heart rhythms and abnormalities in the MCG signals with remarkable accuracy.