Performance Assessment
The tutorials on this page demonstrate how to assess the performance of PPG beat detectors using publicly available datasets.
Assessing performance on a single dataset
This tutorial demonstrates how to assess the performance of beat detectors on a single dataset.
- Install the PPG-beats toolbox by following the instructions here.
- Download the truncated version of the MIMIC PERform Training Dataset from here.
- Use the
assess_beat_detectors.m
script to run the analysis using the following commands:
options.dataset_file = 'filepath'; % NB: Here, instead of 'filepath' insert the path of the `MIMIC_PERform_truncated_train_all_data.mat` file on your computer, _e.g._ `/Users/petercharlton/Downloads/MIMIC_PERform_truncated_train_all_data.mat`
assess_beat_detectors('MIMIC_PERform_truncated_train_all_data', options)
- During this process a new folder will have been created called
proc_data_MIMIC_PERform_truncated_train_all_data
. Within this folder you will find files storing the analysis steps, including the file containing the results: theppg_detect_stats.mat
file. Open this file in Matlab, and you will see it contains a variable calledres
(for results). - Have a look at the table containing the results by typing
res.noQual.txt
at the command window. This provides the median and inter-quartile range for a set of statistics describing the performance of each beat detector (each 'strategy' in this table).
This tutorial is demonstrated in the following video:
Assessing performance on multiple datasets
This tutorial demonstrates how to assess the performance of beat detectors across multiple datasets.
- Install the PPG-beats toolbox by following the instructions here.
- Download the required datasets:
- MIMIC PERform Truncated Training dataset
- MIMIC PERform Truncated Testing dataset
- MIMIC PERform Truncated AF dataset (both AF subjects and non-AF subjects).
- Open the
assess_multiple_datasets.m
script (one of the scripts within the PPG-beats toolbox) in Matlab. Edit it as follows:- Specify the path of the Matlab file for each dataset in the
specify_path_of_dataset_file
function within theassess_multiple_datasets.m
script. - Specify the datasets to be analysed. This can be quickly done by enabling the
do_tutorial
option within thesetup_universal_params
function within theassess_multiple_datasets.m
script. - Specify the folder in which to save results figures by modifying the
up.paths.plots_root_folder
variable within thesetup_universal_params
function within theassess_multiple_datasets.m
script.
- Specify the path of the Matlab file for each dataset in the
- Run the
assess_multiple_datasets.m
script to assess the performance of PPG beat detectors across all of the datasets. This will:- Analyse each dataset in turn
- Generate results (in the command window) and results figures (saved in the specified folder).
This tutorial is demonstrated in the following video: