Performance Assessment

The tutorials on this page demonstrate how to assess the performance of PPG beat detectors using publicly available datasets.

Assessing performance on a single dataset

This tutorial demonstrates how to assess the performance of beat detectors on a single dataset.

  • Install the PPG-beats toolbox by following the instructions here.
  • Download the truncated version of the MIMIC PERform Training Dataset from here.
  • Use the assess_beat_detectors.m script to run the analysis using the following commands:
options.dataset_file = 'filepath'; % NB: Here, instead of 'filepath' insert the path of the `MIMIC_PERform_truncated_train_all_data.mat` file on your computer, _e.g._ `/Users/petercharlton/Downloads/MIMIC_PERform_truncated_train_all_data.mat`
assess_beat_detectors('MIMIC_PERform_truncated_train_all_data', options)
  • During this process a new folder will have been created called proc_data_MIMIC_PERform_truncated_train_all_data. Within this folder you will find files storing the analysis steps, including the file containing the results: the ppg_detect_stats.mat file. Open this file in Matlab, and you will see it contains a variable called res (for results).
  • Have a look at the table containing the results by typing res.noQual.txt at the command window. This provides the median and inter-quartile range for a set of statistics describing the performance of each beat detector (each 'strategy' in this table).

This tutorial is demonstrated in the following video:

Assessing performance on multiple datasets

This tutorial demonstrates how to assess the performance of beat detectors across multiple datasets.

  • Install the PPG-beats toolbox by following the instructions here.
  • Download the required datasets:
  • Open the assess_multiple_datasets.m script (one of the scripts within the PPG-beats toolbox) in Matlab. Edit it as follows:
    • Specify the path of the Matlab file for each dataset in the specify_path_of_dataset_file function within the assess_multiple_datasets.m script.
    • Specify the datasets to be analysed. This can be quickly done by enabling the do_tutorial option within the setup_universal_params function within the assess_multiple_datasets.m script.
    • Specify the folder in which to save results figures by modifying the up.paths.plots_root_folder variable within the setup_universal_params function within the assess_multiple_datasets.m script.
  • Run the assess_multiple_datasets.m script to assess the performance of PPG beat detectors across all of the datasets. This will:
    • Analyse each dataset in turn
    • Generate results (in the command window) and results figures (saved in the specified folder).

This tutorial is demonstrated in the following video: