Expert QC

Expert QC

Six dMRI experts rated 200 participants’ processed data on a 1-5 scale
Using dmriprep-viewer at https://www.nipreps.org/dmriprep-viewer
We'll call this subset the “gold standard” QC dataset.

Experts agree with QSIPrep's auto-QC metrics

Expert QC scores correlate with QSIPrep's automated QC metrics as expected.

Scatterplot of expert QC scores with QSIPrep automated QC metrics.

Experts agree with each other

Excellent inter-rater reliability: ICC3k=0.93 (95% CI: [0.91, 0.94])

Cohen's kappa scores for HBN-POD2 expert raters.