Accuracy and reproducibility of automated white matter hyperintensities segmentation with lesion segmentation tool: A European multi-site 3T study
Federica Ribaldi
(1, 2)
,
Daniele Altomare
(2)
,
Jorge Jovicich
(3)
,
Clarissa Ferrari
(1)
,
Agnese Picco
(4)
,
Francesca Benedetta Pizzini
(5)
,
Andrea Soricelli
(6)
,
Anna Mega
(1)
,
Antonio Ferretti
(7)
,
Antonios Drevelegas
(8)
,
Beatriz Bosch
(9)
,
Bernhard Müller
(10)
,
Camillo Marra
(11)
,
Carlo Cavaliere
(6)
,
David Bartrés-Faz
(9)
,
Flavio Nobili
(4)
,
Franco Alessandrini
(5)
,
Frederik Barkhof
(12, 13)
,
Helene Gros-Dagnac
(14)
,
Jean-Philippe Ranjeva
(15, 16)
,
Jens Wiltfang
(17)
,
Joost Kuijer
(13)
,
Julien Sein
(16)
,
Karl-Titus Hoffmann
(18)
,
Luca Roccatagliata
(1)
,
Lucilla Parnetti
(19)
,
Magda Tsolaki
(8)
,
Manos Constantinidis
(8)
,
Marco Aiello
(6)
,
Marco Salvatore
(6)
,
Martina Montalti
(1)
,
Massimo Caulo
(20)
,
Mira Didic
(21)
,
Núria Bargallo
(22)
,
Olivier Blin
(21)
,
Paolo Rossini
(23)
,
Peter Schonknecht
(18)
,
Piero Floridi
(24)
,
Pierre Payoux
(14)
,
Pieter Jelle Visser
(25)
,
Régis Bordet
(26)
,
Renaud Lopes
(26)
,
Roberto Tarducci
(27)
,
Stephanie Bombois
(26)
,
Tilman Hensch
(18)
,
Ute Fiedler
(28)
,
Jill Richardson
(29)
,
Giovanni Frisoni
(2)
,
Moira Marizzoni
(1)
1
IRCCS -
Centro San Giovanni di Dio, Fatebenefratelli, Brescia
2 Laboratory of Neuroimaging of aging, Memory clinic and LANVIE
3 CIMEC - Center for Mind/Brain Sciences
4 DINOGMI - Dipartimento di Neuroscienze, riabilitazione, oftalmologia, genetica e scienze materno-infantili [Genova]
5 UNIVR | DDSP - Department of Diagnostics and Public Health [Verona]
6 IRCCS SDN Napoli
7 Department of Clinic Sciences and Bioimaging, University G. d'Annunzio Chieti-Pescara
8 Interbalkan Medical Center of Thessaloniki
9 Dept. of Child and Adolescent Psychiatry and Psychology, Institut Clinic of Neurosciences IDIBAPS (Institut d'Investigacions Biomèdiques August Pi Sunyer)
10 Department of Child and Adolescent Psychiatry
11 Department of Neuroscience, Catholic University, Roma
12 CMIC - Centre for Medical Image Computing
13 Department of Radiology and Nuclear Medicine [Amsterdam]
14 ToNIC - Toulouse NeuroImaging Center
15 CRMBM - Centre de résonance magnétique biologique et médicale
16 CEMEREM - Centre d'Exploration Métabolique par Résonance Magnétique [Hôpital de la Timone - APHM]
17 UMG - University Medical Center Göttingen
18 Leipzig University / Universität Leipzig
19 UNIPG - Università degli Studi di Perugia = University of Perugia
20 Department of Clinic Sciences and Bioimaging, University G. d'Annunzio Chieti-Pescara
21 INS - Institut de Neurosciences des Systèmes
22 Neurology Department, Hospital Clinic, IDIBAPS, Facultad de Medicina, Barcelona
23 Dept. Neuroscience & Neurorehabilitation, IRCCS-San Raffaele-Pisana, Rome
24 Neuroradiology Unit, Perugia General Hospital, Perugia,
25 Alzheimer Center Amsterdam
26 LilNCog - Lille Neurosciences & Cognition - U 1172
27 Medical Physics Unit, Perugia General Hospital, Perugia
28 LVR-Clinic for Psychiatry and Psychotherapy, Institutes and Clinics of the University Duisburg-Essen,
29 Neurosciences Therapeutic Area, GlaxoSmithKline R&D,
2 Laboratory of Neuroimaging of aging, Memory clinic and LANVIE
3 CIMEC - Center for Mind/Brain Sciences
4 DINOGMI - Dipartimento di Neuroscienze, riabilitazione, oftalmologia, genetica e scienze materno-infantili [Genova]
5 UNIVR | DDSP - Department of Diagnostics and Public Health [Verona]
6 IRCCS SDN Napoli
7 Department of Clinic Sciences and Bioimaging, University G. d'Annunzio Chieti-Pescara
8 Interbalkan Medical Center of Thessaloniki
9 Dept. of Child and Adolescent Psychiatry and Psychology, Institut Clinic of Neurosciences IDIBAPS (Institut d'Investigacions Biomèdiques August Pi Sunyer)
10 Department of Child and Adolescent Psychiatry
11 Department of Neuroscience, Catholic University, Roma
12 CMIC - Centre for Medical Image Computing
13 Department of Radiology and Nuclear Medicine [Amsterdam]
14 ToNIC - Toulouse NeuroImaging Center
15 CRMBM - Centre de résonance magnétique biologique et médicale
16 CEMEREM - Centre d'Exploration Métabolique par Résonance Magnétique [Hôpital de la Timone - APHM]
17 UMG - University Medical Center Göttingen
18 Leipzig University / Universität Leipzig
19 UNIPG - Università degli Studi di Perugia = University of Perugia
20 Department of Clinic Sciences and Bioimaging, University G. d'Annunzio Chieti-Pescara
21 INS - Institut de Neurosciences des Systèmes
22 Neurology Department, Hospital Clinic, IDIBAPS, Facultad de Medicina, Barcelona
23 Dept. Neuroscience & Neurorehabilitation, IRCCS-San Raffaele-Pisana, Rome
24 Neuroradiology Unit, Perugia General Hospital, Perugia,
25 Alzheimer Center Amsterdam
26 LilNCog - Lille Neurosciences & Cognition - U 1172
27 Medical Physics Unit, Perugia General Hospital, Perugia
28 LVR-Clinic for Psychiatry and Psychotherapy, Institutes and Clinics of the University Duisburg-Essen,
29 Neurosciences Therapeutic Area, GlaxoSmithKline R&D,
Jorge Jovicich
- Fonction : Auteur
- PersonId : 780184
- ORCID : 0000-0001-9504-7503
Flavio Nobili
- Fonction : Auteur
- PersonId : 785159
- ORCID : 0000-0001-9811-0897
Frederik Barkhof
- Fonction : Auteur
- PersonId : 772998
- ORCID : 0000-0003-3543-3706
- IdRef : 138520682
Helene Gros-Dagnac
- Fonction : Auteur
- PersonId : 1370060
- IdRef : 068901356
Jean-Philippe Ranjeva
- Fonction : Auteur
- PersonId : 757779
- ORCID : 0000-0001-8073-102X
- IdRef : 11434938X
Jens Wiltfang
- Fonction : Auteur
- PersonId : 776430
- ORCID : 0000-0003-1492-5330
Joost Kuijer
- Fonction : Auteur
- PersonId : 818934
- ORCID : 0000-0002-4181-0427
Julien Sein
- Fonction : Auteur
- PersonId : 761846
- ORCID : 0000-0003-1767-5330
Mira Didic
- Fonction : Auteur
- PersonId : 757436
- ORCID : 0000-0001-7067-536X
Olivier Blin
- Fonction : Auteur
- PersonId : 780347
- ORCID : 0000-0003-0142-0931
Pierre Payoux
- Fonction : Auteur
- PersonId : 173132
- IdHAL : pierre-payoux
- ORCID : 0000-0002-1374-1620
- IdRef : 094640149
Pieter Jelle Visser
- Fonction : Auteur
- PersonId : 785160
- ORCID : 0000-0001-8008-9727
Roberto Tarducci
- Fonction : Auteur
- PersonId : 780186
- ORCID : 0000-0003-3539-7856
Stephanie Bombois
- Fonction : Auteur
- PersonId : 761047
- ORCID : 0000-0003-3117-1833
Tilman Hensch
- Fonction : Auteur
- PersonId : 780187
- ORCID : 0000-0003-2696-6017
Giovanni Frisoni
- Fonction : Auteur
- PersonId : 768850
- ORCID : 0000-0001-7075-7082
Moira Marizzoni
- Fonction : Auteur
- PersonId : 780185
- ORCID : 0000-0003-3749-2988
Résumé
Brain vascular damage accumulate in aging and often manifest as white matter hyperintensities (WMHs) on MRI. Despite increased interest in automated methods to segment WMHs, a gold standard has not been achieved and their longitudinal reproducibility has been poorly investigated. The aim of present work is to evaluate accuracy and reproducibility of two freely available segmentation algorithms. A harmonized MRI protocol was implemented in 3T-scanners across 13 European sites, each scanning five volunteers twice (test-retest) using 2D-FLAIR. Automated segmentation was performed using Lesion segmentation tool algorithms (LST): the Lesion growth algorithm (LGA) in SPM8 and 12 and the Lesion prediction algorithm (LPA). To assess reproducibility, we applied the LST longitudinal pipeline to the LGA and LPA outputs for both the test and retest scans. We evaluated volumetric and spatial accuracy comparing LGA and LPA with manual tracing, and for reproducibility the test versus retest. Median volume difference between automated WMH and manual segmentations (mL) was -0.22[IQR = 0.50] for LGA-SPM8, -0.12[0.57] for LGA-SPM12, -0.09[0.53] for LPA, while the spatial accuracy (Dice Coefficient) was 0.29[0.31], 0.33[0.26] and 0.41[0.23], respectively. The reproducibility analysis showed a median reproducibility error of 20%[IQR = 41] for LGA-SPM8, 14% [31] for LGA-SPM12 and 10% [27] with the LPA cross-sectional pipeline. Applying the LST longitudinal pipeline, the reproducibility errors were considerably reduced (LGA: 0%[IQR = 0], p < 0.001; LPA: 0% [3], p < 0.001) compared to those derived using the cross-sectional algorithms. The DC using the longitudinal pipeline was excellent (median = 1) for LGA [IQR = 0] and LPA [0.02]. LST algorithms showed moderate accuracy and good reproducibility. Therefore, it can be used as a reliable cross-sectional and longitudinal tool in multi-site studies.
| Origine | Fichiers produits par l'(les) auteur(s) |
|---|