Pardoe and Jackson have commented on our recent article1 in which we demonstrated that automated hippocampal volumetry in 3T MR images can improve the detection of signs of hippocampal sclerosis. They discuss in their letter that consistent data in the literature have demonstrated that manual hippocampal segmentation has a higher sensitivity and specificity than the current automated methods.2 Our study did not address this issue directly because we did not compare the results with manual volumetry. Nevertheless, we believe this is a very important point that needs further discussion.
Taking this issue on a purely conceptual basis, we believe it is logical to assume that automatic MR imaging segmentation will never be superior to evaluation by expert professionals for clinical diagnosis. Therefore, any automatic segmentation would be an additional tool for the imaging diagnosis and never a substitute. As for the sensitivity and specificity of manual vs automatic segmentation, the question is more complex, simply because it will depend on 3 main factors: 1) level of expertise of the professional drawing the boundaries of the hippocampi, 2) the program used for automatic segmentation, and 3) the quality of the MR imaging scan. Because these 3 factors vary significantly among centers, and also because of the constant improvement in software and hardware for imaging acquisition and postprocessing, it is hard to compare different studies.
Our group has extensive experience with manual hippocampal volumetry, with a personal contribution to the validation of the volumetry protocol that is still commonly used.3,4 An important earlier study showed that qualitative visual analysis correctly identified hippocampal sclerosis in most patients (41/44; 93%) and that hippocampal volumetry provided localization in an additional small number of patients (43/44; 97%).5 Since then, imaging scanners and protocols have improved significantly and, thus, the accuracy of visual analyses.
However, although it has been known for more than 20 years that manual hippocampal volumetry can improve visual analysis in the detection of hippocampal sclerosis, why is it still not widely used as a clinical tool? In our opinion, there are 2 main reasons for this: 1) manual volumetry is very time consuming and not practical for radiology clinics, and 2) it is operator dependent. For experienced operators, manual hippocampal volumetry shows very reliable results, but for those without considerable experience, the results vary and the interrater agreement may be very poor.
Another important point is the possible difference in accuracy between the manual vs the automated method to detect hippocampal abnormalities in severe vs subtle hippocampal sclerosis. Although visual analyses with an adequate MR imaging protocol correctly identify signs of hippocampal sclerosis in most patients,1,5 the accuracy of the volumetry tool should also be measured to detect subtle cases in the clinical context, where it would be most useful, and not necessarily in cases where one can detect easily gross asymmetries by visual analysis by using different (T1, T2, FLAIR) images with appropriate acquisition (high-resolution, thin coronal cuts perpendicular to the hippocampi). Clinicians need a validated practical tool for these difficult cases, not for those with clear-cut MRI finding of hippocampal sclerosis (we are not talking here about segmentation for research purposes). This issue has not yet been properly addressed.
Neuroimaging has transformed evaluation of epilepsies that are resistant to antiepileptic drugs. A relevant challenge is to be able to transform a negative MR image into an MR image with evidence of focal abnormality, which can substantially increase the odds of successful surgical treatment of seizures in a given patient. In our study, we demonstrated that hippocampal volumetry and signal quantification are still useful for increasing the detection of MR imaging–positive temporal lobe epilepsy, even in patients who had normal MR imaging results by visual analyses.1 We strongly believe that hippocampal volumetry should be used in the presurgical evaluation of patients with antiepileptic drug–resistant epilepsy. But for that, volumetry must be practical, not time consuming, and free of human bias. More efforts should be made to improve automatic techniques, including improved sensitivity and specificity, to make this technique clinically widely available.
- © 2013 by American Journal of Neuroradiology