Gray Matter Age Prediction as a Biomarker for Risk of Dementia
- aDepartment of Medical Informatics, Erasmus MC University Medical Center, 3015 CE, Rotterdam, The Netherlands;
- bMechanical Engineering, Faculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, 2628 CJ, Delft, The Netherlands;
- cDepartment of Epidemiology, Erasmus MC University Medical Center, 3015 CE, Rotterdam, The Netherlands;
- dResearch Unit of Medical Imaging, Physics and Technology, University of Oulu, 90014, Oulu, Finland;
- eDepartment of Computer Science, University of Copenhagen, 1165 Copenhagen, Denmark;
- fDepartment of Radiology and Nuclear Medicine, Erasmus MC University Medical Center, 3015 CE, Rotterdam, The Netherlands;
- gImaging Physics, Faculty of Applied Sciences, Delft University of Technology, 2628 CJ, Delft, The Netherlands
See allHide authors and affiliations
Edited by Marcus E. Raichle, Washington University in St. Louis, St. Louis, MO, and approved September 10, 2019 (received for review February 13, 2019)

Significance
The difference between brain age estimated from MRI and chronological age is thought to serve as an important biomarker reflecting pathological processes in the brain. Several recent studies showed the relation between accelerated brain aging and various disorders. However, until now, the utility of such an age difference for preclinical screening using longitudinal studies was absent. To fill this gap, we first built a deep learning model using brain MRI from a population-based study including 5,496 participants. And then, using follow-up information, we observed that this age difference was significantly associated with the risk of dementia. Therefore, our study shows that the difference between MRI-brain predicted and chronological age is potentially a biomarker for early dementia risk screening.
Abstract
The gap between predicted brain age using magnetic resonance imaging (MRI) and chronological age may serve as a biomarker for early-stage neurodegeneration. However, owing to the lack of large longitudinal studies, it has been challenging to validate this link. We aimed to investigate the utility of such a gap as a risk biomarker for incident dementia using a deep learning approach for predicting brain age based on MRI-derived gray matter (GM). We built a convolutional neural network (CNN) model to predict brain age trained on 3,688 dementia-free participants of the Rotterdam Study (mean age 66 ± 11 y, 55% women). Logistic regressions and Cox proportional hazards were used to assess the association of the age gap with incident dementia, adjusted for age, sex, intracranial volume, GM volume, hippocampal volume, white matter hyperintensities, years of education, and APOE ε4 allele carriership. Additionally, we computed the attention maps, which shows which regions are important for age prediction. Logistic regression and Cox proportional hazard models showed that the age gap was significantly related to incident dementia (odds ratio [OR] = 1.11 and 95% confidence intervals [CI] = 1.05–1.16; hazard ratio [HR] = 1.11, and 95% CI = 1.06–1.15, respectively). Attention maps indicated that GM density around the amygdala and hippocampi primarily drove the age estimation. We showed that the gap between predicted and chronological brain age is a biomarker, complimentary to those that are known, associated with risk of dementia, and could possibly be used for early-stage dementia risk screening.
The human brain continuously changes throughout the entire lifespan. These changes partially reflect a normal aging process and are not necessarily pathological (1). However, neurodegenerative diseases, including dementia, also affect brain structure and function (2, 3). Therefore, a better understanding and modeling of normal brain aging can help to disentangle these two processes and improve the detection of early-stage neurodegeneration.
Age prediction models based on brain MRI are a popular trend in neuroscience (4⇓⇓–7). The difference between predicted and chronological age is thought to serve as an important biomarker reflecting pathological processes in the brain. Several recent studies showed the relation between accelerated brain aging and various disorders, such as Alzheimer’s disease (8), schizophrenia, epilepsy, or diabetes (7, 9, 10).
In recent years, CNNs have become the methodology of choice for analyzing medical images. These models are able to learn complex relations between input data and desired outcomes. Recent studies (11, 12) were able to demonstrate that CNN models can be successfully applied in brain MRI-based age prediction (5, 6).
Although cross-sectional studies have suggested that the gap between predicted and chronological age may serve as a biomarker for dementia diagnosis, it remains unclear whether this is also the case for the years preceding dementia diagnosis (5, 7). It was shown in recent research that the brain age gap is associated with mortality risk (13). Longitudinal studies examining the link between such a gap and incident dementia are lacking and are crucial for validation of this biomarker for early-stage neurodegeneration detection. Using a deep learning (DL) model, we investigated the association of the GM age gap with incident dementia in a large population-based sample of middle-aged and elderly subjects.
Methods
Study Population.
Data were acquired from the Rotterdam Study, an ongoing population-based cohort study among the inhabitants of Ommoord, a suburb of Rotterdam, the Netherlands (14, 15). More details of the study design and population are described in SI Appendix, Methods 1.
Data from the Rotterdam Study are not publicly available due to informed consent and legal restrictions (e.g., General Data Protection Regulation law in the European Union). However, specific requests for access to the data can be addressed to the Rotterdam Study Management Team that assesses the proposals and adjudicates access—in line with national and international regulations—on a case-by-case basis.
Image Processing.
A 1.5 T GE Signa Excite MRI scanner was used to acquire multiparametric MRI brain data as previously reported (14). Voxel-based morphometry (VBM) was performed according to an optimized VBM protocol as was previously described (16, 17). First, all T1-weighted images were segmented into supratentorial GM, white matter (WM), and cerebrospinal fluid using a previously described k-nearest neighbor algorithm, which was trained on 6 manually labeled atlases (18). Functional MRI of the Brain’s Software Library software was used for VBM data processing (19). All GM density maps were nonlinearly registered to the standard Montreal Neurological Institute GM probability template with a 1 × 1 × 1 mm3 voxel resolution.
A spatial modulation procedure was used to avoid differences in absolute GM volume due to the registration. This involved multiplying voxel density values by the Jacobian determinants estimated during spatial normalization. We did not apply smoothing. While VBM smoothing procedures increase the signal to noise ratio, they can affect the features which the network learns from GM. The Gaussian smoothing is hardly invertible. Additionally, smoothing is only a subgroup of possible mathematical operations which the network filters in the convolutional layer can represent. Therefore, if the Gaussian smoothing is important for prediction, the neural network will incorporate this in one or more convolutional filters.
FreeSurfer 6.0 was used to segment the brain and estimate intracranial volume (ICV), GM volume, hippocampal volume, and WM hyperintensity (WMH) volume (20).
Other measurements.
APOE ε4 carriership was determined using a PCR on coded DNA samples. If these values were missing, Haplotype Reference Consortium imputed genotype values for rs7412 and rs429358 were used to define the APOE ε4 carrier status. Measurements on more characteristics are described in SI Appendix, Methods 2.
DL Model.
A full description of the applied DL model is presented in the SI Appendix, Methods 3. Briefly, a DL model takes a set of inputs and respective outputs from a training set and finds an optimal nonlinear relation between them. A CNN is a class of DL techniques which takes in multidimensional images as model input. These networks are generally used with a variety of different techniques and algorithms, which together define how the model optimizes the input–output relationship (21, 22). We describe this in detail in the model architecture.
Our 3-dimensional (3D) regression CNN model is designed to predict brain age using 3D GM density maps from VBM as input. It is inspired by ConvNet (23) and deep CNN (22) as shown in SI Appendix, Fig. S2. Besides GM brain images, we provide information about the sex of the subject. This allows the network to adjust for GM differences between male and female subjects.
The dataset, excluding subjects with incident dementia, was randomly split into 3 sets: training (3,688 subjects), validation (1,099 subjects), and test (550 subjects). Subjects with incident dementia (159 subjects) were put in a fourth independent dataset. The CNN was trained using the training set as described in SI Appendix, Methods 4. For training, we used all available scans for each subject. Prediction accuracy was assessed on the test set. Model accuracy was measured based on the absolute gap, or mean absolute error (MAE) of prediction, i.e., the difference between model output and real chronological age (gap = agebrain,predicted – agechronological). Given the design of the Rotterdam Study, several follow-up scans were available for some subjects. For training, we used all available scans for each subject. These training methods allowed us to increase the number of training images thereby introducing a natural type of data augmentation.
Attention mapping.
We retrieved attention maps from the trained networks using gradient-weighted class activation mapping (24). Attention maps show which areas on the subject GM image are more important for age prediction. More details about implementation of attention maps can be found in SI Appendix, Methods 5.
Statistical Analysis.
Reproducibility of the CNN age prediction was quantified using the intraclass correlation coefficient (ICC[3,1]), computed on a subset of 80 persons out of the test set who were scanned twice with a time interval of 1–9 wk (25).
In order to be able to compare our findings with previous studies, logistic regression models and Cox proportional hazard models were used to assess the association between the age gap and the incidence of dementia. We adjusted the regression models for biomarkers, which are known for their relation with dementia: age and sex (model I); additional GM volume, ICV, hippocampal volume, and WMHs (model II); and years of education and APOE ε4 carriership (model III) (26, 27). The logistic regression model used the occurrence of dementia development during follow-up as output. The proportional hazards and linearity assumption were met for the Cox proportional hazard models. Python and R were used to perform the statistical analyses (28⇓⇓–31).
Results
The study population characteristics are described in Table 1. The algorithm was trained and validated on random subsets of subjects with mean age 66.09 ± 10.76 y and 55% females; and mean age 64.84 ± 9.69 y and 54% females, respectively. The following results are reported for the test set (mean age 64.85 ± 10.82 y and 55% females).
Characteristics of data sets derived from the population-based Rotterdam Study
Network Performance.
The overall performance measured on the test set was MAE = 4.45 ± 3.59 y (Fig. 1) with a correlation between chronological and predicted brain age of 0.85 (P value = 4.76 × 10−156). A reproducibility score of ICC = 0.97 (95% CI 0.96–0.98) was achieved. No significant difference in prediction was found between male and female subjects (P value = 0.34), and detailed numbers are provided in SI Appendix, Text 1.
Performance of the CNN on the test dataset. (A) The plot depicts chronological age (x-axis) and brain-predicted age (y-axis) with MAE. The dashed line indicates the ideal case x=y. (B) The figure shows reproducibility of the CNN performance. Scans 1 and 2 are taken with an interval of 1-9 weeks. The dashed line indicates a perfect reproducibility and consistent predicting of the network.
Attention map.
SI Appendix, Fig. S5 shows the global attention map of the test set, indicating the areas contributing to age prediction in bright color, as well as the increase in attention map values over age. We found that the amygdala and hippocampus are not only important for predicting brain age, but also that these regions grow more important with increasing chronological age, which is shown in SI Appendix, Fig. S5B. A quantitative analysis per brain region is presented in Table 2, which shows that highest mean intensities were computed for the nucleus accumbens (0.89) and amygdala (0.71). Highest intensity quintiles were computed for the nucleus accumbens (0.99), amygdala (0.98), and subcallosal area (0.98).
Quantitative analysis of the attention map per brain region. Mean and fifth quintiles (lower boundary) of attention map intensity per brain region are listed. Brain regions are grouped by lobes
Logistic Regression.
We computed a logistic regression for the three models as shown in Table 3. The age gap was significantly associated with dementia incidence while age, sex, GM volume, ICV volume, hippocampal volume, WMH volume, years of education, and the APOE ε4 allele carriership were included in the model with model III: OR = 1.09 (95% CI 1.04–1.14) per year age gap.
Association of gap between brain age and chronological age with incident dementia assessed by logistic regression and Cox proportional hazards models, both in the total study sample and in a subsample with a minimum follow-up time of 5 years
Survival Analysis.
As shown in Table 3 and Fig. 2, the age gap was significantly associated with the incidence of dementia with model III, HR = 1.09 (95% CI 1.04–1.14) per year age gap. These associations were similar in a subsample with a follow-up time for indecent dementia of more than 5 y, model III, HR = 1.09 (95% CI 1.01–1.16) per year age gap.
Adjusted survival curves for dementia-free probability by age gap. Dementia-free probability is presented over time for participants with different age gap values, divided into quintiles. Lower gap values correspond to chronological ages surpassing brain age, whereas higher gap values correspond to chronological ages that are lower than the brain age. Plots are based on Cox proportional hazards models, adjusted for age, sex, total grey matter volume, intracranial volume, hippocampal volume, white matter hyperintensity volume, years of education and APOE ε4 carriership status, using a marginal approach.
Gap-Associated Features.
SI Appendix, Table S1 and Fig. S7 show a list of features that can affect the brain pathology and may be associated with the gap (10). Significantly lower values were found for GM volume, hippocampal volume, and WMH volume in the highest quintile.
Discussion
In a large sample of community-dwelling middle-aged and older adults, using a DL model for brain age prediction on MRI-derived GM tissue density, we found that the gap between predicted brain age and chronological age was related to an increased risk of dementia, independent of standard established risk factors for dementia.
Our trained CNN model showed a similar MAE value in age prediction compared to previous studies that use a multimodal data model (5) and DL-based approach (6), which achieved performances of MAE = 4.29 and MAE = 4.16, respectively. Previous studies looked cross sectionally (5, 6) at the association of the age gap and dementia occurrences, while in the current study, we evaluated associations in longitudinal data. As nonreversible pathological changes already occur years prior to diagnosis, identifying early-stage biomarkers for dementia is of importance. The age gap has the potential to be utilized alongside other clinical risk factors and biomarkers to separate the population into categories with sufficiently distinct degrees of risk to drive clinical or personal decision-making, e.g., dementia screening and informed life planning.
Moreover, we retrieved attention maps from the model, showing the relative importance of different brain regions for age prediction. While the network looks at the entire GM (SI Appendix, Fig. S6), the attention pattern is quite complex, which suggests that the gap holds more specific information than global measures of GM volume when predicting brain age. This was further established by the association found between the gap and the incident dementia, which remained significant after adjusting for total GM volume. Interestingly, based on the attention maps, the amygdala and hippocampus, in particular, are relatively more important for age prediction, also increasing in attention and map intensity with older subjects (SI Appendix, Fig. 5B). This is in accordance to literature where significant negative associations between GM volume and age have been reported for these regions (2, 26). Atrophy of these two structures has also shown to be more prevalent in dementia patients, including years before diagnosis (32, 33). Yet, even after adjusting for hippocampal volume, the association between the age gap and the risk of dementia remained significant. This shows that the features which the neural network extracts from images go beyond just global or local volumetric measurements. A more in-depth evaluation of the attention map can be found in SI Appendix, Text 2.
Limitations.
We were not able to perfectly predict the age for healthy subjects based only on MRI. We assume that, due to biological similarity of the brain within a range of several years, there will always be an according level of uncertainty in the age prediction.
While the MAE value of our model was comparable with previous research, the age range of our population-based study is more limited and shifted toward the elderly. Such a study design does not invalidate the subsequent dementia analysis, however, a model trained on an age range which covers the entire lifespan may increase the power for dementia associations.
We have added sex information as an additional input to our CNN to correct for prediction bias. It is known that there are volumetric differences in GM between females and males (34), i.e., for the same age range, there is a difference in male and female GM volume. Therefore, we adjusted for sex as a bias factor.
Furthermore, we excluded subjects with dementia and stroke while training the model, but there are a number of other factors which can influence overall or local GM volume and affect the age prediction and gap (SI Appendix and Table 2). Although only total GM volume differed significantly between subjects with a high versus a low gap, effect estimates of some features differed substantially. Further research is needed to investigate gap-associated features, which may explain gap differences. These features can also introduce bias, which may be solved by adding the information as a covariate to the model. This, however, requires the respective information on the subjects, which can make the method less accessible for general use.
Additionally, brain age regression dilution (35) can affect the performance measurement. Therefore, following the suggestions from previous research (36), we have adjusted our dementia analysis models by chronological age to minimize such an influence on the incident dementia analysis.
The current CNN model is incapable of handling unfamiliar datasets, limiting its practical use. A drawback of the CNN is that the training data should be representative for the data for which the trained network is used. Thus, limiting the generalizability of our method. However, this can be addressed by training models on more diverse or new datasets. It would, therefore, be interesting to extend this model to another dataset and validate its use in a different context.
Lastly, the interpretation of the neural network attention maps should be performed with caution. Increased or decreased attention in specific brain regions might be due to various study specific factors, e.g., the image acquisition protocol, image preprocessing etc. Therefore, further research with an independent dataset is needed to confirm such findings. In general, better methods for neural network interpretation should be developed.
Conclusion
We showed that the gap between age predicted from brain MRI and chronological brain age is a biomarker associated with a risk of dementia development. DL visualization allows further investigation of the gap and neurodegeneration with respect to the human brain. This suggests that the age gap may be applicable for dementia risk screening, but there is still room for improvement in accuracy and for further research into the association between gap and dementia compared to other biomarkers.
Acknowledgments
Mr. Aleksei Tiulpin was supported by the KAUTE Foundation. The Rotterdam Study is funded by the Erasmus Medical Center and Erasmus University, Rotterdam, Netherlands Organization for the Health Research and Development (ZonMw), the Research Institute for Diseases in the Elderly, the Ministry of Education, Culture and Science, the Ministry for Health, Welfare and Sports, the European Commission (Directorate-General XII), and the Municipality of Rotterdam. The authors are grateful to the study participants, the staff from the Rotterdam Study, and the participating general practitioners and pharmacists. H.H.H.A. is supported by ZonMW Grant 916.19.151.
Footnotes
↵1J.W. and M.J.K. contributed equally to this work.
↵2W.J.N. and G.V.R. contributed equally to this work.
- ↵3To whom correspondence may be addressed. Email: g.roshchupkin{at}erasmusmc.nl.
Author contributions: J.W., M.J.K., M.W.V., M.A.I., W.J.N., and G.V.R. designed research; J.W., M.J.K., A.T., F.D., M.d.B., H.H.H.A., and G.V.R. performed research; J.W., M.J.K., A.T., F.D., and G.V.R. analyzed data; and J.W., M.J.K., M.W.V., M.A.I., W.J.N., and G.V.R. wrote the paper.
Competing interest statement: The authors declare no competing interest. W.J.N. is co-founder, scientific lead, and shareholder of Quantib BV. Other authors report no biomedical financial interests.
This article is a PNAS Direct Submission.
This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1902376116/-/DCSupplemental.
Published under the PNAS license.
References
- ↵
- E. J. Vinke et al
- ↵
- ↵
- ↵
- ↵
- F. Liem et al
- ↵
- ↵
- T. Kaufmann et al
- ↵
- ↵
- ↵
- ↵
- P. Herent,
- S. Jegou,
- G. Wainrib,
- T. Clozel
- ↵
- H. Li,
- T. D. Satterthwaite,
- Y. Fan
- ↵
- J. H. Cole et al
- ↵
- ↵
- ↵
- ↵
- G. V. Roshchupkin et al
- ↵
- ↵
- ↵
- ↵
- ↵
- F. Pereira,
- C. J. C. Burges,
- L. Bottou,
- K. Q. Weinberger
- A. Krizhevsky,
- I. Sutskever,
- G. E. Hinton
- ↵
- K. Simonyan,
- A. Zisserman
- ↵
- R. R. Selvaraju et al
- ↵
- ↵
- ↵
- ↵
- G. Van Rossum,
- F. L. Drake
- ↵
- D. Ascher,
- P. Dubois,
- K. Hinsen,
- J. Hugunin,
- T. Oliphant
- ↵
- F. Chollet
- ↵
- R Core Team
- ↵
- ↵
- ↵
- ↵
- S. M. Smith,
- D. Vidaurre,
- F. Alfaro-Almagro,
- T. E. Nichols,
- K. L. Miller
- ↵
Citation Manager Formats
Article Classifications
- Biological Sciences
- Neuroscience