Locus coeruleus integrity is related to an exploitation-based decision-making bias in older adulthood

Edited by Michael Gazzaniga, University of California Santa Barbara College of Letters and Science, Santa Barbara, CA; received January 4, 2024; accepted April 9, 2024
May 21, 2024
121 (22) e2322617121

Abstract

Optimal decision-making balances exploration for new information against exploitation of known rewards, a process mediated by the locus coeruleus and its norepinephrine projections. We predicted that an exploitation-bias that emerges in older adulthood would be associated with lower microstructural integrity of the locus coeruleus. Leveraging in vivo histological methods from quantitative MRI-magnetic transfer saturation—we provide evidence that older age is associated with lower locus coeruleus integrity. Critically, we demonstrate that an exploitation bias in older adulthood, assessed with a foraging task, is sensitive and specific to lower locus coeruleus integrity. Because the locus coeruleus is uniquely vulnerable to Alzheimer’s disease pathology, our findings suggest that aging, and a presymptomatic trajectory of Alzheimer’s related decline, may fundamentally alter decision-making abilities in later life.
The balance between exploring for novel information or exploiting prior knowledge sits at the core of human decision-making. Do we watch that new Netflix series or return to the familiar warmth of Friends? Do we continue in our long-standing book club across town, or accept the neighbor’s invitation to join their new group? Such choices are ubiquitous in everyday life. Exploration involves the search for new sources of information and reward through learning and experimentation despite uncertain outcomes. Exploitation leverages our knowledge and lived experience to pursue more predictable rewards. We proposed that a decision-making bias emerges in later life, favoring exploitation over exploration. This bias is putatively attributable to a shifting cognitive architecture from controlled to more crystalized cognition, socioemotional changes, and associated declines in brain structure and function in later life (see ref. 1 for our neurocognitive model).
Evidence from nonhuman animal studies demonstrates that shifting between exploration and exploitation depends on changes in attentional tuning which are directly mediated by norepinephrine projections originating from the locus coeruleus (LC) (2). Flexible shifting from exploitation to exploration (or vice versa) requires narrowing or broadening of attentional tuning through shifts from phasic to tonic signaling of LC neurons. During exploitation, phasic signaling promotes narrower attentional tuning, as reward contingencies are already known. In contrast, during exploration, tonic signaling of LC neurons promotes broader tuning, initiating an attentional shift to explore for alternate sources of reward. As such, the LC plays a central role in flexibly switching between the two, as necessary for optimal decision-making outcomes (2).
Both ex vivo and in vivo studies have identified LC as an origin site for neuropathological changes associated with aging and neurodegeneration (36), suggesting vulnerability to age-related cognitive decline (79). However, characterizing the LC in vivo has been challenging given its small size, proximity to other brainstem structures, as well as its complex molecular composition (10). In this study, we applied quantitative MRI to derive Magnetization Transfer Saturation (MTsat) measures of LC microstructural integrity (11). MTsat is sensitive to the macromolecular content of a brain region, with signals driven largely by lipids and proteins within the phospholipid bilayer of cells, specifically myelin. Thus, higher MTsat values reflect greater microstructural integrity of the LC (12).
Here, we related LC integrity, measured with MTsat, to exploration versus exploitation-based decision-making on a foraging task (13) in a large sample of cognitively normal older adults. We hypothesized that lower microstructural integrity of LC would be associated with more exploitation-based choices, as predicted by our theoretical account (1).

Results

We first tested our core premise of an age-related exploitation bias on a foraging-based decision-making task. We derived measures of exploration and exploitation bias from a foraging task paradigm wherein participants foraged for berries among spatially distributed patches with varying densities of berry clusters (13). Exploitation was defined as staying in patches longer than optimal, while exploration was defined as leaving patches earlier than optimal. Optimal performance, defined here as Leave Time Difference (LTD), was calculated using marginal value theorem (ref. 13 and SI Appendix, Materials and Methods). Consistent with our model (1) and review (14), we observed a robust age-related exploitation bias on our foraging task (No bias = 0, positive score = exploration bias, negative score = exploitation-bias). Younger adults (N = 108): M = 6.7(SD = 13.8), range = −32.2 to 44.9; Older adults (N = 145): M = −3.1(SD = 15.1), range = −49.2 to 28.2; t(251) = −5.3, P < 0.001, Cohen’s d = 0.67).
Next, we examined MTsat associations with chronological age within our older adult sample who had LC MTsat data (N = 220). As predicted (9), microstructural integrity of LC was significantly lower with advancing age (Fig. 1B; r(218) = −0.25, P < 0.001; pr(215) = −0.25, P < 0.001). Critically, we included sex, education, and brain size in the partial correlation model, the latter of which was included here as a global measure of age-related differences in brain structure and suggests that MTsat is a specific marker of structural brain aging.
Fig. 1.
LC related to age and foraging behavior. (A) LC region of interest. (B) Lower LC MTsat, a measure of LC integrity, is associated with older age. (C) Lower LC MTsat is associated with greater exploitation, indexed by the leave time difference on the foraging task (lower LTD values reflect greater exploitation). p.u.: percent units.
Finally, we tested our central prediction that LC microstructural integrity would be associated with an exploitation bias within our sample of older adults who had both task and LC MTsat data (N = 133). As predicted, lower LC integrity was robustly associated with an exploitation-bias during foraging in this older adult cohort (Fig. 1C; r(131) = 0.22, P = 0.01; pr(126) = 0.28, P < 0.01). In the partial correlation analysis, we included the following as covariates: sex, education, brain size, age and MTsat of the corpus callosum to demonstrate specificity (Materials and Methods).

Discussion

Older age is associated with an exploitation bias as well as lower microstructural integrity of LC. Critically, lower LC integrity is robustly associated with greater exploitation on a foraging-based decision-making task. (i.e., foraging too long within, and suboptimally switching between, berry patches). Taken together, the results provide evidence that LC integrity is a neurobiological substrate for an exploitative decision-making bias in older adults.
We have argued that larger stores of prior knowledge, declining cognitive control, awareness of one’s mortality, and focus on positive close social bonds converge in later life; creating a prepotent tendency to exploit options with known rewards, while avoiding the ambiguity and risk associated with exploration (1). However, optimal decision-making depends on alternating between exploitation and exploration to effectively track shifting reward and risk probabilities over time. As this is mediated by firing patterns of LC neurons (2, 15), we reasoned that lower microstructural integrity in LC would exacerbate prepotent exploitation-biases in later life. Our findings provide strong support for this prediction. Moreover, the association remained reliable after controlling for brain volume and MTsat in a myelin-rich region of no interest, confirming specificity to LC integrity, over and above global changes in brain health.
Decisions to explore or exploit arguably sit at the very core of human volition (16). Subtle biases can fundamentally shape how we interact with and experience the world around us. Overreliance on prior knowledge and experience comes at the cost of new learning and discovery. In contrast, overreliance on novelty and information-seeking comes at the cost of stability and certainty. There is no single path. Understanding neurobiological changes that may shape this landscape, favoring one direction over another, is critically necessary to promote and preserve optimal decision-making abilities. Here, we provide evidence that subcortical brain changes impact the decision-making landscape in older adulthood, a crucial step toward revealing broader structural and functional brain changes that bias decisional capacities in later life. Future research integrating multimodal techniques, including high-field (7 Tesla MRI) structural and functional imaging, as well as neurochemical positron emission tomography imaging, will enable increasingly precise neurobiological models and unique insights into the neural mechanisms that may portend an exploitative decision-making bias in aging and brain disease.

Materials and Methods

Participants.

Cognitively healthy older adults with first-degree familial history of AD were recruited from the PResymptomatic EValuation of Experimental or Novel Treatments for AD (PREVENT-AD) cohort (17). All participants gave informed written consent before participating in the study. The procedures of the PREVENT-AD study were approved by the McGill institutional review board and/or the Comité d’éthique de la recherche du CIUSSS de l’ouest de l’ile de Montréal. To test our prediction of an age-related exploitation bias on the foraging task, we drew from a sample of younger adults reported in the original paper (ref. 13, https://osf.io/skh5y/). More information on the participant samples, including the PREVENT-AD program, is included in SI Appendix, Materials and Methods.

Behavioral Task (13).

The task was a timed, computer-based foraging task involving navigation of an avatar around berry patches to collect as many berries (points) as possible. Participants were free to forage within a patch or to search for a new patch. Exploitation bias was defined as staying in patches longer than optimal, while exploration bias was defined as leaving patches earlier than optimal (SI Appendix, Materials and Methods).

Neuroimaging.

MRI scans were acquired on a 3T Siemens PrismaFit at the Douglas Research Centre. MTsat values were acquired as part of a custom whole brain 1 mm isotropic voxel Multi-Parametric Mapping sequence provided by the McConnell Brain Imaging Centre of The Neuro. All details on the neuroimaging sequences and analysis pipelines are detailed in SI Appendix, Materials and Methods.

Data, Materials, and Software Availability

Data availability is governed by the Open Access protocols administered by the PResymptomatic EValuation of Experimental or Novel Treatments for AD (PREVENT-AD) study. Please refer to ref. 17. Foraging data (baseline) from the younger adult cohort (13) is available from the Open Science Foundation (https://osf.io/skh5y/). Code used for processing behavioral data are available from the Open Science Foundation (https://osf.io/skh5y/).

Acknowledgments

We would like to thank the PREVENT-AD research team and study participants for their time and dedication in collecting the data used in this study. Full acknowledgments can be found in Supplemental Materials. This work was supported in part by a grant from the Canadian Institute of Health Research (CIHR) to G.R.T and R.N.S., and grants from the Healthy Brains for Healthy Lives, Alzheimer’s Association (AARG-22-927100) and NIA R01 AG068563 to R.N.S., who is supported by Fonds de recherche du Québec–Santé. The PREVENT-AD cohort is supported in part by grants from CIHR (J.P. and S.V.), FRQS (J.P. and S.V.) and the J. L. Levesque Foundation. Data used in preparation of this article were obtained from the Presymptomatic Evaluation of Novel or Experimental Treatments for Alzheimer’s Disease (PREVENT-AD) program (https://douglas.research.mcgill.ca/stop-ad-centre). A complete listing of the PREVENT-AD Research Group can be found in: https://preventad.loris.ca/acknowledgements/acknowledgements.php?date=[2023-07-01].

Author contributions

G.R.T., P.H., L.W., J.T.-M., S.V., C.T., R.N.S., and P.-A.R.G. designed research; E.S., J.T.-M., and P.-A.R.G. performed research; A.W., R.v.D., I.R.L., G.B., C.H., C.T., R.N.S., and P.-A.R.G. contributed new reagents/analytic tools; P.H., A.W., and R.N.S. analyzed data; and G.R.T., P.H., A.W., R.v.D., L.W., I.R.L., G.B., C.H., K.M.W., E.S., J.T.-M., J.P., S.V., C.T., and R.N.S. wrote the paper.

Competing interests

The authors declare no competing interest.

Supporting Information

Appendix 01 (PDF)
Dataset S01 (DOCX)

References

1
R. N. Spreng, G. R. Turner, From exploration to exploitation: A shifting mental mode in late life development. Trends Cogn. Sci. 25, 1058–1071 (2021).
2
G. Aston-Jones, J. D. Cohen, Adaptive gain and the role of the locus coeruleus-norepinephrine system in optimal performance. J. Comp. Neurol. 493, 99–110 (2005).
3
M. Mather, C. W. Harley, The locus coeruleus: Essential for maintaining cognitive function and the aging brain. Trends Cogn. Sci. 20, 214–226 (2016).
4
P. Theofilas, S. Dunlop, H. Heinsen, L. T. Grinberg, Turning on the light within: Subcortical nuclei of the isodentritic core and their role in Alzheimer’s disease pathogenesis. J. Alzheimer’s Dis. 46, 17–34 (2015).
5
K. Y. Liu et al., In vivo visualization of age-related differences in the locus coeruleus. Neurobiol. Aging 74, 101–111 (2019).
6
M. J. Dahl, A. Kulesza, M. Werkle-Bergner, M. Mather, Declining locus coeruleus-dopaminergic and noradrenergic modulation of long-term memory in aging and Alzheimer’s disease. Neurosci. Biobehav. Rev. 153, 105358 (2023).
7
J. A. Elman et al., MRI-assessed locus coeruleus integrity is heritable and associated with multiple cognitive domains, mild cognitive impairment, and daytime dysfunction. Alzheimers Dement. 17, 1017–1025 (2021).
8
K. Y. Liu et al., Noradrenergic-dependent functions are associated with age-related locus coeruleus signal intensity differences. Nat. Commun. 11, 1712 (2020).
9
M. J. Dahl et al., The integrity of dopaminergic and noradrenergic brain regions is associated with different aspects of late-life memory performance. Nat. Aging 3, 1128–1143 (2023).
10
P. Trujillo, M. A. Aumann, D. O. Claassen, Neuromelanin-sensitive MRI as a promising biomarker of catecholamine function. Brain 147, 337–351 (2024).
11
M. J. Betts et al., Locus coeruleus imaging as a biomarker for noradrenergic dysfunction in neurodegenerative diseases. Brain 142, 2558–2571 (2019).
12
G. Helms, H. Dathe, K. Kallenberg, P. Dechent, High-resolution maps of magnetization transfer with inherent correction for RF inhomogeneity and T1 relaxation obtained from 3D FLASH MRI. Magn. Reson. Med. 60, 1396–1407 (2008).
13
R. van Dooren, R. de Kleijn, B. Hommel, Z. Sjoerds, The exploration-exploitation trade-off in a foraging task is affected by mood-related arousal and valence. Cogn. Affect Behav. Neurosci. 21, 549–560 (2021).
14
L. E. Wyatt, P. A. Hewan, J. Hogeveen, R. N. Spreng, G. R. Turner, Exploration versus exploitation decisions in the human brain: A systematic review of functional neuroimaging and neuropsychological studies. Neuropsychologia 192, 108740 (2024).
15
J. D. Cohen, S. M. McClure, A. J. Yu, Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 362, 933–942 (2007).
16
P. M. Todd, T. T. Hills, Foraging in mind. Curr. Dir. Psychol. Sci. 29, 309–315 (2020).
17
J. Tremblay-Mercier et al., Open science datasets from PREVENT-AD, a longitudinal cohort of pre-symptomatic Alzheimer’s disease. NeuroImage. Clin. 31, 102733 (2021).

Information & Authors

Information

Published in

The cover image for PNAS Vol.121; No.22
Proceedings of the National Academy of Sciences
Vol. 121 | No. 22
May 28, 2024
PubMed: 38771873

Classifications

Data, Materials, and Software Availability

Data availability is governed by the Open Access protocols administered by the PResymptomatic EValuation of Experimental or Novel Treatments for AD (PREVENT-AD) study. Please refer to ref. 17. Foraging data (baseline) from the younger adult cohort (13) is available from the Open Science Foundation (https://osf.io/skh5y/). Code used for processing behavioral data are available from the Open Science Foundation (https://osf.io/skh5y/).

Submission history

Received: January 4, 2024
Accepted: April 9, 2024
Published online: May 21, 2024
Published in issue: May 28, 2024

Keywords

  1. decision-making
  2. aging
  3. MRI
  4. human

Acknowledgments

We would like to thank the PREVENT-AD research team and study participants for their time and dedication in collecting the data used in this study. Full acknowledgments can be found in Supplemental Materials. This work was supported in part by a grant from the Canadian Institute of Health Research (CIHR) to G.R.T and R.N.S., and grants from the Healthy Brains for Healthy Lives, Alzheimer’s Association (AARG-22-927100) and NIA R01 AG068563 to R.N.S., who is supported by Fonds de recherche du Québec–Santé. The PREVENT-AD cohort is supported in part by grants from CIHR (J.P. and S.V.), FRQS (J.P. and S.V.) and the J. L. Levesque Foundation. Data used in preparation of this article were obtained from the Presymptomatic Evaluation of Novel or Experimental Treatments for Alzheimer’s Disease (PREVENT-AD) program (https://douglas.research.mcgill.ca/stop-ad-centre). A complete listing of the PREVENT-AD Research Group can be found in: https://preventad.loris.ca/acknowledgements/acknowledgements.php?date=[2023-07-01].
Author contributions
G.R.T., P.H., L.W., J.T.-M., S.V., C.T., R.N.S., and P.-A.R.G. designed research; E.S., J.T.-M., and P.-A.R.G. performed research; A.W., R.v.D., I.R.L., G.B., C.H., C.T., R.N.S., and P.-A.R.G. contributed new reagents/analytic tools; P.H., A.W., and R.N.S. analyzed data; and G.R.T., P.H., A.W., R.v.D., L.W., I.R.L., G.B., C.H., K.M.W., E.S., J.T.-M., J.P., S.V., C.T., and R.N.S. wrote the paper.
Competing interests
The authors declare no competing interest.

Authors

Affiliations

Gary R. Turner1
Department of Psychology, York University, Toronto, ON M3J 1P3, Canada
Patrick Hewan
Department of Psychology, York University, Toronto, ON M3J 1P3, Canada
Alfie Wearn
Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada
Roel van Dooren
Institutes of Psychology & Brain and Cognition, Leiden University, Leiden 2300 RC, The Netherlands
Lindsay Wyatt
Department of Psychology, York University, Toronto, ON M3J 1P3, Canada
Ilana R. Leppert
McConnell Brain Imaging Centre, McGill University, Montreal, QC H2A 2B4, Canada
Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada
Colleen Hughes
Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada
Kayla M. Williams
Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada
Elisabeth Sylvain
Douglas Mental Health University Institute, Verdun, QC H4H 1R3, Canada
Jennifer Tremblay-Mercier
Douglas Mental Health University Institute, Verdun, QC H4H 1R3, Canada
Judes Poirier
Douglas Mental Health University Institute, Verdun, QC H4H 1R3, Canada
Department of Psychiatry, McGill University, Montreal, QC H3A 1A1, Canada
McConnell Brain Imaging Centre, McGill University, Montreal, QC H2A 2B4, Canada
Douglas Mental Health University Institute, Verdun, QC H4H 1R3, Canada
Department of Psychiatry, McGill University, Montreal, QC H3A 1A1, Canada
Christine Tardif
Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada
McConnell Brain Imaging Centre, McGill University, Montreal, QC H2A 2B4, Canada
Department of Biomedical Engineering, McGill University, Montreal, QC H3A 2B4, Canada
Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada
McConnell Brain Imaging Centre, McGill University, Montreal, QC H2A 2B4, Canada
Douglas Mental Health University Institute, Verdun, QC H4H 1R3, Canada
Department of Psychiatry, McGill University, Montreal, QC H3A 1A1, Canada
Department of Psychology, McGill University, Montreal, QC H3A 1G1, Canada
for the PREVENT-AD Research Group3

Notes

2
To whom correspondence may be addressed. Email: [email protected].
1
G.R.T. and R.N.S. contributed equally to this work.
3
A complete list of the PREVENT-AD Research Group can be found in the SI Appendix.

Metrics & Citations

Metrics

Note: The article usage is presented with a three- to four-day delay and will update daily once available. Due to ths delay, usage data will not appear immediately following publication. Citation information is sourced from Crossref Cited-by service.


Altmetrics




Citations

Export the article citation data by selecting a format from the list below and clicking Export.

Cited by

    Loading...

    View Options

    View options

    PDF format

    Download this article as a PDF file

    DOWNLOAD PDF

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Personal login Institutional Login

    Recommend to a librarian

    Recommend PNAS to a Librarian

    Purchase options

    Purchase this article to access the full text.

    Single Article Purchase

    Locus coeruleus integrity is related to an exploitation-based decision-making bias in older adulthood
    Proceedings of the National Academy of Sciences
    • Vol. 121
    • No. 22

    Figures

    Tables

    Media

    Share

    Share

    Share article link

    Share on social media