Reward prediction tells us less than expected about musical pleasure
Research Article
February 6, 2019
Gold et al. (1) report a reinforcement-learning experiment where reward prediction errors (RPEs) were elicited by the consonance or dissonance of musical stimuli. They link these RPEs to activation in the nucleus accumbens (NAc) and to behavioral indices of learning. They conclude that music can function as a reward, that musical expectations are linked to pleasure, and that musical rewards motivate learning. We applaud the multifaceted methodological approach, which combines neuroimaging, behavioral data, and computational modeling. However, we believe that some of the conclusions put forward are not warranted by the evidence presented.
First, the paper conflates sensory prediction (predicting future events) with reward prediction (predicting rewards for future events) (2, 3). Fundamentally, the study addresses reward prediction, yet the abstract defines RPEs as signaling “the difference between expected and perceived musical events” (i.e., sensory prediction), and the introduction motivates the experiment by citing prior research on sensory prediction. While sensory prediction enjoys a long tradition of research linking it to musical aesthetics (4, 5), there is currently little evidence that reward prediction plays such an important role. Conflating the 2 types of prediction is problematic, because it implies that investigating reward prediction sheds light on the aesthetic role of sensory prediction, which is not the case.
Furthermore, while the paper purports to investigate musical RPEs, reward predictions in the experiment came from visual rather than musical cues, so it is not clear that the results generalize to typical music listening, where predictions (whether for reward or sensory events) primarily arise from the musical structure itself. This limits the ecological validity of the paradigm, which is better interpreted as a generic visual reinforcement learning task, where the rewarding stimulus simply happens to be musical.
Sign up for PNAS alerts.
Get alerts for new articles, or get an alert when an article is cited.
Lastly, the individual-differences analysis is undermined by methodological issues. The authors use stepwise regression to compensate for the multicollinearity in their features, yet stepwise regression (already heavily criticized in the statistical literature) is particularly vulnerable to multicollinearity (6–8). Moreover, the authors use robust regression to protect from the outliers in their figure 4 (1), yet these are high-leverage outliers, to which robust regression (specifically least absolute deviation) is particularly vulnerable (9). If the outliers are removed, these associations lose statistical significance, implying that the association between right NAc activity and learning was considerably less clear than originally argued. Reproducible code for these reanalyses is available on Code Ocean (10).
To conclude, while this study shows that music can function as a rewarding and reinforcing stimulus, it tells us little about the pleasures of ecological music listening because it addresses reward prediction in the absence of sensory prediction, using visual cues that are typically absent from music listening, and with statistical analyses that are driven by high-leverage outliers. However, we do think that musical reward prediction deserves further exploration, and we look forward to the authors’ future contributions in this area.
Data Availability
Data deposition: Reproducible code related to this work is available on Code Ocean (DOI: https://doi.org/10.24433/CO.4493464.v1).
Acknowledgments
R.d.F. and P.M.C.H. are supported by the Engineering and Physical Sciences Research Council and the Arts and Humanities Research Council Centre for Doctoral Training in Media and Arts Technology (EP/L01632X/1).
References
1
B. P. Gold et al., Musical reward prediction errors engage the nucleus accumbens and motivate learning. Proc. Natl. Acad. Sci. U.S.A. 116, 3310–3315 (2019).
2
N. C. Hansen, M. J. Dietz, P. Vuust, Commentary: Predictions and the brain: How musical sounds become rewarding. Front. Hum. Neurosci. 11, 168 (2017).
3
H. E. M. den Ouden, P. Kok, F. P. de Lange, How prediction errors shape perception, attention, and motivation. Front. Psychol. 3, 548 (2012).
4
L. B. Meyer, Emotion and Meaning in Music (Chicago University Press, 1956).
5
D. Huron, Sweet Anticipation: Music and the Psychology of Expectation (MIT Press, 2006).
6
S. Derksen, H. J. Keselman, Backward, forward and stepwise automated subset selection algorithms: Frequency of obtaining authentic and noise variables. Br. J. Math. Stat. Psychol. 45, 265–282 (1992).
7
R. P. Freckleton, Dealing with collinearity in behavioural and ecological data: Model averaging and the problems of measurement error. Behav. Ecol. Sociobiol. 65, 91–101 (2011).
8
M. J. Whittingham, P. A. Stephens, R. B. Bradbury, R. P. Freckleton, Why do we still use stepwise modelling in ecology and behaviour? J. Anim. Ecol. 75, 1182–1189 (2006).
9
C. Yu, W. Yao, Robust linear regression: A review and comparison. Commun. Stat. Simul. Comput. 46, 6261–6282 (2017).
10
P. M. C. Harrison, Reanalysis of Gold et al. (2019), Figures 4A and 4B. Code Ocean. https://doi.org/10.24433/CO.4493464.v1. Deposited 21 May 2019.
Information & Authors
Information
Published in
Classifications
Copyright
© 2019. Published under the PNAS license.
Data Availability
Data deposition: Reproducible code related to this work is available on Code Ocean (DOI: https://doi.org/10.24433/CO.4493464.v1).
Submission history
Published online: September 19, 2019
Published in issue: October 15, 2019
Acknowledgments
R.d.F. and P.M.C.H. are supported by the Engineering and Physical Sciences Research Council and the Arts and Humanities Research Council Centre for Doctoral Training in Media and Arts Technology (EP/L01632X/1).
Authors
Competing Interests
The authors declare no conflict of interest.
Metrics & Citations
Metrics
Altmetrics
Citations
Cite this article
Reward prediction tells us less than expected about musical pleasure, Proc. Natl. Acad. Sci. U.S.A.
116 (42) 20813-20814,
https://doi.org/10.1073/pnas.1913244116
(2019).
Copied!
Copying failed.
Export the article citation data by selecting a format from the list below and clicking Export.
Cited by
Loading...
View Options
View options
PDF format
Download this article as a PDF file
DOWNLOAD PDFLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Personal login Institutional LoginRecommend to a librarian
Recommend PNAS to a LibrarianPurchase options
Purchase this article to access the full text.