A critical reanalysis of the relationship between genomics and well-being
- Nicholas J. L. Browna,1,
- Douglas A. MacDonaldb,
- Manoj Pratim Samantac,
- Harris L. Friedmand,e, and
- James C. Coynef,g
- aNew School of Psychotherapy and Counselling, London NW6 1DF, United Kingdom;
- bDepartment of Psychology, University of Detroit Mercy, Detroit, MI 48221-3038;
- cSystemix Institute, Redmond, WA 98053-5864;
- dPsychology and Interdisciplinary Inquiry Area, Saybrook University, San Francisco, CA 94111-1945;
- ePsychology Department, University of Florida, Gainesville, FL 32611-2250;
- fDepartment of Health Sciences, University Medical Center, University of Groningen, 9700 AD Groningen, The Netherlands; and
- gInstitute for Health, Health Care Policy and Aging Research, Rutgers University, Piscataway, NJ 08854-8062
-
Edited by Burton H. Singer, University of Florida, Gainesville, FL, and approved June 26, 2014 (received for review April 21, 2014)
Significance
This article critically reanalyzes the work of Fredrickson et al. [Fredrickson BL, et al. (2013) Proc Natl Acad Sci USA 110(33):13684–13689], which claimed to show that distinct dimensions of psychological well-being are differentially correlated with levels of expression of a selection of genes associated with distinct forms of immune response. We show that not only is Fredrickson et al.’s article conceptually deficient, but more crucially, that their statistical analyses are fatally flawed, to the point that their claimed results are in fact essentially meaningless. We believe that our findings may have implications for the reevaluation of other published genomics research based on comparable statistical analyses and that a variant of our methodology might be useful for such a reevaluation.
Abstract
Fredrickson et al. [Fredrickson BL, et al. (2013) Proc Natl Acad Sci USA 110(33):13684–13689] claimed to have observed significant differences in gene expression related to hedonic and eudaimonic dimensions of well-being. Having closely examined both their claims and their data, we draw substantially different conclusions. After identifying some important conceptual and methodological flaws in their argument, we report the results of a series of reanalyses of their dataset. We first applied a variety of exploratory and confirmatory factor analysis techniques to their self-reported well-being data. A number of plausible factor solutions emerged, but none of these corresponded to Fredrickson et al.’s claimed hedonic and eudaimonic dimensions. We next examined the regression analyses that purportedly yielded distinct differential profiles of gene expression associated with the two well-being dimensions. Using the best-fitting two-factor solution that we identified, we obtained effects almost twice as large as those found by Fredrickson et al. using their questionable hedonic and eudaimonic factors. Next, we conducted regression analyses for all possible two-factor solutions of the psychometric data; we found that 69.2% of these gave statistically significant results for both factors, whereas only 0.25% would be expected to do so if the regression process was really able to identify independent differential gene expression effects. Finally, we replaced Fredrickson et al.’s psychometric data with random numbers and continued to find very large numbers of apparently statistically significant effects. We conclude that Fredrickson et al.’s widely publicized claims about the effects of different dimensions of well-being on health-related gene expression are merely artifacts of dubious analyses and erroneous methodology.
Footnotes
- ↵1To whom correspondence should be addressed. Email: nick.brown{at}free.fr.
-
Author contributions: N.J.L.B. and D.A.M. performed research; N.J.L.B. contributed new reagents/analytic tools; N.J.L.B. and D.A.M. analyzed data; and N.J.L.B., D.A.M., M.P.S., H.L.F., and J.C.C. wrote the paper.
-
The authors declare no conflict of interest.
-
This article is a PNAS Direct Submission.
-
This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1407057111/-/DCSupplemental.





