Racial bias in pain assessment and treatment recommendations, and false beliefs about biological differences between blacks and whites
Edited by Susan T. Fiske, Princeton University, Princeton, NJ, and approved March 1, 2016 (received for review August 18, 2015)
Significance
The present work examines beliefs associated with racial bias in pain management, a critical health care domain with well-documented racial disparities. Specifically, this work reveals that a substantial number of white laypeople and medical students and residents hold false beliefs about biological differences between blacks and whites and demonstrates that these beliefs predict racial bias in pain perception and treatment recommendation accuracy. It also provides the first evidence that racial bias in pain perception is associated with racial bias in pain treatment recommendations. Taken together, this work provides evidence that false beliefs about biological differences between blacks and whites continue to shape the way we perceive and treat black people—they are associated with racial disparities in pain assessment and treatment recommendations.
Abstract
Black Americans are systematically undertreated for pain relative to white Americans. We examine whether this racial bias is related to false beliefs about biological differences between blacks and whites (e.g., “black people’s skin is thicker than white people’s skin”). Study 1 documented these beliefs among white laypersons and revealed that participants who more strongly endorsed false beliefs about biological differences reported lower pain ratings for a black (vs. white) target. Study 2 extended these findings to the medical context and found that half of a sample of white medical students and residents endorsed these beliefs. Moreover, participants who endorsed these beliefs rated the black (vs. white) patient’s pain as lower and made less accurate treatment recommendations. Participants who did not endorse these beliefs rated the black (vs. white) patient’s pain as higher, but showed no bias in treatment recommendations. These findings suggest that individuals with at least some medical training hold and may use false beliefs about biological differences between blacks and whites to inform medical judgments, which may contribute to racial disparities in pain assessment and treatment.
Sign up for PNAS alerts.
Get alerts for new articles, or get an alert when an article is cited.
A young man goes to the doctor complaining of severe pain in his back. He expects and trusts that a medical expert, his physician, will assess his pain and prescribe the appropriate treatment to reduce his suffering. After all, a primary goal of health care is to reduce pain and suffering. Whether he receives the standard of care that he expects, however, is likely contingent on his race/ethnicity. Prior research suggests that if he is black, then his pain will likely be underestimated and undertreated compared with if he is white (1–10). The present work investigates one potential factor associated with this racial bias. Specifically, in the present research, we provide evidence that white laypeople and medical students and residents believe that the black body is biologically different—and in many cases, stronger—than the white body. Moreover, we provide evidence that these beliefs are associated with racial bias in perceptions of others’ pain, which in turn predict accuracy in pain treatment recommendations. The current work, then, addresses an important social factor that may contribute to racial bias in health and health care.
Extant research has shown that, relative to white patients, black patients are less likely to be given pain medications and, if given pain medications, they receive lower quantities (1–10). For example, in a retrospective study, Todd et al. (10) found that black patients were significantly less likely than white patients to receive analgesics for extremity fractures in the emergency room (57% vs. 74%), despite having similar self-reports of pain. This disparity in pain treatment is true even among young children. For instance, a study of nearly one million children diagnosed with appendicitis revealed that, relative to white patients, black patients were less likely to receive any pain medication for moderate pain and were less likely to receive opioids—the appropriate treatment—for severe pain (6).
These disparities in pain treatment could reflect an overprescription of medications for white patients, underprescription of medications for black patients, or, more likely, both. Indeed, there is evidence that overprescription is an issue, but there is also clear evidence that the underprescription of pain medications for black patients is a real, documented phenomenon (1, 4). For example, a study examining pain management among patients with metastatic or recurrent cancer found that only 35% of racial minority patients received the appropriate prescriptions—as established by the World Health Organization guidelines—compared with 50% of nonminority patients (4).
Broadly speaking, there are two potential ways by which racial disparities in pain management could arise. The first possibility is that physicians recognize black patients’ pain, but do not to treat it, perhaps due to concerns about noncompliance or access to health care (7, 8). The second possibility is that physicians do not recognize black patients’ pain in the first place, and thus cannot treat it. In fact, recent work suggests that racial bias in pain treatment may stem, in part, from racial bias in perceptions of others’ pain. This research has shown that people assume a priori that blacks feel less pain than do whites (11–17). In a study by Staton et al. (14), for instance, patients were asked to report how much pain they were experiencing, and physicians were asked to rate how much pain they thought the patients were experiencing. Physicians were more likely to underestimate the pain of black patients (47%) relative to nonblack patients (33.5%). Of note, this research has also shown that racial attitudes, measured both implicitly and explicitly, do not predict racial bias in pain perception or treatment (11, 15, 18), with the exception of one study showing that implicit pro-white attitudes predicted physicians’ likelihood of recommending thrombolysis treatment (19). Racial bias in perceptions of pain (and possibly treatment) does not appear to be borne out of racist attitudes. In other words, it is likely not the result of racist individuals acting in racist ways. To date, then, it is unclear what beliefs account for disparities in pain assessment and treatment. Here, we examine the extent to which beliefs about biological differences between blacks and whites (e.g., beliefs that blacks have thicker skin than do white people or that black people’s blood coagulates more quickly than white people’s blood) are associated with racial bias in pain perception and treatment recommendations.
Beliefs that blacks and whites are fundamentally and biologically different have been prevalent in various forms for centuries. In the United States, these beliefs were championed by scientists, physicians, and slave owners alike to justify slavery and the inhumane treatment of black men and women in medical research (20–25). In the 19th century, prominent physicians sought to establish the “physical peculiarities” of blacks that could “serve to distinguish him from the white man” (23). Such “peculiarities” included thicker skulls, less sensitive nervous systems, and diseases inherent in dark skin (20, 21, 23). Dr. Samuel Cartright, for instance, wrote that blacks bore a “Negro disease [making them] insensible to pain when subjected to punishment” (20). Other physicians believed that blacks could tolerate surgical operations with little, if any, pain at all (22, 25). Well into the 20th century, researchers continued to experiment on black people based in part on the assumption that the black body was more resistant to pain and injury. The military covertly tested mustard gas and other chemicals on black soldiers during World War II, and the US Public Health Service, in collaboration with the Tuskegee Institute, studied the progression of untreated syphilis in black men from 1932 to 1972.
Today, many laypeople, scientists, and scholars continue to believe that the black body is biologically and fundamentally different from the white body and that race is a fixed marker of group membership, rooted in biology (26–28). In fact, many people insist that black people are better athletes—stronger, faster, and more agile—as a result of natural selection and deliberate breeding practices during slavery (29–33). Research suggests that people even believe that black people are more likely than white people to be capable of fantastical mental and physical feats, such as withstanding extreme heat from burning coals (17). These biological conceptions of race are only weakly if at all correlated with racial attitudes (27, 34). They are nonetheless consequential. Research has shown that biological conceptions and related beliefs are associated with greater acceptance of racial disparities (27) and even racial bias in pain perception (17). Indeed, in one study, white participants who believed black people can tolerate extreme heat more than white people can, for example, were more likely to think that black people feel less pain than do white people (17).
In the present work, we examine whether beliefs about biological differences are associated with racial bias in pain perception and treatment recommendations. Specifically, we test whether people—including people with some medical training—believe that black people feel less pain than do white people, and we test whether people with some medical training recommend fewer or weaker pain medications to black vs. white patients. In addition, the present work extends prior work in three important ways. First, it documents whether people with some medical training (medical students and residents who already treat patients) hold false beliefs about biological differences between blacks and whites in contemporary times. Second, it tests whether these beliefs predict racial bias in perceptions of others’ pain and racial bias in the accuracy of treatment recommendations among a sample of white medical students and residents. Third, it investigates whether racial bias in pain perception is related to racial bias in pain management. We focus on white participants given the historical context of black–white relations, particularly in the medical context (20–25). Analyses for nonwhite participants can be found in the SI Text for the interested reader.
In two studies, we asked people to make judgments about another person’s pain. In study 1, we used a between-participants design in which laypeople were randomly assigned to rate the pain of either a black or a white target. In study 2, we used a within-participants design in which medical students and residents provided pain ratings and treatment recommendations for both a black and a white target. In addition to pain ratings, we measured beliefs about biological differences between blacks and whites using 15 items (e.g., black people’s skin is thicker than white people’s skin; see SI Text for the full list of items). We predicted that these beliefs would be associated with racial bias in pain perception.
Study 1
In study 1, we first establish that individuals without medical training endorse beliefs about biological differences between blacks and whites and demonstrate that these beliefs are related to racial bias in pain perception. We recruited 121 participants, 92 of whom met our a priori criteria (i.e., white, born in the United States, native English speakers). Participants gave informed consent in accordance with policies of the Institutional Review Board (IRB) of the University of Virginia. Participants reported the amount of pain they would feel across 18 scenarios (e.g., “I slam my hand in a car door”; scale: 1 = not painful, 2 = somewhat painful, 3 = moderately painful, 4 = extremely painful) and were then randomly assigned to rate the pain of a gender-matched black or white target across the same scenarios.
Participants also rated the extent to which 15 biological differences between blacks and whites are true or untrue on a six-point scale (1 = definitely untrue, 2 = probably untrue, 3 = possibly untrue, 4 = possibly true, 5 = probably true, 6 = definitely true; see Table 1 for a list of the items, and SI Text and Table S1 for additional descriptive information for the measure). Here, we report results using a composite averaging the false items about biological differences between the black body and the white body for each participant (α = 0.92). We provide analyses using all items in Table S2.
Table 1.
Item | Study 1: Online sample (n = 92) | Study 2 | |||
---|---|---|---|---|---|
First years (n = 63) | Second years (n = 72) | Third years (n = 59) | Residents (n = 28) | ||
Blacks age more slowly than whites | 23 | 21 | 28 | 12 | 14 |
Blacks’ nerve endings are less sensitive than whites’ | 20 | 8 | 14 | 0 | 4 |
Black people's blood coagulates more quickly than whites' | 39 | 29 | 17 | 3 | 4 |
Whites have larger brains than blacks | 12 | 2 | 1 | 0 | 0 |
Whites are less susceptible to heart disease than blacks* | 43 | 63 | 83 | 66 | 50 |
Blacks are less likely to contract spinal cord diseases* | 42 | 46 | 67 | 56 | 57 |
Whites have a better sense of hearing compared with blacks | 10 | 3 | 7 | 0 | 0 |
Blacks’ skin is thicker than whites’ | 58 | 40 | 42 | 22 | 25 |
Blacks have denser, stronger bones than whites* | 39 | 25 | 78 | 41 | 29 |
Blacks have a more sensitive sense of smell than whites | 20 | 10 | 18 | 3 | 7 |
Whites have a more efficient respiratory system than blacks | 16 | 8 | 3 | 2 | 4 |
Black couples are significantly more fertile than white couples | 17 | 10 | 15 | 2 | 7 |
Whites are less likely to have a stroke than blacks* | 29 | 49 | 63 | 44 | 46 |
Blacks are better at detecting movement than whites | 18 | 14 | 15 | 5 | 11 |
Blacks have stronger immune systems than whites | 14 | 21 | 15 | 3 | 4 |
False beliefs composite (11 items), mean (SD) | 22.43 (22.93) | 14.86 (19.48) | 15.91 (19.34) | 4.78 (9.89) | 7.14 (14.50) |
Range | 0–100 | 0–81.82 | 0–90.91 | 0–54.55 | 0–63.64 |
Combined mean (SD) (medical sample only) | 11.55 (17.38) |
For ease of presentation, we shortened the items; see SI Text for full items and additional information. For ease of interpretation and ease of presentation, we collapsed the scale and coded responses marked as possibly, probably, or definitely untrue as 0 and possibly, probably, or definitely true, as 1, resulting in percentages of individuals who endorsed each item. Bold entries represent the items included in the false beliefs about biological differences between blacks and whites composite.
*
Items that are factual or true.
Table S1.
Composite | Study 1 | Study 2 | ||||
---|---|---|---|---|---|---|
α | M% (SD%) | M (SD) | α | M% (SD%) | M (SD) | |
False beliefs | 0.92 | 22.43 (22.93) | 2.34 (0.89) | 0.92 | 11.55 (17.38) | 1.97 (0.73) |
All items | 0.93 | 26.74 (23.31) | 2.50 (0.85) | 0.91 | 23.42 (17.98) | 2.38 (0.71) |
M% and SD% reflect the average (SD) percentage of beliefs participants rated as possibly, probably, or definitely true. The M and SD represent the average level of endorsement for the items, using the six-point scale. See SI Text for the items used in each composite. The false beliefs composite was the primary measure for the analyses presented in the manuscript.
Table S2.
Composite | β | SE | F | P | |
---|---|---|---|---|---|
False beliefs | −0.07 | 0.03 | 4.36 | 0.040 | 0.05 |
All items | −0.07 | 0.03 | 4.04 | 0.048 | 0.05 |
False beliefs is the primary measure for the analyses presented in the manuscript. See SI Text for a list of the items for both composites.
We conducted all of the analyses using continuous measures of false beliefs and pain ratings. On average, participants endorsed 23.82% (SD = 24.01) of the biological beliefs and 22.43% (SD = 22.93) of the false beliefs specifically. About 73% of the sample endorsed at least one of the false items (i.e., indicated that an item was possibly, probably, or definitely true; Table 1). We regressed pain ratings on target race, false beliefs, and their interaction, controlling for age, gender, and self-ratings of pain (see Table S3 for the correlations between covariates and dependent measures for both studies). Consistent with previous work, results revealed a main effect of target race [β = −0.07, SE = 0.03, F(1,85) = 5.50, P = 0.021, = 0.06, such that participants reported lower pain ratings for the black vs. white target. This effect was qualified by the predicted interaction between target race and false beliefs [β = −0.07, SE = 0.03, F(1,85) = 4.36, P = 0.040, = 0.05; Fig. 1]. Simple slope analyses revealed that participants who endorsed fewer false beliefs (−1 SD) did not differ in their pain estimates for a black vs. a white target [β = −0.01, SE = 0.05, F(1, 85) = 0.02, P > 0.250]. However, target race did predict racial bias in pain ratings among participants who endorsed more false beliefs (+1 SD) [β = −0.14, SE = 0.05, F(1,85) = 9.78, P = 0.002, = 0.10], such that participants who rated the black target reported lower pain estimates than did participants who rated the white target. Interestingly, among this sample, the bias emerged because participants high in false beliefs rated the pain of the black target lower and the pain of the white target higher than did participants low in false beliefs. In other words, relative to participants low in false beliefs, they seemed to assume that the black body is stronger and that the white body is weaker.
Fig. 1.
Table S3.
Covariate | Study 1 pain ratings | Study 2 pain bias | Study 2 treatment recommendation bias |
---|---|---|---|
Age | 0.26* | 0.07 | −0.04 |
Gender | 0.15 | −0.002 | −0.01 |
Self-pain | 0.46** | — | — |
Medical cohort | — | 0.03 | 0.01 |
For study 2, difference scores were used for the correlations to reflect racial bias (i.e., white pain minus black pain; white accuracy minus black accuracy). The dashes indicate a variable that was not measured in the study.
*
P < 0.05; **P < 0.01.
Study 1 thus demonstrates that white adults without medical training endorse at least some beliefs about biological differences between blacks and whites, many of which are false and fantastical in nature (e.g., black people’s blood coagulates more quickly than white people’s blood). Study 1 also demonstrates that these beliefs are related to racial bias in pain perception among a sample of white adults without medical training. Given the well-documented, pervasive racial disparities in pain management, understanding who might contribute to this racial bias and why is of paramount importance. Thus, we next examined whether people with some degree of medical training also endorse these beliefs, and if so, whether these beliefs are associated with racial bias in pain perception and pain treatment recommendations. Study 2 extends the findings of study 1 in at least three important ways: (i) it examines racial bias in a relevant context—medicine—using medical cases similar to those used in medical training; (ii) it extends our investigation to a sample with at least some medical training—medical students and residents; and (iii) it considers a critical downstream outcome—racial bias in pain treatment recommendations.
Study 2
We collected data from a total of 418 medical students and residents. Two hundred twenty-two met the same a priori criteria as in study 1 and completed the study (first years, n = 63; second years, n = 72; third years, n = 59; residents, n = 28). Participants gave informed consent in accordance with policies of the IRB of the University of Virginia. After consenting, participants read two mock medical cases about a black and a white patient and made pain ratings (scale: 0 = no pain to 10 = worst possible pain) and medication recommendations (dummy coded for accuracy: 1 = accurate, 0 = inaccurate) for each.† They also completed the same measure of beliefs about biological differences between blacks and whites as in study 1. We again averaged the 11 items that captured our variable of interest (α = 0.92) (see Table 1 and Table S1 for descriptive information; analyses for the composite with all items can be found in Table S4). On average, participants endorsed 11.55% (SD = 17.38) of the false beliefs. About 50% reported that at least one of the false belief items was possibly, probably, or definitely true (Table 1). These percentages are noticeably lower compared with those in study 1 (50% vs. 73%); however, given this sample (medical students and residents), the percentages for false beliefs are surprisingly high.
Table S4.
Composite | Pain ratings | Treatment recommendation accuracy | ||||
---|---|---|---|---|---|---|
F | P | F | P | |||
False beliefs | 9.56 | 0.002 | 0.02 | 5.68 | 0.018 | 0.01 |
All items | 10.81 | 0.001 | 0.02 | 6.05 | 0.015 | 0.01 |
False beliefs is the primary measure for the analyses presented in the manuscript. See SI Text for a list of the items in both composites.
First, we examined whether those who endorsed false beliefs exhibited a racial bias in pain assessment. We modeled pain ratings as a function of target race (as a repeated measure), false beliefs (as a between-participants measure), and their interaction, controlling for age, gender, and medical cohort.‡,§ Results revealed only the predicted target race by false beliefs interaction [F(1,211) = 9.56, P = 0.002, = 0.02; Fig. 2A]. To decompose this interaction, we conducted simple slope analyses. We constructed a difference score to reflect racial bias in pain perception, subtracting black pain scores from white pain scores; greater, positive scores indicate that a participant rated the white patient as feeling more pain than the black patient. The simple slope analyses indicated that participants who endorsed more false beliefs (+1 SD) rated the black target as feeling less pain than the white target [β = 0.45, SE = 0.20, t(211) = 2.24, P = 0.026]. Conversely, participants who endorsed fewer false beliefs (−1 SD) rated the black target as feeling more pain than the white target [β = −0.48, SE = 0.20, t(211) = −2.34, P = 0.020]. In other words, as in study 1, participants in study 2 who endorsed false beliefs about biological differences between blacks and whites exhibited a racial bias in pain perception similar to the bias shown in previous work (11–17). Unexpectedly, participants who did not endorse such beliefs exhibited a bias in the opposite direction.
Fig. 2.
Table S5.
Model | F | P |
---|---|---|
GLM (with repeated factor) | 9.56 | 0.002 |
Mixed effects | 6.40 | 0.012 |
The GLM is the model reported in the main text.
Table S6.
Model | β | SE | F (χ2) | P |
---|---|---|---|---|
GLM (with repeated factor) | — | — | 5.68 | 0.018 |
Mixed effects | −0.11 | 0.06 | 4.70 | 0.031 |
Generalized linear models | ||||
Logit link | −0.62 | 0.32 | 3.55 | 0.061 |
Probit link | −0.38 | 0.20 | 3.76 | 0.054 |
Ordered logistic regressions | ||||
Logit link | 0.40 | 0.17 | (5.89) | 0.015 |
Probit link | 0.22 | 0.09 | (5.64) | 0.018 |
The GLM is the model reported in the main text. A difference score (white accuracy minus black accuracy) was used for ordered logistic regressions, yielding three potential outcomes: −1, 0, 1; higher, positive estimates reflect greater racial bias, and, thus, the estimates for these models are positive. The dashes indicate that there are no beta and standard error estimates for this statistical model.
We next modeled the accuracy of treatment recommendations (coded as 1 = accurate, 0 = inaccurate) as a function of target race (as a repeated measure), false beliefs (as a between-participants measure), and their interaction, controlling for age, gender, and medical cohort. Once again, we found only the predicted interaction between target race and false beliefs [F(1,192) = 5.68, P = 0.018, = 0.01; Fig. 2B]. To decompose this interaction, we again conducted simple slope analyses on the difference score in treatment recommendation accuracy for the black vs. white target (white accuracy minus black accuracy; greater, positive scores indicate greater likelihood of recommending an accurate treatment for a white vs. black target). These analyses indicated that participants who endorsed more false beliefs (+1 SD) were less accurate in their treatment recommendations for the black target compared with the white target [β = 0.15, SE = 0.06, t(192) = 2.47, P = 0.014]. Conversely, participants who endorsed fewer false beliefs (−1 SD) did not differ in their treatment recommendation accuracy [β = −0.06, SE = 0.06, t(192) = −1.05, P > 0.250]. In other words, participants who endorsed more false beliefs about biological differences between blacks and whites showed a racial bias in the accuracy of their treatment recommendations. Participants who did not endorse such beliefs showed no bias in treatment recommendation accuracy.
We also examined the relationship between racial bias in pain perception and racial bias in treatment recommendation accuracy. We correlated racial bias in pain perception (white pain minus black pain) with racial bias in treatment recommendation accuracy (accuracy for white patient minus accuracy for black patient), covarying out age, gender, and medical cohort. This analysis revealed a significant and sizable positive correlation, such that greater racial bias in pain ratings was associated with greater racial bias in the accuracy of treatment recommendations (r = 0.46, P < 0.0001). As predicted, racial bias in pain perception is related to racial bias in the accuracy of treatment recommendations.
Last, we conducted a mediation analysis to test whether racial bias in pain perception mediated the racial bias in treatment recommendation accuracy. When adding racial bias in pain assessment (white pain minus black pain) to the model predicting racial bias in treatment recommendation accuracy, false beliefs was no longer a significant predictor [B = 0.05, SE = 0.04, F(1,191) = 1.22, P > 0.250, = 0.01], whereas racial bias in pain perception continued to predict racial bias in treatment recommendation accuracy [B = 0.25, SE = 0.04, F (1,191) = 44.44, P < 0.0001, = 0.19], suggesting mediation.
Study 2 demonstrates that, similar to white laypersons in study 1, many white medical students and residents hold beliefs about biological differences between blacks and whites, many of which are false and fantastical in nature, and that these false beliefs are related to racial bias in pain perception. Furthermore, study 2 also reveals that white medical students and residents who endorsed false beliefs showed racial bias in the accuracy of their pain treatment recommendations. Specifically, participants who endorsed more of these beliefs reported that a black (vs. white) target patient would feel less pain and they were less accurate in their treatment recommendations for the black (vs. white) patient. Although the effect sizes for these findings were not large ( = 0.03 and 0.04), the practical importance is significant: those endorsing more false beliefs rated the pain of a black (vs. white) patient half a scale point lower and were less accurate in their treatment recommendations 15% of the time.
In contrast to white medical students and residents who endorsed false beliefs, those who did not endorse (or endorsed fewer) false beliefs reported that a white (vs. black) target patient would feel less pain. This opposite bias perhaps reflects real-world differences, as previous work has shown that black patients tend to report greater pain than do white patients (7, 24, 42). This opposite bias could also reflect participants’ attempt to compensate for known racial disparities (see ref. 13 for a similar explanation). Of note, these medical students and residents did not exhibit a racial bias in treatment recommendations. In other words, endorsing fewer false beliefs was associated with the perception that whites feel less pain but not with insufficient treatment recommendations for white patients. In contrast, endorsing more false beliefs was associated with perceptions that blacks feel less pain and a “commensurate” insufficient treatment recommendation for black patients. It thus seems that racial bias in pain perception has pernicious consequences for accuracy in treatment recommendations for black patients and not for white patients.
Unexpectedly, shifts in racial bias as a function of false beliefs stemmed from shifts in perceptions of the white target and not the black target in study 2 (it stemmed from both shifts in perceptions of the white target and black target in study 1). Although perhaps counterintuitive, this pattern of results is consistent with research on intergroup bias demonstrating that discrimination often occurs due to ingroup favoritism rather than outgroup hostility (43). In the present case, it is possible that shifts in perceptions of the white target (and not the black target) reflect this kind of bias; it is possible that these shifts reflect positive (empathic) cognitions about white ingroup members rather than negative (callous) cognitions about black outgroup members.
Limitations of the present work offer avenues for future research. For practical reasons, we used survey methods to document medical students’ and residents’ beliefs and racial bias. Future work will need to test whether white and nonwhite medical personnel in more advanced stages of their career also hold beliefs about biological differences between blacks and whites, and if so, whether these beliefs have consequences for pain assessment and treatment in real medical contexts. Future work may also delve into the nature of the racial bias: whether it reflects ingroup favoritism rather than outgroup derogation. This distinction may be useful for the development of interventions. These limitations aside, studies 1 and 2 make at least three important contributions. First, they provide the first evidence that racial bias in pain assessment is associated with racial bias in the accuracy of pain treatment recommendations. Second, they reveal that a substantial number of white people—laypersons with no medical training and medical students and residents—hold beliefs about biological differences between blacks and whites, many of which are false and even fantastical in nature. To our knowledge, this is the first demonstration of medical personnel (students and residents with at least some medical training) endorsing such beliefs in modern times. Third, the current studies demonstrate that these beliefs are associated with racial bias in perceptions of others’ pain. Interestingly, in study 2, that bias seemed to result from shifts in perceptions of the white target’s pain more so than perceptions of the black target’s pain, suggesting that perceptions of whites’ frailty may shape racial bias in pain perception as much, if not more, than perceptions of blacks’ strength.
Concluding Remarks
This last year marks the 30th anniversary of the landmark 1985 Report of the Secretary’s Task Force on Black and Minority Health—more commonly known as the Heckler Report—the first comprehensive documentation of racial disparities in health by medical experts. This report put a national spotlight on the pervasive racial inequities in health and issued a resounding call to eliminate health disparities. Although this call was met with a surge in research efforts and substantial changes in medical programs, policy, and legislation, the ultimate goal of eliminating racial disparities remains elusive. Racial disparities in health and health care continue to be a problem in the United States, a point underscored by the US Department of Health and Human Services’ “clarion call to continue to take action toward ending health disparities” (minorityhealth.hhs.gov/Blog/BlogPost.aspx?BlogID=68). The present work sheds light on a heretofore unexplored source of racial bias in pain assessment and treatment recommendations within a relevant population (i.e., medical students and residents), in a context where racial disparities are well documented (i.e., pain management). It demonstrates that beliefs about biological differences between blacks and whites—beliefs dating back to slavery—are associated with the perception that black people feel less pain than do white people and with inadequate treatment recommendations for black patients’ pain.
Materials and Methods
Study 1.
Participants.
We recruited a sample of 121 adults on Amazon’s Mechanical Turk in exchange for a small amount of money. As in previous work (15), we excluded participants who were not born in the United States or native English speakers, as well as participants who did not complete all of the relevant measures. We also excluded all nonwhite participants, given the historical context of black–white relations, particularly in the medical context (20–25). Our final sample consisted of 92 participants (28% female; Mage = 26.70, SD = 8.76).
Procedure and materials.
Participants gave informed consent in accordance with policies of the IRB of the University of Virginia. After consenting, participants were asked to provide their age and gender so the survey program could route the participant to a gender-matched target. They then rated the amount of physical pain they would feel across 18 scenarios and were randomly assigned to rate the pain of a gender-matched black or white target across the same 18 scenarios (SI Text). Next, participants completed a 15-item measure of beliefs about biological differences between blacks and whites that are true or untrue (see Table 1 and SI Text for a list of items and descriptive information). To compose our conceptual variable of interest—false beliefs about biological differences between blacks and whites—we created an average rating of 11 of the items (α = 0.92; see bold items in Table 1 and see SI Text for additional information on the measure). All analyses were conducted using continuous measures of beliefs and pain ratings. After this measure, participants provided demographic information, including their race/ethnicity, nationality, and primary language. SI Text provides additional information on materials, methods, and results. Data and study materials are also available at https://osf.io/crxwa/.
Study 2.
Participants.
We recruited cohorts of first-, second-, and third-year medical students from a large public university, who completed the study online during class sessions. We also recruited medical residents from multiple sites, who completed the study online at their convenience. The sample included 418 participants (first years, n = 134; second years, n = 133; third years, n = 117; residents, n = 34); we had no set sample size, but rather collected data from as many participants as we were able to obtain. As in previous work (15), we excluded participants who were not native English speakers and/or American because racial bias in pain perception is likely a cultural phenomenon. Including these participants in our analyses does not change the pattern of results. We again excluded nonwhite participants given the historical context of black–white relations, particularly in the medical context (20–25). The final sample consisted of 222 participants (first years, n = 63; second years, n = 72; third years, n = 59; residents, n = 28; 48% female; Mage = 25.18, SD = 2.66). Some participants did not report age, gender, and/or race/ethnicity and thus degrees of freedom vary across analyses.
Procedure and materials.
Participants gave informed consent in accordance with policies of the IRB of the University of Virginia. After consenting, participants were asked to provide their age and gender so the survey program could route the participant to gender-matched targets. Participants then read two mock medical cases about a black and a white patient. They were asked to estimate the pain of each patient and to make a recommendation to treat the patient’s pain. Next, participants were asked to provide demographic information and to complete the same measure of beliefs about biological differences between blacks and whites as in study 1, averaging the 11 false items to create a measure of false beliefs (α = 0.92). Last, participants responded to debriefing questions about the study and then were debriefed in person (medical students) or read an electronic debriefing (medical residents). SI Text provides additional information on materials, methods, and results. Data and study materials are also available at https://osf.io/crxwa/.
SI Text
All study materials and data can be freely and openly accessed online at https://osf.io/crxwa/.
Study 1: Laypersons Without Medical Training (Method and Materials).
Participants gave informed consent in accordance with policies of the IRB of the University of Virginia. After consenting, participants were asked to provide their age and gender so the survey program could route the participant to a gender-matched target. They then rated the amount of physical pain they would feel across 18 scenarios (e.g., “I slam my hand in a car door,” “I cut myself with a sheet of paper”) using a four-point scale (1 = not painful, 2 = somewhat painful, 3 = moderately painful, 4 = extremely painful). Participants were then randomly assigned to rate the pain of a gender-matched black or white target across the same 18 scenarios.
Next, participants completed a 15-item measure of beliefs about biological differences between blacks and whites that are true or untrue on a six-point scale (1 = definitely untrue, 2 = probably untrue, 3 = possibly untrue, 4 = possibly true, 5 = probably true, 6 = definitely true; see list of items and descriptive information below and Table 1). Of the 15 items, 4 were true, including 3 items pertaining to disease and morbidity (e.g., blacks are less likely to contract spinal cord diseases); 11 items were false statements about blacks and whites (e.g., black people’s blood coagulates more quickly than white people’s blood), and of these, 8 were in the direction of black strength and white frailty (see previous example) and 3 were in the direction of white strength and black frailty (e.g., whites have a better sense of hearing compared with blacks). To compose our conceptual variable of interest—false beliefs about biological differences between blacks and whites—we created an average rating of the 11 false items (α = 0.92; see bold items in Table 1). Note that one item about racial differences in bone density is tricky; bone strength is strongly associated with lifestyle and diet, and research on racial group differences in bone density and its relationship to fracture risk is mixed. For example, a recent review of the literature on ethnic differences in bone health concluded that there are numerous factors that are crucial to consider when investigating bone strength between racial groups and that bone density alone cannot account for fracture risk (44). Given this mixed evidence, we exclude this item from our composite.
We report results using the false beliefs composite, but we provide descriptive information and analyses using a composite of all items in Tables S1 and S2. Both composites yielded similar patterns of results. All analyses were conducted using continuous measures of false beliefs and pain ratings. After this measure, participants provided demographic information, including their race/ethnicity, age, nationality, and primary language. See Table S3 for correlations between covariates (age, gender, self-ratings of pain) and pain ratings.
Study 2: Medical Students and Residents.
Method.
Procedure and materials.
Participants completed the study through Qualtrics, an online survey program. With the help of faculty and administrators at a medical school, we were given permission to conduct the study with medical students during classroom sessions. Each cohort completed the survey in the same classroom, but on separate dates. A white experimenter provided a link to the study, and participants who chose to participate completed the study online. To recruit medical residents, a faculty member of the medical school and coauthor sent the survey link to other faculty to be distributed to residents, who voluntarily completed the study online at their convenience.
Participants gave informed consent in accordance with policies of the IRB of the University of Virginia. After consenting, participants were asked to provide their age and gender so the survey program could route the participant to gender-matched targets. Participants then read two mock-medical cases about a black and white patient. They were asked to estimate the pain of each patient and to make a recommendation to treat the patient’s pain. Next, participants were asked to provide demographic information. Table S3 provides correlations between covariates (age, gender, self-ratings of pain, medical cohort) and dependent measures. They then answered questions regarding the subjectivity and difficulty of estimating others’ pain (e.g., “How subjective are these types of pain assessments?”), followed by the same measure of beliefs about biological differences between blacks and whites as in study 1. Last, participants responded to debriefing questions about the study and then were debriefed in person (medical students) or read an electronic debriefing (medical residents).
Medical cases.
Participants read two mock medical cases about a gender-matched black patient and white patient (the order of patient race and medical case was counterbalanced across participants); one case referenced an ankle fracture and the other case referenced a kidney stone. Each case was formatted similarly to real medical and mock cases with which students and residents are familiar. The cases contained a brief description of the patient and the medical issue, physical examination notes (e.g., vital statistics, description of patient’s physical presentation), and imaging or laboratory results. For example, in one case, the patient described her/his injury as resulting from slipping on a step and feeling her/his ankle “crack.” The physical examination notes contained such observations as the swelling, range of motion of the ankle, and lack of bone protrusions, as well as the patient’s temperature, heart rate, height, and weight. The case also included X-ray results confirming a fracture.
We manipulated the critical factor—patient race—in two ways. We included a stereotypically black or white patient name at the top of the medical case (black names: Taneisha, Kiesha, Darnell, Jermaine; white names: Hannah, Katelyn, Brett, Connor). We also indicated the ostensible race of the patient in the case information, denoting that the patient was either a Caucasian female/male or an African-American female/male. Each participant received one medical case about a black patient and one medical case about a white patient; thus, patient race was our within-subjects factor.
Pain ratings and treatment recommendation accuracy.
After reading each medical case, participants were asked to rate how much pain they thought the patient would be experiencing on a traditional 11-point medical scale (0 = no pain; 1; 2 = mild pain; 3; 4 = moderate pain; 5; 6 = severe pain; 7; 8 = very severe pain; 9; 10 = worst possible pain). They were then asked to provide a free response for the type of pain medication they would recommend for the patient’s pain. In any medical case, the accurate treatment for pain is based on both objective factors (e.g., imaging, laboratory results) and subjective factors (e.g., patient’s self-reported symptoms and pain). To determine the appropriate treatment for our two specific cases, we provided 10 experienced physicians with both medical cases and asked them to indicate what they would recommend for pain management. The majority of physicians reported that they would prescribe a narcotic (e.g., opiate, oxycodone, tramadol) for both the fracture case (9 of 10 physicians) and the kidney stone case (8 of 10 physicians). Moreover, these physician recommendations align with World Health Organizations (WHO) guidelines for the treatment of acute pain (45). Accordingly, we dummy coded participants’ treatment recommendations as being accurate (coded as 1) or inaccurate (coded as 0). See below for a list of representative responses and their respective codings. Of note, observations where participants wrote “I don’t know” (or something similar) were coded as missing because it is unclear how to interpret such responses. However, coding these as inaccurate does not change the pattern of results.
Beliefs about biological differences between blacks and whites.
Participants completed the same 15-item measure of beliefs about biological differences between blacks and whites from study 1 (see Table 1 for the percentage of participants by medical cohort who endorsed each). We again created a false beliefs composite of 11 of the 15 items (α = 0.92). Here, we again report results using the false beliefs composite, but we provide descriptive information and analyses using a composite of all of the items in Tables S1 and S4; this composite yielded similar patterns of results. All analyses were conducted using continuous measures of false beliefs and pain ratings, except for the dummy-coded treatment recommendation accuracy measure.
Additional items.
Because this study was conducted during class times for students, we were required to include an educational component with reflection questions about pain assessment. Participants were asked to indicate “How subjective are these types of pain assessments?” and “How difficult was it to estimate the pain of another person?” on a five-point scale (1 = not at all, 2 = a little bit, 3 = somewhat, 4 = very, 5 = extremely), as well as a dichotomous yes/no question: “Can doctors and patients ever provide ‘accurate’ pain ratings?” Participants were also given the chance to provide open-ended responses to each of these items. These items were not relevant to the variables of interest and were thus not included in our analyses. They are, however, accessible online for the interested reader.
Results.
Additional analyses.
Of note, one could argue that first-year students’ lack of experience in medical training may be unduly influencing the treatment recommendation accuracy findings. However, the pattern of results does not change when removing first-year students [F(1,147) = 5.50, P = 0.020, = 0.01 (target race × false beliefs interaction)].
Readers may also be interested in analyses for nonwhite participants (Asian, n = 43; black, n = 21; biracial, n = 28; Hispanic/Latino, n = 11; other, n = 3). When examining the same models for nonwhites, there were no effects for pain ratings or treatment recommendation accuracy (P > 0.250).
Beliefs about biological differences between blacks and whites measure.
INSTRUCTIONS: In this part, you will be given a list of statements regarding race and health. Some of these statements are true, while others are not. Please read each statement and rate the extent to which you believe it is true, from Definitely Untrue to Definitely True.
Scale: 1 = Definitely untrue, 2 = Probably untrue, 3 = Possibly untrue, 4 = Possibly true, 5 = Probably true, 6 = Definitely true.
1.
On average, Blacks age more slowly than Whites.
2.
Black people’s nerve-endings are less sensitive than White people’s nerve-endings.
3.
Black people’s blood coagulates more quickly–because of that, Blacks have a lower rate of hemophilia than Whites.
4.
Whites, on average, have larger brains than Blacks.
5.
Whites are less susceptible to heart disease like hypertension than Blacks.
6.
Blacks are less likely to contract spinal cord diseases like multiple sclerosis.
7.
Whites have a better sense of hearing compared with Blacks.
8.
Black people’s skin has more collagen (i.e., it’s thicker) than White people’s skin.
9.
Blacks, on average, have denser, stronger bones than Whites.
10.
Blacks have a more sensitive sense of smell than Whites; they can differentiate odors and detect faint smells better than Whites.
11.
Whites have more efficient respiratory systems than Blacks.
12.
Black couples are significantly more fertile than White couples.
13.
Whites are less likely to have a stroke than Blacks.
14.
Blacks are better at detecting movement than Whites.
15.
Blacks have stronger immune systems than Whites and are less likely to contract colds.
False beliefs about biological differences between blacks and whites.
False beliefs are listed as items 1, 2, 3, 4, 7, 8, 10, 11, 12, 14, and 15.
Representative responses and codings for treatment recommendations.
If participants mentioned both a narcotic and a nonnarcotic, their response was coded as a 1. Participants who wrote responses such as “I don’t know” were coded as missing. One could argue for coding these responses as inaccurate (0); doing so does not change the pattern of results. Given the uncertainty in interpreting these types of responses, we decided to err on the more conservative side of marking these observations as “missing” rather than “inaccurate.”
1 = narcotic (accurate).
Opioids
Opiates
Hydrocodone
Morphine
Vicodin
Prescription pain killers
Fentanyl
Dilaudid
0 = all others (inaccurate).
Tylenol
Anti-inflammatory
NSAIDS
Acetaminophen
OTC pain meds
None
Ice pack
Lidocaine
Data Availability
Data deposition: Data and materials are available through the Open Science Framework, https://osf.io/crxwa/.
Acknowledgments
We thank Laurie Archbald-Pannone and Mary Kate Worden for help and support recruiting medical students; Tim Wilson for helpful comments on this manuscript; and Jennifer Doleac, Derek Ford, Isaac Mbiti, and Jay Shimshack for providing advice regarding data analyses.
Supporting Information
Supporting Information (PDF)
Supporting Information
- Download
- 74.03 KB
References
1
KO Anderson, CR Green, R Payne, Racial and ethnic disparities in pain: Causes and consequences of unequal care. J Pain 10, 1187–1204 (2009).
2
VL Bonham, Race, ethnicity, and pain treatment: Striving to understand the causes and solutions to the disparities in pain treatment. J Law Med Ethics 29, 52–68 (2001).
3
A Cintron, RS Morrison, Pain and ethnicity in the United States: A systematic review. J Palliat Med 9, 1454–1473 (2006).
4
CS Cleeland, R Gonin, L Baez, P Loehrer, KJ Pandya, Pain and treatment of pain in minority patients with cancer. The Eastern Cooperative Oncology Group Minority Outpatient Pain Study. Ann Intern Med 127, 813–816 (1997).
5
HP Freeman, R Payne, Racial injustice in health care. N Engl J Med 342, 1045–1047 (2000).
6
MK Goyal, N Kuppermann, SD Cleary, SJ Teach, JM Chamberlain, Racial disparities in pain management of children with appendicitis in emergency departments. JAMA Pediatr 169, 996–1002 (2015).
7
CR Green, et al., The unequal burden of pain: Confronting racial and ethnic disparities in pain. Pain Med 4, 277–294 (2003).
8
VL Shavers, A Bakos, VB Sheppard, Race, ethnicity, and pain among the U.S. adult population. J Health Care Poor Underserved 21, 177–220 (2010).
9
BD Smedley, AY Stith, AR Nelson Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care (National Academies Press, Washington, DC, 2013).
10
KH Todd, C Deaton, AP D’Adamo, L Goe, Ethnicity and analgesic practice. Ann Emerg Med 35, 11–16 (2000).
11
RA Dore, KM Hoffman, AS Lillard, S Trawalter, Children’s racial bias in perceptions of others’ pain. Br J Dev Psychol 32, 218–231 (2014).
12
KH Hoffman, S Trawalter, Assumptions about life hardship and pain perception. Group Process Intergroup Relat, 2016).
13
VA Mathur, JA Richeson, JA Paice, M Muzyka, JY Chiao, Racial bias in pain perception and response: Experimental examination of automatic and deliberate processes. J Pain 15, 476–484 (2014).
14
LJ Staton, et al., When race matters: Disagreement in pain perception between patients and their physicians in primary care. J Natl Med Assoc 99, 532–538 (2007).
15
S Trawalter, KM Hoffman, A Waytz, Racial bias in perceptions of others’ pain. PLoS One 7, e48546 (2012).
16
LD Wandner, CD Scipio, AT Hirsh, CA Torres, ME Robinson, The perception of pain in others: How gender, race, and age influence pain expectations. J Pain 13, 220–227 (2012).
17
A Waytz, KM Hoffman, S Trawalter, A superhumanization bias in Whites’ perceptions of Blacks. Soc Psychol Personal Sci 6, 352–359 (2014).
18
AH Haider, et al., Association of unconscious race and social class bias with vignette-based clinical assessments by medical students. JAMA 306, 942–951 (2011).
19
AR Green, et al., Implicit bias among physicians and its prediction of thrombolysis decisions for black and white patients. J Gen Intern Med 22, 1231–1238 (2007).
20
SA Cartwright, Report on the diseases and physical peculiarities of the Negro race. New Orleans Med Surg J 7, 691–715 (1851).
21
JD Guillory, The pro-slavery arguments of Dr. Samuel A. Cartwright. La Hist 9, 209–227 (1968).
22
MS Pernick A Calculus of Suffering: Pain, Professionalism, and Anesthesia in Nineteenth-Century America (Columbia Univ Press, New York, 1985).
23
P Tidyman, A sketch of the most remarkable disease of the negroes of the southern states. Phila J Med Phys Sci 12, 306–338 (1826).
24
S Trawalter, KM Hoffman, Got pain? Racial bias in perceptions of pain. Soc Personal Psychol Compass 9, 146–157 (2015).
25
HA Washington Medical Apartheid: The Dark History of Medical Experimentation on Black Americans from Colonial Times to the Present (Doubleday, New York, 2006).
26
DA Prentice, DT Miller, Psychological essentialism of human categories. Curr Dir Psychol Sci 16, 202–206 (2007).
27
MJ Williams, JL Eberhardt, Biological conceptions of race and the motivation to cross racial boundaries. J Pers Soc Psychol 94, 1033–1047 (2008).
28
A Morning The Nature of Race: How Scientists Think and Teach About Human Difference (Univ of California Press, Berkeley, CA, 2011).
29
JM Hoberman Darwin’s Athletes: How Sport Has Damaged Black America and Preserved the Myth of Race (Houghton Mifflin Company, New York, 1997).
30
M Hughey, DR Goss, A level playing field? Media constructions of athletics, genetics, and race. Ann Am Acad Pol Soc Sci 661, 182–211 (2015).
31
GA Sailes The African American Athlete: Social Myths and Stereotypes. African Americans in Sports: Contemporary Themes, ed GA Sailes (Transaction Publishers, New Brunswick, NJ), pp. 183–198 (1998).
32
RE Hall, The ball curve: Calculated racism and the stereotype of African American men. J Black Stud 32, 104–119 (2001).
33
S Price, Whatever happened to the White athlete? Sports Illustrated 87, 30–55 (1997).
34
TE Jayaratne, et al., White Americans’ genetic lay theories of race differences and sexual orientation: Their relationship with prejudice toward Blacks, and gay men and lesbians. Group Process Intergroup Relat 9, 77–94 (2006).
35
JD Angrist, J-S Pischke Mostly Harmless Econometrics: An Empiricist’s Companion (Princeton Univ Press, Princeton, NJ, 2009).
36
PD Allison, Comparing logit and probit coefficients across groups. Sociol Methods Res 28, 186–208 (1999).
37
G Baetschmann, KE Staub, R Winkelmann, Consistent estimation of the fixed effects ordered logit model. J R Stat Soc [Ser A] 178, 685–703 (2015).
38
WH Greene, The bias of the fixed effects estimator in nonlinear models. Working paper EC-02-05 (New York University, New York) Available at people.stern.nyu.edu/wgreene/nonlinearfixedeffects.pdf. Accessed October 17, 2015. (2002).
39
O Hellevik, Linear versus logistic regression when the dependent variable is a dichotomy. Qual Quant 43, 59–74 (2009).
40
C Mood, Logistic regression: Why we cannot do what we think we can do, and what we can do about it. Eur Sociol Rev 26, 67–82 (2010).
41
M Neumann, et al., Empathy decline and its reasons: A systematic review of studies with medical students and residents. Acad Med 86, 996–1009 (2011).
42
EA Klonoff, Disparities in the provision of medical care: An outcome in search of an explanation. J Behav Med 32, 48–63 (2009).
43
AG Greenwald, TF Pettigrew, With malice toward none and charity for some: Ingroup favoritism enables discrimination. Am Psychol 69, 669–684 (2014).
44
A Zengin, A Prentice, KA Ward, Ethnic differences in bone health. Front Endocrinol (Lausanne) 6, 24 (2015).
45
; Medecins Sans Frontieres, Clinical guidelines: Diagnosis and treatment manual for curative programmes in hospitals and dispensaries: Guidance for prescribing. Available at apps.who.int/medicinedocs/documents/s17078e/s17078e.pdf. Accessed February 23, 2016. (2013).
Information & Authors
Information
Published in
Classifications
Data Availability
Data deposition: Data and materials are available through the Open Science Framework, https://osf.io/crxwa/.
Submission history
Published online: April 4, 2016
Published in issue: April 19, 2016
Keywords
Acknowledgments
We thank Laurie Archbald-Pannone and Mary Kate Worden for help and support recruiting medical students; Tim Wilson for helpful comments on this manuscript; and Jennifer Doleac, Derek Ford, Isaac Mbiti, and Jay Shimshack for providing advice regarding data analyses.
Notes
†
We counterbalanced the order of target race (black, white) and medical case (kidney stone, ankle fracture) across participants. Preliminary analyses revealed that the order of target race and medical case did not moderate the effects, and we thus exclude them from our models for parsimony. Including them does not change the pattern of results.
‡
We present analyses using ordinary least squares (OLS) regressions. For the continuous pain measure in study 2, we provide the mixed-effects model for comparison in Table S5. For binary outcomes, such as treatment recommendation accuracy in study 2, logistic or OLS regressions are appropriate and produce similar results. The OLS regression is our preferred specification because interpretation requires weaker functional form assumptions than a linear dependent variable model (35) and provides unbiased, reliable estimates of a variable's average effect (36–40). However, because the outcome is binary, some may prefer a logit and/or probit specification; we provide these specifications in Table S6.
§
This analysis also revealed that medical cohort was a significant predictor of both pain ratings and treatment recommendation accuracy irrespective of patient race [F(1,211) = 38.79, P < 0.0001 and F(1,192) = 8.08, P = .005, respectively]. As participants progressed in their training from first-year students through residents, they rated the targets as feeling more pain and they were more accurate in their treatment recommendations. This finding is interesting given the common perception that medical training hardens physicians to others’ pain and suffering (see ref. 41 for a review). At least in our sample, people with more medical training were actually more, not less, sensitive to others’ pain. Perhaps in the present sample, as more senior medical students and residents gained “hands-on” experience on the medical wards and witnessed patients in pain, they perceived greater pain for the scenarios we provided—both of which would be extremely painful. In addition, it is perhaps not surprising that treatment recommendation accuracy was higher among more senior students, as additional training and experience should yield greater accuracy. Medical cohort did not moderate the interaction between target race and false beliefs for pain ratings or treatment recommendation accuracy (Fs < 1). We thus included medical cohort as a covariate and not as a moderator of the target race × false beliefs interaction term in all of our analyses.
This article is a PNAS Direct Submission.
Authors
Competing Interests
The authors declare no conflict of interest.
Metrics & Citations
Metrics
Citation statements
Altmetrics
Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
Loading...
View Options
View options
PDF format
Download this article as a PDF file
DOWNLOAD PDFLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Personal login Institutional LoginRecommend to a librarian
Recommend PNAS to a LibrarianPurchase options
Purchase this article to access the full text.