Skip to main content
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian
  • Log in
  • My Cart

Main menu

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Home
Home

Advanced Search

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses

New Research In

Physical Sciences

Featured Portals

  • Physics
  • Chemistry
  • Sustainability Science

Articles by Topic

  • Applied Mathematics
  • Applied Physical Sciences
  • Astronomy
  • Computer Sciences
  • Earth, Atmospheric, and Planetary Sciences
  • Engineering
  • Environmental Sciences
  • Mathematics
  • Statistics

Social Sciences

Featured Portals

  • Anthropology
  • Sustainability Science

Articles by Topic

  • Economic Sciences
  • Environmental Sciences
  • Political Sciences
  • Psychological and Cognitive Sciences
  • Social Sciences

Biological Sciences

Featured Portals

  • Sustainability Science

Articles by Topic

  • Agricultural Sciences
  • Anthropology
  • Applied Biological Sciences
  • Biochemistry
  • Biophysics and Computational Biology
  • Cell Biology
  • Developmental Biology
  • Ecology
  • Environmental Sciences
  • Evolution
  • Genetics
  • Immunology and Inflammation
  • Medical Sciences
  • Microbiology
  • Neuroscience
  • Pharmacology
  • Physiology
  • Plant Biology
  • Population Biology
  • Psychological and Cognitive Sciences
  • Sustainability Science
  • Systems Biology
Research Article

Spectral statistics in natural scenes predict hue, saturation, and brightness

Fuhui Long, Zhiyong Yang, and Dale Purves
PNAS April 11, 2006 103 (15) 6013-6018; https://doi.org/10.1073/pnas.0600890103
Fuhui Long
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Zhiyong Yang
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dale Purves
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: purves@neuro.duke.edu
  1. Contributed by Dale Purves, February 15, 2006

  • Article
  • Figures & SI
  • Info & Metrics
  • PDF
Loading

Abstract

The perceptual color qualities of hue, saturation, and brightness do not correspond in any simple way to the physical characteristics of retinal stimuli, a fact that poses a major obstacle for any explanation of color vision. Here we test the hypothesis that these basic color attributes are determined by the statistical covariations in the spectral stimuli that humans have always experienced in typical visual environments. Using a database of 1,600 natural images, we analyzed the joint probability distributions of the physical variables most relevant to each of these perceptual qualities. The cumulative density functions derived from these distributions predict the major colorimetric functions that have been reported in psychophysical experiments over the last century.

  • color
  • colorimetry
  • perception
  • psychophysics
  • vision

Color percepts are described in terms of hue (the sensation of the relative redness, greenness, blueness, or yellowness of a spectral stimulus), saturation (the degree to which a color percept deviates from neutral gray), and brightness (the apparent intensity of the stimulus). Although color percepts are obviously initiated by the spectral characteristics of light stimuli, a major difficulty rationalizing these color qualities in either neurobiological or psychological terms is that they are not linked in any straightforward way to the physical attributes of the corresponding retinal stimuli (i.e., to the energy distribution in the stimuli, to their relative uniformity, or to their overall power, respectively). Thus varying the physical parameter underlying any one of these perceptual categories changes the appearance of all three qualities in highly nonlinear and interdependent ways (1–8).

These classical psychophysical functions, which are illustrated in the Figs. 1 a–6 a, can be divided into those measured by color discrimination testing and those revealed in color-matching paradigms. In color discrimination tests, the ability to distinguish equally noticeable (or just noticeable) differences in hue or saturation varies systematically as a function of the wavelength of a monochromatic stimulus (1, 2). In color-matching tests, (i) saturation varies as a function of luminance [the Hunt effect (3)]; (ii) hue varies as a function of stimulus changes that affect saturation [the Abney effect (4, 5)]; (iii) hue varies as a function of luminance [the Bezold–Brücke effect (6, 7)]; and (iv) brightness varies as a function of stimulus changes that affect both hue and saturation [the Helmholtz–Kohlrausch effect (8)]. Explanations proposed in the past have been based on assumptions about neuronal interactions early in the visual pathway and have not led to any consensus (3, 6, 8–11).

Fig. 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 1.

Statistical explanation of the hue discrimination function. (a) The wavelength change in a monochromatic stimulus needed to elicit a just noticeable difference in hue (after ref. 1). (b) Joint probability distribution of the physical correlates of hue and brightness, P(Hp,Bp), obtained from the image database (probability values in this and subsequent figures are indicated by color coding; see bar on right). (c) Cumulative density functions of P(Hp|Bp) at two different values of the physical correlate of hue (Hp 1 = 0.6, Hp 2 = 0.1) for the same physical correlate of brightness (Bp = 0.6), obtained by normalizing and accumulating the probability values of P(Hp|Bp) within a local window. The abscissa shows the relative value of the physical correlate of hue with respect to the center of the local window. (d) The predicted changes in wavelength needed to maintain constant perceived differences in hue. The points are the constant differences in cumulative density functions at the indicated wavelengths, using 0.02 as a value for d (the scale of d in c has been enlarged for clarity); the solid curve is a polynomial fit.

Fig. 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 2.

Statistical explanation of the saturation discrimination function. (a) The amount of monochromatic light needed to generate the same perceived saturation difference with respect to neutral gray at different wavelengths (after ref. 2). (b) Joint probability distribution of the physical correlates of hue and saturation, P(Hp|Sp), obtained from the image database. (c) The cumulative density functions of P(Sp|Hp) when the physical correlate of hue (Hp) was 0.1 (blue curve; ≈575 nm) or 0.4 (red curve; ≈515 nm). (d) The predicted changes in the physical correlates of saturation needed to maintain a constant difference in perceived saturation as a function of the wavelength (the value illustrated is 0.3 in the cumulative density function, as shown in c). The points were derived from the cumulative density functions at the indicated wavelengths; the solid curve is a polynomial fit.

Fig. 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 3.

Statistical explanation of the Hunt effect. (a) Psychophysical data showing that increasing luminance elicits an increasing sense of saturation; the curves are examples of stimuli that elicit yellow (upper curve) and green (lower curve) percepts (after ref. 3). (b) Joint probability distribution of the physical correlates of saturation and brightness, P(Sp,Bp), obtained from the database when the physical correlate of hue Hp was 0.1. (c) Cumulative density functions of P(Sp|Bp) at brightness values of 0.4 (blue curve) and 0.7 (red curve), corresponding to the dashed lines in b. (d) Saturations predicted from cumulative density functions under different levels of the physical correlate of brightness (Bp = 0.20, 0.31, 0.43, 0.55, 0.67, 0.78, 0.90) when the physical correlate of saturation (Sp) was 0.3 and the physical correlates of hue (Hp) were 0.1 and 0.3, thus corresponding to the examples in a.

Fig. 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 4.

Statistical explanation of the Abney effect. (a) Psychophysical data showing variations in apparent hue as a function of saturation (after ref. 5). Lines of constant hue radiating from the white point (red dot; D65 daylight) curve systematically as saturation varies (after ref. 5). (b) Joint probability distribution of the physical correlates of hue and saturation, P(Hp,Sp), derived from the database. The cumulative density functions of P(Hp|Sp) were calculated within a local window centered on the physical correlate of hue in question (black bars). (c) Cumulative density functions when the physical correlate of saturation was 0.2 (blue curve) or 0.45 (red curve) and the physical correlate of hue 0.3. The abscissa shows the relative value of the physical correlate of hue, defined as in Fig. 2. (d) The constant hue curves predicted by the cumulative density functions, plotted as in a. The relatively short lengths of curves D and E reflect the limited number of highly saturated samples in the database and the limited gamut of xy values in the CIE chromaticity diagram that can be represented by RGB values.

Fig. 5.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 5.

Statistical explanation of the Bezold–Brücke effect. (a) Psychophysical data showing the changes in wavelength needed to match the hue of a monochromatic light presented at a higher intensity (after ref. 6). (b) Joint probability distribution of the physical correlates of hue and brightness, P(Hp,Bp), obtained from the database. (c) The cumulative density functions of P(Hp|Bp) calculated within a ±0.1 window centered at 0.3 as the value of the physical correlate of hue, given a lower and a higher levels of the physical correlate of brightness (indicated by the dashed lines in b). (d) The predicted hue shifts for the indicated points; the solid line is a polynomial fit.

Fig. 6.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 6.

Statistical explanation of the Helmholtz–Kohlrausch effect. (a) Psychophysical changes in brightness as a function of both hue and saturation, plotted in the 1931 CIE chromaticity diagram (after ref. 8; the red dot indicates the white point). (b) Joint probability distribution of the physical correlates of saturation and brightness, P(Sp,Bp), at a particular value of the physical correlate of hue (Hp = 0.1). (c) The cumulative density functions of the physical correlate of brightness when the physical correlate of saturation is 0.3 and the physical correlate of hue 0.4 (blue curve) and when the physical correlate of saturation is 0.39 and the physical correlate of hue 0 (red curve). The cumulative probability values in these functions at a physical correlate of brightness value of 0.4 are the same. (d) The equal-brightness curves predicted by these statistics. Each of the points on a given curve has the same physical correlate of brightness value (0.2) and the same predicted brightness. The relative closeness of these curves reflects the limited number of highly saturated samples in the database and the limited gamut of the xy values in the CIE chromaticity diagram that can be represented by RGB values.

Motivated by evidence that natural image statistics predict the response properties of some visual neurons (12) and that image-source statistics predict several aspects of visual perception (13–16), we here examine the hypothesis that this perplexing phenomenology arises from a scheme of visual processing based on statistical covariations of the physical characteristics of light stimuli in typical visual environments. To test this possibility, we acquired a database of 1,600 color images of natural scenes to approximate the range of light stimuli that humans have normally witnessed (see Fig. 7, which is published as supporting information on the PNAS web site). The joint probability distributions of the physical correlates most closely associated with hue, saturation, and brightness were then analyzed and the cumulative density functions of one attribute given the others determined. We show that the major colorimetric functions are surprisingly well predicted in this way, supporting the conclusion that color percepts are generated by a fundamentally probabilistic strategy of vision.

Results

Hue Discrimination.

The human ability to discriminate small changes in hue, measured by just noticeable (or equally noticeable) differences, varies systematically as a function of the wavelength of a monochromatic stimulus. This variation defines a remarkably complex function (1): at the same luminance level, the amount of wavelength change needed to elicit reports of just noticeable differences in hue has two local maxima at ≈460 and 530 nm and three local minima at ≈440, 480, and 575 nm, with sharp increases at both ends of the visible spectrum (Fig. 1 a).

The explanation of the hue discrimination curve in Fig. 1 a in terms of statistical covariations in the light from natural scenes is illustrated in Fig. 1 b–d. Fig. 1 b shows the joint probability distribution of the physical correlates of hue and brightness, i.e., P(Hp, Bp), which determines the conditional probability distribution of the physical correlate of hue at any given physical correlate of brightness (as illustrated by the dashed line in Fig. 1 b), i.e., P(Hp|Bp). The corresponding cumulative density functions were computed by normalizing and accumulating the probability values of P(Hp|Bp) within a local window centered at the physical correlate of hue in question (the black vertical lines in Fig. 1 b; see Methods). Fig. 1 c shows examples of two such functions, corresponding to two different values of the physical correlates of hue (indicated by Hp 1 and Hp 2 in Fig. 1 b) at the same value of the physical correlate of brightness (indicated by the dashed line in Fig. 1 b). As described earlier, these cumulative density functions should predict the hue seen by observers.

Note that the functions in Fig. 1 c have different slopes at p 1 and p 2. Thus to maintain the same difference in apparent hue (indicated by d), the changes in the corresponding physical correlates, i.e., Δh 1 and Δh 2, must be different for different values of the physical correlate of hue (Hp). By assessing these differences for many different values of the physical correlates of hue, we determined the changes that would be expected to generate a constant difference in perceived hue over the full visible spectrum. To compare the function generated on this basis with the function obtained in psychophysical studies of hue discrimination, the values of the physical correlates of hue were converted to wavelengths (Fig. 1 d; see Methods). Comparison of Fig. 1 a and d shows good agreement between the complex psychophysical function and the predicted function based on covariations of the physical attributes of light in natural scenes.

Saturation Discrimination.

The ability to discriminate small changes in saturation measured by the amount of monochromatic light added to white light needed to elicit just noticeable (or equally noticeable) differences in saturation also varies with wavelength (Fig. 2 a). At the same luminance level, the psychophysical function defined in this way has a maximum at ≈570 nm with decreasing values at both ends of the spectrum (2).

The statistical explanation of the saturation discrimination function is illustrated in Fig. 2 b–d. The joint probability distribution of the physical correlates of hue and saturation in the database of natural scenes, i.e., P(Hp, Sp), is shown in Fig. 2 b, with examples of the cumulative density functions of P(Sp|Hp) given two different values of the physical correlate of hue (Hp 1 and Hp 2 in Fig. 2 b) in Fig. 2 c. Points on these functions that have the same cumulative probability values (e.g., p 1 and p 2 in Fig. 2 c) should elicit the same perceptual saturation difference with respect to a neutral reference light, even though they correspond to different values of the physical correlates of saturation (indicated by the dotted vertical lines in Fig. 2 c). Given many such values, we could again derive the changes in the physical correlates of saturation needed to maintain the same perceived saturation difference as a function of the physical correlate of hue. To compare these changes with the psychophysical function in Fig. 2 a, we converted the values of the physical correlates of hue to wavelengths (Fig. 2 d). The predicted changes in the physical correlates of saturation needed to generate the same perceived saturation difference reach a maximum at ≈570 nm with decreasing values at the ends of the spectrum, in agreement with the psychophysical observations.

The Hunt Effect.

The Hunt effect refers to the observation that the saturation of a stimulus increases as luminance increases, as illustrated in Fig. 3 a (3). Fig. 3 b shows the joint probability distributions of the physical correlates of saturation and brightness, i.e., P(Sp, Bp), at a constant value of the physical correlate of hue. Fig. 3 c shows examples of two cumulative density functions determined by accumulating the probability values of P(Sp|Bp) at the values of physical correlate of brightness indicated by the dashed lines in Fig. 3 b. Because a higher value in the cumulative density functions predicts greater saturation, a stimulus with the same physical correlate of saturation (e.g., the dashed line in Fig. 3 c) should appear more saturated as the physical correlate of brightness increases (e.g., the two points on the curves in Fig. 3 c).

By generating the cumulative density functions of P(Sp|Bp) for different values of physical correlate of brightness, we plotted the cumulative probabilities for a given value of the physical correlate of saturation as a function of physical correlate of brightness. Fig. 3 d shows two such functions, corresponding to two different values of the physical correlate of hue. The results based on natural scenes analysis accord with the psychophysical observations in Fig. 3 a.

The Abney Effect.

The Abney effect refers to the observation that hue changes as a function of saturation (4, 5). As a result, lines of constant hue radiating from the white point in the International Commission on Illumination (CIE) chromaticity diagram are specifically distorted (Fig. 4 a). Fig. 4 b shows the joint probability distribution of the physical correlates of hue and saturation, P(Hp,Sp). The corresponding cumulative density functions were determined by normalizing and accumulating the probability values of the conditional probability distribution P(Hp|Sp) within a window centered at the physical correlate of the hue in question (indicated by the black bars in Fig. 4 b). Fig. 4 c shows examples of two such functions (for the values of the physical correlate of saturation indicated by the dashed lines in Fig. 4 b).

If points with the same value in the cumulative density functions (e.g., p 1 and p 2 in Fig. 4 c) elicit the same apparent hue, then the values of the physical correlates of hue needed to maintain the same perceived hue given different values of the physical correlates of saturation can be derived. The series of pair-wise values [i.e., (Hp 1, Sp 1), (Hp 2, Sp 2), …, (Hp n, Sp n)] determined in this way were then converted into corresponding xy values in the CIE chromaticity diagram by using the standard transform (17). The results obtained by repeating this process for many different values of the physical correlates of hue (Fig. 4 d) show distortions of the constant hue curves similar to those that define the Abney effect (Fig. 4 a).

The Bezold–Brücke Effect.

The Bezold–Brücke effect refers to the change in apparent hue as a function of luminance, measured by the wavelength change needed to match the perceived hue of a monochromatic light at a higher luminance level with another monochromatic stimulus at a lower luminance level (6, 7). As shown in Fig. 5 a, some monochromatic wavelengths (the locations where the curve intersects the 0 line) are relatively resistant to changes in hue at different intensities, creating a complex psychophysical function that divides the spectrum into regions characterized by oppositely directed hue shifts.

Fig. 5 b shows the joint probability distributions of the physical correlates of hue and brightness, i.e., P(Hp, Bp) and Fig. 5 c, the corresponding cumulative density functions of the conditional probability distribution P(Hp|Bp) at a higher and a lower value of luminance (dashed lines in Fig. 5 b). In the present framework, points on the two functions in Fig. 5 c that have the same cumulative probability value (e.g., p 1 and p 2) should elicit the same hue. Thus matching the hue of p 2 under a higher luminance entails point p 1, which has the same cumulative probability value as p 2. The difference ΔHp between the physical correlates of hue at p 1 and p 2 is thus the shift needed for the perceived hue under the lower physical correlate of brightness to match the hue under the higher physical correlate of brightness. By repeating this analysis for a full range of different physical correlates of hue, we determined the curve that describes the shift of the physical correlates of hue at lower luminance as a function of the physical correlates of hue at a higher luminance. The function in Fig. 5 d was generated by converting the physical correlates of hue into wavelengths. Comparison of Fig. 5 a and d shows good general agreement with the psychophysical data.

The Helmholtz–Kohlrausch Effect.

Finally, the Helmholtz–Kohlrausch effect refers to the observation that at constant luminance, the brightness of a stimulus changes as a function of the physical correlates of both saturation and hue (8). The effect is typically illustrated in terms of isobrightness contours in a CIE chromaticity diagram, as in Fig. 6 a. Thus, if the physical correlate of hue is held constant, brightness of a stimulus increases with the physical correlate of saturation; conversely, if the physical correlate of saturation is held constant, brightness changes systematically as a function of the physical correlate of hue.

Fig. 6 b shows an example of the joint probability distribution of the physical correlates of saturation and brightness [i.e., P(Sp, Bp)] at a constant value of the physical correlate of hue. Fig. 6 c shows the cumulative density functions of P(Bp|Sp) at two physical correlations of hue and saturation. Given a constant level luminance (the dashed line in Fig. 6 c), we determined the values of the physical correlates of saturation needed to maintain the same cumulative probability value given different values of the physical correlates of hue. In this way, we obtained paired values of the physical correlates of hue and saturation [i.e., (Hp 1, Sp 1), (Hp 2, Sp 2), …, (Hp n, Sp n)]. By converting these data into corresponding xy coordinates in the CIE chromaticity diagram (17), we could plot the predicted isobrightness curves (Fig. 6 d). Comparison of Fig. 6 a and d shows that the functions predicted from the analysis of natural scenes generally accord with the isobrightness functions that define the Helmholtz–Kohlrausch effect.

Discussion

We have examined the idea that the perceptual qualities of hue, saturation and brightness are determined by statistical covariations in the physical characteristics of light in nature, the biological rationale being a means of relating inevitably ambiguous spectral information in retinal stimuli to the real-world sources that observers must respond to (14). In this framework, the cumulative density functions derived from the conditional probability distributions of the physical attributes underlying each of these sensations should predict the hue, saturation, and brightness elicited by spectral stimuli in classical colorimetry.

Analysis of the image database shows that, as might be expected, the physical attributes of light from natural scenes (i.e., the physical correlates most closely associated with hue, saturation, and brightness, respectively) covary in specific ways (see Figs. 1 b–6 b). As a result, the probability distributions of one attribute, given values of the other two attributes, vary systematically. The reasons for at least some of these physical covariances are not hard to understand. For example, the peaks in the joint probability distributions of the physical correlates of hue and brightness (Fig. 1 b) and of hue and saturation (Fig. 2 b) presumably reflect the fact that light from natural scenes is especially rich in middle wavelengths (18). The results we report show that these statistical covariations predict the full range of classical colorimetry functions surprisingly well.

Many other explanations of these phenomena have been proposed over the years. Most investigators have sought to rationalize colorimetric functions as epiphenomena of early visual processing (see refs. 3, 6, 8–11, 19–21; see ref. 22 for a related review). For example, the hue and saturation discrimination functions in Figs. 1 a and 2 a can be computed by modeling combinations of the outputs of cone classes or color channels (r-g, y-b, luminance) to small variations in wavelength or color purity (9–11, 19–21). Similarly, some studies have successfully rationalized the Hunt, Abney, and Bezold–Brücke effects as nonlinear combination of cone (9) or color channel responses (21). Others have also used statistical estimation theory to derive hue and saturation discrimination functions (23, 24).

From the perspective of the present framework, this variety of earlier results makes good sense. If the visual system generates color percepts reflexively according to the frequency of physical cooccurrences in the relevant stimuli experienced during evolution, the existing physiological apparatus at all levels of the visual system should have evolved to facilitate neuronal responses that reflect the statistical associations needed to contend successfully with the inherent ambiguity of light stimuli. In other words, from this perspective, the cone fundamentals would have evolved to efficiently use the statistical regularities we have described here. For example, Barlow (25) has argued that the differences in spectral responses among cones represent a balance between wavelength discrimination and acuity. Thus, the 30-nm difference in sensitivity between the L and M cones means that their signals will be highly correlated, leading to higher achromatic contrast and better acuity. Conversely, S cones are sparse, so as not to affect contrast and 100 nm removed in sensitivity to enhance wavelength discrimination and to cover the rest of the spectrum. The present observations suggest that this arrangement evolved to take advantage of the statistical characteristics in natural spectral stimuli. Our results are similarly consistent with the idea that the color opponent channels evolved to contend with the statistical regularities of the natural visual stimuli. Although the classic perceptions of hue, saturation, and brightness were tested by using visual stimuli generated in laboratory and rarely found in nature, the way the subjects perceive the stimuli, according to our hypothesis, would have been shaped by natural scene statistics. The generally good agreement between our predictions of the full range of colorimetry functions based on light in natural images and the psychophysical data supports this interpretation. Other evidence has already shown that the responses of visual neurons reflect the statistical characteristics of natural visual stimuli (23, 26–31). These neurophysiological findings accord with the implication that the complex interdependence of hue, saturation, and brightness described in colorimetric experiments is the result of a visual processing scheme determined by statistical covariations of the physical attributes underlying these perceptual qualities.

In sum, the success of this statistical framework in explaining these otherwise puzzling colorimetry functions [and at least some of the effects of spatial context on color (15)] implies that the color percepts elicited by any light stimulus are determined statistically according to past human experience, rather than by the features of the stimulus as such. If this idea is correct, then the behavior of color-sensitive neurons at all levels of the primary visual pathway will eventually need to be understood in these terms.

Methods

Conceptual Framework.

The fact that retinal images cannot uniquely specify their physical sources has led a number of vision scientists to consider the possibility that visual percepts might be generated statistically (12–16). Let P(x) be the probability distribution of a physical variable x and P(y) the distribution of the corresponding variable y in perceptual “space.” In terms of probability theory, P(x)dx = P(y)dy. To use the full perceptual range, the probability distribution must have maximum entropy and thus be approximately flat (see Fig. 8, which is published as supporting information on the PNAS web site). P(y) is therefore constant, dy ∼ P(x)dx and y(x) ∼ ∫xmin x P(x′)dx′, which is the cumulative density function of x. Because the value of a physical variable xunderlying any point in a natural stimulus (e.g., its luminance) is correlated with other physical variables (e.g., the distribution of spectral power and its relative uniformity), the perceptual variable y will be determined by the conditional cumulative density function of x. Cumulative density functions derived from natural scenes have already been used to model neuronal responses to contrast (26), to evaluate optimal nonlinear coding (31), and to rationalize brightness contrast effects (16).

In this conception, any psychophysical function that entails hue, saturation, and brightness should be predicted by the conditional cumulative density function of the physical variable underlying the quality tested (these variables are further discussed in Supporting Text, which is published as supporting information on the PNAS web site). Accordingly, the same value in any two cumulative density functions should elicit the same percept, and a given difference in such functions should elicit the same perceptual difference.

Acquisition and Calibration of the Natural Image Database.

To examine whether this framework can indeed rationalize colorimetric psychophysics, we acquired a database of 1,600 images of natural scenes to serve as a proxy for human color experience (see Fig. 7). Although the database would ideally comprise hyperspectral images, this is not practical at present. We therefore used a digital camera (Olympus C2040, Melville, NY) to take high-quality color red, green, and blue (RGB) images of fully natural visual environments. The images were obtained at different locations in the southern U.S. in all four seasons during the hours of full daylight and included a variety of natural terrains with objects at distances of <1 m to thousands of meters. The purpose of image calibration is to map the camera RGB values to a standard linearized RGB space. Thus we first determined the response functions of the camera RGB channels by measuring 70 pair-wise measurements of raw and linearly transformed RGB values for each exposure setting. We then used these functions to correct the raw RGB values of each image pixel to linear and standard RGB values (see Supporting Text and Fig. 9, which is published as supporting information on the PNAS web site, for further details).

Physical Correlates of Hue, Saturation, and Brightness.

To test whether the major colorimetric functions can be explained statistically requires quantitative representation of the physical variables that correlate most closely with the perceptual qualities of hue, saturation, and brightness, respectively. For this purpose, we used the hue, saturation, and value (HSV) color space model (32) (see Supporting Text).

Predicting Color Percepts Using Cumulative Density Functions.

To predict colorimetric functions, the hue, saturation, and value (HSV) triplet values derived from the corrected RGB values of each image pixel were used to compute the joint probability distributions of the physical attributes of light underlying hue, saturation, and brightness. The basis for the distributions was a compilation of 4.5 × 108 pixels sampled at random from the 1,600 images in the database. We counted and then normalized the frequency of cooccurrence of the physical correlates of brightness (Bp), hue (Hp), or saturation (Sp) to obtain the joint probability distributions of: (i) the physical correlates of hue and saturation, P(Hp, Sp); (ii) the physical correlates of hue and brightness, P(Hp, Bp); and (iii) the physical correlates of saturation and brightness, P(Sp, Bp). From these distributions, we determined directly the one-dimensional conditional probability distribution for each physical attribute, given values for the others. The cumulative density functions used to predict colorimetric functions were then computed from these one-dimensional conditional probability distributions by accumulating the relevant probability values (see Supporting Text). Particular values of x in the conditional cumulative density function F(x|X) were determined by the sum of the probability values of all variables x′ less than or equal to x, i.e., F(x|X)=Σmin x P(x′|X), where x min < x< x max and x max and x min are the maximum and minimum, respectively, of all of the possible values of x, and X is the set of given physical variables correlated with x. Because brightness and saturation are ordinal percepts, the cumulative probability values were computed over the full range of their physical correlates (i.e., x min = 0, x max = 1). Because sensations of hue are circular, these cumulative probability values were computed over a local range centered at the value of the physical correlate of the hue (Hp) in question (i.e., x min = Hp − Δw and x max =Hp + Δw, where Δw is the width of the window). When Hp − Δw was <0, the determination was begun from 1; and when Hp + Δw was >1, the determination was begun from 0.

To compare these statistical analyses to the relevant psychophysical functions, we mapped the physical correlates of hue to the corresponding wavelength values used in psychophysical experiments. The mapping was generated by converting each spectrum to corresponding RGB values and then to HSV values, using the standard transformation described earlier (17, 32). Because colorimetry is carried out with monochromators that have some uncertainly arising from backlash, the monochromatic light at each wavelength from 400 to 700 nm was assumed to be a narrow-band Gaussian function.

Acknowledgments

We are grateful to Beau Lotto, David Schwartz, and James Voyvodic for helpful criticism and to Hanchuan Peng for help in acquiring the database. We also thank Vince Billock and David Brainard for thorough and helpful reviews of the manuscript. This work was supported by the National Institutes of Health, the Air Force Office of Scientific Research, and the Geller Endowment.

Footnotes

  • *To whom correspondence should be addressed. E-mail: purves{at}neuro.duke.edu
  • Author contributions: F.L. and D.P. designed research; F.L. and D.P. performed research; Z.Y. contributed new analytic tools; and F.L. and D.P. wrote the paper.

  • Conflict of interest statement: No conflicts declared.

  • Abbreviations:

    Abbreviations:

    RGB,
    red, green, and blue;
    CIE,
    International Commission on Illumination.
  • Freely available online through the PNAS open access option.

  • © 2006 by The National Academy of Sciences of the USA
View Abstract

References

  1. ↵
    1. Bedford R. E. ,
    2. Wyszecki G.
    (1958) J. Opt. Soc. Am 48:129–135.
    OpenUrlPubMed
  2. ↵
    1. Evans R. M. ,
    2. Swenholt B. K.
    (1968) J. Opt. Soc. Am 57:580–584.
    OpenUrl
  3. ↵
    1. Hunt R. W. G.
    (1952) J. Opt. Soc. Am 42:190–199.
    OpenUrlCrossRefPubMed
  4. ↵
    1. Abney W.
    (1910) Proc. R. Soc. London 83:120–127.
    OpenUrl
  5. ↵
    1. Roberson A. R.
    (1970) AIC Proc. Color 69:395–402.
    OpenUrl
  6. ↵
    1. Purdy D. M.
    (1931) Am. J. Psych 43:541–559.
    OpenUrl
  7. ↵
    1. Boynton R. M. ,
    2. Gordon J.
    (1965) J. Opt. Soc. Am 55:78–86.
    OpenUrl
  8. ↵
    1. Wyszecki G. ,
    2. Stiles W. S.
    (1982) Color Science: Concepts and Methods, Quantitative Data and Formulae (Wiley, New York).
  9. ↵
    1. Hurvich L. M. ,
    2. Jameson D.
    (1955) J. Opt. Soc. Am 45:602–616.
    OpenUrlCrossRefPubMed
  10. ↵
    1. Stiles W. S.
    1. Vos J. J. ,
    2. Fridle L. F. C. ,
    3. Walraven P. L.
    (1972) in Color Metrics, eds Vos J. J. , Fridle L. F. C. , Walraven P. L. (AIC/Holland, Soesterberg, Holland), pp 1–25.
  11. ↵
    1. Pokorny J. ,
    2. Smith V.
    1. Chalupa L. M. ,
    2. Werner J. S
    (2004) in The Visual Neurosciences, eds Chalupa L. M. , Werner J. S (MIT Press, Cambridge, MA), pp 908–923.
  12. ↵
    1. Rao R. P. N. ,
    2. Olshausen B. A. ,
    3. Lewicki M. S.
    (2002) Probabilistic Models of the Brain: Perception and Neural Function (MIT Press, Cambridge, MA).
  13. ↵
    1. Geisler W. S. ,
    2. Perry J. S. ,
    3. Super B. J. ,
    4. Gallogly D. P.
    (2001) Vision Res 41:711–724.
    OpenUrlCrossRefPubMed
  14. ↵
    1. Purves D. ,
    2. Lotto R. B.
    (2003) Why We See What We Do: An Empirical Theory of Vision (Sinauer, Sunderland, MA).
  15. ↵
    1. Long F. ,
    2. Purves D.
    (2003) Proc. Natl. Acad. Sci. USA 100:15190–15193.
    OpenUrlAbstract/FREE Full Text
  16. ↵
    1. Yang Z. Y. ,
    2. Purves D.
    (2004) Proc. Natl. Acad. Sci. USA 101:8745–8750.
    OpenUrlAbstract/FREE Full Text
  17. ↵
    1. Commission Internationale de L'Eclairage
    (1986) Colorimetry (Central Bureau of the Commission Internationale de L'Eclairage, Vienna), 2nd Ed..
  18. ↵
    1. Regan B. C. ,
    2. Julliot C. ,
    3. Simmen B. ,
    4. Viénot F. ,
    5. Charles-Dominique P. ,
    6. Mollon J. D.
    (2001) Philos. Trans. R. Soc. London Ser. B 356:229–283.
    OpenUrlAbstract/FREE Full Text
  19. ↵
    1. Vos J. J.
    (1982) Color Res. Appl 7:69–77.
  20. ↵
    1. Ingling C. R., Jr ,
    2. Tsou B. H. P.
    (1977) Vision Res 17:1075–1082.
    OpenUrlCrossRefPubMed
  21. ↵
    1. Guth S. L.
    (1991) J. Opt. Soc. Am. A 8:976–993.
    OpenUrlPubMed
  22. ↵
    1. Billock V. A. ,
    2. Tsou B. H.
    (2005) J. Opt. Soc. Am. A 22:2289–2298.
    OpenUrlCrossRef
  23. ↵
    1. Buchsbaum G. ,
    2. Goldstein J. L.
    (1979a) in Proc. R. Soc. London Ser. B 205, pp 229–248.
  24. ↵
    1. Buchsbaum G. ,
    2. Goldstein J. L.
    (1979b) in Proc. R. Soc. London Ser. B 205, pp 249–266.
  25. ↵
    1. Barlow H.
    (1982) Vision Res 22:635–643.
    OpenUrlCrossRefPubMed
  26. ↵
    1. Laughlin S. B.
    (1981) Zeitschr. Naturforsch. Sect. C Biosci 36:910–912.
    OpenUrl
  27. ↵
    1. Golz J. ,
    2. Macleod D. I. A.
    (2002) Nature 415:637–640.
    OpenUrlCrossRefPubMed
  28. ↵
    1. Field D. J.
    (1987) J. Opt. Soc. Am. A 4:2379–2394.
    OpenUrlCrossRefPubMed
  29. ↵
    1. Scwartz O. ,
    2. Simoncelli E. P.
    (2001) Nat. Neurosci 4:819–825.
    OpenUrlCrossRefPubMed
  30. ↵
    1. Ruderman D. L. ,
    2. Cronin T. W. ,
    3. Chiao C. C.
    (1998) J. Opt. Soc. Am. A 15:2036–2045.
    OpenUrlCrossRef
  31. ↵
    1. Von der Twer T. ,
    2. Macleod D. I. A.
    (2001) Network Comput. Neural Sys 12:395–407.
    OpenUrlCrossRef
  32. ↵
    1. Hearn P. ,
    2. Baker M. P.
    (1994) Computer Graphics (Prentice Hall, Englewood Cliffs, NJ).
PreviousNext
Back to top
Article Alerts
Email Article

Thank you for your interest in spreading the word on PNAS.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Spectral statistics in natural scenes predict hue, saturation, and brightness
(Your Name) has sent you a message from PNAS
(Your Name) thought you would like to see the PNAS web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Spectral statistics in natural scenes predict hue, saturation, and brightness
Fuhui Long, Zhiyong Yang, Dale Purves
Proceedings of the National Academy of Sciences Apr 2006, 103 (15) 6013-6018; DOI: 10.1073/pnas.0600890103

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Request Permissions
Share
Spectral statistics in natural scenes predict hue, saturation, and brightness
Fuhui Long, Zhiyong Yang, Dale Purves
Proceedings of the National Academy of Sciences Apr 2006, 103 (15) 6013-6018; DOI: 10.1073/pnas.0600890103
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Mendeley logo Mendeley
Proceedings of the National Academy of Sciences: 103 (15)
Table of Contents

Submit

Sign up for Article Alerts

Jump to section

  • Article
    • Abstract
    • Results
    • Discussion
    • Methods
    • Acknowledgments
    • Footnotes
    • References
  • Figures & SI
  • Info & Metrics
  • PDF

You May Also be Interested in

Abstract depiction of a guitar and musical note
Science & Culture: At the nexus of music and medicine, some see disease treatments
Although the evidence is still limited, a growing body of research suggests music may have beneficial effects for diseases such as Parkinson’s.
Image credit: Shutterstock/agsandrew.
Scientist looking at an electronic tablet
Opinion: Standardizing gene product nomenclature—a call to action
Biomedical communities and journals need to standardize nomenclature of gene products to enhance accuracy in scientific and public communication.
Image credit: Shutterstock/greenbutterfly.
One red and one yellow modeled protein structures
Journal Club: Study reveals evolutionary origins of fold-switching protein
Shapeshifting designs could have wide-ranging pharmaceutical and biomedical applications in coming years.
Image credit: Acacia Dishman/Medical College of Wisconsin.
White and blue bird
Hazards of ozone pollution to birds
Amanda Rodewald, Ivan Rudik, and Catherine Kling talk about the hazards of ozone pollution to birds.
Listen
Past PodcastsSubscribe
Goats standing in a pin
Transplantation of sperm-producing stem cells
CRISPR-Cas9 gene editing can improve the effectiveness of spermatogonial stem cell transplantation in mice and livestock, a study finds.
Image credit: Jon M. Oatley.

Similar Articles

Site Logo
Powered by HighWire
  • Submit Manuscript
  • Twitter
  • Facebook
  • RSS Feeds
  • Email Alerts

Articles

  • Current Issue
  • Latest Articles
  • Archive

PNAS Portals

  • Anthropology
  • Chemistry
  • Classics
  • Front Matter
  • Physics
  • Sustainability Science
  • Teaching Resources

Information

  • Authors
  • Editorial Board
  • Reviewers
  • Librarians
  • Press
  • Site Map
  • PNAS Updates

Feedback    Privacy/Legal

Copyright © 2021 National Academy of Sciences. Online ISSN 1091-6490