Color vision





Color vision is the capacity of an organism or machine to distinguish objects based on the wavelengths (or frequencies) of the light they reflect, emit, or transmit. Colors can be measured and quantified in various ways; indeed, a human's perception of colors is a subjective process whereby the brain responds to the stimuli that are produced when incoming light reacts with the several types of cone photoreceptors in the eye.

Wavelength and hue detection
Isaac Newton discovered that white light splits into its component colors when passed through a prism, but that if those bands of colored light pass through another and rejoin, they make a white beam. The characteristic colors are, from low to high frequency: red, orange, yellow, green, cyan, blue, violet. Sufficient differences in frequency give rise to a difference in perceived hue; the just noticeable difference in wavelength varies from about 1 nm in the blue-green and yellow wavelengths, to 10 nm and more in the red and blue. Though the eye can distinguish up to a few hundred hues, when those pure spectral colors are mixed together or diluted with white light, the number of distinguishable chromaticities can be quite high.

In very low light levels, vision is scotopic: light is detected by rod cells of the retina. Rods are maximally sensitive to wavelengths near 500 nm, and play little, if any, role in color vision. In brighter light, such as daylight, vision is photopic: light is detected by cone cells which are responsible for color vision. Cones are sensitive to a range of wavelengths, but are most sensitive to wavelengths near 555 nm. Between these regions, mesopic vision comes into play and both rods and cones provide signals to the retinal ganglion cells. The shift in color perception from dim light to daylight gives rise to differences known as the Purkinje effect.

The perception of "white" is formed by the entire spectrum of visible light, or by mixing colors of just a few wavelengths, such as red, green, and blue, or by mixing just a pair of complementary colors such as blue and yellow.

Physiology of color perception






Perception of color begins with specialized retinal cells containing pigments with different spectral sensitivities, known as cone cells. In humans, there are three types of cones sensitive to three difference spectra, resulting in trichromatic color vision.

The cones are conventionally labeled according to the ordering of the wavelengths of the peaks of their spectral sensitivities: short (S), medium (M), and long (L) cone types. These three types do not correspond well to particular colors as we know them. Rather, the perception of color is achieved by a complex process that starts with the differential output of these cells in the retina and it will be finalized in the visual cortex and associative areas of the brain.

For example, while the L cones have been referred to simply as red receptors, microspectrophotometry has shown that their peak sensitivity is in the greenish-yellow region of the spectrum. Similarly, the S- and M-cones do not directly correspond to blue and green, although they are often depicted as such. It is important to note that the RGB color model is merely a convenient means for representing color, and is not directly based on the types of cones in the human eye.

The peak response of human cone cells varies, even among individuals with 'normal' color vision; in non-human species this polymorphic variation is even greater, and it may well be adaptive.

Theories of color vision
Two complementary theories of color vision are the trichromatic theory and the opponent process theory. The trichromatic theory, or Young–Helmholtz theory, proposed in the 19th century by Thomas Young and Hermann von Helmholtz, as mentioned above, states that the retina's three types of cones are preferentially sensitive to blue, green, and red. Ewald Hering proposed the opponent process theory in 1872. It states that the visual system interprets color in an antagonistic way: red vs. green, blue vs. yellow, black vs. white. We now know both theories to be correct, describing different stages in visual physiology.

Cone cells in the human eye
A range of wavelengths of light stimulates each of these receptor types to varying degrees. Yellowish-green light, for example, stimulates both L and M cones equally strongly, but only stimulates S-cones weakly. Red light, on the other hand, stimulates L cones much more than M cones, and S cones hardly at all; blue-green light stimulates M cones more than L cones, and S cones a bit more strongly, and is also the peak stimulant for rod cells; and blue light stimulates S cones more strongly than red or green light, but L and M cones more weakly. The brain combines the information from each type of receptor to give rise to different perceptions of different wavelengths of light.

The opsins (photopigments) present in the L and M cones are encoded on the X chromosome; defective encoding of these leads to the two most common forms of color blindness. The OPN1LW gene, which codes for the opsin present in the L cones, is highly polymorphic (a recent study by Verrelli and Tishkoff found 85 variants in a sample of 236 men ). A very small percentage of women may have an extra type of color receptor because they have different alleles for the gene for the L opsin on each X chromosome. X chromosome inactivation means that only one opsin is expressed in each cone cell, and some women may therefore show a degree of tetrachromatic color vision. Variations in OPN1MW, which codes the opsin expressed in M cones, appear to be rare, and the observed variants have no effect on spectral sensitivity.

Color in the human brain


Color processing begins at a very early level in the visual system (even within the retina) through initial color opponent mechanisms. Both Helmholtz's trichromatic theory, and Hering's opponent process theory are therefore correct, but trichromacy arises at the level of the receptors, and opponent processes arise at the level of retinal ganglion cells and beyond. In Hering's theory opponent mechanisms refer to the opposing color effect of red–green, blue–yellow, and light–dark. However, in the visual system, it is the activity of the different receptor types that are opposed. Some midget retinal ganglion cells oppose L and M cone activity, which corresponds loosely to red–green opponency, but actually runs along an axis from blue-green to magenta. Small bistratified retinal ganglion cells oppose input from the S cones to input from the L and M cones. This is often thought to correspond to blue–yellow opponency, but actually runs along a color axis from lime green to violet.

Visual information is then sent to the brain from retinal ganglion cells via the optic nerve to the optic chiasma: a point where the two optic nerves meet and information from the temporal (contralateral) visual field crosses to the other side of the brain. After the optic chiasma the visual tracts are referred to as the optic tracts, which enter the thalamus to synapse at the lateral geniculate nucleus (LGN).

The LGN is divided into laminae (zones), of which there three types: the M-laminae, consisting primarily of M-cells, the P-laminae, consisting primarily of P-cells, and the koniocellular laminae. M- and P-cells received relatively balanced input from both L- and M-cones throughout most of the retina, although this seems to not be the case at the fovea, with midget cells synapsing in the P-laminae. The koniocellular laminae receive axons from the small bistratified ganglion cells.

After synapsing at the LGN, the visual tract continues on back to the primary visual cortex (V1) located at the back of the brain within the occipital lobe. Within V1 there is a distinct band (striation). This is also referred to as "striate cortex", with other cortical visual regions referred to collectively as "extrastriate cortex". It is at this stage that color processing becomes much more complicated.

In V1 the simple three-color segregation begins to break down. Many cells in V1 respond to some parts of the spectrum better than others, but this "color tuning" is often different depending on the adaptation state of the visual system. A given cell that might respond best to long wavelength light if the light is relatively bright might then become responsive to all wavelengths if the stimulus is relatively dim. Because the color tuning of these cells is not stable, some believe that a different, relatively small, population of neurons in V1 is responsible for color vision. These specialized "color cells" often have receptive fields that can compute local cone ratios. Such "double-opponent" cells were initially described in the goldfish retina by Nigel Daw; their existence in primates was suggested by David H. Hubel and Torsten Wiesel and subsequently proven by Bevil Conway. As Margaret Livingstone and David Hubel showed, double opponent cells are clustered within localized regions of V1 called blobs, and are thought to come in two flavors, red–green and blue–yellow. Red–green cells compare the relative amounts of red–green in one part of a scene with the amount of red–green in an adjacent part of the scene, responding best to local color contrast (red next to green). Modeling studies have shown that double-opponent cells are ideal candidates for the neural machinery of color constancy explained by Edwin H. Land in his retinex theory.

From the V1 blobs, color information is sent to cells in the second visual area, V2. The cells in V2 that are most strongly color tuned are clustered in the "thin stripes" that, like the blobs in V1, stain for the enzyme cytochrome oxidase (separating the thin stripes are interstripes and thick stripes, which seem to be concerned with other visual information like motion and high-resolution form). Neurons in V2 then synapse onto cells in the extended V4. This area includes not only V4, but two other areas in the posterior inferior temporal cortex, anterior to area V3, the dorsal posterior inferior temporal cortex, and posterior TEO. (Area V4 was identified by Semir Zeki to be exclusively dedicated to color, but this has since been shown not to be the case. Color processing in the extended V4 occurs in millimeter-sized color modules called globs. This is the first part of the brain in which color is processed in terms of the full range of hues found in color space.

Anatomical studies have shown that neurons in extended V4 provide input to the inferior temporal lobe. "IT" cortex is thought to integrate color information with shape and form, although it has been difficult to define the appropriate criteria for this claim. Despite this murkiness, it has been useful to characterize this pathway (V1 > V2 > V4 > IT) as the ventral stream or the "what pathway", distinguished from the dorsal stream ("where pathway") that is thought to analyze motion, among many other features.

Subjectivity of color perception
It has been established that the Himba people perceive colors differently from most humans - they easily distinguish close shades of green, barely discernable for most people. The leading explanation is that the Himba created a very different color scheme which divides the spectrum to dark shades (Zuzu in Himba), very light (Vapa), Vivid blue and green (Buru) and dry colors - probably due to their specific way of life. However other explanations exist that have not been ruled out yet.

An example of the subjectivity of color occurs in a rainbow. In a rainbow (or a spectrum of light projected from a prism), the changes between wavelengths of light are smooth and continuous; there are no breaks or boundaries corresponding to the "bands of color" which are seen subjectively by the eye. A black-and-white photograph of a rainbow shows no band stucture at all, demonstrating that the number of bands, and the bands themselves, are phenomena added to nature by the eye and the brain. They are not objectively real any more than "hot" or "cold."

The cone photoreceptors, which begin the process that results in the ultimate sensation of color in the brain, are sensitive to different portions of the visible spectrum. For humans, the visible spectrum ranges approximately from 380 to 740 nm, and there are normally three types of cones. The number of colors that can be distinguished by these cones is in principle unlimited and in practice extremely large.

The sensation of color is also heavily dependent on contrast with surroundings. For example, a 'red' piece of construction paper or red filing folder does not reflect pure monochromatic "red" light. Rather, it absorbs a larger fraction of other frequencies of visible light shining upon it than those in a group of frequencies that are perceived as red when they are viewed alone. However, although the red paper reflects more of light near the red end of the spectrum, it reflects some of all frequencies (not only red), and a room lit with only the reflection from a red piece of paper would soon appear to be normally lit to an adapted eye, and would allow visualization of all of the other colors present in the room. A red-colored paper is therefore perceived to be red mainly by contrast with its surroundings, because the human eye can distinguish between different wavelengths, and the brain creates the separate sensation of "red" as a helper in discriminating one object from another, or from its background. Color, which in nature is never constructed from pure frequencies of light, is a quality constructed by the visual brain from spectral reflectance, the objective property of objects. The advantage of color perception is the better discrimination of surfaces allowed by this aspect of visual processing, which makes quite similar surfaces into very different perceptions.

In non-human animals
The visible range and number of cone types differ between species. Mammals in general have color vision of a limited type, and are usually red-green color-blind, with only two types of cones. Humans, some primates, and some marsupials see an extended range of colors, but only by comparison with other mammals. Most non-mammalian vertebrate species distinguish different colors at least as well as humans, and many species of birds, fish, reptiles and amphibians, as well as some invertebrates, have more than three cone types and probably superior color vision to humans.

In most Catarrhini (Old World monkeys and apes — primates closely related to humans) there are three types of color receptors (known as cone cells), resulting in trichromatic color vision. These primates, like humans, are known as trichromats. Many other primates and other mammals are dichromats, which is the general color vision state for mammals that are active during the day (i.e., felines, canines, ungulates). Nocturnal mammals may have little or no color vision. Trichromat non-primate mammals are rare.

Many invertebrates have color vision. Honey- and bumblebees have trichromatic color vision, which is insensitive to red but sensitive in ultraviolet. Papilio butterflies possess six types of photoreceptors and may have pentachromatic vision. The most complex color vision system in animal kingdom has been found in stomatopods (such as the mantis shrimp) with up to 12 different spectral receptor types thought to work as multiple dichromatic units.

Vertebrate animals such as tropical fish and birds sometimes have more complex color vision systems than humans; thus the many subtle colors they exhibit generally serve as direct signals between fish or between birds, and are not intended to signal mammals. In the birds, tetrachromacy is achieved through up to four cone types, depending on species. Brightly colored oil droplets inside the cones shift or narrow the spectral sensitivity of the cell. It has been suggested that it is likely that pigeons are pentachromats.

Reptiles and amphibians also have four cone types (occasionally five), and probably see at least the same number of colors that humans do, or perhaps more. In addition, some nocturnal geckos have the capability of seeing color in dim light.

In the evolution of mammals, segments of color vision were lost, then for a few species of primates, regained by gene duplication. Eutherian mammals other than primates (for example, dogs, cats, mammalian farm animals) generally have less-effective two-receptor (dichromatic) color perception systems, which distinguish blue, green, and yellow—but cannot distinguish oranges and reds. The adaptation to see reds is particularly important for primate mammals, since it leads to identification of fruits, and also newly sprouting reddish leaves, which are particularly nutritious.

However, even among primates, full color vision differs between New World and Old World monkeys. Old World primates, including monkeys and all apes, have vision similar to humans. New World monkeys may or may not have color sensitivity at this level: in most species, males are dichromats, and about 60% of females are trichromats, but the owl monkeys are cone monochromats, and both sexes of howler monkeys are trichromats. Visual sensitivity differences between males and females in a single species is due to the gene for yellow-green sensitive opsin protein (which confers ability to differentiate red from green) residing on the X sex chromosome.

Several marsupials such as the fat-tailed dunnart (Sminthopsis crassicaudata) have been shown to have trichromatic color vision.

Marine mammals, adapted for low-light vision, have only a single cone type and are thus monochromats.

Evolution
Color perception mechanisms are highly dependent on evolutionary factors, of which the most prominent is thought to be satisfactory recognition of food sources. In herbivorous primates, color perception is essential for finding proper (immature) leaves. In hummingbirds, particular flower types are often recognized by color as well. On the other hand, nocturnal mammals have less-developed color vision, since adequate light is needed for cones to function properly. There is evidence that ultraviolet light plays a part in color perception in many branches of the animal kingdom, especially insects. In general, the optical spectrum encompasses the most common electronic transitions in matter and is therefore the most useful for collecting information about the environment.

The evolution of trichromatic color vision in primates occurred as the ancestors of modern monkeys, apes, and humans switched to diurnal (daytime) activity and began consuming fruits and leaves from flowering plants. Color vision, with UV discrimination, is also present in a number of arthropods – the only terrestrial animals besides the vertebrates to possess this trait.

Some animals can distinguish colors in the ultraviolet spectrum. The UV spectrum falls outside the human visible range, except for some cataract surgery patients. Birds, turtles, lizards, many fish and some rodents have UV receptors in their retinas. These animals can see the UV patterns found on flowers and other wildlife that are otherwise invisible to the human eye.

UV and multi-dimensional vision is an especially important adaptation in birds. It allows birds to spot small prey from a distance, navigate, avoid predators, and forage while flying at high speeds. Birds also utilize their broad spectrum vision to recognize other birds, and in sexual selection.

Mathematics of color perception
A "physical color" is a combination of pure spectral colors (in the visible range). Since there are, in principle, infinitely many distinct spectral colors, the set of all physical colors may be thought of as an infinite-dimensional vector space, in fact a Hilbert space. We call this space Hcolor. More technically, the space of physical colors may be considered to be the (mathematical) cone over the simplex whose vertices are the spectral colors, with white at the centroid of the simplex, black at the apex of the cone, and the monochromatic color associated with any given vertex somewhere along the line from that vertex to the apex depending on its brightness.

An element C of Hcolor is a function from the range of visible wavelengths—considered as an interval of real numbers [Wmin,Wmax]—to the real numbers, assigning to each wavelength w in [Wmin,Wmax] its intensity C(w).

A humanly perceived color may be modeled as three numbers: the extents to which each of the 3 types of cones is stimulated. Thus a humanly perceived color may be thought of as a point in 3-dimensional Euclidean space. We call this space R3color.

Since each wavelength w stimulates each of the 3 types of cone cells to a known extent, these extents may be represented by 3 functions s(w), m(w), l(w) corresponding to the response of the S, M, and L cone cells, respectively.

Finally, since a beam of light can be composed of many different wavelengths, to determine the extent to which a physical color C in Hcolor stimulates each cone cell, we must calculate the integral (with respect to w), over the interval [Wmin,Wmax], of C(w)·s(w), of C(w)·m(w), and of C(w)·l(w). The triple of resulting numbers associates to each physical color C (which is an element in Hcolor) to a particular perceived color (which is a single point in R3color). This association is easily seen to be linear. It may also easily be seen that many different elements in the "physical" space Hcolor can all result in the same single perceived color in R3color, so a perceived color is not unique to one physical color.

Thus human color perception is determined by a specific, non-unique linear mapping from the infinite-dimensional Hilbert space Hcolor to the 3-dimensional Euclidean space R3color.

Technically, the image of the (mathematical) cone over the simplex whose vertices are the spectral colors, by this linear mapping, is also a (mathematical) cone in R3color. Moving directly away from the vertex of this cone represents maintaining the same chromaticity while increasing its intensity. Taking a cross-section of this cone yields a 2D chromaticity space. Both the 3D cone and its projection or cross-section are convex sets; that is, any mixture of spectral colors is also a color.



In practice, it would be quite difficult to physiologically measure an individual's three cone responses to various physical color stimuli. Instead, a psychophysical approach is taken. Three specific benchmark test lights are typically used; let us call them S, M, and L. To calibrate human perceptual space, scientists allowed human subjects to try to match any physical color by turning dials to create specific combinations of intensities (IS, IM, IL) for the S, M, and L lights, resp., until a match was found. This needed only to be done for physical colors that are spectral (since a linear combination of spectral colors will be matched by the same linear combination of their (IS, IM, IL) matches. Note that in practice, often at least one of S, M, L would have to be added with some intensity to the physical test color, and that combination matched by a linear combination of the remaining 2 lights. Across different individuals (without color blindness), the matchings turned out to be nearly identical.

By considering all the resulting combinations of intensities (IS, IM, IL) as a subset of 3-space, a model for human perceptual color space is formed. (Note that when one of S, M, L had to be added to the test color, its intensity was counted as negative.) Again, this turns out to be a (mathematical) cone, not a quadric, but rather all rays through the origin in 3-space passing through a certain convex set. Again, this cone has the property that moving directly away from the origin corresponds to increasing the intensity of the S, M, L lights proportionately. Again, a cross-section of this cone is a planar shape that is (by definition) the space of "chromaticities" (informally: distinct colors); one particular such cross section, corresponding to constant X+Y+Z of the CIE 1931 color space, gives the CIE chromaticity diagram.

It should be noted that this system implies that for any hue or non-spectral color not on the boundary of the chromaticity diagram, there are infinitely many distinct physical spectra that are all perceived as that hue or color. So, in general there is no such thing as the combination of spectral colors that we perceive as (say) a specific version of tan; instead there are infinitely many possibilities that produce that exact color. The boundary colors that are pure spectral colors can be perceived only in response to light that is purely at the associated wavelength, while the boundary colors on the "line of purples" can each only be generated by a specific ratio of the pure violet and the pure red at the ends of the visible spectral colors.

The CIE chromaticity diagram is horseshoe-shaped, with its curved edge corresponding to all spectral colors (the spectral locus), and the remaining straight edge corresponding to the most saturated purples, mixtures of red and violet.

Chromatic adaptation
In color science, chromatic adaptation is the estimation of the representation of an object under a different light source than the one in which it was recorded. A common application is to find a chromatic adaptation transform (CAT) that will make the recording of a neutral object appear neutral (color balance), while keeping other colors also looking realistic. For example, chromatic adaptation transforms are used when converting images between ICC profiles with different white points. Adobe Photoshop, for example, uses the Bradford CAT.

In color vision, chromatic adaptation refers to color constancy; the ability of the visual system to preserve the appearance of an object under a wide range of light sources.