Image color transfer is afunction that maps (transforms) thecolors of one (source)image to the colors of another (target) image. A color mapping may be referred to as thealgorithm that results in the mapping function or the algorithm that transforms the image colors. The image modification process is sometimes calledcolor transfer or, whengrayscale images are involved,brightness transfer function (BTF); it may also be calledphotometric camera calibration orradiometric camera calibration.
The termimage color transfer is a bit of a misnomer since most common algorithms transfer both color and shading. (Indeed, the example shown on this page predominantly transfers shading other than a small orange region within the image that is adjusted to yellow.)
There are two types of image color transfer algorithms: those that employ the statistics of the colors of two images, and those that rely on a givenpixel correspondence between the images. In a wide-ranging review, Faridul and others[1] identify a third broad category of implementation, namely user-assisted methods.
An example of an algorithm that employs the statistical properties of the images ishistogram matching. This is a classic algorithm for color transfer, but it can suffer from the problem that it is too precise so that it copies very particular color quirks from the target image, rather than the general color characteristics, giving rise to color artifacts. Newer statistic-based algorithms deal with this problem. An example of such algorithm is one that adjusts themean and thestandard deviation of each of the source image channels to match those of the corresponding reference image channels. This adjustment process is typically performed in the Lαβ orLab color spaces.[2]
A common algorithm for computing the color mapping when the pixel correspondence is given is building thejoint-histogram (see alsoco-occurrence matrix) of the two images and finding the mapping by usingdynamic programming based on the joint-histogram values.[3]
When the pixel correspondence is not given and the image contents are different (due to different point of view), the statistics of the image corresponding regions can be used as an input to statistics-based algorithms, such as histogram matching. The corresponding regions can be found by detecting the correspondingfeatures.[4]
Liu[5] provides a review of image color transfer methods. The review extends into considerations of video color transfer and deep learning methods includingNeural style transfer.
Color transfer processing can serve two different purposes: one is calibrating the colors of two cameras for further processing using two or more sample images, the second is adjusting the colors of two images for perceptual visual compatibility.
Color calibration is an important pre-processing task incomputer vision applications. Many applications simultaneously process two or more images and, therefore, need their colors to be calibrated. Examples of such applications are:Image differencing,registration,object recognition, multi-cameratracking,co-segmentation andstereo reconstruction.
Other applications of image color transfer have been suggested. These include the co-option of color palettes from recognised sources such as famous paintings and the use as a further alternative to color modification methods commonly found in commercial image processing applications such as ‘posterise’, ‘solarise’ and ‘gradient’.[6] A web application has been made available to explore these possibilities.
The use of the termssource andtarget in this article reflects the usage in the seminal paper by Reinhard et al.[2] However, others such as Xiao and Ma[7] reverse that usage and indeed it seems more natural to consider that the colors from asource image are directed at atarget image. Adobe use the termsource for the color reference image in the PhotoshopMatch Color function. Because of confusion over this terminology some software has been released into the public domain with incorrect functionality. To minimise further confusion, it may be good practice henceforth to utilise terms such asinput image orbase image andcolor source image orcolor palette image respectively.
Color topics | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Color science |
|  | ||||||||
| Color philosophy |
| |||||||||
| Color terms |
| |||||||||
| Color organizations | ||||||||||
| Names |
| |||||||||
| Related | ||||||||||
