Summary of the invention
The technical problem to be solved in the present invention is how to form a more real stereo display effect.
In order to address the above problem, the invention provides a kind of display control chip, comprising:
For the first memory buffer of storing image data;
Image processing engine, for from described the first memory buffer reads image data;
Command process module, for obtaining current viewing location, adjusts the display parameters of each pixel in described view data according to the described image processing engine of mobile instruction of viewing location; Described display parameters comprise parallax and coordinate figure;
In the time that image processing engine is adjusted coordinate figure, described command process module is adjusted the display parameters of each pixel in described view data according to the described image processing engine of mobile instruction of viewing location, be specially:
The coordinate figure that the angle of described command process module middle shaft rotation in display floater horizontal direction according to viewing location indicates described image processing engine to adjust each pixel changes; Wherein, the angle of described rotation is to calculate with respect to the side-play amount of display floater parallel according to current viewing location.
Further, in the time that image processing engine is adjusted parallax;
Described command process module is adjusted the display parameters of each pixel in described view data according to the described image processing engine of mobile instruction of viewing location, be specially:
Described command process module, according to the change of distance of viewing location and display floater, indicates described image processing engine to adjust the parallax of pixel; When viewing location is during away from display floater, indicate described image processing engine to reduce the parallax of each pixel in view data; When viewing location is during near display floater, indicate described image processing engine to increase the parallax of each pixel in view data.
Further, described command process module, according to the change of distance of viewing location and display floater, indicates described image processing engine to adjust the parallax of each pixel in view data, is specially:
Described command process module indicates described image processing engine for the each pixel in view data, is multiplied by the former parallax of this pixel with former distance and the ratio of current distance of viewing location and display floater, obtains the parallax after this pixel is adjusted.
Further, the coordinate figure that the angle of described command process module middle shaft rotation in display floater horizontal direction according to viewing location indicates described image processing engine to adjust each pixel changes, and is specially:
Described command process module is in the time that viewing location moves with respect to display floater parallel transverse, obtain the first angle of the middle shaft rotation of viewing location in display floater horizontal direction, described in when viewing location moves to left, the first angle is being for just, when viewing location moves to right described in the first angle for negative; Indicate described image processing engine for each pixel in view data, be multiplied by the parallax of this pixel with the sine value of described the first angle, add the former abscissa value of this pixel, obtain the abscissa value after this pixel is adjusted;
Described command process module is in the time that viewing location moves with respect to display floater parallel longitudinal direction, obtain the second angle of the middle shaft rotation of viewing location in display floater vertical direction, described in when viewing location moves down, the second angle is being for just, while moving in viewing location described in the second angle for negative; Indicate described image processing engine for each pixel in view data, be multiplied by the parallax of this pixel with the sine value of described the second angle, then add the former ordinate value of this pixel, obtain the ordinate value after this pixel is adjusted.
Further, described image processing engine also, for according to the coordinate figure of each object after adjusting, redefines the hiding relation between each object in view data.
Further, described display control chip also comprises:
Spectral array drive control module, adjusts light-splitting device for the parameter according to light-splitting device;
Described command process module is also for indicating described spectral array drive control module to upgrade the parameter of light-splitting device according to described current viewing location.
Further, the parameter of described light-splitting device comprises the width P of light-splitting device;
The parameter that described command process module indicates described spectral array drive control module to upgrade light-splitting device according to described current viewing location refers to:
Described command process module indicates described spectral array drive control module that the width P of light-splitting device is updated to:
Wherein D is current viewing location and the distance B of described light-splitting device, and M forms the width of the display unit that stereo-picture will cover for described light-splitting device, and f is the distance between described light-splitting device and pixel planes.
Further, the parameter of described light-splitting device comprises side-play amount offset;
The parameter that described command process module indicates described spectral array drive control module to upgrade light-splitting device according to described current viewing location refers to:
Described command process module indicates described spectral array drive control module that the side-play amount offset of light-splitting device is updated to:
offset=(D+f)/OFFSET;
Wherein, OFFSET is the current viewing location side-play amount with respect to screen parallel.
Further, described display control chip also comprises:
Synchronization control module, for completing synchronous between described image processing engine and spectral array drive control module according to the instruction of described command process module.
Further, described display control chip also comprises:
The second memory buffer;
Described image processing engine is sent view data after treatment to this second memory buffer.
Further, described image processing engine is multiple;
Described display control chip also comprises:
Image blend processing module, for exporting the result of each image processing engine in a certain order.
The present invention also provides a kind of 3 d display device, comprising:
Display floater;
Tracking equipment, for following the tracks of viewing location;
It is characterized in that, also comprise:
The above-mentioned display control chip of stating, for adjusting the display parameters of the each pixel of view data according to the movement of viewing location;
Drive circuit, for driving described display floater to show described view data according to the display parameters after adjusting.
The present invention provides more real stereo display effect by changing the parameter of pixel.Prioritization scheme of the present invention coordinates the adjustment of light-splitting device parameter to realize more real stereo display effect by the processing to image, can according to the real-time correction stereo-picture in beholder's position such as parallax, block/remove the information such as block, make beholder more on the spot in person.The parameter of the controlled light-splitting device that another prioritization scheme of the present invention forms by control LC-Barrier, LC-Lens or other materials realizes the adjustment of viewing areas, and interpolation arithmetic is less, can reduce the impact of crosstalking.
Embodiment
Below in conjunction with drawings and Examples, technical scheme of the present invention is described in detail.
It should be noted that, if do not conflicted, each feature in the embodiment of the present invention and embodiment can mutually combine, all within protection scope of the present invention.
Embodiment mono-, a kind of display control chip, comprising:
For the first memory buffer of storing image data;
Image processing engine, for from described the first memory buffer reads image data;
Command process module, for obtaining current viewing location, adjusts the display parameters of each pixel in described view data according to the described image processing engine of mobile instruction of viewing location.
In the present embodiment, described viewing location can be, but not limited to as position of human eye, can be also spectators' position, the position of receiver etc.
When the present embodiment is used for 3 d display device, the display driver circuit module drive display floater in drive circuit shows the view data after image processing engine is adjusted, and can revise two kinds of distortions shown in Fig. 1.
Described command process module is the core cell of this display control chip, this command process module can be, but not limited to obtain from viewing location and instruction area beholder's positional information, and for the computations of the required graph and image processing of doing of diverse location information.
In described display chip, can have one or more image processing engine, these image processing engines, under the control of described command process module, complete the adjustment of anaglyph, draw and play up.
If single image processing engine, view data can be processed by the first memory buffer piecemeal serial, on the contrary, if multiple image processing engine, can be by fast incoherent image parallel processing.
In the present embodiment, the display parameters of described pixel can comprise parallax;
The display parameters that described command process module is adjusted each pixel in described view data according to the described image processing engine of mobile instruction of viewing location can refer to:
Described command process module, according to the change of distance of viewing location and display floater, indicates described image processing engine to adjust the parallax of pixel; When viewing location is during away from display floater, indicate described image processing engine to reduce the parallax of each pixel in view data; When viewing location is during near display floater, indicate described image processing engine to increase the parallax of each pixel in view data.
Wherein, described command process module is according to the change of distance of viewing location and display floater, and the parallax of indicating described image processing engine to adjust each pixel in view data can be, but not limited to refer to:
Described command process module indicates described image processing engine for the each pixel in view data, is multiplied by the former parallax of this pixel with former distance and the ratio of current distance of viewing location and display floater, obtains the parallax after this pixel is adjusted.
When practical application, also can with other mode come along with viewing location away from/carry out the parallax of corresponding adjustment pixel near display floater, make it meet visual custom.
Fig. 2 (a) and (b) described the relation of parallax and viewing distance, in Fig. 2 (a), human eye 01,02 is original and be H for the distance between the virtual view object object of stereo display, between object object and human eye 01,02, a solid line nearer apart from object object represent parallax free face, object object forms projection P 1 on the imaging surface 601 of human eye 01, on the imaging surface 602 of human eye 02, forms projection P 2; In Fig. 2 (b), human eye 01,02 is H ' to the distance moving away from object object direction, distance after mobile between human eye 01,02 and object object is changed into H+H ', object object forms projection P 1 ' on the imaging surface 601 of human eye 01, on the imaging surface 602 of human eye 02, forms projection P 2 '; So described command process module indicates described image processing engine to adjust the parallax of each pixel, and the parallax Dis ' after adjustment is:
Dis’=Dis*H/(H+D); (1)
The parallax that wherein Dis is original pixel.
Described image processing engine, from described the first memory buffer reads image data, according to the instruction of described command process module, is adjusted the parallax of each pixel in view data respectively according to formula (1).
In above formula (1), D is the variable quantity of distance between viewing location and display floater; When viewing location (spectators are away from scene) when moving away from the direction of display floater, D be on the occasion of; In the time that viewing location moves to the direction that approaches display floater (spectators approach scene), D is negative value, so just can unify to revise spectators and move forward and backward the impact on parallax.Visible, the parallax after adjustment dwindles according to the ratio of H/ (H+D), meets human eye vision custom in the demonstration of the degree of depth.
In the present embodiment, the display parameters of described pixel can comprise coordinate figure;
The display parameters that described command process module is adjusted each pixel in described view data according to the described image processing engine of mobile instruction of viewing location can refer to:
Described command process module is the direction with respect to display floater parallel according to viewing location, indicates described image processing engine that the coordinate figure of each pixel in view data is adjusted in the opposite direction.
Fig. 3 (a) and (b) described the relation for virtual view and the viewing angle of stereo display, in Fig. 3 (a), overlaps between the axis in the original and screen level direction of viewing location (center line); In Fig. 3 (b), current viewing location, with respect to side-play amount (being transverse shifting distance in Fig. 3) OFFSET of screen parallel, can calculate the angle a of the middle shaft rotation of spectators in screen level direction according to the OFFSET detecting; Described command process module is indicated described image processing engine adjustment according to this anglec of rotation a, and the parallax value of each pixel is constant, and variation has occurred coordinate, and new coordinate X ' is:
X’=X+(Dis)×sin(a); (2)
The parallax that wherein Dis is pixel, the former coordinate that X is pixel.
Described image processing engine, from described the first memory buffer reads image data, according to the instruction of described command process module, is adjusted the coordinate of each pixel in view data respectively according to formula (2).
Image 701 in Fig. 3 (a) is viewing location virtual views that scene forms in situ time, wherein comprises object A; Image 702 in Fig. 3 (b) be viewing location with respect to screen parallel after time scene form virtual view; Can see, generate for after the virtual view of stereo display according to revised coordinate, along with after viewing location moves to left with respect to screen parallel transverse, object A moves to right in spectators' eye, meets human eye vision custom.
Viewing location refer to respect to display floater parallel the movement that the distance between viewing location and display floater remains unchanged in situation, comprise and move horizontally (transverse shifting, namely move left and right) and vertical mobile (vertically move, namely move up and down).
In the present embodiment, described command process module is the direction with respect to display floater parallel according to viewing location, indicates described image processing engine that the coordinate figure of each pixel in view data is adjusted in the opposite direction specifically and can be referred to:
Described command process module is in the time that viewing location moves with respect to display floater parallel transverse, obtain the first angle of the middle shaft rotation of viewing location in display floater horizontal direction, described in when viewing location moves to left (direction reducing to abscissa in pixel coordinate system moves), the first angle is being for just, when viewing location moves to right (direction increasing to abscissa in pixel coordinate system moves) described in the first angle for negative; Indicate described image processing engine to adjust the abscissa value of each pixel in view data according to formula (2), that is: for each pixel in view data, be multiplied by the parallax of this pixel with the sine value of described the first angle, add the former abscissa value of this pixel, obtain the abscissa value after this pixel is adjusted;
Described command process module is in the time that viewing location moves with respect to display floater parallel longitudinal direction, obtain the second angle of the middle shaft rotation of viewing location in display floater vertical direction, described in when viewing location moves down (direction reducing to ordinate in pixel coordinate system moves), the second angle is being for just, while moving (direction increasing to ordinate in pixel coordinate system moves) in viewing location described in the second angle for negative; Indicate described image processing engine for each pixel in view data, be multiplied by the parallax of this pixel with the sine value of described the second angle, then add the former ordinate value of this pixel, obtain the ordinate value after this pixel is adjusted, ordinate Y ' after namely pixel adjustment equals Y+ (Dis) × sin (b), b is the second angle, the former ordinate value that Y is pixel.
When practical application, also can carry out to come with respect to the situation of display floater parallel along with viewing location by other mode the coordinate figure of corresponding adjustment pixel, make it meet visual custom; Such as can be according to the ratio between viewing location and display floater distance and parallax, be multiplied by viewing location parallel distance and obtain coordinate figure change amplitude, then adjust according to coordinate figure change amplitude.
If viewing location both moved horizontally also and vertically moves, adjust respectively X, the Y-axis coordinate of each pixel; If only horizontal/vertical moves, only adjust the X/Y axial coordinate of each pixel.
If viewing location has all produced variation in the X, Y, Z axis position of space coordinates, this variation can split into respect to display floater parallel and distance moving so, now can adjust respectively the coordinate of each pixel according to parallel, adjust the parallax of each pixel according to distance moving.
In the present embodiment, described image processing engine can also be used for, according to the coordinate figure of each object after adjusting, redefining the hiding relation between each object in view data;
When described display driver circuit module drive display floater shows, will show each object according to the hiding relation redefining.
In the present embodiment, described display control chip can also comprise:
Spectral array drive control module, adjusts light-splitting device for the parameter according to light-splitting device;
Described command process module can also be used for indicating described spectral array drive control module to upgrade the parameter of light-splitting device according to described current viewing location.
Described command process module can walk abreast and indicates described image processing engine to adjust the display parameters of pixel and indicate described spectral array drive control module to upgrade the parameter of light-splitting device.
When the present embodiment is used for 3 d display device, controlled spectral array drive circuit module in drive circuit is used to the controlled light-splitting device in display floater that voltage is provided, and described spectral array drive control module can be adjusted light-splitting device by controlling this controlled spectral array drive circuit module.
The light-splitting device of controllable parameter can be formed by LC-Barrier, LC-Lens or other automatically controlled materials, a feature of controlled light-splitting device is width and the position that described controlled spectral array drive circuit module can be adjusted by changing voltage this light-splitting device (one-period of Barrier or Lens), if lens arrangement can also adjusting focal length.Can allow naked-eye stereoscopic display there are multiple best viewing location by this adjustment, thereby can help to eliminate the restriction of viewing areas.
In the present embodiment, consider that controlled spectral array is in dynamically adjusting, display parameters also need to complete corresponding adjustment simultaneously, and therefore described display control chip can also comprise:
Synchronization control module, for completing synchronous between described image processing engine and spectral array drive control module according to the instruction of described command process module; If it is multiple that described image processing engine has, be synchronous between these multiple image processing engines and spectral array drive control module.
In the present embodiment, image processing engine is for inserting frame time stamp (frame stamp) in described view data, to make can there be different time stamps between each different frame; Described like this display driver circuit module just can detect the sequence between different frame, thereby adjusts controlled spectral array drive circuit module, automatically completes synchronous adjustment.
In the present embodiment, the parameter of described light-splitting device can comprise the width P of light-splitting device;
Described command process module indicates described spectral array drive control module that the width P of light-splitting device is updated to:
Wherein, D is the distance of current viewing location and described light-splitting device; M forms the width of the display unit that stereo-picture will cover for controlled light-splitting device; F is the distance between described light-splitting device and pixel planes; Described display unit represents a pixel, and a pixel comprises at least one sub-pixel.
In the present embodiment, the parameter of described light-splitting device can comprise side-play amount offset;
Described command process module indicates described spectral array drive control module that the side-play amount offset of light-splitting device is updated to:
offset=(D+f)/OFFSET。
Wherein, the side-play amount that OFFSET is current viewing location.
After Fig. 4 has shown that the light-splitting device as an example of LC-Lens example is combined with display floater, the Computing Principle of viewing distance; Wherein on display floater, pixel planes comprises pixel (also can be described as sub-pixel) some groups times, and every group has m time pixel, and m is positive number.
Can obtain the calculating formula of the width of light-splitting device P according to Fig. 4:
Wherein P represents the width of light-splitting device, f is the distance of light-splitting device apart from pixel planes on display floater, D is viewing ratio (being the distance that human eye arrives described light-splitting device), and M forms the width of the display unit that stereo-picture will cover for controlled light-splitting device.Place if light-splitting device and display plane are certain angle, P also will be multiplied by the sine value of angle.Formula (4) below obtaining from formula (3) conversion, can see, in the time that P broadens, other values are constant, and D will increase; When P narrows, other values are constant, and D will reduce.
D=M*f/(M-P)–f (4)
In addition, in the time that light-splitting device moves horizontally, the horizontal level of viewing areas also can respective change, as shown in Figure 5.
Suppose that the side-play amount that light-splitting device moves horizontally is offset, can calculate so the side-play amount OFFSET that viewing areas moves horizontally and be:
OFFSET=(D+f)/offset (5)
When viewing areas vertically moves OFFSET, the relation between the side-play amount offset that light-splitting device vertically moves also as the formula (5).
In the present embodiment, described display control chip can also comprise: the second memory buffer;
Described image processing engine is sent view data after treatment to this second memory buffer, to can complete demonstration below.
Described display driver circuit module is obtained image processing engine view data after treatment from described the second memory buffer.
An application example of described display control chip as shown in Figure 6, comprises the command process module being connected with viewing location and processing instruction memory block, the spectral array drive control module that is subject to this command process module control, synchronization control module, multiple image processing engine: image processing engine 1 is to image processing engine n; Synchronization control module completes synchronous between described image processing engine and spectral array drive control module; For the first memory buffer of view data is provided to multiple image processing engines; For storing the second memory buffer of the view data after multiple image processing engines are adjusted; In Fig. 6, extract the display driver circuit module of view data from described the second memory buffer, be connected with display floater; The controlled spectral array drive circuit module that is controlled by spectral array drive control module, is also connected with display floater, and synchronous with described display driver circuit module.
Add the second memory buffer can make display driver circuit module obtain easily display image data and do not interrupt, the situations such as wait.In some cases, consider determining of viewing location, the processing of image, transmission and driving all need certain time delay, for some specific application scenario, image shows when increasing beholder's displacement, the real-time adjustment of parallax control and spectral array, the second memory buffer can be omitted, in another instantiation as shown in Figure 7, remove the second memory buffer, increased image blend processing module, for the result of each image processing engine being exported in a certain order to described display driver circuit module; A same example of other module and annexation.
Because there is no the second memory buffer, the image that image processing engine completes will directly be exported to display driver circuit module.Because can input display floater piecemeal, and then driving is processed, therefore, image processing engine can adopt serial process, the mode of serial output, also can adopt parallel processing, the mode of serial output, the view data that adjustment is completed outputs to display floater one by one, for display floater, do not need to wait until that all view data just can show output by view data after finishing dealing with, but after processing a part of view data, just can export at once display floater, thereby save buffering area and processed the time delay bringing, reach real-time effect.
Embodiment bis-, a kind of 3 d display device, as shown in Figure 8, comprises: display floater 803;
Tracking equipment 804, for following the tracks of viewing location;
Display control chip 801 in embodiment mono-, for adjusting the display parameters of the each pixel of view data according to the movement of viewing location;
Drive circuit 802, for driving described display floater to show described view data according to the display parameters after adjusting.
In the present embodiment, described viewing location can be, but not limited to as position of human eye, can be also spectators' position, the position of receiver etc.
In the present embodiment, described display floater can also comprise controlled light-splitting device.
In the present embodiment, described controlled light-splitting device can be, but not limited to as parallax obstacle or controlled lens arra (LC-Barrier or LC-Lens); A control chip (can be also general processor) is used for the parameter of the light-splitting device that coordinates image processing algorithm control display floater; And corresponding control circuit and driving.
In the present embodiment, described display control chip realize details with embodiment mono-.
In the present embodiment, described drive circuit can be, but not limited to comprise controlled spectral array drive circuit module and the display driver circuit module described in embodiment mono-,
Certainly; the present invention also can have other various embodiments; in the situation that not deviating from spirit of the present invention and essence thereof; those of ordinary skill in the art are when making according to the present invention various corresponding changes and distortion, but these corresponding changes and distortion all should belong to the protection range of claim of the present invention.