CN101388138A - Interactive image system, interactive device and operation method thereof - Google Patents

Abstract

An interactive imaging system includes a host having a first wireless module and a storage device for accessing software, at least one reference point for generating light of a predetermined spectrum, and an interactive device. The interaction device comprises a second wireless module, an image module, a modulation module and a processing unit. The image module acquires the reference point image at a sampling frequency to form a first image and a second image, and calculates and outputs a movement vector of the reference point between the first image and the second image; the processor controls the second wireless module to transmit the motion vector to the first wireless module, and controls the modulation module to modulate the sampling frequency of the image module in real time according to a preset condition. The invention also provides an interaction device and an operation method thereof.

Description

Interaction image system, interactive device and How It Works thereof

Technical field

The present invention relates to a kind of interaction image system, interactive device and How It Works thereof, particularly relate to a kind of interaction image system, interactive device and the How It Works thereof of the sampling frequency of the image module in the interactive device that pass through to change with the saving electric energy.

Background technology

Existing game remote device, can be applicable to the light gun recreation as the device among the TaiWan, China patent I267754 of " indicator positioning device of video camera " by name, described indicator positioning device is in the photography indicator device control circuit to be set, and described control circuit connects video camera, computing unit and communication interface respectively.Described communication interface is connected to main frame, and described video camera the place ahead is provided with filter, and screen is provided with a plurality of light-emitting components that can supply video camera to take.When the user uses described photography indicator device to carry out the performed operation of main frame, described photo-opportunity is taken display screen, and because of filter that video camera had with the light source filtering beyond the spectrum that light-emitting component sent, so the light source of light-emitting component only can appear in the captured picture of video camera, this picture being transferred to computing unit calculates the coordinate figure of video camera aiming point and is sent to main frame, the control that makes main frame can utilize this coordinate figure to be correlated with again.

Yet on reality was used, in order to promote the property convenient for control of telechiric device, telechiric device utilized and carries out data transmission between radio communication and main frame, and used the whole required electric energy of battery module supply telechiric device.Because telechiric device comprises a plurality of dissipative cells, therefore, the power consumption that must as far as possible reduce each element is to prolong the life-span of battery module.Usually in order to promote the precision that computing unit calculates the aiming point coordinate, video camera is preferably and uses higher Image Acquisition frequency to obtain image, but hi-vision obtains the computation burden that rate can increase computing unit relatively, and then the power consumption of increase telechiric device integral body, and the serviceable life of reducing battery module.

For these reasons, be necessary further to improve the function mode of above-mentioned telechiric device really,, prolong the serviceable life of battery module so that save the power consumption of telechiric device integral body.

Summary of the invention

The purpose of this invention is to provide a kind of interaction image system, interactive device and How It Works thereof, by modulating the sampling frequency of image module in the interactive device in real time, to save the power consumption of interactive device integral body.

For achieving the above object, the invention provides a kind of interaction image system, described system comprises main frame, at least one reference point and interactive device.Described main frame comprises that first wireless module reaches the storage device in order to access software.Described reference point produces the light of default spectrum, for example, but is not limited to special spectrums such as infrared light or ultraviolet light.Described interactive device comprises second wireless module, image module, modulation module and processing unit, described second wireless module in order to and first wireless module between carry out data transmission; Described image module obtains described reference point image to form first image and second image with sampling frequency, calculates and export the motion-vector of described reference point image between described first image and described second image; Described modulation module is in order to modulate the sampling frequency of described image module; Described processing unit couples described image module, and control second wireless module motion-vector is transferred to first wireless module, and according to the pre-conditioned control modulation module sampling frequency of modulation image module in real time.

According to another characteristics of the present invention, the present invention also provides a kind of interactive device employed interaction image system, described interaction image system comprises the reference point of the light of described interactive device, main frame and the default spectrum of at least one generation, and described interactive device connects main frame by radio communication.Described interactive device comprises wireless module, image module, modulation module and processing unit.Wireless module in order to and main frame between carry out data transmission.Image module obtains described reference point image to form first image and second image with a sampling frequency, calculates and export the motion-vector of described reference point image between first image and second image.Modulation module is in order to the sampling frequency of modulation image module.Processing unit couples image module, and the control wireless module transfers to main frame with motion-vector, and according to the pre-conditioned control modulation module sampling frequency of modulation image module in real time.

The present invention provides a kind of How It Works of interactive device in addition, described interactive device is used for interaction image system, described interaction image system comprises the reference point of the light of interactive device, main frame and the default spectrum of at least one generation, and interactive device connects main frame by radio communication.Described How It Works comprises the following steps: to provide image module, described image module obtains described reference point image to form first image and second image with a sampling frequency, calculates and export the motion-vector of described reference point image between first image and second image; Wireless module is provided, carries out data transmission between described wireless module and main frame; Processing unit is provided, and described processing unit control wireless module transfers to main frame with motion-vector, and according to the sampling frequency of the pre-conditioned module of modulation image in real time.

Interaction image system of the present invention and interactive device, also comprise in order to the state of sensing interaction device and produce the action sensing module of electric signal, described electric signal is for for example, but be not limited to, potential difference signal or current signal, described processing unit then calculates the acceleration of described interactive device according to described electric signal, and the control wireless module transfers to main frame with described acceleration.

In interaction image system, interactive device and the How It Works thereof of the invention described above, described pre-conditioned comprising: main frame transfers to the frequency of interactive device and selects signal, the motion-vector of the reference point image that it can be determined by the software of the storage device institute access of main frame, the image module of described interactive device is exported between first image and second image and/or the acceleration of the processing unit interactive device of trying to achieve according to described electric signal.Processing unit can be according to above-mentioned one or more combination control modulation module in pre-conditioned sampling frequency of modulation image module in real time, so that save the whole energy consumption of interactive device.

According to interaction image system of the present invention, interactive device and How It Works thereof, can obtain the motion-vector of reference point image between first image and second image in order to make image module, its sampling frequency is preferably and was higher than for 60 frame/seconds; Based on the hardware transmission speed, sampling frequency can reach for 200 frame/seconds.

According to interaction image system of the present invention and interactive device, described main frame can be game host or computer system main frame; Described software can be Games Software or computer software; Described interactive device can be telepilot or indicator positioning device.

Description of drawings

Fig. 1 has shown the synoptic diagram of a kind of embodiment of interaction image system provided by the invention.

Fig. 2 has shown the structural representation of a kind of embodiment of interactive device provided by the invention.

Fig. 3 has shown the running synoptic diagram of the interactive device in a kind of embodiment provided by the invention.

Fig. 4 has shown the process flow diagram of the How It Works in a kind of embodiment provided by the invention.

Fig. 5 has shown the process flow diagram that utilizes the vernier on the interactive device control image display to move in a kind of embodiment provided by the invention.

Fig. 6 a has shown that interactive device in a kind of embodiment provided by the invention is in the time the turn clockwise digital picture of an angle time institute sensing of shooting.

Fig. 6 b has shown that the interactive device in a kind of embodiment provided by the invention spends the digital picture of time institute's sensing at when shooting dextrorotation gyration greater than 180.

Fig. 7 has shown that interactive device in a kind of embodiment provided by the invention is in the make a video recording digital picture of time institute's sensing of different distance.

Fig. 8 has shown that the sensing position of the interactive device in a kind of embodiment provided by the invention moves the digital picture of time institute's sensing.

Fig. 9 has shown in the interaction image system in a kind of embodiment provided by the invention, the proportionate relationship of distance between the image-forming range of image sensing module and image sensing module and screen.

Figure 10 has shown in the interaction image system in a kind of embodiment provided by the invention, the change in location of vernier on the image display screen and the synoptic diagram of the change in location of reference point image on sensing array.

Figure 11 has shown in the interaction image system of a kind of embodiment provided by the invention, the graph of a relation of the sampling frequency of image module and the motion-vector of vernier.

Main description of reference numerals

10 main frames, 12,14 reference point

16 first wireless modules, 18 storage devices

20 interactive devices, 21 image modules

210 optical filtering modules, 212 image sensing modules

214 image processing modules, 22 processing units

23 modulation modules, 24 action sensing modules

25 second wireless modules, 26 multiplexer (MUXs

80 image displays, 801 screens

802 verniers, 90 CD-RW discsCD-RW

L, l reference point image pitch are from the θ anglec of rotation

Δ S motion-vector Δ S_xThe horizontal component of motion-vector

Δ S_YThe vertical component SA sensing array of motion-vector

A image sensing scope DI digital picture

B1～B 4steps 150～720 steps

F image sensing module image-forming range X_Scale, Y_ScaleScale parameter

Distance between F image sensing module and screen

The distance at D, d reference point image averaging coordinate and sensing array center

i₁₂, i₁₄, i₁₂', i₁₄' reference point image

I₁₂, I₁₄, I₁₂', I₁₄', I₁₂", I₁₄", I₁₂" ', I₁₄" ' reference point image

(X, Y), (X₀, Y₀), (X_i, Y_i) average coordinates of reference point image

Embodiment

In order to allow above-mentioned and other purposes of the present invention, feature and the advantage can be more obvious, embodiment of the present invention cited below particularly, and cooperate appended diagram, be described in detail below.In addition, in the explanation of this instructions, similar elements is to represent with identical Reference numeral, in this prior statement.

With reference to shown in Figure 1, it has shown the synoptic diagram of a kind of embodiment of interaction image system of the present invention, and described system comprises main frame 10, two reference point 12 and 14, interactive device 20 and image display 80.The embodiment of described main frame 10 for example, game host or computer system main frame, described main frame comprises first wireless module 16 and storage device 18, described storage device 18 is in order to the access software in CD-RW discsCD-RW 90, mobile USB flash disk or the memory storage for example, and the executing state of software is shown on the image display 80 controls for the user.Can show vernier 802 on the screen 801 of image display 80, what its embodiment for example included, but not limited to the point of impact of light gun and software controls vernier etc.The embodiment of reference point 12,14 can be, but be not limited to, the reference point of the different shape that light source rearranged of specific wavelengths such as a plurality of infrared light light emitting diodes (wavelength for example can be 940 nanometers), laser diode or ultraviolet light, described light source can be electrically connected to image display 80 or main frame 10, can also supply electric energy required when luminous voluntarily with power supply independently.In addition, the number of reference point is not limited to two, can comprise one or more reference point.The image that described interactive device 20 obtains reference point 12,14 changes to judge interactive device 20 and the relative position and/or the angle of reference point, with the action of relative control vernier 802 on screen 801.Interactive device 20 is in order to control the performed software of main frame 10, for example Games Software or computer software.When main frame 10 performed be Games Software the time, interactive device 20 for example can be used as into, but be not limited to, light gun, cue, golf clubs, tennis racket, bat, racket or table tennis bat etc. are so that control the carrying out of recreation; When main frame 10 performed be computer software the time, interactive device 20 for example can be used as pointer (vernier) locating device so that control the carrying out of described computer software.

Shown in Fig. 1,2 and 3, Fig. 2 has shown the structural representation of a kind of embodiment of interactive device 20 provided by the invention, and described interactive device 20 comprises image module 21, processing unit 22, modulation module 23, action sensing module 24 and second wireless module 25.Image module 21 comprises optical filtering module 210, image sensing module 212 and image processing module 214, described optical filtering module 210 is in order to filtering special spectrum (for example spectrum of specific wavelength such as infrared light spectrum and ultraviolet spectrum) light in addition, make described image sensing module 212 only receive light, and get rid of the interference that other light sources caused from reference point 12,14; Described image sensing module 212 has sensing array (not drawing), lighting angle according to its angular field of view and reference point 12,14 can define the image sensing scope " A " (Fig. 1), and with a sampling frequency (for example 60～200 frame/seconds) sensing reference point 12,14 light that produced, to form digital picture.Be understandable that Fig. 1 only exemplarily draws image sensing scope " A ", in fact described image sensing scope " A " may be wider.When image sensing module 212 points to the image sensing scopes " A " in the time, because described image module 21 has optical filtering module 210, thereby, make the image that only has reference point 12,14 on the described digital picture, the embodiment of image sensing module 212 comprises charge-coupled device (CCD) imageing sensor and complementary metal oxide semiconductor (CMOS) (CMOS) imageing sensor.Image processing module 214 is according to a plurality of digital pictures from image sensing module 212, the motion-vector of calculating reference point 12,14 images between described digital picture, and export processing unit 22 to.Be understandable that the digital picture that image sensing module 212 is exported also can be handled by processing unit 22, to calculate the motion-vector of reference point 12,14 images between digital picture.

The embodiment of described action sensing module 24 comprises, but be not limited to, acceleration transducer (accelerometer) and gyro sensor (gyro sensor), in order to the two dimension and/or the three-dimensional acceleration change ofsensing interaction device 20, and output potential difference signal or current signal.For example, wheninteractive device 20 is set at bat in the recreation, but 24 sensing users' of action sensing module (not drawing) the state of swinging, and produce electric signal (potential difference signal or current signal).Processing unit 22, and is controlled second wireless module 25 described acceleration is sent tofirst wireless module 16 ofmain frame 10 calculating the acceleration ofinteractive device 20 according to described electric signal, with the operation of relative Control Software.

Described modulation module 23 is in order to the sampling frequency according to pre-conditioned modulation image module 21, for example in one embodiment, described modulation module 23 is by the described sampling frequency of multiplexer (MUX 26 modulation, as shown in Figure 3, and in order to make image module 21 can calculate the motion-vector of reference point 12,14 images between a plurality of digital pictures, the sampling frequency of employing module 21 is preferably and was higher than for 60 frame/seconds, and based on the hardware transmission speed, described sampling frequency can reach for 200 frame/seconds.Be understandable that modulation module 23 does not limit and is arranged at processing unit 22 inside, shown in Figure 2 only is a kind of embodiment.The present invention is in order to modulate the pre-conditioned of described image module 21 sampling frequencies, described pre-conditioned comprising: main frame 10 transfers to the frequency of interactive device 20 and selects signal, described signal can be automatically determined by the software of 18 accesses of storage device of main frame 10, for example, the sampling frequency of dynamic gaming is very fast, the sampling frequency of static recreation is slower, or can be set up on their own by the user; The motion-vector of reference point 12,14 images between digital picture that the image module 21 of interactive device 20 is tried to achieve; And the acceleration of the processing unit 22 described interactive device 20 of trying to achieve etc.Processing unit 22 can be according to above-mentioned one or more combination (Fig. 3) control modulation module 23 in pre-conditioned sampling frequency of modulation image module 21 in real time.Thus, when main frame 10 performed softwares do not need image module 21 to obtain image at a high speed, can be by reducing the whole energy consumption that sampling frequency is saved interactive device 20.

With reference to Fig. 1 and 4, Fig. 4 has shown the process flow diagram of How It Works of the interactive device of one embodiment of the present invention, described How It Works comprises the following steps: to provide image module, described image module obtains the reference point image to form first image and second image with a sampling frequency, calculates and the motion-vector (step B1) of output reference point image between first image and second image; Wireless module is provided, carries out data transmission (step B2) between described wireless module and described main frame; The action sensing module is provided, and described action sensing module is in order to the state of the described interactive device of sensing and produce electric signal (step B3); Processing unit is provided, described processing unit calculates the acceleration of described interactive device according to described electric signal, control described wireless module described motion-vector and acceleration are sent to main frame, and according to pre-conditioned sampling frequency (step B4) of modulating described image module in real time.At first, the image sensing module 212 of image module 21 obtains the spectral signal of reference point 12,14 by optical filtering module 210, to form a plurality of digital pictures, image processing module 214 calculates according to described digital picture and the motion-vector of output reference point 12,14 images between digital picture, and its account form will be in aftermentioned paragraph illustrated (step B1); Simultaneously, described action sensing module 24 sensing users control the state of interactive device 20, and produce potential difference signal or current signal (step B3); Then processing unit 22 calculates the acceleration of interactive device 20 according to described electric signal, and control described second wireless module signal of described acceleration and described motion-vector is transferred to main frame 10, so that carry out relative control, and according to the sampling frequency (step B4) of above-mentioned one or more combination control modulating unit 23 modulation image modules 21 in pre-conditioned.

In order to further specify the present invention, illustrate a kind of embodiment of the motion-vector of thevernier 802 on theinteractive device 20 computed image displays 80 below, but it is not in order to restriction the present invention.

To shown in Figure 8, in this embodiment, interactive device 20 moves in order to the vernier 802 on the screen 801 of control image display 80 with reference to Fig. 5, and described vernier 802 for example can be represented the point of impact or the vernier (cursor) in order to carry out software control of light gun.Reference point 12,14 is with two different area but the identical reference point of shape represents that for example reference point 12 is represented with big asterisk, is presented on then to be I on the digital picture DI₁₂Reference point 14 represents with little asterisk, is presented on then to be I on the digital picture DI₁₄The control method of vernier 802 comprises the following steps: to provide two reference point producing default spectrum, and defines preset range (step 150); Provide image module to point in the described preset range (step 250); Utilize described image module to receive and preset spectrum and form digital picture (step 300); Judge the image space and the shape of the reference point on the described digital picture, and produce first parameter (step 400); Carry out distance and angle compensation (step 500) at described first parameter; The sensing position of mobile image module in described preset range, and produce second parameter (step 600); And according to described first parameter after the compensation and the displacement of the reference point image space between the described digital picture of second calculation of parameter with move (step 700) relative to the control vernier.Wherein, in step 700, carry out distance and angle compensation (step 710) and can select importing the sensitivity that scale parameter (step 720) moves with control vernier 802 at second parameter simultaneously, wherein, step 720 also can be selected and will not implement.

Refer again to Fig. 1,5 and 6a shown in, interactive device 20 is preferably to be set with in described image processing module 214 in advance before dispatching from the factory and is preset to image position parameter and default image-forming range parameter, when described parameter can be interactive device 20 distance reference points 12,14 for predeterminable range (for example 3 meters), the preset reference dot image I of the reference point of being obtained according to image sensing module 212 12,14₁₂And I₁₄The parameter preset of being tried to achieve, shown in Fig. 6 a, with this as distance and the benchmark during angle compensation.According to the formed plane space coordinate of the sensing array of image sensing module 212, for example, be the formed planimetric coordinates of initial point with the center "+" of sensing array, definable is preset to image position parameter and default image-forming range parameter.For example: the described image position parameter that is preset to can comprise in the plane space coordinate, reference point 12 and the 14 default image I that form₁₂And I₁₄Coordinate, its average coordinates (X₀, Y₀) and described two default image I₁₂And I₁₄The angle of inclination of line; Described default image-forming range parameter can comprise that reference point 12 and 14 form default image I₁₂And I₁₄Between distance L and average coordinates (X thereof₀, Y₀) with the distance D of sensing array central point "+".

At first, making reference point 12,14 produce the light of default spectrum, for example, is infrared light spectrum in the present embodiment, so, then can around reference point 12,14, determine image sensing scope " A " (step 150) according to the lighting angle of the angular field of view and the reference point 12,14 of image sensing module 212; Then, image sensing module 212 with interactive device 20 points to described image sensing scope " A " interior any one (step 250), because image sensing module 212 used in the present invention only can sense default spectrum, therefore the formed digital picture DI image (step 300) that only has reference point 12,14 comprises I shown in Fig. 6 a₁₂' and I₁₄' first image.Because when interactive device 20 obtained described digital picture, described interactive device 20 had rotated angle θ along clockwise direction, thereby the image I of reference point₁₂' and I₁₄' reference point the image I taken the photograph at aforementioned predeterminable range with image sensing module 212₁₂And I₁₄Between produced the deviation of anglec of rotation θ relatively, therefore, cause the reference point image I₁₂' and I₁₄' average coordinates (X Y) is different from preset reference dot image I₁₂And I₁₄Average coordinates (X₀, Y₀), though this moment, described image sensing module 212 pointed to same position.

Shown in Fig. 1,5,6a and 6b, describedimage processing module 214 is judged the reference point image I₁₂' and I₁₄' position and shape, and produce first parameter, described first parameter comprises: the first image space parameter, the first image-forming range parameter and imaging form parameter (step 400).214 of image processing modules are according to the described first image space parameter (reference point image I for example₁₂' and I₁₄' average coordinates and the angle of inclination of line) with described image position parameter (the preset reference dot image I for example that is preset to₁₂And I₁₄And the angle of inclination of line) the angular deviation θ between carries out angle compensation (step 500), and the mode of its compensation is represented with (1) formula:

$\left[\begin{array}{c}X\′\\ Y\′\end{array}\right]=\left[\begin{array}{cc}\cos \left(\mathrm{\θ}\right)& -\sin \left(\mathrm{\θ}\right)\\ \sin \left(\mathrm{\θ}\right)& \cos \left(\mathrm{\θ}\right)\end{array}\right]\left[\begin{array}{c}X\\ Y\end{array}\right]---\left(1\right)$

Wherein, θ represents the first image space parameter and is preset to anglec of rotation deviation between the parameter of image position; X, Y represent the average coordinates of the preceding first image space parameter of angle compensation; X ', Y ' (not drawing) then represent the average coordinates of compensation back reference point image space parameter.Therefore,reference point 12,14 images after compensation are the image for being tried to achieve under same benchmark then, in view of the above as user during in the same distance shooting of the described image display ofdistance 80,image sensing module 212 all can obtain identical result when any anglec of rotation operation.

When described misalignment angle θ forms the reference point image I greater than 180 degree₁₂" and I₁₄" time, shown in Fig. 6 b, if the reference point image I₁₂, I₁₄Between do not have otherness (having identical size and shape), can't judge the reference point image I₁₂" and I₁₄" be by the reference point image I₁₂' and I₁₄' (it still is that translation forms that Fig. 6 a) rotates formation.Therefore in the present embodiment, by using tworeference point 12,14 of different area, and the imaging form parameter of being tried to achieve according to image processing module 214 (for example, the area size of reference point image) firstidentification reference point 12,14 become the position separately of image, and then carry out angle compensation.Thus, even surpassing 180 degree, the anglec of rotation ofimage sensing module 212 still can correctly carry out angle compensation.

With reference to shown in Figure 7, it has shown the mode of present embodiment middle distance compensation.The image sensing module 212 of interactive device 20 is when predeterminable range is made a video recording, and the preset reference dot image that can obtain reference point 12 and 14 is I₁₂And I₁₄, when the distance of 12,14 of described interactive device 20 and reference point strengthened gradually, its obtained image then can diminish gradually, and its average coordinates can be gradually near the center "+" of image sensing array, I as shown in FIG.₁₂" ' and I₁₄" ', but this kind skew are not to represent the user to change the sensing position of interactive device 20, if described skew is not proofreaied and correct, then may take place to judge situation for moving horizontally by accident because of the change of camera distance.In the present invention, suppose image I in the described default image-forming range parameter₁₂And I₁₄Between distance be L, its average coordinates (X₀, Y₀) and the center "+" of sensing array between distance be D; Image I in the first image-forming range parameter₁₂" ' with I₁₄" ' distance be l, the distance between the center "+" of its average coordinates and sensing array is d, so can utilize the proportionate relationship of (2) formula, the deviation (step 500) that compensation is caused because of the camera distance difference:

$\frac{D}{L}=\frac{d}{l}---\left(2\right)$

With reference to shown in Figure 8, the image space of reference point forms i after having compensated₁₂And i₁₄, it has been compensated for as the image of being tried to achieve under same default distance and angle reference, and its average coordinates is shown as (X_i, Y_i).Then the sensing position of moving described interactive device 20 in described image sensing scope " A " is to obtain second image (step 600), and described second image comprises reference point image i₁₂' and i₁₄', this moment, 212 of described image sensing modules were sent to described image processing module 214 with second image that it sensed, 214 of described image processing modules produce second parameter according to described second image, and described second parameter comprises second image space parameter and the second image-forming range parameter of reference point 12,14 on second image behind the sensing position of moving described image sensing module 212.The described second image space parameter for example, is the formed plane space of initial point with the induction arrays center on the formed plane space of the sensing array of image sensing module 212, the average coordinates of reference point 12,14 images that form; The described second image-forming range parameter is that the described reference point on the formed plane space of the sensing array of image sensing module 212 forms the distance between image.214 of described image processing modules are according to the first image space parameter after the described compensation and the second image space parameter, calculating reference point image i₁₂And i₁₄Move to i₁₂' and i₁₄' motion-vector Δ S, when calculating, must utilize aforesaid compensation way to carry out the compensation (step 710) of angle and range deviation at described second parameter, vernier control in the hope of correct because the compensation way of second parameter is identical with first parameter, does not repeat them here.Then, processing unit 22 controls second wireless module 25 utilizes wireless mode, and described motion-vector Δ S is sent to image-display units 80.Have application software in image-display units 80 is preferably, described software, then can move on screen 801 relative to controlling vernier 802 (step 700) behind the motion-vector signal of accepting from second wireless module 25 in order to control user interface and vernier 802.In addition, carrying out reference point image i₁₂And i₁₄The calculating of motion-vector Δ S the time, can select to import one group of scale parameter X_Scale, Y_ScaleIn order to adjust the motion sensitivity of vernier 802, for example, this moment, motion-vector Δ S then can represent with (3) formula (step 720):

$\mathrm{\ΔS}=(\frac{{\mathrm{\ΔS}}_X}{X_{\mathrm{scale}}},\frac{{\mathrm{\ΔS}}_Y}{Y_{\mathrm{scale}}})---\left(3\right)$

Wherein, Δ S_XBe illustrated in the motion-vector component of horizontal direction; Δ S_YBe illustrated in the motion-vector component of vertical direction.Hence one can see that, the X in (3) formula_ScaleAnd Y_ScaleDuring increase, the motion sensitivity ofvernier 802 is reduced, that is the sensing displacement ofinteractive device 20 must increase the distance that could make thatvernier 802 mobile phases are same; Otherwise, the X in (3) formula_ScaleAnd Y_ScaleWhen reducing, the motion sensitivity ofvernier 802 is raise, that is the sensing displacement ofinteractive device 20 less relatively can makevernier 802 mobile phases with distance, so can promote the practicality ofinteractive device 20 of the present invention.

With reference to shown in Fig. 9 to 11, below illustrate the motion-vector of reference point between a plurality of images that processing unit 22 is tried to achieve according to theimage processing module 214 ofinteractive device 20, a kind of embodiment of the sampling frequency ofcontrol modulation module 23 modulation image modules 21.Fig. 9 has shown the proportionate relationship apart from F of 801 of the image-forming range f ofimage sensing module 212 andimage sensing module 212 and screens, in one embodiment, image-forming range f=32 millimeter, 801 ofimage sensing module 212 and screens apart from F=1.6 rice, that is F/f=50.Cooperate Figure 10 as can be known, distance and reference point image I that vernier 802 moves on thescreen 801 ofimage display 80₁₂Ratio in the displacement of the sensing array SA ofimage sensing module 212 is 50 times, that is whenimage processing module 214 was tried to achieve 1 micron motion-vector,expression vernier 802 had moved 50 microns on thescreen 801 ofimage display 80.

Then a kind of embodiment of the sampling frequency boundary value of described image module 21 is set in explanation, when each pixel of the sensing array SA of image sensing module 212 is of a size of 15 microns * 15 microns, be the motion-vector of the reference point 12 between 200 figure/seconds and per two figure when being 2 pixels in sampling frequency then, can try to achieve the per second change in location of vernier 802 on the screen 801 of image display 80 is (15 * 10^-3/ 25.4) * and 2 * 50 * 200=11.81 inch per second, in like manner can obtain respectively in the per second change in location of sampling frequency when being 100 frame/seconds and 50 frames/second and be respectively 5.91 inch per seconds and 2.95 inch per seconds.Please refer to Figure 11, it has shown the graph of a relation of the sampling frequency and the change in location of vernier 802 on the screen 801 of image display 80 of image module 21, in the present embodiment 2.95 inch per seconds and 5.91 inch per seconds are set at the boundary value that changes image module 21 sampling frequencies, that is when the change in location of vernier 802 on screen 801 was lower than 2.95 inch per seconds, the described image module 21 of modulation module 23 modulation obtained image with the sampling frequency of 50 frame/seconds; When described change in location was lower than 5.91 inch per seconds and is higher than 2.95 inch per seconds, described image module 21 obtained image with the sampling frequency of 100 frame/seconds; When described change in location was higher than 5.91 inch per seconds, described image module 21 obtained image with the sampling frequency of 200 frame/seconds.

Be understandable that, shown ratio value, boundary value, boundary value number and the sampling rate numerical value of Fig. 9 to 11 only is a kind of embodiment, be not that described ratio value, boundary value, boundary number and sampling frequency all can set up on their own according to actual product in order to qualification the present invention.In addition, the acceleration that described processing unit 22 is tried to achieve according to the action sensing module 24 ofinteractive device 20, the mode of the sampling frequency ofcontrol modulation module 23modulation image modules 21, be that the electric signal of described action sensing module 24 outputs is compared with one or more boundary values, described processing unit 22 is according to the sampling frequency of comparative resultcontrol modulation module 23 modulation image modules 21.Thus, when the acceleration of the change in location ofvernier 802 and/orinteractive device 20 was low, the describedimage module 21 ofmodulation module 23 modulation obtained image with lower sampling frequency, so that effectively save the power consumption ofinteractive device 20 integral body.

In addition, if have other light sources near the described interaction image system, its partly or all spectrum and reference point 12,14 sent spectra overlapping the time, for example, Halogen lamp LED or sunshine light source can utilize cycle or aperiodic signal modulation reference point 12,14 light that sent.In one embodiment, modulating unit (not drawing) can be located to reference point 12,14 provide in the device of electric energy, for example, in main frame 10 or image display 80, the sampling frequency of image module 21 is preferably with the modulating frequency of modulating unit and becomes multiple to concern, so that the sampling of described image and reference point 12,14 sampling forms synchronously, for example, in one embodiment, the sampling frequency of image module 21 is 200 hertz (per 5 milliseconds of samplings once), reference point 12,14 modulating frequency is 20 hertz (per 50 milliseconds of samplings once), when image module 21 every samplings the 10th time, reference point 12,14 all light, so that image module 21 can obtain reference point 12, the 14 default spectral signals that produced; Simultaneously the rectification device is set in addition in interactive device 20, thus, can gets rid of the interference of other light sources image identification in order to the modulated light signal of identification.

In sum, because in the existing telechiric device, the sampling frequency of imageing sensor is fixed, it is higher and need change the problem of battery module often to have a whole power consumption.With device and How It Works thereof,, can effectively reduce the whole energy consumption of interactive device, according to games system of the present invention, recreation to increase its practicality by the sampling frequency of modulation image module in real time.

Though the present invention is described with aforementioned preferred implementation, in order to limit the present invention, any the ordinary technical staff in the technical field of the invention without departing from the spirit and scope of the present invention, can not make various changes and modification to described content.Therefore protection scope of the present invention is when being limited by appended claim.

Claims (38)

Translated fromChinese

1、一种互动图像系统，其特征是，所述系统包括：1. An interactive image system, characterized in that the system includes:主机，所述主机包括第一无线模块及储存装置，所述储存装置用以存取软件；a host, the host includes a first wireless module and a storage device, the storage device is used to access software;至少一个参考点，所述参考点产生预设光谱的光；及at least one reference point that produces a predetermined spectrum of light; and互动装置，所述互动装置包括：An interactive device, the interactive device comprising:第二无线模块，用以与所述第一无线模块间进行数据传输；a second wireless module, configured to perform data transmission with the first wireless module;图像模块，以取样频率获取所述参考点图像以形成第一图像及第二图像，计算并输出所述参考点图像在所述第一图像及所述第二图像间的移动向量；An image module, acquiring the reference point image at a sampling frequency to form a first image and a second image, calculating and outputting a motion vector of the reference point image between the first image and the second image;调制模块，用以调制所述图像模块的取样频率；及a modulation module, used to modulate the sampling frequency of the image module; and处理单元，控制所述第二无线模块将所述移动向量传输至所述第一无线模块，并根据预设条件控制所述调制模块实时地调制所述图像模块的取样频率。A processing unit, controlling the second wireless module to transmit the motion vector to the first wireless module, and controlling the modulation module to modulate the sampling frequency of the image module in real time according to preset conditions.2、根据权利要求1所述的互动图像系统，其特征是，所述预设条件为所述主机传输至所述互动装置的频率选择信号。2. The interactive image system according to claim 1, wherein the preset condition is a frequency selection signal transmitted from the host to the interactive device.3、根据权利要求2所述的互动图像系统，其特征是，所述频率选择信号由所述主机的储存装置所存取的软件所决定。3. The interactive image system according to claim 2, wherein the frequency selection signal is determined by software accessed by the storage device of the host.4、根据权利要求1所述的互动图像系统，其特征是，所述预设条件为所述互动装置的图像模块所输出的所述移动向量。4. The interactive image system according to claim 1, wherein the preset condition is the motion vector output by the image module of the interactive device.5、根据权利要求1所述的互动图像系统，其特征是，所述互动装置还包括动作感测模块，所述动作感测模块用以感测所述互动装置的状态并产生电信号，其中所述处理单元根据所述电信号计算所述互动装置的加速度，并控制所述第二无线模块将所述加速度传输至所述第一无线模块。5. The interactive image system according to claim 1, wherein the interactive device further comprises a motion sensing module, the motion sensing module is used to sense the state of the interactive device and generate an electrical signal, wherein The processing unit calculates the acceleration of the interactive device according to the electrical signal, and controls the second wireless module to transmit the acceleration to the first wireless module.6、根据权利要求5所述的互动图像系统，其特征是，所述预设条件为所述互动装置的处理单元所求得的所述加速度。6. The interactive image system according to claim 5, wherein the preset condition is the acceleration obtained by the processing unit of the interactive device.7、根据权利要求5所述的互动图像系统，其特征是，所述动作感测模块选自加速度传感器及陀螺仪传感器中的一者。7. The interactive image system according to claim 5, wherein the motion sensing module is selected from one of an acceleration sensor and a gyroscope sensor.8、根据权利要求5所述的互动图像系统，其特征是，所述电信号选自电位差信号及电流信号中的一者。8. The interactive image system according to claim 5, wherein the electrical signal is selected from one of a potential difference signal and a current signal.9、根据权利要求1所述的互动图像系统，其特征是，所述参考点为红外光发光二极管，所述预设光谱为红外光光谱。9. The interactive image system according to claim 1, wherein the reference point is an infrared light emitting diode, and the preset spectrum is an infrared light spectrum.10、根据权利要求9所述的互动图像系统，其特征是，所述图像模块还包括：10. The interactive image system according to claim 9, wherein the image module further comprises:红外光滤光镜，用以滤除所述预设光谱以外的光；an infrared light filter, used to filter out light other than the preset spectrum;图像感测模块，所述图像感测模块以取样频率获取所述参考点图像以形成所述第一图像及所述第二图像；及an image sensing module that acquires the reference point image at a sampling frequency to form the first image and the second image; and图像处理模块，所述图像处理模块计算并输出所述参考点图像在所述第一图像及所述第二图像间的移动向量。An image processing module, the image processing module calculates and outputs a motion vector of the reference point image between the first image and the second image.11、根据权利要求10所述的互动图像系统，其特征是，所述图像感测模块选自CCD图像传感器及CMOS图像传感器中的一者。11. The interactive image system according to claim 10, wherein the image sensing module is selected from one of a CCD image sensor and a CMOS image sensor.12、根据权利要求1所述的互动图像系统，其特征是，所述图像模块的取样频率范围介于60帧/秒至200帧/秒之间。12. The interactive image system according to claim 1, wherein the sampling frequency range of the image module is between 60 frames/second and 200 frames/second.13、根据权利要求1所述的互动图像系统，其特征是，所述参考点电连接至所述主机。13. The interactive image system according to claim 1, wherein the reference point is electrically connected to the host.14、根据权利要求1所述的互动图像系统，其特征是，所述系统还包括用以显示所述主机所执行的软件的图像显示器。14. The interactive image system according to claim 1, further comprising an image display for displaying the software executed by the host computer.15、根据权利要求14所述的互动图像系统，其特征是，所述参考点电连接至所述图像显示器。15. The interactive graphic system of claim 14, wherein the reference point is electrically connected to the graphic display.16、根据权利要求1所述的互动图像系统，其特征是，所述调制模块还包括用以调制所述图像模块的取样频率的多路开关选择器。16. The interactive image system according to claim 1, wherein the modulation module further comprises a multiplexer for modulating the sampling frequency of the image module.17、根据权利要求1所述的互动图像系统，其特征是，所述主机选自游戏主机及电脑系统主机中的一者。17. The interactive image system according to claim 1, wherein the host is selected from one of a game host and a computer system host.18、根据权利要求1所述的互动图像系统，其特征是，所述互动装置选自遥控器及指针定位装置中的一者。18. The interactive image system according to claim 1, wherein the interactive device is selected from one of a remote controller and a pointer positioning device.19、根据权利要求1所述的互动图像系统，其特征是，所述参考点选自发光二极管及激光二极管中的一者。19. The interactive graphics system according to claim 1, wherein the reference point is selected from one of a light emitting diode and a laser diode.20、一种互动装置，其特征是，所述装置用于互动图像系统，所述系统包括所述互动装置、主机及至少一个用以产生预设光谱的光的参考点，所述互动装置通过无线通信连接所述主机，所述互动装置包括：20. An interactive device, characterized in that the device is used in an interactive image system, the system includes the interactive device, a host and at least one reference point for generating light with a preset spectrum, and the interactive device passes The host is connected by wireless communication, and the interactive device includes:无线模块，所述无线模块用以与所述主机间进行数据传输；a wireless module, the wireless module is used for data transmission with the host;图像模块，所述图像模块以取样频率获取所述参考点图像以形成第一图像及第二图像，计算并输出所述参考点图像在所述第一图像及第二图像间的移动向量；An image module, the image module acquires the reference point image at a sampling frequency to form a first image and a second image, and calculates and outputs a motion vector of the reference point image between the first image and the second image;调制模块，所述调制模块用以调制所述图像模块的取样频率；及a modulation module, the modulation module is used to modulate the sampling frequency of the image module; and处理单元，所述处理单元控制所述无线模块将所述移动向量传输至所述主机，并根据预设条件控制所述调制模块实时地调制所述图像模块的取样频率。A processing unit, the processing unit controls the wireless module to transmit the motion vector to the host, and controls the modulation module to modulate the sampling frequency of the image module in real time according to preset conditions.21、根据权利要求20所述的互动装置，其特征是，所述预设条件为所述主机传输至所述互动装置的频率选择信号。21. The interactive device according to claim 20, wherein the preset condition is a frequency selection signal transmitted from the host to the interactive device.22、根据权利要求20所述的互动装置，其特征是，所述预设条件为所述互动装置的图像模块所输出的移动向量。22. The interactive device according to claim 20, wherein the preset condition is a motion vector output by an image module of the interactive device.23、根据权利要求20所述的互动装置，其特征是，所述互动装置还包括用以感测所述互动装置的状态并产生电信号的动作感测模块，其中所述处理单元根据所述电信号计算所述互动装置的加速度，并控制所述无线模块将所述加速度传输至所述主机。23. The interactive device according to claim 20, characterized in that the interactive device further comprises a motion sensing module for sensing the state of the interactive device and generating an electrical signal, wherein the processing unit according to the The electric signal calculates the acceleration of the interactive device, and controls the wireless module to transmit the acceleration to the host.24、根据权利要求23所述的互动装置，其特征是，所述预设条件为所述互动装置的处理单元所求得的加速度。24. The interactive device according to claim 23, wherein the preset condition is the acceleration obtained by the processing unit of the interactive device.25、根据权利要求23所述的互动装置，其特征是，所述动作感测模块选自加速度传感器及陀螺仪传感器中的一者。25. The interactive device according to claim 23, wherein the motion sensing module is selected from one of an acceleration sensor and a gyroscope sensor.26、根据权利要求23所述的互动装置，其特征是，所述电信号选自电位差信号及电流信号中的一者。26. The interactive device according to claim 23, wherein the electrical signal is selected from one of a potential difference signal and a current signal.27、根据权利要求20所述的互动装置，其特征是，所述预设光谱为红外光光谱，所述图像模块还包括：27. The interactive device according to claim 20, wherein the preset spectrum is an infrared light spectrum, and the image module further includes:红外光滤光镜，所述红外光滤光镜用以滤除所述预设光谱以外的光；an infrared light filter, the infrared light filter is used to filter out light other than the preset spectrum;图像感测模块，所述图像感测模块以取样频率获取所述参考点图像以形成所述第一图像及所述第二图像；及an image sensing module that acquires the reference point image at a sampling frequency to form the first image and the second image; and图像处理模块，所述图像处理模块计算并输出所述参考点图像在所述第一图像及所述第二图像间的移动向量。An image processing module, the image processing module calculates and outputs a motion vector of the reference point image between the first image and the second image.28、根据权利要求27所述的互动装置，其特征是，所述图像感测模块选自CCD图像传感器及CMOS图像传感器中的一者。28. The interactive device according to claim 27, wherein the image sensing module is selected from one of a CCD image sensor and a CMOS image sensor.29、根据权利要求20所述的互动装置，其特征是，所述图像模块的取样频率范围介于60帧/秒至200帧/秒之间。29. The interactive device according to claim 20, wherein the sampling frequency range of the image module is between 60 frames/second and 200 frames/second.30、根据权利要求20所述的互动装置，其特征是，所述调制模块还包括用以调制所述图像模块的取样频率的多路开关选择器。30. The interactive device according to claim 20, wherein the modulation module further comprises a multiplexer for modulating the sampling frequency of the image module.31、根据权利要求20所述的互动装置，其特征是，所述装置选自遥控器及指针定位装置中的一者。31. The interactive device according to claim 20, wherein said device is selected from one of a remote control and a pointing device.32、一种互动装置的运作方法，其特征是，所述互动装置用于互动图像系统，所述系统包括所述互动装置、主机及至少一个用于产生预设光谱的光的参考点，且所述互动装置通过无线通信连接所述主机，所述运作方法包括下列步骤：32. An operation method of an interactive device, characterized in that the interactive device is used in an interactive image system, and the system includes the interactive device, a host and at least one reference point for generating light with a predetermined spectrum, and The interactive device is connected to the host through wireless communication, and the operation method includes the following steps:提供图像模块以取样频率获取所述参考点图像以形成第一图像及第二图像，计算并输出所述参考点图像在所述第一图像及所述第二图像间的移动向量；An image module is provided to obtain the reference point image at a sampling frequency to form a first image and a second image, and calculate and output a motion vector of the reference point image between the first image and the second image;提供无线模块，所述无线模块与所述主机间进行数据传输；及providing a wireless module for data transmission between the wireless module and the host; and提供处理单元，所述处理单元控制所述无线模块将所述移动向量传输至所述主机，并根据预设条件实时地调制所述图像模块的取样频率。A processing unit is provided, the processing unit controls the wireless module to transmit the motion vector to the host, and modulates the sampling frequency of the image module in real time according to preset conditions.33、根据权利要求32所述的运作方法，其特征是，所述方法还包括下列步骤：通过所述无线模块接收所述主机所发出的频率选择信号，其中所述预设条件为所述频率选择信号。33. The operation method according to claim 32, characterized in that the method further comprises the following step: receiving the frequency selection signal sent by the host through the wireless module, wherein the preset condition is that the frequency Select a signal.34、根据权利要求32所述的运作方法，其特征是，所述预设条件为所述互动装置的图像模块所输出的所述移动向量。34. The operation method according to claim 32, wherein the preset condition is the motion vector output by the image module of the interactive device.35、根据权利要求32所述的运作方法，其特征是，所述方法还包括下列步骤：35. The operating method according to claim 32, characterized in that said method further comprises the following steps:提供动作感测模块用以感测所述互动装置的状态并产生电信号；providing a motion sensing module for sensing the state of the interactive device and generating an electrical signal;根据所述电信号计算所述互动装置的加速度；及calculating an acceleration of the interactive device based on the electrical signal; and通过所述无线模块将所述加速度传输至所述主机。The acceleration is transmitted to the host through the wireless module.36、根据权利要求35所述的运作方法，其特征是，所述预设条件为根据所述电信号求得的所述互动装置的所述加速度。36. The operating method according to claim 35, wherein the preset condition is the acceleration of the interactive device obtained from the electrical signal.37、根据权利要求32所述的运作方法，其特征是，所述图像模块的取样频率范围介于60帧/秒至200帧/秒之间。37. The operation method according to claim 32, wherein the sampling frequency range of the image module is between 60 frames/second and 200 frames/second.38、一种互动图像系统，其特征是，所述系统包括：38. An interactive image system, characterized in that the system includes:主机，所述主机包括第一无线模块及储存装置，所述储存装置用以存取软件；a host, the host includes a first wireless module and a storage device, the storage device is used to access software;至少一个参考点，所述参考点产生预设光谱的光；及at least one reference point that produces a predetermined spectrum of light; and互动装置，所述互动装置包括：An interactive device, the interactive device comprising:第二无线模块，所述第二无线模块用以与所述第一无线模块间进行数据传输；a second wireless module, the second wireless module is used for data transmission with the first wireless module;图像模块，所述图像模块以取样频率获取并输出所述参考点图像以形成第一图像及第二图像；an image module, the image module acquires and outputs the reference point image at a sampling frequency to form a first image and a second image;调制模块，所述调制模块用以调制所述图像模块的取样频率；及a modulation module, the modulation module is used to modulate the sampling frequency of the image module; and处理单元，所述处理单元计算所述参考点图像在所述第一图像及所述第二图像间的移动向量，控制所述第二无线模块将所述移动向量传输至所述第一无线模块，并根据预设条件控制所述调制模块实时地调制所述图像模块的取样频率。a processing unit, the processing unit calculates a motion vector of the reference point image between the first image and the second image, and controls the second wireless module to transmit the motion vector to the first wireless module , and control the modulation module to modulate the sampling frequency of the image module in real time according to preset conditions.

Images