Embodiment
Please refer to Fig. 1, Fig. 1 is the schematic diagram of the embodiment of the present invention one electronic installation 10.As shown in Figure 1, electronic installation 10 comprises one first sensing module 100,1 second sensing module 102, environment sensing module 104 and a processor module 106.Wherein, processor module 106 is coupled in the first sensing module 100, second sensing module 102 and environment sensing module 104, to control the first sensing module 100, second sensing module 102 and environment sensing module 104 performs sensing, or receive the signal transmitted after the first sensing module 100, second sensing module 102 and environment sensing module 104 sense and process.
Electronic installation 10 is electronic installations as common in flat computer, intelligent TV or intelligent mobile phone etc., electronic installation 10 can sense user by wave or the gesture motion such as flexible finger and in addition after Analysis and judgments to perform the running corresponding to gesture, therefore electronic installation 10 can not need user to control via touching.Wherein, gesture motion can as the mobile gesture of user's moveable finger, user hold and decontrol the convergent-divergent gestures of five fingers, user towards the pressing gesture of the direction moveable finger of electronic installation 10 or user away from electronic installation 10 direction moveable finger retract gesture etc.For example, when electronic installation 10 is intelligent electric apparent time, user by mobile gesture control electronic installation 10 perform turntable, controlled by convergent-divergent gesture electronic installation 10 adjust volume, by pressing gesture control electronic installation 10 start shooting or by retract gesture control electronic installation 10 shut down etc.
In addition, user is also by other more complicated gesture motion, as point, by or the various sequencing such as towing the gesture motion that combines coordinate the content of the display module of electronic installation 10 as shown in screen to carry out interaction, to perform the more complicated running of the data etc. of surfing the web, and can change according to this and be not limited thereto.Thus, user does not need to touch the assemblies such as the screen of electronic installation 10 or control knob and just performs function for running by gesture to control electronic installation 10.
Specifically, first sensing module 100 can be an infrared sensing module, when user utilizes finger to perform gesture motion before electronic installation 10, first sensing module 100 has infrared light-emitting diode can launch infrared ray to the finger performing gesture, meanwhile, the first sensing module 100 separately there is infrared ray sensor can the infrared ray that reflects of sensing finger.Whereby, the infrared ray sensed can be converted to signal and be sent to processor module 106 by the first sensing module 100, and processor module 106 is at analytic signal and after judging gesture content, controls electronic installation 10 and performs the running corresponding to gesture.In addition, first sensing module 100 can have an infrared ray colored filter and be filtered in advance by the light of outside, pass through to allow the light had near infrared frequency and be sent to infrared ray sensor, and the infrared ray that infrared ray sensor can be made correctly to sense finger reflect.
Second sensing module 102 can be a photography sensing module, and when user utilizes finger to perform gesture motion before electronic installation 10, the second sensing module 102 has the image that camera fechtable is relevant to gesture performed by user.Whereby, captured image data can be sent to processor module 106 by the second sensing module 102, and processor module 106 is at identification image data and after judging gesture content, controls electronic installation 10 and performs the running corresponding to gesture.In addition, the second sensing module 102 can have an otherwise visible light color optical filter and be filtered in advance by the light of outside, passes through and make camera can clearly capture the image data being relevant to visible ray to allow the light had near visible frequency.
Environment sensing module 104 comprises ambient light sensor, is used for detecting the brightness of electronic installation 10 surrounding environment light, and produces environment bright angle value to be sent to processor module 106.In addition, because the vision of people is that the green light of 555.016nm is the most responsive to wavelength, therefore environment sensing module 104 can have a green glow colored filter and filtered in advance by the light of electronic installation 10 surrounding environment, to allow the light of frequency near green light pass through and to be sent to ambient light sensor, and it is more accurate that ambient light sensor can be made to detect the environment bright angle value produced.But be not limited thereto, environment sensing module 104 also can device ruddiness colored filter or blue light colored filter etc. first filter after detecting light brightness again.
Processor module 106 comprises processor 108 and a storage device 110.Processor 108 can be a microprocessor (microprocessor) or an Application Specific Integrated Circuit (application-specificintegrated circuit, ASIC).Storage device 110 can be arbitrary data memory device, for example, storage device 110 can be read-only internal memory (read-only memory, ROM), random access memory (random-access memory, RAM), compact disc read-only memory (CD-ROMs), tape (magnetic tapes), floppy disk (floppy disks), optical data storage device (optical data storagedevices) etc., and to be not limited thereto.In addition, store a program code 112 in storage device 110 to be used to refer to processor 108 and to control the first sensing module 100, second sensing module 102 and environment sensing module 104 senses, or receive the signal that the first sensing module 100, second sensing module 102 and environment sensing module 104 transmit and carry out the flow processs such as judgement gesture.
In the case, because electronic installation 10 comprises the first sensing module 100 and the second sensing module 102, therefore the processor module 106 of electronic installation 10 can control the detection procedure that the first sensing module 100 and the second sensing module 102 perform corresponding two different qualities respectively, and processor module 106 can be selected wherein more suitable detection procedure to sense and judge gesture.Specifically, please refer to Fig. 2, Fig. 2 is the process flow diagram that the embodiment of the present invention one gesture judges flow process 20, in the present embodiment, gesture judges that flow process 20 performs also can be compiled as program code 112 and be stored in storage device 110 in the processor module 106 of Fig. 1, performs gesture judge flow process 20 in order to control processor 108.As shown in Figure 2, gesture judges that flow process 20 comprises the following step:
Step 200: start;
Step 202: executive utility;
Step 204: judge application program support operate gesture content, obtain support gesture content;
Step 206: by environment sensing module 104, detects and judges the brightness of electronic installation 10 surrounding environment light, to produce brightness judged result;
Step 208: according to support gesture content and brightness judged result, determines that execution first detection procedure or the second detection procedure sense and judge the gesture of operating application program;
Step 210: terminate.
Judge in flow process 20 in gesture, first detection procedure and the second detection procedure control the first sensing module 100 and the second sensing module 102 to after sensing gesture via processor module 106, then receive the first sensing module 100 and the second sensing module 102 and sense the signal of rear conversion or image data to carry out Analysis and judgments gesture.
Specifically, in step 202 ~ 204, after user starts application program in electronic installation 10, processor module 106 just starts executive utility, and processor module 106 judge further perform application program institute support running gesture content, to obtain support gesture content.Wherein, support gesture content as mobile gesture, convergent-divergent gesture, press gesture or retract gesture etc., when user's execution is relevant to and supports that the gesture of gesture content carrys out operating application program, application program correctly could receive and perform corresponding running.For example, when electronic installation 10 is intelligent mobile phone, after user starts address book program, user by address book program support that the mobile gesture operated moves up and down and to browse in address book program described communication data.Moreover user, also by the pressing gesture that address book program is supported, start the call running that communication data is browsed by present institute, and execution is called to browsed correspondent.Whereby, due to address book program support operate gesture content be program designer's defined good gesture content in advance, therefore processor module 106 is after address book program performs, and can judge the gesture content that address book program is supported, and obtains and save as support gesture content.
It is noted that processor module 106 also by the type of the further feature of application program as application program or the designed use of application program, can judge and obtain the information supporting gesture content.For example, when the application program performed by user be audio-visual playing program or take pictures program time, processor module 106 can according to the type of application program, judge that application program is only need perform to dial to put or the application program of the simple control action such as shooting, and obtain and support that the information of gesture content is for can perform simple gesture action.And when the application program performed by user be notebook program or Web browsing application time, processor module 106 judge application program be need perform as point, by or the application program of the complex control action such as towing, and obtain and support that the information of gesture content is for can perform complicated gesture motion.Moreover, when the application program performed by user be design to user when short distance is to perform the application program of gesture operation, processor module 106 can according to the designed use of application program, judge that application program is the application program of user at short distance gesture operation, and the information obtaining support gesture content is short-range gesture operation.Such as, user performs bulletin program and need when intelligent TV comes to carry out gesture operation with report bulletin content, processor module 106 just can according to the designed use of bulletin program, and the information obtaining the support gesture content of bulletin program is short-range gesture operation.And when the application program performed by user be design to user when long distance is to perform the application program of gesture operation, processor module 106 similarly can obtain supports that the information of gesture content is the gesture operation of long distance.Wherein, be relevant to and support that the visualization of information actual demand needed for gesture content changes according to this, not limited.
In step 206, processor module 106 starts and after notifying that environment sensing module 104 detects the brightness of electronic installation 10 surrounding environment light, the processor module 106 environment bright angle value that reception environment sensing module 104 produces after detecting again judges.Processor module 106 can judge whether received environment bright angle value is less than a brightness settings set in advance, to produce brightness judged result.When processor module 106 judges that environment bright angle value is less than brightness settings, producing brightness judgment result displays electronic installation 10 surrounding environment light is low-light level.When processor module 106 judges that environment bright angle value is non-and is less than brightness settings, producing brightness judgment result displays electronic installation 10 surrounding environment light is high brightness.
In addition, in order to make brightness judged result can be more stable and can not change arbitrarily, processor module 106 is at a very first time point, detected the brightness of electronic installation 10 surrounding environment light by environment sensing module 104 after, the environment bright angle value that reception environment sensing module 104 produces after detecting also is produced as one first brightness value.And at one second time point, detected the brightness of electronic installation 10 surrounding environment light by environment sensing module 104 after, the environment bright angle value that reception environment sensing module 104 produces after detecting also is produced as one second brightness value.Wherein, the time interval size between very first time point and the second time point, visual demand is adjusted and not limited.
Then, after processor module 106 obtains the first brightness value and the second brightness value, processor module 106 calculates the absolute difference between the first brightness value and the second brightness value and obtains a brightness absolute difference, changes size with the brightness representing electronic installation 10 surrounding environment light between very first time point and the second time point.Further, can not change arbitrarily at any time in order to ensure brightness judged result, when brightness absolute difference is greater than in advance set brightness range values, just can control environment brightness that sensing module 104 detects electronic installation 10 surrounding environment light of processor module 106 is detected with reception environment sensing module 104 the environment bright angle value produced afterwards and is carried out judging to produce brightness judged result.Whereby, when processor module 106 judges that environment bright angle value is less than brightness settings, producing brightness judgment result displays electronic installation 10 surrounding environment light is low-light level.When processor module 106 judges that environment bright angle value is non-and is less than brightness settings, producing brightness judgment result displays electronic installation 10 surrounding environment light is high brightness.It is noted that the size of brightness range values, visual environment demand or the rear environment bright angle value produced of detecting are adjusted and are changed, and are not limited in a fixed size value.
In a step 208, processor module 106 to the first sensing module 100 inquire about and judge the first sensing module 100 support the gesture content that can sense, to obtain sensing gesture content.For example, because the first sensing module 100 is infrared sensing module, therefore when the first sensing module 100 have the resolution of infrared ray sensor less and the infrared ray of larger reflective surface area can only be sensed time, processor module 106 can perform to the first sensing module 100 and to inquire about and after obtaining the resolution information being relevant to infrared ray sensor, judge the gesture content that the first sensing module 100 can sense again, to obtain sensing gesture content.Such as when the resolution of infrared ray sensor is not high, processor module 106 judges that sensing gesture content is that simple gesture motion is as mobile gesture or convergent-divergent gesture etc., but or when the resolution of infrared ray sensor is not high, processor module 106 judges that sensing gesture content is as sensing short-range gesture operation.
Processor module 106 can judge after obtaining sensing gesture content to sense the support gesture content stored before whether gesture content comprises, to produce sensing judged result, be used for showing whether can perform the first detection procedure and control the first sensing module 100 sensing and judging gesture.Should be noted, the resolution that can sense due to the first sensing module 100 middle infrared (Mid-IR) sensor is low compared with the resolution of camera institute pick-up image in the second sensing module 102, namely the gesture motion that the first sensing module 100 can sense can be more limited, therefore processor module 106 first judges whether the sensing gesture content of the first sensing module 100 comprises the support gesture content of application program, senses to determine whether to perform the first detection procedure and to control the first sensing module 100 and judges gesture.When sensing gesture content and comprising support gesture content, produce sensing judgment result displays and can perform the first detection procedure to sense, and sense by controlling the first sensing module 100 and perform correlated judgment gesture.When sensing gesture content and not comprising support gesture content, produce sensing judgment result displays and can not perform the first detection procedure to sense.
Thus, when brightness judgment result displays surrounding environment light is high brightness, because the second sensing module 102 carrys out pick-up image by camera and judges gesture, therefore being comparatively applicable to the action being captured gesture by the second sensing module 102, processor module 106 performs the second detection procedure and controls the second sensing module 102 and senses and judge gesture.When brightness judgment result displays surrounding environment light is low-light level, because the first sensing module 100 senses gesture by launching infrared ray, therefore be comparatively applicable to the action being sensed gesture by the first sensing module 100.Now, processor module 106 needs to judge whether sensing judged result shows further in addition and can perform the first detection procedure to sense, and just can perform the first detection procedure and control the first sensing module 100 sense and judge gesture.When brightness judgment result displays surrounding environment light is low-light level and sensing judgment result displays can not perform the first detection procedure to sense, processor module 106 does not perform the judgement of gesture, and by display device as screen shows information to notify to perform the user of gesture.
About processor module in step 208 106 according to support gesture content and brightness judged result, determine that the running of execution first detection procedure or the second detection procedure also can be summarized as a detection procedure further and judge flow process 30.In the present embodiment, detection procedure judges that flow process 30 performs also can be compiled as program code 112 equally and be stored in storage device 110 in the processor module 106 of Fig. 1, performs detection procedure judge flow process 30 in order to control processor 108.As shown in Figure 3, Fig. 3 is the process flow diagram that embodiment of the present invention detection procedure judges flow process 30, and detection procedure judges that flow process 30 comprises following steps:
Step 300: start;
Step 302: judge the gesture content that the first detection procedure can sense, obtains sensing gesture content;
Step 304: when sensing gesture content and comprising support gesture content, produce sensing judgment result displays can perform the first detection procedure to sense, and when sensing gesture content and not comprising support gesture content, produce sensing judgment result displays and can not perform the first detection procedure to sense;
Step 306: when brightness judgment result displays surrounding environment light is high brightness, performs the second detection procedure to sense and judge gesture; Or when brightness judgment result displays surrounding environment light is low-light level and sensing judgment result displays can perform the first detection procedure to sense, performs the first detection procedure to sense and judge gesture; Or when brightness judgment result displays surrounding environment light is low-light level and sensing judgment result displays can not perform the first detection procedure to sense, do not perform the judgement of gesture;
Step 308: terminate.
In simple terms, electronic installation 10 has the first sensing module 100 and senses the infrared ray being relevant to gesture performed by user by infrared ray sensor, and carry out the first detection procedure and judge gesture, and electronic installation 10 has the second sensing module 102 is in addition relevant to the image of gesture performed by user by camera acquisition, and carry out the second detection procedure and judge gesture.Whereby, electronic installation 10 detects the brightness of surrounding environment light and the support gesture content judging performed application program, and in the first sensing module 100 and the second sensing module 102 neither with in the sensing module of sensed characteristic, select more suitable detection procedure to sense gesture.In this case, when user performs gesture operation electronic installation 10 under the environment that light is brighter, electronic installation 10 performs the second detection procedure by processor module 106 and controls the second sensing module 102 to capture gesture image to judge gesture, make the second sensing module 102 can correctly pick-up image under the environment that light is brighter, to carry out gesture judgement and operating application program.In addition, when performing gesture under the environment of user in dark, electronic installation 10 performs the first detection procedure by processor module 106 and controls the first sensing module 100 to sense infrared ray to judge gesture, make the first sensing module 100 correctly can sense the infrared ray being relevant to gesture and reflecting under the environment of dark, to carry out gesture judgement and operating application program.
Further, more complicated trickle gesture motion cannot be sensed because the first sensing module 100 is limited in the resolution of infrared ray sensor, so electronic installation 10 need judge whether the first sensing module 100 can sense the support gesture content of application program again, just determine whether to perform the first detection procedure and control the first sensing module 100 to sense, to avoid sensing result mistake.Thus, electronic installation 10 can suitably sense in conjunction with the detection procedure of two different qualities and judge gesture, makes the judged result of gesture more accurate.
On the other hand, when user's a period of time does not use electronic installation 10, processor module 106 can control electronic installation 10 and operate in sleep pattern, to save power supply.The interlock circuit being only used for waking up electronic installation 10 in sleep pattern can perform running, and other circuit then can be closed the object reaching power saving.In addition, because user need wake electronic installation 10 up to continue operating electronic devices 10 by gesture again, therefore in sleep pattern, processor module 106 can continue execution first detection procedure and control the first sensing module 100 sense and judge gesture, wherein, processor module 106 performs the first detection procedure to sense is that the power consumption that the power consumption utilizing infrared ray sensor to sense due to the first sensing module 100 utilizes camera to sense compared to the second sensing module 102 is less.
When processor module 106 perform the first detection procedure to sense and judge user have perform gesture time, processor module 106 can produce gesture judged result and the enabled instruction pre-set with user is compared, to judge whether gesture judged result meets enabled instruction, when gesture judged result meets enabled instruction, processor module 106 just can wake electronic installation 10 up makes electronic installation 10 switch to normal mode by sleep pattern.For example, the pre-set enabled instruction of user is after convergent-divergent gesture, and when user's a period of time does not use electronic installation 10, processor module 106 can control electronic installation 10 and operate in sleep pattern, to save power supply.In this case, user can perform the action of convergent-divergent gesture before electronic installation, processor module 106 can sense via the first sensing module 100 and carry out judging rear generation gesture judged result, and comparison gesture judged result is when meeting convergent-divergent gesture, processor module 106 just controls electronic installation 10 and switches to normal mode by sleep pattern, can continue the operation performing electronic installation 10 to allow user.
Running about processor module 106 switching sleep mode also can be summarized as one further and wake flow process 40 up.In the present embodiment, waking flow process 40 up is perform also can be compiled as program code 112 equally and be stored in storage device 110 in the processor module 106 of Fig. 1, performs wake flow process 40 up in order to control processor 108.As shown in Figure 4, wake flow process 40 up and comprise following steps:
Step 400: start;
Step 402: perform the first detection procedure to sense and judge gesture, to produce gesture judged result;
Step 404: when gesture judged result meets enabled instruction, controls electronic installation and switches to normal mode by sleep pattern;
Step 406: terminate.
In simple terms, after user can set the enabled instruction of certain gestures action in advance in electronic installation 10, then wake electronic installation 10 up by gesture and continue to use electronic installation 10, such as the continuation intelligent TV of viewing or continuation use intelligent mobile phone etc.And electronic installation 10 is in the sensing module of two different sensed characteristic, to select compared with power saving and the detection procedure comparatively easily performed senses gesture in sleep pattern, user can be allowed to wake electronic installation 10 rapidly up and can allow again electronic installation 10 in sleep pattern, expend less power supply continue to perform the running that detecting wakes gesture up.
Specifically, the present invention is in conjunction with the sensing module of different sensed characteristic and according to the brightness of the external operating environment of electronic installation 10 and the demand of performed application program in electronic installation 10, suitable sensing module is selected to perform corresponding detection procedure, with sensing and the gesture judging user, make the judgement of gesture energy more accurate, those skilled in the art is when carrying out according to this modifying or changing.For example, in the present embodiment, first sensing module 100 is infrared sensing module, and the second sensing module 102 is photography sensing module, and selects one of them sensing module to sense judgement gesture according to the brightness of operating environment and the demand of performed application program.But in other embodiments, first sensing module 100 also can be as ultrasonic sensing module, and the second sensing module 102 is similarly photography sensing module, and one of them sensing module is selected to sense judgement gesture according to the brightness of operating environment, temperature, humidity or amount of sound size etc.All sensing modules in conjunction with two or more different sensed characteristic also select more suitable sensing module to perform sensing and the judgement of gesture, and it is all applicable to the present invention.
Moreover, in the present embodiment, processor module 106 can judge after obtaining sensing gesture content to sense the support gesture content stored before whether gesture content comprises, to produce sensing judged result, be used for showing whether can perform the first detection procedure and control the first sensing module 100 sensing and judging gesture.But in other embodiments, processor module 106 also can obtain sensing gesture content be can sense perhaps can sense complicated gesture content in simple gesture information after, judge whether the information sensing gesture content meets the information supporting gesture content, to produce sensing judged result, be used for showing whether can perform the first detection procedure and control the first sensing module 100 sensing and judging gesture.Or, it is to sense after short-range gesture operation maybe can sense the information of gesture operation of long distance that processor module 106 also can obtain sensing gesture content, judge whether the information sensing gesture content meets the information supporting gesture content, to produce sensing judged result, be used for showing whether can perform the first detection procedure and control the first sensing module 100 sensing and judging gesture.About supporting the information that gesture content comprises with corresponding sensing gesture content, visual actual demand changes according to this, not limited.
In addition, in the present embodiment, use the sensing module of two kinds of different sensed characteristic, to illustrate that electronic installation 10 can according to the external environment for use of electronic installation 10, suitable sensing module is selected to perform corresponding detection procedure, to sense and to judge the gesture of user.But, in other embodiments, electronic installation 10 also can arrange the sensing module of three kinds, four kinds or multiple different sensed characteristic, and the environment for use that foundation electronic installation 10 is external, wherein a kind of suitable sensing module is selected to perform corresponding detection procedure, with sensing and the gesture judging user, not limited.
In sum, prior art is only sensed by single detection technology and judges gesture, along with the difference of operating environment, often affects the correctness of sensing result.In comparison, the present invention in conjunction with the detection procedure of different qualities, and according to the brightness of operating environment and the demand of operating application program, selects better suited detection procedure to sense and judges gesture, makes the judged result of gesture more accurate.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.