CN110850971A - Handshake interaction method and system between hand model and intelligent mirror and storage medium - Google Patents
Handshake interaction method and system between hand model and intelligent mirror and storage mediumDownload PDFInfo
- Publication number
- CN110850971A CN110850971ACN201911023951.XACN201911023951ACN110850971ACN 110850971 ACN110850971 ACN 110850971ACN 201911023951 ACN201911023951 ACN 201911023951ACN 110850971 ACN110850971 ACN 110850971A
- Authority
- CN
- China
- Prior art keywords
- handshake
- action
- hand
- intelligent mirror
- hand model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Technical Field
The invention relates to the technical field of intelligent life, in particular to a handshake interaction method and system between a hand model and an intelligent mirror and a storage medium.
Background
The idol can bring people with belief, feeling or insistence as a person leading trend in an era or a person which is immortal in historical long rivers. Encouraging close contact with (e.g., shaking or hugging) and obtaining a ghost would provide a tremendous incentive for encouraging, enhancing the confidence and happiness of the person. However, it is difficult to see their own idol or fan due to various reasons (e.g., the idol has been a historical figure, or is too far away from the idol, etc.), and even if occasionally seen, they are not necessarily in close proximity.
With the continuous development and progress of internet technology, people can watch the audio and video related to the idol of themselves through various terminal devices such as televisions or mobile phones, but cannot realize the feeling of direct contact with the idol and cannot obtain the encouragement of the idol to themselves.
Disclosure of Invention
The embodiment of the invention provides a handshake interaction method and system between a hand model and an intelligent mirror and a storage medium.
The first aspect of the embodiments of the present invention provides a handshake interaction method between a hand model and an intelligent mirror, which may include:
detecting whether a shielding action aiming at the hand model at the fixed position exists or not based on the data acquisition device;
judging whether the shielding action is a handshake action based on preset handshake action data;
and when the shielding action is determined to be the handshake action, outputting the video and audio data of the target object corresponding to the hand model.
A second aspect of the embodiments of the present invention provides a handshake interaction system between a hand model and an intelligent mirror, which may include: intelligent mirrors and hand models;
the intelligent mirror is used for detecting whether shielding action aiming at the hand model at the fixed position exists or not based on the data acquisition device;
the intelligent mirror is also used for judging whether the shielding action is a handshake action based on the preset handshake action data;
the hand model is used for identifying user identity information corresponding to a hand of a person who executes a handshaking action based on the identity identification device when the intelligent mirror determines that the shielding action is the handshaking action, and transmitting the user identity information to the intelligent mirror;
and the intelligent mirror is also used for searching a target object matched with the user identity information and outputting the video and audio data of the target object corresponding to the hand model.
A third aspect of embodiments of the present invention provides an intelligent mirror, which includes a processor and a memory, where the memory stores at least one instruction, at least one program, a code set, or a set of instructions, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by the processor to implement the method for handshake interaction between a hand model and an intelligent mirror described in the above aspect.
A fourth aspect of the embodiments of the present invention provides a computer storage medium, where at least one instruction, at least one program, a code set, or a set of instructions is stored in the computer storage medium, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by a processor to implement the method for handshake interaction between a hand model and an intelligent mirror described in the above aspect.
In the embodiment of the invention, the data acquisition sensor in the intelligent mirror is used for detecting the blocking action, namely the possible handshake action, and then whether the action is the handshake action is further determined, so that the detection accuracy is improved, and when the handshake action is confirmed, the audio-video data of the target object corresponding to the hand model is output. Through regard intelligent mirror and hand model as the idol entity, hear the words that the idol danced to oneself when user shakes hands with the idol, realized a kind of brand-new intelligent experience with the idol is interactive.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic structural diagram of a handshake interaction system between a hand model and an intelligent mirror according to an embodiment of the present invention;
FIG. 2 is a schematic flowchart of a handshake interaction method between a hand model and an intelligent mirror according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an intelligent mirror according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "including" and "having," and any variations thereof, in the description and claims of this invention and the above-described drawings are intended to cover a non-exclusive inclusion, and the terms "first" and "second" are used for distinguishing designations only and do not denote any order or magnitude of a number. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
It should be noted that the handshake interaction method between the hand model and the intelligent mirror provided by the present application may be applied to household life, for example, in an application scenario where the intelligent mirror is installed in a hallway and a hand model is placed in front of the mirror.
As shown in fig. 1, the handshake interaction system between the hand model and the intelligent mirror may include at least anintelligent mirror 1 and ahand model 2.
It should be noted that there may be non-handshake actions (e.g. a child curiously wants to touch a hand model) that affect the determination of the handshake actions by theintelligent mirror 1. Therefore, in the implementation process of the above handshake system, theintelligent mirror 1 may first detect whether there is a shielding action for thehand mold 2 at the fixed position based on the data acquisition device, and the shielding action may be understood as an action that affects judgment of the handshake action and has direct or indirect contact with thehand mold 2, for example, a book is placed in front of thehand mold 2 to block thehand mold 2, or a hand is touching a finger, a back of the hand, or the like of the hand mold. It is understood that the data acquisition device may be at least one of an infrared sensor, a temperature sensor, a camera, and a distance detection device.
Further, after the shielding action is detected, theintelligent mirror 1 may determine whether the shielding action is a handshake action based on preset handshake action data. The preset handshake data may be information of a state of a human hand relative to theintelligent mirror 1, such as a bending state of a finger (including a distance between the finger and the mirror at a bending angle or a secondary angle), when the human hand and thehand model 2 perform a handshake. Optionally, theintelligent mirror 1 may detect whether an execution object executing the blocking action is a human hand based on the preset handshake action data, and on the premise that the execution object is the human hand, detect whether the current state information of the human hand meets the preset handshake action data, if so, determine that the blocking action is the handshake action, otherwise, not.
In an optional embodiment, the motion detection time may also be preset in theintelligent mirror 1, and only within the detection time, theintelligent mirror 1 will trigger the judgment for the blocking motion. For example, when a user goes to work every morning, the user wants to shake hands with his idol, and wants to hear his dancing oneself, and bring a good mood of one day to him, theintelligent mirror 1 may be preset to start the motion detection mode in a time period of 7 to 8 am every day, and the user determines the shaking motion.
It can be understood that all people in a family may want to handshake with their idol before going out every day and hear the idol saying to themselves, and at this moment, there are a plurality of idols that are stored in the intelligent mirror, and then theintelligent mirror 1 needs to know who is shaking hands at present, so as to accurately output the corresponding video data. Optionally, when theintelligent mirror 1 determines that the shielding action is a handshaking action, thehand model 2 may identify, based on the identity recognition device, user identity information corresponding to a hand of a person performing the handshaking action, and transmit the user identity information to theintelligent mirror 1. The identity recognition device can be a fingerprint detection device arranged on the hand model, and the identity information of the handshake person can be uniquely determined by detecting the fingerprint. It is understood that data transmission between thehand model 2 and theintelligent mirror 1 can be performed through bluetooth or other wireless communication modes. Further, theintelligent mirror 1 can search for a target object matched with the user identity information determined by thehand model 2, namely, search for a target idol of the user, and then output a famous sentence of the idol or other encouraging words uttered by the user through the mouth kissing.
Optionally, the face image data of the object to be executed by the handshake action may be directly captured by a camera of the intelligent mirror, and the user identity information corresponding to the face image data is identified behind the person.
In an optional embodiment, when outputting the video and audio data of the target object, theintelligent mirror 1 can also synthesize a picture or a video of the handshake of the user and the target object to be displayed in the mirror, so that the sense of reality of the interaction with the idol is increased.
In an optional embodiment, theintelligent mirror 1 can also output the holographic projection of the target object to thehand model 2, so that the perfect fusion of thehand model 2 and the holographic projection is realized, and a more real scene of shaking hands with the idol is achieved.
In the embodiment of the invention, the data acquisition sensor in the intelligent mirror is used for detecting the blocking action, namely the possible handshake action, and then whether the action is the handshake action is further determined, so that the detection accuracy is improved, and when the handshake action is confirmed, the audio-video data of the target object corresponding to the hand model is output. Through regard intelligent mirror and hand model as the idol entity, hear the words that the idol danced to oneself when user shakes hands with the idol, realized a kind of brand-new intelligent experience with the idol is interactive.
Fig. 2 is a schematic flow chart of a handshake interaction method between a hand model and an intelligent mirror according to an embodiment of the present invention, which at least includes the following steps:
s101, whether shielding action aiming at the hand model at the fixed position exists is detected based on the data acquisition device.
It is understood that the data acquisition device may include at least one of an infrared sensor, a temperature sensor, a camera, and a distance detection device.
And S102, judging whether the shielding action is a handshake action based on the preset handshake action data.
It can be understood that the preset handshake data may be hand state information of the hand relative to the intelligent mirror when the hand and the hand model perform handshake.
In an optional embodiment, the mirror may detect, based on the motion data, that all execution objects performing the blocking motion are human hands, and further, when it is detected that the execution objects are human hands and the state information of the human hands of the execution objects meets preset handshake motion data, it may be determined that the blocking motion is a handshake motion.
And S103, outputting the video and audio data of the target object corresponding to the hand model when the shielding action is determined to be the handshake action.
In an optional embodiment, when outputting the video and audio data of the target object, theintelligent mirror 1 can also synthesize a picture or a video of the handshake of the user and the target object to be displayed in the mirror, so that the sense of reality of the interaction with the idol is increased.
In an optional embodiment, theintelligent mirror 1 can also output the holographic projection of the target object to thehand model 2, so that the perfect fusion of thehand model 2 and the holographic projection is realized, and a more real scene of shaking hands with the idol is achieved.
It should be noted that, in this embodiment, reference may be made to the detailed description in the above system embodiment for the interaction process of the intelligent mirror and the hand model in the interaction system, and details are not described here again.
In the embodiment of the invention, the data acquisition sensor in the intelligent mirror is used for detecting the blocking action, namely the possible handshake action, and then whether the action is the handshake action is further determined, so that the detection accuracy is improved, and when the handshake action is confirmed, the audio-video data of the target object corresponding to the hand model is output. Through regard intelligent mirror and hand model as the idol entity, hear the words that the idol danced to oneself when user shakes hands with the idol, realized a kind of brand-new intelligent experience with the idol is interactive.
An embodiment of the present invention further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, where the instructions are suitable for being loaded by a processor and executing the method steps in the embodiment shown in fig. 2, and a specific execution process may refer to a specific description of the embodiment shown in fig. 2, which is not described herein again.
The embodiment of the application also provides an intelligent mirror. As shown in fig. 3, theintelligent mirror 20 may include: the at least oneprocessor 201, e.g., CPU, the at least onenetwork interface 204, theuser interface 203, the memory 205, the at least one communication bus 202, and optionally, adisplay 206. Wherein a communication bus 202 is used to enable the connection communication between these components. Theuser interface 203 may be a touch screen, among others. Thenetwork interface 204 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), and a communication connection may be established with the hand model via thenetwork interface 204. The memory 205 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory, and the memory 205 includes a flash in the embodiment of the present invention. The memory 205 may optionally be at least one memory system located remotely from theprocessor 201. As shown in fig. 3, memory 205, which is a type of computer storage medium, may include an operating system, a network communication module, a user interface module, and program instructions.
It should be noted that thenetwork interface 204 may be connected to a receiver, a transmitter or other communication module, and the other communication module may include, but is not limited to, a WiFi module, a bluetooth module, etc., and it is understood that the intelligent mirror in the embodiment of the present invention may also include a receiver, a transmitter, other communication module, etc.
Theprocessor 201 may be used to invoke program instructions stored in the memory 205 and cause theintelligent mirror 20 to perform the following operations:
detecting whether a shielding action aiming at the hand model at the fixed position exists or not based on the data acquisition device;
judging whether the shielding action is a handshake action based on preset handshake action data;
and when the shielding action is determined to be the handshake action, outputting the video and audio data of the target object corresponding to the hand model.
In some embodiments, the data acquisition device is at least one of an infrared sensor, a temperature sensor, a camera, and a distance detection device.
In some embodiments, the preset handshake data is hand state information of the hand relative to the intelligent mirror when the hand and the hand model perform handshake.
In some embodiments, themirror 20, when determining whether the blocking action is a handshake action based on the preset handshake action data, is specifically configured to:
detecting whether an execution object for executing the shielding action is a human hand or not based on preset handshake action data;
and when the execution object is detected to be a hand and the hand state information of the execution object meets the preset handshake action data, determining that the shielding action is the handshake action.
In some embodiments, themirror 20 is also used to obtain user identification information corresponding to the identified human hand when the hand model performs the handshaking operation.
In some embodiments, themirror 20 is also used to search for target objects that match the user identity information.
In the embodiment of the invention, the data acquisition sensor in the intelligent mirror is used for detecting the blocking action, namely the possible handshake action, and then whether the action is the handshake action is further determined, so that the detection accuracy is improved, and when the handshake action is confirmed, the audio-video data of the target object corresponding to the hand model is output. Through regard intelligent mirror and hand model as the idol entity, hear the words that the idol danced to oneself when user shakes hands with the idol, realized a kind of brand-new intelligent experience with the idol is interactive.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.
Claims (10)
1. A handshake interaction method between a hand model and an intelligent mirror is characterized by comprising the following steps:
detecting whether a shielding action aiming at the hand model at the fixed position exists or not based on the data acquisition device;
judging whether the shielding action is a handshake action based on preset handshake action data;
and when the shielding action is determined to be a handshake action, outputting the video data of the target object corresponding to the hand model.
2. The method of claim 1, wherein the data acquisition device is at least one of an infrared sensor, a temperature sensor, a camera, a distance detection device.
3. The method according to claim 1, wherein the preset handshake data is hand state information of a hand relative to the intelligent mirror when the hand performs handshake with the hand model.
4. The method according to claim 1, wherein the determining whether the occlusion action is a handshake action based on preset handshake action data comprises:
detecting whether an execution object for executing the shielding action is a human hand or not based on the preset handshake action data;
and when the execution object is detected to be a hand and the hand state information of the execution object meets the preset handshake action data, determining that the shielding action is a handshake action.
5. The method of claim 4, further comprising:
and acquiring user identity information corresponding to the hand identified by the hand model during the handshake action.
6. The method of claim 5, further comprising:
and searching a target object matched with the user identity information.
7. A handshake interaction system between a hand model and an intelligent mirror, comprising: intelligent mirrors and hand models;
the intelligent mirror is used for detecting whether shielding action aiming at the hand model at the fixed position exists or not based on the data acquisition device;
the intelligent mirror is also used for judging whether the shielding action is a handshake action based on preset handshake action data;
the hand model is used for identifying user identity information corresponding to a hand of a person who executes the handshake action based on an identity identification device when the intelligent mirror determines that the shielding action is used as the handshake action, and transmitting the user identity information to the intelligent mirror;
the intelligent mirror is also used for searching a target object matched with the user identity information and outputting the video data of the target object corresponding to the hand model.
8. The system of claim 7, wherein the smart mirror is further configured to:
detecting whether an execution object for executing the shielding action is a human hand or not based on the preset handshake action data;
and when the execution object is detected to be a hand and the hand state information of the execution object meets the preset handshake action data, determining that the shielding action is a handshake action.
9. An intelligent mirror, comprising a processor and a memory, said memory having stored therein at least one instruction, at least one program, set of codes, or set of instructions, said at least one instruction, said at least one program, said set of codes, or set of instructions being loaded and executed by said processor to implement the method of handshake interaction between a hand model and an intelligent mirror according to any of claims 1 to 6.
10. A computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by a processor to implement the method of handshake interaction between a hand model and a smart mirror according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911023951.XACN110850971A (en) | 2019-10-25 | 2019-10-25 | Handshake interaction method and system between hand model and intelligent mirror and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911023951.XACN110850971A (en) | 2019-10-25 | 2019-10-25 | Handshake interaction method and system between hand model and intelligent mirror and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110850971Atrue CN110850971A (en) | 2020-02-28 |
Family
ID=69598069
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911023951.XAPendingCN110850971A (en) | 2019-10-25 | 2019-10-25 | Handshake interaction method and system between hand model and intelligent mirror and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110850971A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107081774A (en)* | 2017-05-27 | 2017-08-22 | 上海木爷机器人技术有限公司 | Robot shakes hands control method and system |
| CN108052250A (en)* | 2017-12-12 | 2018-05-18 | 北京光年无限科技有限公司 | Virtual idol deductive data processing method and system based on multi-modal interaction |
| CN108388399A (en)* | 2018-01-12 | 2018-08-10 | 北京光年无限科技有限公司 | The method of state management and system of virtual idol |
| CN108748071A (en)* | 2018-04-25 | 2018-11-06 | 苏州米机器人有限公司 | A kind of intelligent hotel service robot |
| CN109508687A (en)* | 2018-11-26 | 2019-03-22 | 北京猎户星空科技有限公司 | Man-machine interaction control method, device, storage medium and smart machine |
- 2019
- 2019-10-25CNCN201911023951.XApatent/CN110850971A/enactivePending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107081774A (en)* | 2017-05-27 | 2017-08-22 | 上海木爷机器人技术有限公司 | Robot shakes hands control method and system |
| CN108052250A (en)* | 2017-12-12 | 2018-05-18 | 北京光年无限科技有限公司 | Virtual idol deductive data processing method and system based on multi-modal interaction |
| CN108388399A (en)* | 2018-01-12 | 2018-08-10 | 北京光年无限科技有限公司 | The method of state management and system of virtual idol |
| CN108748071A (en)* | 2018-04-25 | 2018-11-06 | 苏州米机器人有限公司 | A kind of intelligent hotel service robot |
| CN109508687A (en)* | 2018-11-26 | 2019-03-22 | 北京猎户星空科技有限公司 | Man-machine interaction control method, device, storage medium and smart machine |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3121557B1 (en) | Method and apparatus for determining spatial parameter based on an image | |
| US10115019B2 (en) | Video categorization method and apparatus, and storage medium | |
| EP3086275A1 (en) | Numerical value transfer method, terminal, cloud server, computer program and recording medium | |
| CN108848313B (en) | Multi-person photographing method, terminal and storage medium | |
| EP3312702B1 (en) | Method and device for identifying gesture | |
| CN104054039A (en) | Augmented Reality With Sound And Geometric Analysis | |
| EP3236469B1 (en) | Object monitoring method and device | |
| EP3125164A1 (en) | Method and device for presenting ticket information | |
| CN110929616B (en) | Human hand identification method and device, electronic equipment and storage medium | |
| CN111131735B (en) | Video recording method, video playing method, video recording device, video playing device and computer storage medium | |
| CN106774849B (en) | Virtual reality equipment control method and device | |
| KR20180075224A (en) | Electronic device and method for providing recognition result of object | |
| WO2022179080A1 (en) | Positioning method and apparatus, electronic device, storage medium, program and product | |
| KR20140081731A (en) | Apparatus and method for assisting the visually imparied in object recognition | |
| US10645274B2 (en) | Server apparatus, distribution system, distribution method, and program with a distributor of live content and a viewer terminal for the live content including a photographed image of a viewer taking a designated body pose | |
| US20210312476A1 (en) | Information processing device, information processing method, and program | |
| JP5997824B1 (en) | Remote terminal, remote instruction method, and program for remote terminal | |
| CN110751951B (en) | Handshake interaction method and system based on intelligent mirror and storage medium | |
| CN106527697A (en) | Safety verification method and device in virtual reality | |
| CN110850971A (en) | Handshake interaction method and system between hand model and intelligent mirror and storage medium | |
| CN111796740A (en) | Unmanned vehicle control method, device and system based on wearable intelligent equipment | |
| WO2024140410A1 (en) | Method and apparatus for determining relative pose, and extended reality system, device and medium | |
| CN108280184B (en) | Test question extracting method and system based on intelligent pen and intelligent pen | |
| CN110309712A (en) | A motion type identification method and terminal equipment | |
| KR101753359B1 (en) | Method, apparatus, and system for displaying use records |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20200228 |