CN111078099A - A learning function switching method and learning device based on gesture recognition - Google Patents
A learning function switching method and learning device based on gesture recognitionDownload PDFInfo
- Publication number
- CN111078099A CN111078099ACN201910454727.XACN201910454727ACN111078099ACN 111078099 ACN111078099 ACN 111078099ACN 201910454727 ACN201910454727 ACN 201910454727ACN 111078099 ACN111078099 ACN 111078099A
- Authority
- CN
- China
- Prior art keywords
- learning
- gesture
- switching
- function
- learning function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Technical Field
The invention relates to the technical field of electronic equipment, in particular to a learning function switching method based on gesture recognition and learning equipment.
Background
At present, most learning devices (such as family education machines) are provided with corresponding learning functions aiming at various different learning scenes, and then users can switch the learning functions at the learning devices aiming at different learning scenes. The traditional function switching method is to switch function scenes by clicking virtual keys in a touch screen of the learning device. However, in an actual learning process, a user usually needs to frequently click a touch screen of the learning device, and then a situation of mistaken touch is easily caused, so that the learning device switches a current learning function under the situation that the user does not have a function switching requirement.
Therefore, the conventional method for switching the learning function of the learning device is easy to miss touch, and has low accuracy, so that the learning efficiency of a user is not improved.
Disclosure of Invention
The embodiment of the invention discloses a learning function switching method based on gesture recognition and learning equipment, which are beneficial to improving the accuracy of the learning function switching of the learning equipment.
The first aspect of the embodiments of the present invention discloses a learning function switching method based on gesture recognition, including:
when a first learning function of the learning device is in a starting state, acquiring first image information containing a first gesture made by a user, and acquiring second image information containing a second gesture made by the user after a preset time interval;
judging whether the first gesture contained in the first image information is matched with a preset first switching gesture or not;
if the first switching gesture is matched with the first switching gesture, judging whether the second gesture contained in the second image information is matched with a preset second switching gesture or not, wherein the first switching gesture is different from the second switching gesture;
and if the first gesture is matched with the second switching gesture, switching the learning equipment from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, before the switching the learning device from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time, the method further includes:
acquiring a first learning progress of a user in learning through the first learning function, and storing the first learning progress into a cache;
and, after the switching the learning device from the first learning function to a second learning function indicated by both the first gesture and the second gesture, the method further comprises:
when the learning device is detected to be switched from the second learning function to the first learning function, acquiring the first learning progress from the cache;
and adjusting the learning progress of the first learning function to the first learning progress.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the switching the learning device from the first learning function to a second learning function indicated by the first gesture and the second gesture simultaneously includes:
analyzing the first gesture and the second gesture to determine combined information formed by combining the first gesture and the second gesture;
determining a switching mode indicated by the combined information in a preset switching rule according to the combined information;
if the switching mode indicates that the learning equipment is switched to the next learning function of the current learning function, determining the next learning function of the first learning function as a second learning function in a plurality of learning functions of the learning equipment, and switching the learning equipment to the second learning function;
and if the switching mode indicates that the learning equipment is switched to the last learning function of the current learning function, determining the last learning function of the first learning function as a second learning function in a plurality of learning functions of the learning equipment, and switching the learning equipment to the second learning function.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after determining that the second gesture included in the second image information matches a preset second switching gesture, and before switching the learning device from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time, the method further includes:
shooting image information of a book page to determine coordinate information of a finger, used by the user for clicking the book page, in the image information;
determining learning content in the book page according to the coordinate information of the finger;
and the switching the learning device from the first learning function to a second learning function indicated by both the first gesture and the second gesture comprises:
switching the learning device from the first learning function to a second learning function indicated by both the first gesture and the second gesture, and executing the second learning function according to the learning content.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the determining learning content in the book page according to the coordinate information of the finger includes:
collecting voice information which is input by the user and indicates learning requirements, and analyzing the voice information to obtain the learning requirements;
and determining learning content in the book page according to the learning requirement and the coordinate information of the finger.
A second aspect of the embodiments of the present invention discloses a learning apparatus, including:
the device comprises an acquisition unit, a display unit and a control unit, wherein the acquisition unit is used for acquiring first image information containing a first gesture made by a user when a first learning function of the learning device is in a starting state, and acquiring second image information containing a second gesture made by the user after a preset time interval;
a first judging unit, configured to judge whether the first gesture included in the first image information matches a preset first switching gesture;
a second determining unit, configured to determine whether the second gesture included in the second image information matches a preset second switching gesture when the first determining unit determines that the first gesture included in the first image information matches the preset first switching gesture, where the first switching gesture is different from the second switching gesture;
a switching unit, configured to switch the learning device from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time when the second determination unit determines that the second gesture included in the second image information matches a preset second switching gesture.
As an alternative implementation, in the second aspect of the embodiment of the present invention, the learning apparatus further includes:
a storage unit, configured to, before the switching unit switches the learning device from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time, obtain a first learning progress of a user when the user learns through the first learning function, and store the first learning progress in a cache;
an obtaining unit, configured to, after the switching unit switches the learning device from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time, obtain the first learning progress from the cache if it is detected that the learning device is switched from the second learning function to the first learning function;
an adjusting unit configured to adjust a learning progress of the first learning function to the first learning progress.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the manner that the switching unit is configured to switch the learning device from the first learning function to the second learning function indicated by the first gesture and the second gesture simultaneously is specifically:
the switching unit is used for analyzing the first gesture and the second gesture to determine combined information formed by combining the first gesture and the second gesture; determining a switching mode indicated by the combined information in a preset switching rule according to the combined information; if the switching mode indicates that the learning equipment is switched to the next learning function of the current learning function, determining the next learning function of the first learning function as a second learning function in a plurality of learning functions of the learning equipment, and switching the learning equipment to the second learning function; and if the switching mode indicates that the learning device is switched to the last learning function of the current learning function, determining the last learning function of the first learning function as a second learning function in a plurality of learning functions of the learning device, and switching the learning device to the second learning function.
As an alternative implementation, in the second aspect of the embodiment of the present invention, the learning apparatus further includes:
a shooting unit, configured to shoot image information of a book page after the second determining unit determines that the second gesture included in the second image information matches a preset second switching gesture and before the switching unit switches the learning device from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time, so as to determine, in the image information, coordinate information of a finger used by the user to click the book page;
the determining unit is used for determining learning content in the book page according to the coordinate information of the finger;
and the switching unit is configured to switch the learning device from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time in a specific manner:
a switching unit, configured to switch the learning device from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time, and execute the second learning function according to the learning content.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the manner that the determining unit is configured to determine the learning content in the book page according to the coordinate information of the finger is specifically:
the determining unit is used for acquiring the voice information which is input by the user and indicates the learning requirement, and analyzing the voice information to obtain the learning requirement; and determining learning content in the book page according to the learning requirement and the coordinate information of the finger.
A third aspect of an embodiment of the present invention discloses a learning apparatus, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute the learning function switching method based on gesture recognition disclosed by the first aspect of the embodiment of the invention.
A fourth aspect of the present invention discloses a computer-readable storage medium storing a computer program, where the computer program enables a computer to execute the learning function switching method based on gesture recognition disclosed in the first aspect of the present invention.
A fifth aspect of the embodiments of the present invention discloses a computer program product, which, when running on a computer, causes the computer to perform part or all of the steps of any one of the methods of the first aspect of the embodiments of the present invention.
A sixth aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where when the computer program product runs on a computer, the computer is caused to perform part or all of the steps of any one of the methods in the first aspect of the present embodiment.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, when a first learning function of the learning device is in a starting state, the learning device can acquire first image information containing a first gesture made by a user, and acquire second image information containing a second gesture made by the user after a preset time interval; judging whether a first gesture contained in the first image information is matched with a preset first switching gesture or not; if the first switching gesture is matched with the first switching gesture, judging whether a second gesture contained in the second image information is matched with a preset second switching gesture or not, wherein the first switching gesture is different from the second switching gesture; and if the gesture is matched with the second switching gesture, switching the learning equipment from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time. By implementing the embodiment of the invention, a user can control the learning equipment to be switched to different learning functions through different gesture combinations, and compared with the traditional learning function switching method which needs to switch by touching the touch screen of the learning equipment, the learning function can be prevented from being switched by the unconscious touch operation of the user, so that the learning progress of the user is interrupted; in addition, the learning function switching of the learning equipment is controlled by using the gesture combination, and compared with the control of switching by using a single gesture motion, the switching of the learning function triggered by an unconscious gesture motion of a user can be avoided, so that the learning progress of the user is interrupted. Therefore, the implementation of the embodiment of the invention is beneficial to improving the accuracy of the learning auxiliary function switching of the learning equipment, and is further beneficial to improving the learning efficiency of the user.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a learning function switching method based on gesture recognition according to an embodiment of the present invention;
FIG. 2 is a schematic flowchart of another learning function switching method based on gesture recognition according to an embodiment of the present disclosure;
fig. 3 is a schematic diagram illustrating an implementation manner of a shooting module shooting a book page to obtain image information of the book page according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a learning device according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of another learning device disclosed in the embodiment of the present invention;
fig. 6 is a schematic structural diagram of another learning device disclosed in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It is to be noted that the terms "first" and "second" and the like in the description and the claims of the present invention are used for distinguishing different objects, and are not used for describing a specific order. The terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a learning function switching method based on gesture recognition and learning equipment, which are beneficial to improving the accuracy of the learning function switching of the learning equipment.
The technical solution of the present invention will be described in detail with reference to specific examples.
Example one
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a learning function switching method based on gesture recognition according to an embodiment of the present invention. As shown in fig. 1, the learning function switching method based on gesture recognition may include the following steps:
101. when a first learning function of the learning device is in a starting state, the learning device collects first image information containing a first gesture made by a user, and collects second image information containing a second gesture made by the user after a preset time interval.
In this embodiment of the present invention, the learning Device may be a learning tablet, a learning machine, a learning mobile phone, a point reading machine, a teaching machine, a mobile tablet, a Personal Digital Assistant (PDA), a Mobile Internet Device (MID), a television, or the like, which is not limited in this embodiment of the present invention.
In the embodiment of the present invention, the learning device may be provided with corresponding learning functions for different learning scenarios, for example: a click-to-read function can be set for a pre-learned scene, a dictation function can be set for a dictation scene, and the like; that is, in the embodiment of the present invention, the first learning function may be one of the learning functions (for example, a click-to-read function).
In the embodiment of the present invention, the learning device may be provided with a display screen, and a shooting module may be further provided on the same side as the display screen to shoot the book page to obtain image information of the book page, where the shooting module may be a pop-up camera, a rotatable camera, a protruding camera, or the like, and the embodiment of the present invention is not limited; the learning equipment can further acquire first image information containing a first gesture made by a user through the camera module when a first learning function of the learning equipment is in a starting state, and acquire second image information containing a second gesture made by the user after a preset time interval; the preset time duration may be 1 second or 2 seconds, and the specific time duration may be set by a developer according to a large amount of development data.
102. The learning equipment judges whether a first gesture contained in the first image information is matched with a preset first switching gesture or not; if yes, go to step 103; if not, the process is ended.
In the embodiment of the present invention, the learning device may recognize a first gesture included in the first image information through an Optical Character Recognition (OCR) technique, and compare a recognition result with a preset first switching gesture; if the preset first switching gesture is "fist making", executingstep 103 if the recognized first gesture is also "fist making"; if the recognized first gesture is not "fist making", the flow is ended.
It should be noted that: the OCR technology converts characters of various bills, newspapers, books, documents and other printed matters into image information by means of optical input methods such as scanning, and then converts the image information into a usable computer input technology by means of a character recognition technology.
103. The learning equipment judges whether a second gesture contained in the second image information is matched with a preset second switching gesture or not; if yes, go to step 104; if not, the process is ended.
In this embodiment of the present invention, the first switching gesture and the second switching gesture may be different, and the embodiment of the present invention is not limited.
In the embodiment of the present invention, the learning device may recognize a second gesture included in the second image information through an Optical Character Recognition (OCR) technique, and compare the recognition result with a preset second switching gesture; if the preset second switching gesture is "open palm", then if the recognized second gesture is also "open palm", then executestep 104; if the recognized second gesture is not "open palm", the flow is ended.
104. The learning device switches the learning device from a first learning function to a second learning function indicated by both the first gesture and the second gesture.
In the embodiment of the present invention, as described instep 101, corresponding learning functions are set in the learning device for different learning scenarios; and different combinations of the first gesture and the second gesture can instruct the learning device to switch to different learning functions. Therefore, the learning device can switch the learning device from the first learning function to the second learning function indicated by the first gesture and the second gesture at the same time, for example, from the point-and-read function to the dictation function, according to the combined information of the first gesture and the second gesture.
As an optional implementation manner, before the learning device is switched from the first learning function to the second learning function indicated by the first gesture and the second gesture at the same time, the learning device may further obtain a first learning progress of the user during learning through the first learning function, and store the first learning progress into the cache; and after the learning device is switched from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time, if the fact that the learning device is switched from the second learning function to the first learning function is detected, acquiring a first learning progress from the cache, and adjusting the learning progress of the first learning function to the first learning progress.
For example, the learning device may store the learning progress of the "dictation function dictation to the third unit" into the cache if the learning device acquires that the user has dictated the third unit in the dictation function, and switch the learning device from the dictation function to a second learning function indicated by the first gesture and the second gesture at the same time; subsequently, if it is detected that the learning device is switched from the second learning function to the dictation function, the learning device may obtain the learning progress of the dictation function from the cache, and adjust the learning progress of the dictation function to the third unit.
By implementing the method, the learning device can store the first learning progress of the first learning function before switching into the cache when the learning function switching is triggered; if the subsequent user switches back to the first learning function, the learning device can automatically extract the first learning progress from the cache, and adjust the learning progress of the first learning function to the first learning progress, so that the user can conveniently continue learning, and the use experience of the user is improved.
As an alternative embodiment, the way for the learning apparatus to switch the learning apparatus from the first learning function to the second learning function indicated by the first gesture and the second gesture simultaneously may be: the learning equipment analyzes the first gesture and the second gesture to determine combined information formed by combining the first gesture and the second gesture; determining a switching mode indicated by the combined information in a preset switching rule according to the combined information; if the switching mode indicates that the learning device is switched to the next learning function of the current learning function, determining the next learning function of the first learning function as a second learning function in the plurality of learning functions of the learning device, and switching the learning device to the second learning function; and if the switching mode indicates that the learning device is switched to the last learning function of the current learning function, determining the last learning function of the first learning function as a second learning function in the plurality of learning functions of the learning device, and switching the learning device to the second learning function.
For example, the learning device analyzes the first gesture and the second gesture, determines that the first gesture is "fist making", and the second gesture is "palm opening", and then the combined information formed by combining the first gesture and the second gesture is "fist making becomes palm opening"; and determining that 'fist making is changed into palm opening' as an instruction to switch the learning equipment to the next learning function of the current learning function according to a preset switching rule; the learning device may determine, among the plurality of learning functions of the learning device, a next learning function of the first learning function as a second learning function, and switch the learning device to the second learning function;
similarly, if the combined information formed by the first gesture and the second gesture is that the palm is opened and the fist is made; and determining that 'opening the palm to make a fist' is the instruction to switch the learning equipment to the last learning function of the current learning function according to a preset switching rule; the learning apparatus may determine a last learning function of the first learning function as the second learning function among the plurality of learning functions of the learning apparatus, and switch the learning apparatus to the second learning function.
It should be noted that: the preset switching rule may be set by a developer based on a large amount of development data. For example, the specific switching rule may be: when the combined information formed by combining the first gesture and the second gesture is that the fist is opened, switching to the next learning function; when the combined information is 'open palm becomes fist', switching to the last learning function;
another example is: when the combined information formed by combining the first gesture and the second gesture is that the palm is changed from up to down, switching to the next learning function; when the combined information is that the palm of the hand is changed from downward to upward, the function is switched to the last learning function.
Compared with the traditional learning function switching method which needs a touch screen of touch learning equipment to switch, the method can switch the learning function through gestures, and can select the learning function to be switched through different gesture combinations, so that the learning efficiency is improved, and the use experience of a user is improved.
Therefore, by implementing the method described in fig. 1, a user can control the learning device to switch to different learning functions through different gesture combinations, and compared with the conventional learning function switching method that the user needs to touch the touch screen of the learning device for switching, the learning function can be prevented from being switched by the user through an unconscious touch operation, so that the learning progress of the user is interrupted; in addition, the learning function switching of the learning equipment is controlled by using the gesture combination, and compared with the control of switching by using a single gesture motion, the switching of the learning function triggered by an unconscious gesture motion of a user can be avoided, so that the learning progress of the user is interrupted. Therefore, the implementation of the embodiment of the invention is beneficial to improving the accuracy of the learning auxiliary function switching of the learning equipment, and is further beneficial to improving the learning efficiency of the user.
Example two
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating another learning function switching method based on gesture recognition according to an embodiment of the present invention. As shown in fig. 2, the learning function switching method based on gesture recognition may include the following steps:
201;step 201 is the same asstep 101 in the first embodiment, and is not described herein again.
202. The learning equipment judges whether a first gesture contained in the first image information is matched with a preset first switching gesture or not; if yes, go to step 203; if not, the process is ended.
203. The learning equipment judges whether a second gesture contained in the second image information is matched with a preset second switching gesture or not; if yes, go to step 204; if not, the process is ended.
204. The learning device captures image information of the book page to determine coordinate information of a finger used by the user to click the book page in the image information.
In the embodiment of the invention, the setting mode of the shooting module of the learning equipment is based on thestep 101; further, as shown in fig. 3, fig. 3 is a schematic diagram of an implementation manner in which a shooting module shoots a book page to obtain image information of the book page according to an embodiment of the present invention. The shooting module can also be provided with the reflex reflector (for example, reflector, prism or convex lens etc.) in the dead ahead for the shooting light path of shooting the module is changed, and then makes the shooting module can shoot the books page, and wherein the dotted line represents the light path of shooting the module.
In the embodiment of the present invention, the learning device may recognize the image information of the book page through an Optical Character Recognition (OCR) technology, so as to determine, according to the recognition result, the finger coordinate information of the user clicking the book page in the image of the book page.
205. And the learning equipment determines the learning content in the book page according to the coordinate information of the finger.
For example, if the finger coordinates of the user point to a section in the page of the book, the section can be determined as the learning content; for another example, if the finger coordinate of the user points to a question in the page of the book, the question can be determined as the learning content; as another example, the coordinates of the user's finger point to a picture in the page of the book, and the picture can be determined as the learning content.
As an alternative implementation, the way that the learning device determines the learning content in the book page according to the coordinate information of the finger may be: the learning equipment collects voice information which is input by a user and indicates learning requirements, and analyzes the voice information to obtain the learning requirements; and determining the learning content in the book page according to the learning requirement and the coordinate information of the fingers.
It should be noted that: in the embodiment of the invention, a microphone device can be arranged in the learning equipment and is used for collecting the voice information input by the user, and further, the Natural Language Processing (NLP) technology can be utilized to identify the semantics of the voice information input by the user so as to determine the learning requirement of the user; the NLP technology is a sub-field of artificial intelligence and is a technology for processing a human-computer interaction language problem. Further, the learning device can determine the learning content according to the learning requirement of the user and the finger coordinates of the user. In practice, it is found that the finger coordinate of the user is only one point, and the learning content that the user wants to specify may not be determined according to one point coordinate, so the learning content that the user wants to learn can be determined according to the learning requirement of the user.
For example: for example, when performing a point-and-read function, if the user points to a certain point on the page of the book: "what this word means", then can confirm a word closest to this point coordinate as the learning content; for another example, if the user points to a point on the page of the book: "what this word means", then can confirm a word closest to this point coordinate as the learning content; as another example, if the user points to a point on the page of the book: "how this question does", a question closest to the point coordinate can be determined as the learning content. That is, it can be determined whether the user wants to ask a word, a word or a question by combining the voice information input by the user and the finger coordinates.
By implementing the method, the learning equipment can more accurately determine the learning content which the user wants to learn by combining the learning demand voice information input by the user and the finger coordinate pointed by the user in the book page, so that the learning efficiency of the user is improved, and the use experience of the user is further improved.
206. The learning apparatus switches the learning apparatus from the first learning function to a second learning function indicated by both the first gesture and the second gesture, and executes the second learning function according to the learning content.
In the embodiment of the present invention, after determining the learning content according tostep 205, the learning device may perform the second learning function according to the determined learning content. For example, if the learning content is a session and the second learning function is a dictation function, the learning device may perform the dictation function for the session.
It can be seen that, compared with the implementation of the method described in fig. 1, the implementation of the method described in fig. 2 can also combine the learning requirement voice information input by the user and the finger coordinates pointed by the user in the book page to more accurately determine the learning content that the user wants to learn, and after the learning function is subsequently switched, the switched learning function is executed for the determined learning content, so that the learning efficiency of the user is improved, and the user experience is further improved.
EXAMPLE III
Referring to fig. 4, fig. 4 is a schematic structural diagram of a learning device according to an embodiment of the present invention. As shown in fig. 4, the learning apparatus may include:
theacquisition unit 401 is configured to acquire first image information including a first gesture made by a user when a first learning function of the learning device is in a start state, and acquire second image information including a second gesture made by the user after a preset time interval;
a first determiningunit 402, configured to determine whether a first gesture included in the first image information matches a preset first switching gesture;
a second determiningunit 403, configured to determine whether a second gesture included in the second image information matches a preset second switching gesture when the first determiningunit 402 determines that the first gesture included in the first image information matches the preset first switching gesture, where the first switching gesture is different from the second switching gesture;
aswitching unit 404, configured to switch the learning apparatus from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time when the second determiningunit 403 determines that the second gesture included in the second image information matches a preset second switching gesture.
As can be seen, with the implementation of the learning device described in fig. 4, a user can control the learning device to switch to different learning functions through different gesture combinations, and compared with the conventional learning function switching method that the user needs to touch the touch screen of the learning device for switching, the learning function can be prevented from being switched by the user through an unintentional touch operation, so that the learning progress of the user is interrupted; in addition, the learning function switching of the learning equipment is controlled by using the gesture combination, and compared with the control of switching by using a single gesture motion, the switching of the learning function triggered by an unconscious gesture motion of a user can be avoided, so that the learning progress of the user is interrupted. Therefore, the implementation of the embodiment of the invention is beneficial to improving the accuracy of the learning auxiliary function switching of the learning equipment, and is further beneficial to improving the learning efficiency of the user.
Example four
Referring to fig. 5, fig. 5 is a schematic structural diagram of another learning apparatus according to an embodiment of the present invention. The learning apparatus shown in fig. 5 is optimized by the learning apparatus shown in fig. 4. Compared to the learning apparatus shown in fig. 4, the learning apparatus shown in fig. 5 may further include:
astorage unit 405, configured to, before theswitching unit 404 switches the learning device from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time, acquire a first learning progress of the user during learning through the first learning function, and store the first learning progress in a cache;
an obtainingunit 406, configured to, after theswitching unit 404 switches the learning apparatus from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time, obtain a first learning progress from the cache if it is detected that the learning apparatus is switched from the second learning function to the first learning function;
anadjusting unit 407 for adjusting the learning progress of the first learning function to a first learning progress.
As an alternative embodiment, the manner for switching the learning device from the first learning function to the second learning function indicated by the first gesture and the second gesture simultaneously by theswitching unit 404 may specifically be:
aswitching unit 404, configured to analyze the first gesture and the second gesture to determine combination information formed by combining the first gesture and the second gesture; determining a switching mode indicated by the combined information in a preset switching rule according to the combined information; if the switching mode indicates that the learning device is switched to the next learning function of the current learning function, determining the next learning function of the first learning function as a second learning function in the plurality of learning functions of the learning device, and switching the learning device to the second learning function; and if the switching mode indicates that the learning device is switched to the last learning function of the current learning function, determining the last learning function of the first learning function as a second learning function in the plurality of learning functions of the learning device, and switching the learning device to the second learning function.
Compared with the traditional learning function switching method which needs a touch screen of touch learning equipment to switch, the method can switch the learning function through gestures, and can select the learning function to be switched through different gesture combinations, so that the learning efficiency is improved, and the use experience of a user is improved.
As an alternative embodiment, the learning apparatus shown in fig. 5 may further include:
ashooting unit 408, configured to shoot the image information of the book page after the second determiningunit 403 determines that the second gesture included in the second image information matches a preset second switching gesture, and before theswitching unit 404 switches the learning device from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time, so as to determine, in the image information, coordinate information of a finger used by the user to click the book page;
a determiningunit 409, configured to determine learning content in the book page according to the coordinate information of the finger;
and the manner of theswitching unit 404 for switching the learning device from the first learning function to the second learning function indicated by the first gesture and the second gesture at the same time may specifically be:
aswitching unit 404, configured to switch the learning apparatus from the first learning function to a second learning function indicated by the first gesture and the second gesture at the same time, and execute the second learning function according to the learning content.
As an alternative embodiment, the manner that the determiningunit 409 is used for determining the learning content in the book page according to the coordinate information of the finger may specifically be:
a determiningunit 409, configured to collect voice information indicating a learning requirement input by a user, and analyze the voice information to obtain the learning requirement; and determining the learning content in the book page according to the learning requirement and the coordinate information of the fingers.
By implementing the method, the learning content which the user wants to learn can be more accurately determined by combining the learning demand voice information input by the user and the finger coordinate pointed by the user in the book page, and after the learning function is switched subsequently, the switched learning function is executed according to the determined learning content, so that the learning efficiency of the user is improved, and the user experience is further improved.
It can be seen that, compared with the learning apparatus described in fig. 4, the learning apparatus described in fig. 5 may further store the first learning progress of the first learning function before switching into the cache when the switching of the learning function is triggered; if the subsequent user switches back to the first learning function, the learning device can automatically extract the first learning progress from the cache, and adjust the learning progress of the first learning function to the first learning progress, so that the user can conveniently continue learning, and the use experience of the user is improved.
EXAMPLE five
Referring to fig. 6, fig. 6 is a schematic structural diagram of another learning apparatus according to an embodiment of the present invention. As shown in fig. 6, the learning apparatus may include:
amemory 601 in which executable program code is stored;
aprocessor 602 coupled to amemory 601;
theprocessor 602 calls the executable program code stored in thememory 601 to execute any one of the learning function switching methods based on gesture recognition in fig. 1 to 2.
The embodiment of the invention discloses a computer-readable storage medium which stores a computer program, wherein the computer program enables a computer to execute any one of the learning function switching methods based on gesture recognition in figures 1-2.
The embodiment of the present invention also discloses an application publishing platform, wherein the application publishing platform is used for publishing a computer program product, and when the computer program product runs on a computer, the computer is caused to execute part or all of the steps of the method in the above method embodiments.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Those skilled in the art should also appreciate that the embodiments described in this specification are exemplary and alternative embodiments, and that the acts and modules illustrated are not required in order to practice the invention.
In various embodiments of the present invention, it should be understood that the sequence numbers of the above-mentioned processes do not imply an inevitable order of execution, and the execution order of the processes should be determined by their functions and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated units, if implemented as software functional units and sold or used as a stand-alone product, may be stored in a computer accessible memory. Based on such understanding, the technical solution of the present invention, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the above-described method of each embodiment of the present invention.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc-Read-Only Memory (CD-ROM), or other Memory, magnetic disk, magnetic tape, or magnetic tape, Or any other medium which can be used to carry or store data and which can be read by a computer.
The method for switching the learning function based on gesture recognition and the learning device disclosed by the embodiment of the invention are described in detail, a specific embodiment is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
Translated fromChinesePriority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910454727.XACN111078099A (en) | 2019-05-29 | 2019-05-29 | A learning function switching method and learning device based on gesture recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910454727.XACN111078099A (en) | 2019-05-29 | 2019-05-29 | A learning function switching method and learning device based on gesture recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111078099Atrue CN111078099A (en) | 2020-04-28 |
Family
ID=70310347
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910454727.XAPendingCN111078099A (en) | 2019-05-29 | 2019-05-29 | A learning function switching method and learning device based on gesture recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111078099A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111813321A (en)* | 2020-08-12 | 2020-10-23 | Oppo广东移动通信有限公司 | Gesture control method and related device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103226443A (en)* | 2013-04-02 | 2013-07-31 | 百度在线网络技术（北京）有限公司 | Method and device for controlling intelligent glasses and intelligent glasses |
| CN103246347A (en)* | 2013-04-02 | 2013-08-14 | 百度在线网络技术（北京）有限公司 | Control method, device and terminal |
| US20140184493A1 (en)* | 2012-12-28 | 2014-07-03 | Hon Hai Precision Industry Co., Ltd. | Electronic device and gesture contol method for electronic device |
| CN106210836A (en)* | 2016-07-28 | 2016-12-07 | 广东小天才科技有限公司 | Interactive learning method and device in video playing process and terminal equipment |
| CN106599888A (en)* | 2016-12-13 | 2017-04-26 | 广东小天才科技有限公司 | Translation method, translation device and mobile terminal |
| CN109800297A (en)* | 2019-01-23 | 2019-05-24 | 广东小天才科技有限公司 | Learning auxiliary method based on learning equipment and learning equipment |
- 2019
- 2019-05-29CNCN201910454727.XApatent/CN111078099A/enactivePending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140184493A1 (en)* | 2012-12-28 | 2014-07-03 | Hon Hai Precision Industry Co., Ltd. | Electronic device and gesture contol method for electronic device |
| CN103226443A (en)* | 2013-04-02 | 2013-07-31 | 百度在线网络技术（北京）有限公司 | Method and device for controlling intelligent glasses and intelligent glasses |
| CN103246347A (en)* | 2013-04-02 | 2013-08-14 | 百度在线网络技术（北京）有限公司 | Control method, device and terminal |
| CN106210836A (en)* | 2016-07-28 | 2016-12-07 | 广东小天才科技有限公司 | Interactive learning method and device in video playing process and terminal equipment |
| CN106599888A (en)* | 2016-12-13 | 2017-04-26 | 广东小天才科技有限公司 | Translation method, translation device and mobile terminal |
| CN109800297A (en)* | 2019-01-23 | 2019-05-24 | 广东小天才科技有限公司 | Learning auxiliary method based on learning equipment and learning equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111813321A (en)* | 2020-08-12 | 2020-10-23 | Oppo广东移动通信有限公司 | Gesture control method and related device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109635772A (en) | Dictation content correcting method and electronic equipment | |
| CN109639952B (en) | Photographing question searching method and electronic equipment | |
| CN107977146B (en) | A mask-based topic search method and electronic device | |
| CN111680177A (en) | Data search method, electronic device, and computer-readable storage medium | |
| CN111026901A (en) | A search method and learning device for learning content | |
| CN111026949A (en) | A method and system for searching questions based on electronic equipment | |
| CN112163513A (en) | Information selection method, system, device, electronic device and storage medium | |
| CN111091034B (en) | Question searching method and tutoring equipment based on multi-finger recognition | |
| CN110795918B (en) | Method, device and equipment for determining reading position | |
| WO2014181508A1 (en) | Information processing apparatus, information processing method, and program | |
| CN111079494A (en) | Learning content pushing method and electronic equipment | |
| CN111079726B (en) | Image processing method and electronic device | |
| CN111077992B (en) | Click-to-read method, electronic equipment and storage medium | |
| CN111753715A (en) | Method, device, electronic device and storage medium for shooting test questions in a reading scene | |
| CN111026786B (en) | Dictation list generation method and home education equipment | |
| CN111722711A (en) | Augmented reality scene output method, electronic device, and computer-readable storage medium | |
| CN111027353A (en) | Search content extraction method and electronic equipment | |
| CN111078982A (en) | An electronic page retrieval method, electronic device and storage medium | |
| CN111078099A (en) | A learning function switching method and learning device based on gesture recognition | |
| CN111711758B (en) | Method, device, electronic device and storage medium for shooting test questions with multiple assignments | |
| CN111077997A (en) | Point reading control method and electronic device in point reading mode | |
| CN111079498B (en) | A learning function switching method and electronic equipment based on mouth shape recognition | |
| CN111753617B (en) | A method for arranging wrong question information, electronic device and storage medium | |
| CN111079503B (en) | Character recognition method and electronic equipment | |
| CN111079486A (en) | A method and electronic device for enabling dictation detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20200428 |