A kind of body-building movement error correction system and method based on movement acquisitionTechnical field
The present invention relates to one kind to acquire more people based on CCD (Charge-coupled Device, charge coupled cell) movementThe applicable body-building of group acts error correction system, and in particular to acts error correction system to a kind of body-building based on movement acquisition, appliesHuman action acquisition and analytical technology, digital-to-analogue conversion technology, human body three-dimensional skeleton modeling technique etc., mainly with CCD camera fromHuman body different direction carries out movement acquisition, utilizes DSP (Digital Signal Processing, Digital Signal Processing, abbreviationDSP) processor carries out the motion images information processing technology and acts the error correction system analyzed to body-building.
Background technique
Body-building equipment mainly includes single function training aids and multifunctional trainer in the market at present, but these equipment only haveOperation instructions are labeled with application method and step in the side of equipment, if but unprofessional during body-buildingFitness's guidance, body builder carry out body-building just can not know whether the movement of oneself is quasi- according to the movement marked on equipmentReally；And present body-building equipment is designed primarily directed to all non-physical disabilities, but the disabled also has the need of body-building in lifeIt asks, so the present exercise guide system designed for physical disabilities is very few.
With the development of the society, the consciousness of national body-building gradually increases, people increasingly pay attention to the raising of physical fitness, butBe resulted in since the expense of the gymnasiums such as personal coach is out of the ordinary many people body-building movement it is nonstandard, make that body builder's is strongBody is not up to expected effect.
Body-building equipment mainly includes single function training aids and multifunctional trainer in the market at present, but these equipment only haveOperation instructions are labeled with application method and step in the side of equipment, if but unprofessional during body-buildingFitness's guidance, body builder carry out body-building just can not know whether the movement of oneself is quasi- according to the movement marked on equipmentReally.
It only proposes to show out the standard operation trained on a display screen in current intelligent body-building system scheme, can not markThe malfunction for remembering and showing body builder, such as the patent of invention of Publication No. CN101791466A, the intelligence with coach functionBody-building system is the movement of body builder to be acquired based on the sensor on fitness equipment, but require on each fitness equipment moreA sensor, and the price of professional sensor is costly, so that body-building increased costs, and body-building movement is correctWhether, whether each artis for being concentrated mainly on body builder is located at correct position, so using the sensor on fitness equipment comeJudge that the movement of body builder will generate very big error, just correct labeling and can not show the malfunction of body builder.
Present body-building equipment is designed primarily directed to all non-physical disabilities, but the disabled also has the need of body-building in lifeIt asks.Design scheme in intelligent body-building system scheme for physical disabilities is fewer and fewer, such as Publication No. CN105963956AFull crowd's intelligent body-building system does not relate to individuals with disabilities designed by all ages crowd just for the non-disabled, instituteIt is problem to be solved with the body-building system for individuals with disabilities.
Summary of the invention
It is provided by the invention that the body-building movement error correction system that more crowds are applicable in is acquired based on movement, voice and figure can be passed throughIt reminds body builder's specification to act as the mode of prompting, some body-building is made to act non-type people, it can be in the feelings that do not trainTimely discovery is wrong under condition and corrects, and the body-building of body builder is made to act and can get a desired effect very well；Make in societySome physical disabilities experience the love of society.
The technical solution of the present invention is as follows:
A kind of body-building movement error correction system based on movement acquisition, including movement acquisition device, DSP processing unit, displayDevice and voice prompt device；
Movement acquisition device includes image capture module and data converter, and image capture module shoots strong from different perspectivesThe video image of the body-building movement of body person, data converter are converted to the image data that image capture module acquires comprising human bodyThe digital signal of the two-dimensional coordinate of each key point is simultaneously sent to DSP processing unit；
Dsp processor includes MCU, memory, and memory is stored with a plurality of instruction, and MCU is for recording and executing memoryThe instructions of storage:
The body-building movement of the standardized human body's three-dimensional framework model stored in control display playout storage；
The three-dimensional coordinate of key point is calculated according to the digital signal of the two-dimensional coordinate comprising each key point of human body；
The human body three-dimensional of body builder is established according to the three-dimensional coordinate of each key point of body builder of movement acquisition device outputSkeleton pattern；
The standardized human body's three-dimensional framework mould that will be stored in the body-building movement of the human body three-dimensional skeleton pattern of foundation and memoryThe body-building movement of type is compared, to determine that whether in error range movement and the standard body-building of body builder act: if body-buildingThe activities of person are more than error range, corresponding key point on the human body three-dimensional skeleton pattern of the standard played over the displayIt is highlighted, and/or voice prompting is carried out by voice prompt device.
The above-mentioned body-building based on movement acquisition acts error correction system, wherein the voice prompt device has at least twoA loudspeaker；
An at least loudspeaker is used to play the voice prompting of the body-building movement of corresponding standardized human body's three-dimensional framework model, if strongThe activities of body person's key point are more than error range, and it is dynamic to broadcast position corresponding to this key point by remaining loudspeakerMake the voice prompting of mistake.
The above-mentioned body-building based on movement acquisition acts error correction system, wherein movement acquisition device includes two CCD camera shootingsMachine and two video a/d converters；
CCD camera is placed at the different perspectives in body-building region of body builder, to shoot body builder's different angle simultaneouslyBody-building movement；
The image that each CCD camera takes is switched to the laggard row information of electric signal and handles to obtain by each video a/d converterThe two-dimensional coordinate of each key point of human body.
The above-mentioned body-building based on movement acquisition acts error correction system, wherein the body builder in body-building region takes the photograph in two CCDProjection ray on camera imaging surface intersects at a point in the sky.
The above-mentioned body-building based on movement acquisition acts error correction system, wherein CCD camera is carried out by support triangle frameFixed, the height of the support triangle frame is adjustable, and is furnished with level meter on the turntable of support triangle frame.
The above-mentioned body-building based on movement acquisition acts error correction system, wherein strong at least through movement acquisition device acquisitionThe malfunction of N number of each position maximum magnitude of movement, records each position three-dimensional coordinate most according to malfunction in body movementBig value and minimum value, export to dsp processor, all sites maximum angle data and minimum angles are calculated in dsp processorData；
After the maximum and minimum value of all people's body region is tested out, according to the sequence of storage standard operation, deposit2N array is stored up into memory, the max value of error of each key point of whole body and most when each array respectively represents some movementSmall value, the data in the 2N array are used to judge whether the body-building movement of body builder to be more than error range；N is positive integer.
The present invention also provides a kind of body-building based on movement acquisition to act error correction method simultaneously, includes the following steps:
The body-building movement of playing standard human body three-dimensional skeleton pattern over the display；
Acquire the image that body builder acts in the body-building of different perspectives；
The body-building image for the body builder that different perspectives takes is switched into the laggard row information processing of digital signal, obtains body-buildingThe two-dimensional coordinate of each key point of person, and calculate the three-dimensional coordinate of each key point of body builder；
The human body three-dimensional skeleton pattern of body builder is established according to the three-dimensional coordinate of each key point of body builder；
The body-building movement of the human body three-dimensional skeleton pattern of foundation and the body-building of the human body three-dimensional skeleton pattern of standard are actedIt is compared, to determine that whether in error range movement and the standard body-building of body builder act: if the activities of body builderMore than error range, user is reminded to be corrected at least through the mode that voice reminder and/or display are reminded.
The above-mentioned body-building based on movement acquisition acts error correction method, wherein if the activities of body builder are more than errorRange, corresponding key point is highlighted on the human body three-dimensional skeleton pattern of the standard played over the display.
The above-mentioned body-building based on movement acquisition acts error correction method, wherein the method also includes:
The voice prompting of the body-building movement of corresponding standardized human body's three-dimensional framework model is played by loudspeaker, and
If the activities of body builder's key point are more than error range, this key point institute is broadcasted by remaining loudspeakerThe voice prompting of corresponding position stroke defect.
The above-mentioned body-building based on movement acquisition acts error correction method, wherein the method also includes:
The malfunction for prerecording N number of each position maximum magnitude of movement in body-building movement, according to corresponding to malfunctionThe maximum angle and minimum angles at position obtain the number of the maximum value and minimum value of each position three-dimensional coordinate when malfunctionAccording to；
After the maximum and minimum value of all people's body region is tested out, according to the sequence of storage standard operation, depositStore up 2N array, the max value of error and minimum value of each key point of whole body, the 2N when each array respectively represents some movementData in a array are used to judge whether the body-building movement of body builder to be more than error range；N is positive integer.
The human skeleton threedimensional model of standard operation is completed in invention by software programming.The number of the key point of standard operationAccording to from body builder act in the data of key point that acquire constantly compared, to identify the mistake of body builder's body-building movementAccidentally position carries out color mark to error location on a display screen, while carrying out the position of voice broadcast mistake, makes body-building in this wayPerson is apparent from the mistake of oneself, reduces error brought by sensor；Voice broadcast function and image display function are with regard to appropriateIt is kind solve the problems, such as physical disabilities in stroke defect can error correction in time this, while also making this set body-building system more peopleProperty, it is intelligent.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to embodiment or description of the prior artNeeded in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only of the invention someEmbodiment for those of ordinary skill in the art without any creative labor, can also be according to theseAttached drawing obtains other attached drawings.
Fig. 1 is that a kind of human action that the present invention provides in one embodiment acquires CCD camera placement schematic diagram；
Fig. 2 is human body corresponding to the human body key point of the invention provided in one embodiment；
Fig. 3 is the simplified diagram that a kind of body-building based on movement acquisition provided by the invention acts error correction system；
Fig. 4 is the flow chart that a kind of camera calibration provided by the invention obtains human body key point three-dimensional coordinate；
Fig. 5 is the work that a kind of body-building based on movement acquisition that the present invention provides in one embodiment acts error correction methodFlow chart.
Specific embodiment
In the following description, a large amount of concrete details are given so as to provide a more thorough understanding of the present invention.SoAnd it is obvious to the skilled person that the present invention may not need one or more of these details and be able toImplement.In other examples, in order to avoid confusion with the present invention, for some technical characteristics well known in the art not intoRow description.
In order to thoroughly understand the present invention, detailed step and detailed structure will be proposed in following description, so as toIllustrate technical solution of the present invention.Presently preferred embodiments of the present invention is described in detail as follows, however other than these detailed descriptions, thisInvention can also have other embodiments.
The present invention provides a kind of body-building based on movement acquisition to act error correction system, referring to shown in Fig. 3-4, includingAct acquisition device, DSP processing unit, display and voice prompt device；
Movement acquisition device includes image capture module and data converter, and image capture module shoots strong from different perspectivesThe video image of the body-building movement of body person, data converter are converted to the image data that image capture module acquires comprising human bodyThe digital signal of the two-dimensional coordinate of each key point is simultaneously sent to DSP processing unit；
Dsp processor includes MCU, memory, and memory is stored with a plurality of instruction, and MCU is for recording and executing memoryThe instructions of storage:
The body-building movement of the standardized human body's three-dimensional framework model stored in control display playout storage；
The three-dimensional coordinate of key point is calculated according to the digital signal of the two-dimensional coordinate comprising each key point of human body；
The human body three-dimensional of body builder is established according to the three-dimensional coordinate of each key point of body builder of movement acquisition device outputSkeleton pattern；
The standardized human body's three-dimensional framework mould that will be stored in the body-building movement of the human body three-dimensional skeleton pattern of foundation and memoryThe body-building movement of type is compared, to determine that whether in error range movement and the standard body-building of body builder act: if body-buildingThe activities of person are more than error range, corresponding key point on the human body three-dimensional skeleton pattern of the standard played over the displayIt is highlighted, and/or voice prompting is carried out by voice prompt device.
Wherein, Software Development Tools used in D reconstruction is the open source computer vision generation that Intel Company establishesThe code library Open CV and Visual C++6.0 run under Microsoft's Windows operating system, and programmed using C/C++Method is realized, the binary digit signal for acting acquisition device output is converted to three-dimensional coordinate data.
Human body three-dimensional skeleton pattern is established to calculate using the particle filter target following of the multiple features fusion based on binocular visionMethod tracks artis position, realizes the target of the final three-dimensional motion skeleton for restoring human body.
Wherein, it can allow coach after completing each movement more to stop in the crucial point data acquisition for carrying out standard operationStay 3-5 seconds time, on the one hand, allow body builder to there is time enough to keep the movement, if the on the other hand body-building of body builderActing wrong can also timely correct.After the body-building movement of acquisition standard, the data of acquisition are stored into memory.
In an optional embodiment of the invention, the voice prompt device has at least two loudspeakers；At least one raisesSound device is used to play the voice prompting of the body-building movement of corresponding standardized human body's three-dimensional framework model, if the office of body builder's key pointPortion's movement is more than error range, is mentioned by the voice that remaining loudspeaker broadcasts position stroke defect corresponding to this key pointShow.This need to be acted when each movement carries out the data acquisition of key point and carry out voice broadcast, explain each movementMain points, and storage of recording, play simultaneously for first loudspeaker and display；For position corresponding to each key pointAlso voice broadcast of the storage for second loudspeaker of specially recording is needed.
In an optional embodiment of the invention, movement acquisition device includes that two CCD cameras and two video a/ds turnParallel operation；Each CCD camera is placed at the different perspectives in body-building region of body builder, to shoot body builder's different angle simultaneouslyBody-building movement, as shown in Figure 1；Each video a/d converter carries out letter after the image that each CCD camera takes is switched to electric signalBreath handles to obtain the two-dimensional coordinate of each key point of human body.Further alternative, the body builder in body-building region is in two CCD camerasProjection ray on imaging surface intersects at a point in the sky.
In an optional embodiment of the invention, CCD camera is fixed by support triangle frame, the support triangleThe height of frame is adjustable, and is furnished with level meter on the turntable of support triangle frame.
In an optional embodiment of the invention, N number of each position of movement in body-building movement is acquired by movement acquisition deviceThe malfunction of maximum magnitude is simultaneously sent to dsp processor, the maximum angle at dsp processor position according to corresponding to malfunctionAnd minimum angles, obtain the maximum value and minimum value of each position three-dimensional coordinate when malfunction；
After the maximum and minimum value of all people's body region is tested out, according to the sequence of storage standard operation, deposit2N array is stored up into memory, the max value of error of each key point of whole body and most when each array respectively represents some movementSmall value, the data in the 2N array are used to judge whether the body-building movement of body builder to be more than error range；N is positive integer.
Wherein, it is as follows accurately to determine the whether standard compliant method of the movement of body builder at this time:
According to the actual conditions that the set body-building acts, each position maximum magnitude in set body-building movement is made by coachMalfunction, such as: the maximum angle of ancon, the smallest angle.The maximum value and minimum of the ancon three-dimensional coordinate of record at this timeThen value uses the method, the data of each movement all sites maximum angle data and minimum angles are obtained, when allPosition maximum and minimum value all test out after, from head, neck, left shoulder, right shoulder, chest, left elbow, right elbow, left wrist,Right wrist, abdomen, left stern, right stern, left knee, right knee, left ankle, right ankle, as shown in Fig. 2, being sequentially stored into according to crucial dot sequency to oneIn a array, if there is N number of movement, then 2N array is stored, respectively represents the mistake of whole body each key point when doing some movementPoor maximum value and minimum value, the data in this 2N array are used for the criterion of error determination module, in this, as body builderError term of reference.
When body builder when carrying out body-building all key points three of each movement obtained by movement acquisition moduleDimension coordinate and error range are constantly compared.Determine whether the movement of body builder at this time complies with standard to realize.
The data of key point at this time are judged not in error range, then dsp processor will issue the positionAlarm signal carries out the transmission of signal by USB communication interface, when voice prompt device receives the signal at different positions,The casting of corresponding information (such as remind: your hand motion is lack of standardization) is made, can inform the malfunction of body builderPosition, while the signal is also communicated to display, when display receives the signal, according to different signals being played onThe key point that red highlights mistake is carried out on three-dimensional framework model；All body builders are facilitated clearly to see which position notComply with standard (such as in hand region red display).
Wherein, the method for being embodied as more crowds' offer guidances is as follows:
By way of voice prompting and/or display prompts, people that whether hearing has obstacle or eyesight to have obstacleIt can clearly prompt whether body builder's body-building movement standardizes, and in the time of the 3-5 second reserve when movement acquisitionIt can just be used to act for body builder's correction.
The explanation of each movement of first loudspeaker in voice prompt device and display show the people of standardThe body-building movement that body three-dimensional framework body-building model is done is synchronous to be carried out, and it is careful that the further body builder for disability crowd providesGuidance, so that it may realize the body builder of different crowd in the case where no coach by display and voice prompt deviceOneself can right a wrong movement, to achieve the purpose that correct body-building.
In the present invention, it is display immediately ahead of body builder, plays the human skeleton three-dimensional mould of the standard builtType body-building movement, body builder can follow the skeleton pattern to learn together, are progressive, so that the movement of body builder more standardizes, reachingTo better body-building effect.
Embodiment two
The present invention also provides a kind of body-building based on movement acquisition to act error correction method simultaneously, includes the following steps:
The body-building movement of playing standard human body three-dimensional skeleton pattern over the display；
Acquire the image that body builder acts in the body-building of different perspectives；
The body-building image for the body builder that different perspectives takes is switched into the laggard row information processing of digital signal, obtains body-buildingThe two-dimensional coordinate of each key point of person, and calculate the three-dimensional coordinate of each key point of body builder；
The human body three-dimensional skeleton pattern of body builder is established according to the three-dimensional coordinate of each key point of body builder；
The body-building movement of the human body three-dimensional skeleton pattern of foundation and the body-building of the human body three-dimensional skeleton pattern of standard are actedIt is compared, to determine that whether in error range movement and the standard body-building of body builder act: if the activities of body builderMore than error range, user is reminded to be corrected at least through the mode that voice reminder and/or display are reminded.
In an optional embodiment of the invention, if the activities of body builder are more than error range, broadcast over the displayCorresponding key point is highlighted on the human body three-dimensional skeleton pattern for the standard put.
In an optional embodiment of the invention, the method also includes:
The voice prompting of the body-building movement of corresponding standardized human body's three-dimensional framework model is played by loudspeaker, and
If the activities of body builder's key point are more than error range, this key point institute is broadcasted by remaining loudspeakerThe voice prompting of corresponding position stroke defect.
In an optional embodiment of the invention, the method also includes:
The malfunction for prerecording N number of each position maximum magnitude of movement in body-building movement, according to corresponding to malfunctionThe maximum angle and minimum angles at position obtain the number of the maximum value and minimum value of each position three-dimensional coordinate when malfunctionAccording to；
After the maximum and minimum value of all people's body region is tested out, according to the sequence of storage standard operation, depositStore up 2N array, the max value of error and minimum value of each key point of whole body, the 2N when each array respectively represents some movementData in a array are used to judge whether the body-building movement of body builder to be more than error range；Wherein, N is positive integer.
In conclusion due to present invention employs above-mentioned technical solution, study course and the guidance for realizing body-building movement are wrongBody-building movement accidentally, the malfunction of body builder can be rapidly determined in body-building and carries out phonetic warning, to standardizeThe body-building of body builder acts, to reach expected body-building effect.
Presently preferred embodiments of the present invention is described above.It is to be appreciated that the invention is not limited to above-mentionedParticular implementation, devices and structures not described in detail herein should be understood as gives reality with the common mode in this fieldIt applies；Anyone skilled in the art, without departing from the scope of the technical proposal of the invention, all using the disclosure aboveMethods and technical content many possible changes and modifications are made to technical solution of the present invention, or be revised as equivalent variations etc.Embodiment is imitated, this is not affected the essence of the present invention.Therefore, anything that does not depart from the technical scheme of the invention, foundationTechnical spirit of the invention any simple modifications, equivalents, and modifications made to the above embodiment, still fall within the present inventionIn the range of technical solution protection.