Disclosure of Invention
The invention mainly aims to provide wireless distributed limb motion capture equipment, and aims to solve the technical problems that wearing experience is poor and errors are large when a user carries out motion capture in the prior art.
In order to achieve the above object, the present invention provides a wireless distributed limb motion capture device, where the wireless distributed limb motion capture device includes a motion capture sub-node and a motion capture central node, and the motion capture sub-node is disposed on a limb; wherein,
the motion capture sub-node is used for capturing the posture data to be processed of the limb part where the motion capture sub-node is located and sending the posture data to be processed to the motion capture central node;
the motion capture central node is used for receiving the gesture data to be processed sent by each motion capture sub-node and obtaining a motion result according to the gesture data to be processed.
Preferably, the motion capture sub-node is further configured to perform real-time noise reduction processing on the to-be-processed posture data.
Preferably, the motion capture sub-node is further configured to determine a window length according to a sampling frequency of an attitude sensor, perform window division on the attitude data to be processed according to the window length, obtain a signal to be processed in each window, and perform noise reduction on the signal to be processed in each window based on empirical mode decomposition.
Preferably, the motion capture sub-node is further configured to perform empirical mode decomposition on the signal to be processed to obtain an inherent modal component; performing fast Fourier transform on the inherent modal component to obtain the center frequency of the inherent modal component; and when the central frequency is not less than the effective frequency threshold, deleting the signal to be processed from the attitude data to be processed to obtain the current attitude data.
Preferably, the motion capture central node is further configured to recognize the current posture data to obtain a motion result.
Preferably, the motion capture central node is further configured to monitor an online state, power information, and a working state of each motion capture child node.
Preferably, the motion capture sub-nodes and the motion capture central node are both in a wireless distributed structure.
Preferably, the motion capture sub-node comprises an attitude sensor, a microprocessor and a wireless communication unit.
Preferably, the motion capture sub-node is disposed on the limb through an adhesive type fixing structure, a sewing type fixing structure, a nylon hasp type fixing structure or an elastic bandage type fixing structure.
The wireless distributed limb motion capture equipment comprises a motion capture sub-node and a motion capture central node, wherein the motion capture sub-node is arranged on a limb; the motion capture sub-node is used for capturing gesture data to be processed of the limb part where the motion capture sub-node is located and sending the gesture data to be processed to the motion capture central node; the motion capture central node is used for receiving to-be-processed attitude data sent by each motion capture sub-node and obtaining a motion result according to the to-be-processed attitude data; according to the scheme, the motion capture is from a plurality of capture sub-nodes which are not connected with each other through electric cables and are embedded with the gesture sensors, the gesture of the user can be directly captured, the constraint of electric connecting cables is eliminated, and the gesture capture device has the advantages of being rapid and accurate in motion capture, convenient to detach and replace equipment components, comfortable in user experience and the like.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a functional block diagram of a first embodiment of a wireless distributed limb motion capture device according to the invention.
In the first embodiment, the wireless distributed limb motion capture device comprises a motion capture sub-node 10 and a motion capture central node 20, wherein the motion capture sub-node 10 is arranged on a limb; wherein,
the motion capture sub-node 10 is configured to capture to-be-processed posture data of a limb part where the motion capture sub-node is located, and send the to-be-processed posture data to the motion capture central node 20;
the motion capture central node 20 is configured to receive the to-be-processed posture data sent by each motion capture sub-node, and obtain a motion result according to the to-be-processed posture data.
It should be noted that, the motion capture sub-nodes 10 are generally multiple, and attached to the limbs, and can sense the posture of the attached position; the motion capture central node 20 may be one or more that receive and process the pose data returned by all or a particular number of the motion capture sub-nodes. The number of the motion capture sub-nodes 10 and the number of the motion capture central nodes 20 can be set by a user in a user-defined mode, and the motion capture sub-nodes 10 are attached to the limbs to directly capture the postures of the limbs of the user instead of indirectly capture the postures of the limbs of the user, so that the limb motion capture accuracy of the user is high.
The motion capture sub-nodes 10 and the motion capture central node 20 are both wireless distributed structures. The nodes are communicated with each other in a Wireless mode, and the communication mode includes but is not limited to Wireless-Fidelity (WIFI), bluetooth, ultra-low power Bluetooth, zigbee, 2.4GHz, 433MHz, 470MHz and the like. Through the wireless distributed structure, the constraint of an electrical connection cable of a common motion capture suit is eliminated, the number of motion capture sub-nodes or motion capture central nodes can be increased or decreased at any time, the motion capture sub-nodes can be replaced mutually, and when a certain motion capture sub-node fails, the motion capture sub-nodes can be completely replaced, so that the use is not influenced, and the equipment components are convenient to disassemble and replace.
Data transmission links are mutually established among the action capturing sub-nodes in an ad hoc network mode, a multi-head star (shown in figure 2) or a network topology structure (shown in figure 3) can be adopted between the central node and each sub-node, so that the central node can receive posture data returned by all or specific action capturing sub-nodes, the real-time performance of limb action capturing is improved, and the action capturing equipment is enabled to react more sensitively.
Further, the motion capture central node 20 may be a hardware device having a microprocessor, a display unit and a wireless communication unit, and may also exist in the form of an executable program or APP running on a terminal with wireless communication capability, such as a PC, a tablet, a mobile phone, and the like, which is not limited in this embodiment.
The motion capture central node 20 has a role as a relay station and a role as a client, and is mainly used for collecting attitude data returned from each motion capture child node; according to the current posture data of the limb part where each motion capture sub-node is located, the current motion is calculated and recognized through an algorithm; the identified action result is displayed to a user or forwarded to a designated terminal; and monitoring the online state, the electric quantity information, the working state and the like of each motion capture sub-node.
Further, the motion capture sub-node 10 includes an attitude sensor, a microprocessor, and a wireless communication unit.
It should be understood that the attitude sensor is a high performance three dimensional motion attitude measurement system based on micro electro mechanical systems technology. The device comprises auxiliary motion sensors such as a three-axis gyroscope, a three-axis accelerometer, a three-axis electronic compass and the like, outputs calibrated angular velocity, acceleration, magnetic data and the like through an embedded low-power-consumption processor, measures the motion attitude through a sensor data algorithm based on quaternion, and outputs zero-drift three-dimensional attitude data expressed by quaternion, euler angle and the like in real time.
It should be noted that the gesture sensor is configured to sense current gesture data of the limb part where the motion capture sub-node 10 is located; the microprocessor is used for capturing data of the attitude sensor, carrying out real-time noise reduction processing and integrating effective information; the wireless communication unit is used for establishing wireless communication links with other motion capture sub-nodes and the motion capture central node and wirelessly transmitting effective data obtained by the operation of the microprocessor to the other motion capture sub-nodes and the motion capture central node.
In addition, the motion capture sub-node 10 is mounted to the limb and should ensure as rigid synchronization as possible with the limb motion. The number and the limb parts of the motion capture sub-nodes 10 can be adjusted arbitrarily according to the requirements of users. Referring to fig. 5, typical limb motion capture requires 16 motion capture sub-nodes, and the attachment positions are at the hand (1 on each of the left and right), forearm (1 on each of the left and right), shoulder (1 on each of the left and right), head, waist, thigh (1 on each of the left and right), calf (1 on each of the left and right), and foot (1 on each of the left and right).
The motion capture sub-node 10 may be mounted on the limb in various ways, including: but sticky formula, sewing formula, nylon hasp formula elasticity bandage formula etc. the user can be installed according to the action seizure demand of oneself, and user experience is more comfortable.
Referring to fig. 6, fig. 6 shows an adhesive type fixing structure, that is, the bottom surface of the motion capture sub-node is adhered to the motion capture garment by using gel.
Referring to fig. 7, fig. 7 is a sewing type fixing structure, namely, a threading hole is reserved on the shell of the motion capture sub-node, and the motion capture sub-node is sewn on the motion capture clothes by using a needle and a thread.
Referring to fig. 8, fig. 8 is a velcro-type fixing structure, i.e., a sub-buckle of the velcro is covered on the bottom surface of the motion capture sub-node, a female buckle of the velcro is covered on the motion capture clothes, the motion capture clothes and the female buckle are mutually buckled to complete the fixation, and the disassembly and replacement are very convenient.
Referring to fig. 9, fig. 9 is a fastening structure of an elastic bandage type, that is, the bottom surface of the motion capture sub-node is provided with an elastic bandage, and when in use, the motion capture sub-node is directly tied to a human body and is convenient to use.
The following is the scenario in which the wireless distributed limb motion capture device is applied to "teaching":
usually, a piano training teacher can only train a few students intensively in the same time period, and if a large-scale collective teaching mode is adopted, the teaching quality is reduced because one-to-one explanation guidance cannot be realized for each student. If the wireless distributed type limb motion capturing device is adopted, the limb language of the student can be collected in real time and converted into a data format, then the data of the teachers is used as standard data, the limb language data of the student is compared with the standard data, the difference of the motion can be represented through the difference of the data, and finally, the teacher can learn and exercise the teacher by eliminating the difference, so that the teachers can guide each student one-to-one in a collective teaching mode.
Further, the data of the attitude sensor captured by the motion capture sub-node 10 is inevitably doped with noise signals due to the defects of the design principle of the sensor, external electromagnetic interference, high-frequency coupling of lines and other reasons, so that errors are brought to the subsequent identification of the motion attitude. Therefore, the present embodiment proposes to perform real-time noise reduction processing on the attitude data, specifically, perform real-time noise reduction processing on the attitude data based on empirical mode decomposition, and the motion capture sub-node 10 forwards the attitude sensor data to the central node after processing the attitude sensor data by the real-time noise reduction algorithm.
Referring to fig. 10, the specific steps of the motion capture sub-node 10 performing real-time noise reduction processing on the attitude data include:
s10: and determining the window length according to the sampling frequency of the attitude sensor, and carrying out window division on the attitude data to be processed according to the window length to obtain signals to be processed in each window.
It can be understood that, according to the data sampling frequency of the attitude sensor, the window length of applying the empirical mode decomposition is determined, and the data in the window containing the latest acquired data is used as the signal to be processed. Considering that the number of sampling points and the identifiable frequency domain are in a positive correlation relationship, this embodiment indicates that the window length should be equal to the sampling frequency, which can ensure a higher frequency domain identification range, and can also ensure that the algorithm calculation is not too complex, thereby ensuring the real-time performance.
S20: and carrying out empirical mode decomposition on the signal to be processed to obtain an inherent mode component.
Specifically, all maximum value points and minimum value point sequences of the signal x (t) to be processed are found and are respectively fitted into an upper envelope line e and a lower envelope line e by a cubic spline functionh (t) and el (t) calculating the average m of the two envelopesi (t):
Subtracting the mean value m of the upper envelope and the lower envelope from the original data sequence x (t)i (t) obtaining a new sequence hi (t), namely:
hi (t)=x(t)-mi (t);
h obtained by two successive iterationsk-1 And hk Normalized mean square error of as the judgment sequence hi Whether the normalized mean square error is the criterion of the inherent modal component or not is imf if the normalized mean square error is not higher than the threshold value SD (0.2-0.3 is recommended)i (t)=hi (t), otherwise hi As the new sequence x (t) continues the iterative computation:
s30: and carrying out fast Fourier transform on the inherent modal component to obtain the center frequency of the inherent modal component.
It will be appreciated that if a modal component imf is obtainedi (t), utilization speedThe fast fourier transform algorithm analyzes the frequency domain components to obtain the center frequency of the natural modal component, and the calculation formula of the center frequency may be:
wherein d isf For the center frequency, f is the frequency component and s (f) is the amplitude spectrum.
It should be noted that the center frequency may also be determined according to the value of the highest peak in the frequency spectrum, or determined by other methods, which is not limited in this embodiment.
S40: and when the central frequency is not less than the effective frequency threshold, deleting the signal to be processed from the attitude data to be processed to obtain the current attitude data.
It should be noted that when the window length is equal to the sampling frequency, the time span of the data in the current time window is 1 second, so the effective frequency threshold can be set to 50Hz, which can both eliminate clutter noise and retain useful attitude data. When the window length is greater than the acquisition frequency, the effective frequency threshold should be increased appropriately, and conversely, the effective frequency threshold should be decreased appropriately. Of course, the effective frequency threshold may also be set to other fixed values or an adaptive dynamic threshold, which is not limited in this embodiment.
If the central frequency is greater than or equal to the effective frequency threshold, that means that the inherent modal component belongs to a noise domain and needs to be removed from the data, the remaining signals are:
rj+1 (t)=rj (t)-imfi (t);
wherein r is0 (t) = x (t). For the residual signal rj+1 (t) continuing to decompose to obtain the next natural modal component imfi+1 (t) of (d). This is repeated.
If the central frequency is less than the effective frequency threshold, the inherent modal component is a part of effective data and cannot be removed, therefore, after the noise reduction processing, the noise reduction processing is carried outIs given as rj And (t), finishing the algorithm operation.
It can be understood that, since the empirical mode decomposition decomposes the natural mode component according to the order of the frequencies from high to low, the empirical mode decomposition of the signal to be processed may be stopped when the center frequency is smaller than the effective frequency threshold, so as to save the calculation time and achieve the purpose of fast real-time noise reduction.
By performing real-time noise reduction processing on the data in the motion capture sub-node 10, the interference of noise data is reduced, and simultaneously, the huge data processing amount of a motion capture central node is avoided, the load of the central node is reduced, and the real-time performance is improved.
In the embodiment, the gesture data to be processed of the limb part where the motion capture sub-node is located is captured through the motion capture sub-node, and the gesture data to be processed is sent to the motion capture central node; the motion capture central node receives to-be-processed attitude data sent by each motion capture sub-node and obtains a motion result according to the to-be-processed attitude data; according to the scheme, the motion capture is from a plurality of capture sub-nodes which are not connected with each other through electric cables and are embedded with the gesture sensors, the limb gestures of the user can be directly captured, the constraint of electric connection cables is eliminated, and the motion capture system has the advantages of rapidness and accuracy in motion capture, convenience in equipment component replacement, comfort in user experience and the like.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or system that comprises the element.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and all equivalent structures or equivalent processes performed by the present invention or directly or indirectly applied to other related technical fields are also included in the scope of the present invention.