CN115016635A - A target control method and system based on action recognition - Google Patents
A target control method and system based on action recognitionDownload PDFInfo
- Publication number
- CN115016635A CN115016635ACN202210405585.XACN202210405585ACN115016635ACN 115016635 ACN115016635 ACN 115016635ACN 202210405585 ACN202210405585 ACN 202210405585ACN 115016635 ACN115016635 ACN 115016635A
- Authority
- CN
- China
- Prior art keywords
- wrist
- movement
- target
- relative
- motion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本发明涉及人机交互技术领域，尤其涉及一种基于动作识别的目标控制方法及系统。The invention relates to the technical field of human-computer interaction, and in particular, to a target control method and system based on action recognition.
背景技术Background technique
通过识别手势动作来实现指令的输出，以此来实现人机交互是一个发展趋势，可以给用户操作相关设备带来方便。It is a development trend to realize the output of instructions by recognizing gesture actions, so as to realize human-computer interaction, which can bring convenience to users to operate related devices.
现有技术可以通过获取手指相对于手腕的运动，用于控制目标设备。但是手指相对于手腕的移动范围比较有限，例如食指相对于手腕左右移动的极限范围通常为20公分左右(舒适灵活的移动范围通常不超过10公分)，前后移动的极限范围通常为15公分左右(舒适灵活的移动范围通常不超过7公分)。如果要进行大幅度、精细的目标操控，例如操控一个尺寸较大的屏幕中的光标，宽度为2米，那么手指左右移动的幅度要至少放大10倍(如果考虑舒适的移动范围，则需要放大20倍)，才能完整覆盖整个目标屏幕。这样会造成两个问题：The prior art can be used to control the target device by acquiring the movement of the finger relative to the wrist. However, the movement range of the finger relative to the wrist is relatively limited. For example, the limit range of the left and right movement of the index finger relative to the wrist is usually about 20 cm (the comfortable and flexible range of movement is usually no more than 10 cm), and the limit range of forward and backward movement is usually about 15 cm ( The comfortable and flexible range of movement is usually no more than 7 cm). If you want to perform large-scale and fine target manipulation, such as manipulating a cursor on a large screen with a width of 2 meters, the range of the left and right movement of the finger should be enlarged by at least 10 times (if the comfortable movement range is considered, it needs to be enlarged 20 times) to completely cover the entire target screen. This creates two problems:
(1)、手指移动被过度放大，会导致手指难以在目标屏幕里做精细复杂的操作，当图标排列比较紧密的时候，会容易造成误触；(1) Excessive magnification of the finger movement will make it difficult for the finger to perform delicate and complex operations on the target screen. When the icons are arranged closely, it will easily cause false touches;
(2)、光学识别手指移动的方法下，识别到的手指关键点会在小范围内波动，当手指移动被过度放大后，小的波动也会造成目标屏幕中代表手指的光标的剧烈抖动，强烈影响精度和使用体验。(2) Under the method of optically recognizing finger movement, the identified key points of the finger will fluctuate in a small range. When the finger movement is excessively magnified, the small fluctuation will also cause the cursor representing the finger in the target screen to shake violently. Strongly affects the accuracy and user experience.
以上情况，就限制了被控制目标屏幕的尺寸，即当目标屏幕尺寸过大时，即不适用该方案去控制。The above situation limits the size of the target screen to be controlled, that is, when the size of the target screen is too large, this scheme is not applicable to control.
现有技术中还可以在手腕上佩戴定位设备(或者手持定位设备)，用于测量手腕的空间运动，定位设备可以是惯性定位设备(如加速度传感器、陀螺仪)、磁力计、光学传感器等，但是这种单独以手腕的运动作为控制目标设备屏幕中元素的方法，因为手腕的运动远远不及手指灵活，所以操作的效率低、灵活性差。In the prior art, a positioning device (or a handheld positioning device) can also be worn on the wrist to measure the spatial motion of the wrist. The positioning device can be an inertial positioning device (such as an acceleration sensor, a gyroscope), a magnetometer, an optical sensor, etc., However, this method of controlling the elements on the screen of the target device solely uses the movement of the wrist, because the movement of the wrist is far less flexible than that of the fingers, so the operation efficiency is low and the flexibility is poor.
因此，现有技术还有待于改进和发展。Therefore, the existing technology still needs to be improved and developed.
发明内容SUMMARY OF THE INVENTION
本发明的主要目的在于提供一种基于动作识别的目标控制方法及系统，旨在解决现有技术中不方便对目标屏幕进行精细控制操作的问题。The main purpose of the present invention is to provide a target control method and system based on motion recognition, which aims to solve the problem of inconvenient fine control operation on the target screen in the prior art.
为实现上述目的，本发明提供一种基于动作识别的目标控制方法，所述基于动作识别的目标控制方法包括如下步骤：In order to achieve the above object, the present invention provides a target control method based on motion recognition, and the target control method based on motion recognition includes the following steps:
基于手腕下部佩戴的光学传感器，获取手指相对于手腕的第一运动；Obtain the first movement of the finger relative to the wrist based on the optical sensor worn on the lower part of the wrist;
基于手腕上佩戴的采集装置，获取手腕相对用户身体上目标位置的第二运动；Acquire the second movement of the wrist relative to the target position on the user's body based on the collection device worn on the wrist;
将手指相对于手腕的第一运动和手腕相对用户身体上目标位置的第二运动进行叠加，根据叠加的运动结果控制目标。The first movement of the finger relative to the wrist and the second movement of the wrist relative to the target position on the user's body are superimposed, and the target is controlled according to the superimposed movement result.
可选地，所述的基于动作识别的目标控制方法，其中，所述采集装置包括至少一个佩戴在人体上的配件，所述配件用于辅助穿戴设备本体测量自身相对于所述配件的空间位置和\或空间运动。Optionally, in the target control method based on motion recognition, the acquisition device includes at least one accessory worn on the human body, and the accessory is used to assist the body of the wearable device to measure its spatial position relative to the accessory. and\or space motion.
可选地，所述的基于动作识别的目标控制方法，其中，所述配件为悬挂在脖子上的吊坠、粘贴在身上或者衣服上的贴纸、固定在衣服上的部件以及放在口袋里面的部件。Optionally, in the object control method based on motion recognition, the accessories are pendants hanging on the neck, stickers attached to the body or clothes, parts fixed on clothes and parts placed in pockets. .
可选地，所述的基于动作识别的目标控制方法，其中，基于手腕上佩戴的采集装置获取的信息，直接计算手腕相对于身体上目标位置的第二运动，不在人体上设置佩戴的配件。Optionally, in the target control method based on motion recognition, the second movement of the wrist relative to the target position on the body is directly calculated based on the information obtained by the collection device worn on the wrist, and no accessories are provided on the human body.
可选地，所述的基于动作识别的目标控制方法，其中，增加一个标定动作，使得采集装置准确识别身体上的目标位置；所述标定动作的方法为：将采集装置采集到的部分身体信息设置为目标位置。Optionally, in the target control method based on action recognition, a calibration action is added, so that the collection device can accurately identify the target position on the body; the calibration action method is: part of the body information collected by the collection device Set as the target location.
可选地，所述的基于动作识别的目标控制方法，其中，所述将手指相对于手腕的第一运动和手腕相对用户身体上目标位置的第二运动进行叠加，根据叠加的运动结果控制目标，具体包括：Optionally, in the target control method based on motion recognition, the first movement of the finger relative to the wrist and the second movement of the wrist relative to the target position on the user's body are superimposed, and the target is controlled according to the superimposed movement result. , including:
将手指相对于手腕的第一运动M和手腕相对用户身体上目标位置的第二运动N进行叠加得到运动结果P为：The motion result P is obtained by superimposing the first motion M of the finger relative to the wrist and the second motion N of the wrist relative to the target position on the user's body:
运动结果P＝手指相对于手腕的第一运动M+手腕相对用户身体上目标位置的第二运动N。Movement result P=first movement M of the finger relative to the wrist+second movement N of the wrist relative to the target position on the user's body.
可选地，所述的基于动作识别的目标控制方法，其中，所述将手指相对于手腕的第一运动M和手腕相对用户身体上目标位置的第二运动N进行叠加得到运动结果P具体包括：Optionally, in the target control method based on motion recognition, the motion result P obtained by superimposing the first motion M of the finger relative to the wrist and the second motion N of the wrist relative to the target position on the user's body specifically includes: :
将第一运动M沿三个互相垂直的方向分解为Mx、My、Mz；Decompose the first motion M into Mx, My, and Mz along three mutually perpendicular directions;
将第二运动N沿三个互相垂直的方向分解为Nx、Ny、Nz；Decompose the second motion N into Nx, Ny, and Nz along three mutually perpendicular directions;
将运动结果P沿三个互相垂直的方向分解为Px、Py、Pz；Decompose the motion result P into Px, Py, and Pz along three mutually perpendicular directions;
则运动结果P表示为：Then the motion result P is expressed as:
Px＝kx1*Mx+kx2*Nx；Px=kx1*Mx+kx2*Nx;
Py＝ky1*My+ky2*Ny；Py=ky1*My+ky2*Ny;
Pz＝kz1*Mz+kz2*Nz；Pz=kz1*Mz+kz2*Nz;
其中，kx1、kx2、ky1、ky2、kz1、kz2均为系数；Among them, kx1, kx2, ky1, ky2, kz1, kz2 are all coefficients;
根据运动结果P中的Px、Py和Pz控制目标设备；Control the target device according to Px, Py and Pz in the motion result P;
其中，第一运动M和第二运动N的分解在同一坐标系或者在不同坐标系。Wherein, the decomposition of the first motion M and the second motion N are in the same coordinate system or in different coordinate systems.
可选地，所述的基于动作识别的目标控制方法，其中，获取手腕相对于身体目标位置的第二运动的采集装置和获取手指相对于手腕的第一运动的传感器为同一个传感器。Optionally, in the target control method based on motion recognition, the acquisition device for acquiring the second movement of the wrist relative to the target position of the body and the sensor for acquiring the first movement of the finger relative to the wrist are the same sensor.
可选地，所述的基于动作识别的目标控制方法，其中，所述目标位置为用户身体上胸部或者胸口。Optionally, in the target control method based on motion recognition, the target position is the upper chest or the chest of the user's body.
此外，为实现上述目的，本发明还提供一种基于动作识别的目标控制系统，其中，所述基于动作识别的目标控制系统包括：目标、光学传感器和采集装置；In addition, in order to achieve the above object, the present invention also provides a target control system based on motion recognition, wherein the target control system based on motion recognition includes: a target, an optical sensor and a collection device;
基于手腕下部佩戴的光学传感器用于获取手指相对于手腕的第一运动；An optical sensor based on the lower part of the wrist is used to obtain the first movement of the finger relative to the wrist;
基于手腕上佩戴的采集装置用于获取手腕相对用户身体上目标位置的第二运动；The acquisition device based on the wrist is used to acquire the second movement of the wrist relative to the target position on the user's body;
将手指相对于手腕的第一运动和手腕相对用户身体上目标位置的第二运动进行叠加，根据叠加的运动结果控制目标。The first movement of the finger relative to the wrist and the second movement of the wrist relative to the target position on the user's body are superimposed, and the target is controlled according to the superimposed movement result.
本发明中，基于手腕下部佩戴的光学传感器，获取手指相对于手腕的第一运动；基于手腕上佩戴的采集装置，获取手腕相对用户身体上目标位置的第二运动；将手指相对于手腕的第一运动和手腕相对用户身体上目标位置的第二运动进行叠加，根据叠加的运动结果控制目标。本发明将手指相对于手腕的运动和手腕相对用户身体上目标位置的运动进行叠加后再控制目标，因为用户手部活动范围更大，这样可实现更大幅度和更加精细复杂的操控，避免手指动作过度放大导致过于明显的抖动，改善了操作体验。In the present invention, the first movement of the finger relative to the wrist is obtained based on the optical sensor worn on the lower part of the wrist; the second movement of the wrist relative to the target position on the user's body is obtained based on the collection device worn on the wrist; the first movement of the finger relative to the wrist is obtained. The first movement and the second movement of the wrist relative to the target position on the user's body are superimposed, and the target is controlled according to the superimposed movement result. The present invention superimposes the movement of the finger relative to the wrist and the movement of the wrist relative to the target position on the user's body, and then controls the target, because the user's hand has a larger range of motion, which can achieve larger and more sophisticated manipulation, avoiding the need for fingers Excessive magnification of the action leads to too obvious jitter, which improves the operating experience.
附图说明Description of drawings
图1是本发明基于动作识别的目标控制方法的较佳实施例的流程图。FIG. 1 is a flow chart of a preferred embodiment of the object control method based on motion recognition of the present invention.
具体实施方式Detailed ways
为使本发明的目的、技术方案及优点更加清楚、明确，以下参照附图并举实施例对本发明进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。In order to make the objectives, technical solutions and advantages of the present invention clearer and clearer, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
本发明较佳实施例所述的基于动作识别的目标控制方法，如图1所示，所述基于动作识别的目标控制方法包括以下步骤：The target control method based on motion recognition according to the preferred embodiment of the present invention, as shown in FIG. 1 , the target control method based on motion recognition includes the following steps:
步骤S10、基于手腕下部佩戴的光学传感器，获取手指相对于手腕的第一运动。Step S10 , acquiring the first movement of the finger relative to the wrist based on the optical sensor worn on the lower part of the wrist.
具体地，基于佩戴在用户手腕处的光学传感器(优选为3D光学传感器)感测来源于手指的光线；所述光学传感器基于所述光线获取手指的至少一个特征点的实时三维坐标(优选为手指尖)，以得到手指相对于手腕的第一运动。其中，光学传感器佩戴在用户手腕或小臂朝向手掌的一侧。Specifically, light from the finger is sensed based on an optical sensor (preferably a 3D optical sensor) worn on the user's wrist; the optical sensor obtains real-time three-dimensional coordinates (preferably a finger) of at least one feature point of the finger based on the light tip) to get the first movement of the fingers relative to the wrist. Among them, the optical sensor is worn on the side of the user's wrist or forearm facing the palm.
步骤S20、基于手腕上佩戴的采集装置，获取手腕相对用户身体上目标位置的第二运动。Step S20: Acquire a second movement of the wrist relative to the target position on the user's body based on the collection device worn on the wrist.
具体地，在使用者身体上佩戴至少一个配件，所述配件用于辅助穿戴设备本体测量自身相对于所述配件的空间位置和\或空间运动。Specifically, at least one accessory is worn on the user's body, and the accessory is used to assist the body of the wearable device to measure its spatial position and/or spatial movement relative to the accessory.
具体的，所述配件按照固定方式可以分为悬挂物、固定物、粘贴物、盛放物等，悬挂物例如吊坠，固定物例如别针、粘贴物例如贴纸，盛放物例如装在口袋里面的传感器。Specifically, the accessories can be divided into hanging objects, fixed objects, stickers, holding objects, etc. according to the fixing method, hanging objects such as pendants, fixed objects such as pins, stickers such as stickers, and holding objects such as pockets sensor.
所述配件按照工作原理可以分为电磁波定位、磁定位、声波定位等，电磁波定位例如信标、磁定位例如永磁铁、声波定位例如超声波发射器。The accessories can be classified into electromagnetic wave positioning, magnetic positioning, and acoustic wave positioning according to the working principle. Electromagnetic wave positioning such as beacons, magnetic positioning such as permanent magnets, and acoustic wave positioning such as ultrasonic transmitters.
所述配件按照是否主动发射信号可以分为主动式、被动式等，主动式例如超声波发射器，被动式例如二维码贴纸。The accessories can be divided into active type, passive type, etc. according to whether they actively transmit signals, active type such as ultrasonic transmitter, passive type such as two-dimensional code sticker.
所述佩戴在手腕上的采集装置通过采集来源于所述配件的信息来实现获取手腕相对于身体上目标位置的第二运动。The collection device worn on the wrist realizes the acquisition of the second movement of the wrist relative to the target position on the body by collecting information from the accessory.
具体的，凭借手腕上佩戴的采集装置获取的信息，即可计算出手腕相对于身体上目标位置的第二运动，而不需要佩戴在人体上的配件。例如所述采集装置为3D传感器，可以测量身体三维轮廓并识别出目标位置，从而计算出手腕相对于身体上目标位置的第二运动。Specifically, the second movement of the wrist relative to the target position on the body can be calculated based on the information obtained by the collection device worn on the wrist, without the need for accessories worn on the human body. For example, the acquisition device is a 3D sensor, which can measure the three-dimensional contour of the body and identify the target position, thereby calculating the second movement of the wrist relative to the target position on the body.
具体的，可以增加一个标定动作使得采集装置能更加准确地识别身体上的目标位置。标定动作的方法为：将采集装置采集到的部分身体信息设置为目标位置。例如采集装置为3D传感器，开启标定模式然后对着身体上的目标位置采集信息，则设备会将此时采集到的信息设置为目标位置；再例如先通过3D传感器采集了包含目标位置的信息，然后在采集到的信息中将目标位置标记出来。Specifically, a calibration action can be added so that the acquisition device can more accurately identify the target position on the body. The method for calibrating the action is: setting part of the body information collected by the collecting device as the target position. For example, the acquisition device is a 3D sensor, turn on the calibration mode and then collect information on the target position on the body, then the device will set the information collected at this time as the target position; for example, first collect the information including the target position through the 3D sensor, The target location is then marked in the collected information.
其中，所述光学传感器和所述采集装置可以均设置在一个智能可穿戴设备上，所述智能可穿戴设备佩戴在用户手腕上以采集手指相对于手腕的运动和手腕相对用户身体上目标位置的运动。Wherein, both the optical sensor and the collection device may be arranged on a smart wearable device, and the smart wearable device is worn on the user's wrist to collect the movement of the finger relative to the wrist and the movement of the wrist relative to the target position on the user's body. sports.
需要说明的是，其中步骤S10(获取手指相对于手腕的第一运动)和步骤S20(获取手腕相对用户身体上目标位置的第二运动)可以同时进行，不分先后。It should be noted that, step S10 (acquiring the first movement of the finger relative to the wrist) and step S20 (acquiring the second movement of the wrist relative to the target position on the user's body) may be performed simultaneously, in no particular order.
步骤S30、将手指相对于手腕的第一运动和手腕相对用户身体上目标位置的第二运动进行叠加，根据叠加的运动结果控制目标。Step S30: Superimpose the first movement of the finger relative to the wrist and the second movement of the wrist relative to the target position on the user's body, and control the target according to the superimposed movement result.
具体地，将手指相对于手腕的第一运动M和手腕相对用户身体上目标位置的第二运动N进行叠加得到运动结果P(P用来控制目标设备)，则运动结果P为：Specifically, the first movement M of the finger relative to the wrist and the second movement N of the wrist relative to the target position on the user's body are superimposed to obtain the movement result P (P is used to control the target device), then the movement result P is:
运动结果P＝手指相对于手腕的第一运动M+手腕相对用户身体上目标位置的第二运动N(即用户手指相对于胸口的运动＝手指相对于手腕的运动+手腕相对于胸口的运动)。Movement result P=first movement M of finger relative to wrist+second movement N of wrist relative to target position on user's body (ie, movement of user's finger relative to chest=movement of finger relative to wrist+movement of wrist relative to chest).
其中，M、N、P三个运动可以在某种坐标系下分解为几个分运动，这里的运动是物理里面位移的概念，包含距离和方向，以直角坐标系为例：Among them, the three movements of M, N, and P can be decomposed into several sub-movements in a certain coordinate system. The movement here is the concept of displacement in physics, including distance and direction. Take the Cartesian coordinate system as an example:
将第一运动M沿三个互相垂直的方向分解为Mx、My、Mz；Decompose the first motion M into Mx, My, and Mz along three mutually perpendicular directions;
将第二运动N沿三个互相垂直的方向分解为Nx、Ny、Nz；Decompose the second motion N into Nx, Ny, and Nz along three mutually perpendicular directions;
将运动结果P沿三个互相垂直的方向分解为Px、Py、Pz；Decompose the motion result P into Px, Py, and Pz along three mutually perpendicular directions;
则运动结果P可以表示为：Then the motion result P can be expressed as:
Px＝kx1*Mx+kx2*Nx；Px=kx1*Mx+kx2*Nx;
Py＝ky1*My+ky2*Ny；Py=ky1*My+ky2*Ny;
Pz＝kz1*Mz+kz2*Nz；Pz=kz1*Mz+kz2*Nz;
其中，kx1、kx2、ky1、ky2、kz1、kz2均为系数；Among them, kx1, kx2, ky1, ky2, kz1, kz2 are all coefficients;
上述六个系数可以有两个或者两个以上的相同，也可以全部都不相同，这六个系数是设计者根据经验来定，并且在控制不同的目标设备时可以换成另一组不同的系数，在不同的使用者使用时，也可以更换，这些系数意义在于对M、N两个运动，为控制目标所做的贡献(放大或者缩小)。Two or more of the above six coefficients can be the same, or all of them can be different. These six coefficients are determined by the designer according to experience, and can be replaced by another set of different when controlling different target devices. The coefficients can also be replaced when different users use them. The significance of these coefficients lies in the contribution (enlargement or reduction) of the two movements of M and N to the control target.
其中第一运动M和第二运动N的分解，可以在同一坐标系中分解，也可以在不同坐标系中分解。The decomposition of the first motion M and the second motion N may be decomposed in the same coordinate system, or may be decomposed in different coordinate systems.
上述举例为在直角坐标系下分解运动，也可以在极坐标系或者其他坐标系下分解。The above example is to decompose the motion in the Cartesian coordinate system, and it can also be decomposed in the polar coordinate system or other coordinate systems.
最后，根据运动结果P中的Px、Py和Pz控制目标。Finally, the target is controlled according to Px, Py and Pz in the motion result P.
具体的，获取手腕相对于身体目标位置的第二运动的采集装置可以和获取手指相对于手腕的第一运动的传感器为同一个传感器。例如使用一个3D传感器同时获取所述第一运动和第二运动，或者以某一间隔时间轮流获取所述第一运动和第二运动。Specifically, the acquisition device for acquiring the second movement of the wrist relative to the target position of the body may be the same sensor as the sensor for acquiring the first movement of the finger relative to the wrist. For example, a 3D sensor is used to acquire the first motion and the second motion simultaneously, or to acquire the first motion and the second motion alternately at a certain interval.
由于手腕相对于身体的运动范围较大，例如，手腕相对于身体左右移动的范围可以轻松达到80公分，叠加上手指相对于手腕左右移动的范围，可以达到1米，在这种情况下，左右方向的移动仅需放大2倍，即可完成对一个宽度达到2米的屏幕中内容的操控，即可以实现对更大屏幕的精细控制。Due to the large range of motion of the wrist relative to the body, for example, the range of left and right movement of the wrist relative to the body can easily reach 80 cm, and the range of the left and right movement of the finger relative to the wrist can reach 1 meter. The movement of the direction only needs to be enlarged by 2 times to complete the manipulation of the content on a screen with a width of 2 meters, that is, fine control of a larger screen can be realized.
进一步地，通过控制目标可用于实现人和其它设备之间的人机交互，例如实现设备的开关操作、设备画面切换、声音调整、文字输入、游戏控制等，也可以作为信号或者指令输出的对象，来控制该目标设备上一些功能，例如设备开关操作、设备中应用的打开或关闭、应用中画面的切换、应用中声音的调整等。Further, the control target can be used to realize human-computer interaction between people and other devices, such as device switch operation, device screen switching, sound adjustment, text input, game control, etc., and can also be used as the object of signal or command output. , to control some functions on the target device, such as device switch operation, opening or closing the application in the device, switching the screen in the application, adjusting the sound in the application, etc.
有益效果：Beneficial effects:
(1)放大倍率小，所以手指可以对其中内容做精细复杂的操控；(1) The magnification is small, so the fingers can do fine and complex manipulation of the content;
(2)放大倍率小，所以手指或者手腕微小的抖动，不会被放大到过于明显的程度，改善了使用体验；(2) The magnification is small, so the tiny shaking of fingers or wrists will not be magnified to an overly obvious level, which improves the user experience;
(3)可以用于需要更大幅度操控的设备。(3) Can be used for equipment that requires greater manipulation.
进一步地，基于上述基于动作识别的目标控制方法，本发明还相应提供了一种基于动作识别的目标控制系统，其中，所述基于动作识别的目标控制系统包括：目标、光学传感器和采集装置；基于手腕下部佩戴的光学传感器用于获取手指相对于手腕的第一运动；基于手腕上佩戴的采集装置用于获取手腕相对用户身体上目标位置的第二运动；将手指相对于手腕的第一运动和手腕相对用户身体上目标位置的第二运动进行叠加，根据叠加的运动结果控制目标。Further, based on the above-mentioned target control method based on motion recognition, the present invention also provides a target control system based on motion recognition, wherein the target control system based on motion recognition includes: a target, an optical sensor and a collection device; The optical sensor based on the lower part of the wrist is used to acquire the first movement of the finger relative to the wrist; the acquisition device based on the wrist is used to acquire the second movement of the wrist relative to the target position on the user's body; the first movement of the finger relative to the wrist is used to acquire It is superimposed with the second movement of the wrist relative to the target position on the user's body, and the target is controlled according to the superimposed movement result.
综上所述，本发明提供一种基于动作识别的目标控制方法及系统，所述方法包括：基于手腕下部佩戴的光学传感器，获取手指相对于手腕的第一运动；基于手腕上佩戴的采集装置，获取手腕相对用户身体上目标位置的第二运动；将手指相对于手腕的第一运动和手腕相对用户身体上目标位置的第二运动进行叠加，根据叠加的运动结果控制目标。现有技术中仅通过检测手指相对于手腕的第一运动来控制目标，当需要进行大幅度的控制时，需要将手指的运动进行放大，这样手指微小的抖动会被放大到过于明显的程度，影响使用体验。本发明将手指相对于手腕的运动和手腕相对用户身体上目标位置的运动进行叠加后再控制目标，这样用户手部活动范围更大，可实现更大幅度的操控，且放大倍率小可以对目标进行精细复杂的操控，并且手指或者手腕微小的抖动不会被放大到过于明显的程度，改善了操作体验。In summary, the present invention provides a target control method and system based on motion recognition, the method includes: acquiring the first movement of the finger relative to the wrist based on an optical sensor worn on the lower part of the wrist; based on a collection device worn on the wrist , obtain the second movement of the wrist relative to the target position on the user's body; superimpose the first movement of the finger relative to the wrist and the second movement of the wrist relative to the target position on the user's body, and control the target according to the superimposed movement result. In the prior art, the target is only controlled by detecting the first movement of the finger relative to the wrist. When a large-scale control is required, the movement of the finger needs to be amplified, so that the tiny shaking of the finger will be amplified to an excessively obvious degree. affect the user experience. The present invention superimposes the movement of the finger relative to the wrist and the movement of the wrist relative to the target position on the user's body and then controls the target, so that the user's hand has a wider range of motion, and can achieve greater control, and the small magnification can be used to target the target. Perform delicate and complex manipulations, and the tiny shaking of fingers or wrists will not be magnified to an overly obvious level, improving the operating experience.
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.
当然，本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关硬件(如处理器，控制器等)来完成，所述的程序可存储于一计算机可读取的计算机可读存储介质中，所述程序在执行时可包括如上述各方法实施例的流程。其中所述的计算机可读存储介质可为存储器、磁碟、光盘等。Of course, those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware (such as processors, controllers, etc.) through a computer program, and the programs can be stored in a In a computer-readable computer-readable storage medium, the program, when executed, may include the processes of the foregoing method embodiments. The computer-readable storage medium may be a memory, a magnetic disk, an optical disk, or the like.
应当理解的是，本发明的应用不限于上述的举例，对本领域普通技术人员来说，可以根据上述说明加以改进或变换，所有这些改进和变换都应属于本发明所附权利要求的保护范围。It should be understood that the application of the present invention is not limited to the above examples. For those of ordinary skill in the art, improvements or transformations can be made according to the above descriptions, and all these improvements and transformations should belong to the protection scope of the appended claims of the present invention.
Claims (10)
Translated fromChinesePriority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210405585.XACN115016635B (en) | 2022-04-18 | 2022-04-18 | A target control method and system based on motion recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210405585.XACN115016635B (en) | 2022-04-18 | 2022-04-18 | A target control method and system based on motion recognition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115016635Atrue CN115016635A (en) | 2022-09-06 |
| CN115016635B CN115016635B (en) | 2025-02-07 |
Family
ID=83067081
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210405585.XAActiveCN115016635B (en) | 2022-04-18 | 2022-04-18 | A target control method and system based on motion recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115016635B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005352739A (en)* | 2004-06-10 | 2005-12-22 | Nec Corp | Portable terminal device, input system and information input method |
| US20110054360A1 (en)* | 2009-08-27 | 2011-03-03 | Electronics And Telecommunications Research Institute | Finger motion detecting apparatus and method |
| CN104460992A (en)* | 2014-11-20 | 2015-03-25 | 大连理工大学 | Device and method for finger motion detection using infrared rays to irradiate wrist ligaments |
| WO2015084082A1 (en)* | 2013-12-04 | 2015-06-11 | 주식회사 퓨처플레이 | Method, device and system for recognizing posture or motion, and non-temporary computer-readable recording medium |
| CN104820498A (en)* | 2015-05-14 | 2015-08-05 | 周谆 | Man-machine interactive method and system for trying on virtual hand accessories |
| CN205540575U (en)* | 2016-03-14 | 2016-08-31 | 北京诺亦腾科技有限公司 | A motion capture gloves and virtual reality system for virtual reality system |
| CN107209582A (en)* | 2014-12-16 | 2017-09-26 | 肖泉 | The method and apparatus of high intuitive man-machine interface |
| US20170315620A1 (en)* | 2014-11-21 | 2017-11-02 | Abhishek | System and Method for Data and Command Input |
| US20180150186A1 (en)* | 2015-05-21 | 2018-05-31 | Nec Corporation | Interface control system, interface control apparatus, interface control method, and program |
| CN109692471A (en)* | 2018-12-29 | 2019-04-30 | 歌尔科技有限公司 | A kind of wearable device and exchange method |
| CN111563459A (en)* | 2020-05-09 | 2020-08-21 | 胡团伟 | Finger motion acquisition method and finger motion acquisition equipment |
| US20220019283A1 (en)* | 2018-12-11 | 2022-01-20 | Sony Group Corporation | Ultrasonic user interface device |
- 2022
- 2022-04-18CNCN202210405585.XApatent/CN115016635B/enactiveActive
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005352739A (en)* | 2004-06-10 | 2005-12-22 | Nec Corp | Portable terminal device, input system and information input method |
| US20110054360A1 (en)* | 2009-08-27 | 2011-03-03 | Electronics And Telecommunications Research Institute | Finger motion detecting apparatus and method |
| WO2015084082A1 (en)* | 2013-12-04 | 2015-06-11 | 주식회사 퓨처플레이 | Method, device and system for recognizing posture or motion, and non-temporary computer-readable recording medium |
| CN104460992A (en)* | 2014-11-20 | 2015-03-25 | 大连理工大学 | Device and method for finger motion detection using infrared rays to irradiate wrist ligaments |
| US20170315620A1 (en)* | 2014-11-21 | 2017-11-02 | Abhishek | System and Method for Data and Command Input |
| CN107209582A (en)* | 2014-12-16 | 2017-09-26 | 肖泉 | The method and apparatus of high intuitive man-machine interface |
| CN104820498A (en)* | 2015-05-14 | 2015-08-05 | 周谆 | Man-machine interactive method and system for trying on virtual hand accessories |
| US20180150186A1 (en)* | 2015-05-21 | 2018-05-31 | Nec Corporation | Interface control system, interface control apparatus, interface control method, and program |
| CN205540575U (en)* | 2016-03-14 | 2016-08-31 | 北京诺亦腾科技有限公司 | A motion capture gloves and virtual reality system for virtual reality system |
| US20220019283A1 (en)* | 2018-12-11 | 2022-01-20 | Sony Group Corporation | Ultrasonic user interface device |
| CN109692471A (en)* | 2018-12-29 | 2019-04-30 | 歌尔科技有限公司 | A kind of wearable device and exchange method |
| CN111563459A (en)* | 2020-05-09 | 2020-08-21 | 胡团伟 | Finger motion acquisition method and finger motion acquisition equipment |
| WO2021227651A1 (en)* | 2020-05-09 | 2021-11-18 | 胡团伟 | Finger action acquisition method and finger action acquisition device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115016635B (en) | 2025-02-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20240272723A1 (en) | Hand gesture input for wearable system | |
| US10534431B2 (en) | Tracking finger movements to generate inputs for computer systems | |
| Quek | Eyes in the interface | |
| US20110148755A1 (en) | User interface apparatus and user interfacing method based on wearable computing environment | |
| US20100103104A1 (en) | Apparatus for user interface based on wearable computing environment and method thereof | |
| KR101318244B1 (en) | System and Method for Implemeting 3-Dimensional User Interface | |
| CN104331154B (en) | Realize the man-machine interaction method and system of non-contact type mouse control | |
| JP2010108500A (en) | User interface device for wearable computing environmental base, and method therefor | |
| CN109243575B (en) | Virtual acupuncture method and system based on mobile interaction and augmented reality | |
| CN102402290A (en) | Method and system for identifying posture of body | |
| US11054923B2 (en) | Automatic switching between different modes of tracking user motions to control computer applications | |
| US20230031200A1 (en) | Touchless, Gesture-Based Human Interface Device | |
| KR20200051938A (en) | Method for controlling interaction in virtual reality by tracking fingertips and VR system using it | |
| Oh et al. | FingerTouch: Touch interaction using a fingernail-mounted sensor on a head-mounted display for augmented reality | |
| Yi et al. | Magnetic motion tracking for natural human computer interaction: A review | |
| Boruah et al. | Development of a learning-aid tool using hand gesture based human computer interaction system | |
| CN109960404B (en) | Data processing method and device | |
| TW202335707A (en) | Motion computing system and method for mixed reality | |
| CN202512510U (en) | Limb gesture identification system | |
| US11635823B1 (en) | Detecting user input from multi-modal hand bio-metrics | |
| Prasad et al. | A wireless dynamic gesture user interface for HCI using hand data glove | |
| JP2022142624A (en) | Detection processing device, detection processing method, and information processing system | |
| CN115016635A (en) | A target control method and system based on action recognition | |
| EP4246289A1 (en) | Detecting user input from multi-modal hand bio-metrics | |
| KR102322968B1 (en) | a short key instruction device using finger gestures and the short key instruction method using thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |