技术领域technical field
本发明涉及一种触控系统，且特别涉及一种光学触控系统以及其物件分析方法。The invention relates to a touch control system, and in particular to an optical touch control system and its object analysis method.
背景技术Background technique
随着触控技术的发展，面板逐渐与显示设备整合形成触摸屏，以供使用者直接通过触控方式进行输入操作。光学触控系统因具有高准确度、可靠度佳、损坏率低、支持多点触控以及反应速度快且不受面板制造技术的影响等优点，目前已广泛地应用于各类中大型电子显示产品，例如游客导览系统或工业控制系统。With the development of touch technology, panels are gradually integrated with display devices to form touch screens for users to directly perform input operations through touch. The optical touch system has been widely used in various medium and large electronic displays due to its advantages of high accuracy, good reliability, low damage rate, multi-touch support, fast response speed and no influence of panel manufacturing technology. Products such as tourist guide systems or industrial control systems.
目前光学触控系统包括至少一影像感测器以及多个发光二极管，例如红外光发光二极管(Infrared Light Emitting Diode，IR LED)。在光学触控系统运行时，上述发光二极管会发出光线照射光学触控系统的触控平面。当一物件，例如手指或是触控笔，接触该触控平面时，该物件会遮蔽部份光线而于触控平面形成遮蔽阴影。光学触控系统会利用影像感测器撷取横跨触控平面的影像，并根据所撷取影像中是否存在阴影以及阴影成像位置计算出物件相对于触控平面上的位置，进而达到触控操作的功能。The current optical touch system includes at least one image sensor and a plurality of light emitting diodes, such as infrared light emitting diodes (Infrared Light Emitting Diode, IR LED). When the optical touch system is running, the LEDs emit light to illuminate the touch plane of the optical touch system. When an object, such as a finger or a stylus, touches the touch surface, the object will block part of the light and form a shadow on the touch surface. The optical touch system uses the image sensor to capture images across the touch plane, and calculates the position of the object relative to the touch plane based on whether there is a shadow in the captured image and the shadow imaging position, thereby achieving touch control. function of the operation.
发明内容Contents of the invention
本发明实施例提供一种光学触控系统以及其物件分析方法，此物件分析方法可快速且准确地判断接近光学触控系统的触控平面的物件是触碰触控平面或悬浮于触控平面，以此有效提升光学触控系统中触控点的识别率。An embodiment of the present invention provides an optical touch system and an object analysis method thereof. The object analysis method can quickly and accurately determine whether an object close to the touch surface of the optical touch system touches the touch surface or floats on the touch surface. , so as to effectively improve the recognition rate of touch points in the optical touch system.
本发明实施例提供一种光学触控系统的物件分析方法，此物件分析方法包括下列步骤。首先，驱动一影像感测装置撷取横跨该触控面的第一影像。所述第一影像具有对应该指示物的一物件影像。接着，在所述第一影像中定义出对应该物件影像的一影像区域。而后，根据影像区域中多个像素之间的亮度差异，判断该指示物是否触碰触控面或是悬浮于触控面。当判断该指示物触碰触控面时，根据第一影像中该物件影像的成像位置，计算该指示物相对于该面板的一触控坐标。An embodiment of the present invention provides an object analysis method for an optical touch system, and the object analysis method includes the following steps. First, an image sensing device is driven to capture a first image across the touch surface. The first image has an object image corresponding to the pointer. Next, an image area corresponding to the object image is defined in the first image. Then, according to the brightness difference among the pixels in the image area, it is judged whether the pointer touches the touch surface or floats on the touch surface. When it is determined that the pointer touches the touch surface, a touch coordinate of the pointer relative to the panel is calculated according to the imaging position of the object image in the first image.
本发明实施例另提供一种光学触控系统的物件分析方法，其中光学触控系统包括面板、第一影像感测装置以及第二影像感测装置。所述第一影像感测装置与第二影像感测装置是分别设置于面板上不同位置，且具有重叠的影像感测范围。所述物件分析方法包括下列步骤。首先，驱动第一影像感测装置以及第二影像感测装置撷取对应面板的触控面的第一背景影像以及第二背景影像。而后，驱动第一影像感测装置以及第二影像感测装置分别撷取横跨该触控面的第一影像及第二影像。所述第一影像具有对应该指示物的第一物件影像，而所述第二影像具有对应该指示物的第二物件影像。接着，在第一影像中定义出对应第一物件影像的第一影像区域。而在第二影像中定义出对应第二物件影像的第二影像区域。随后，分别根据第一影像区域以及第二影像区域中多个像素之间的亮度差异，判断指示物是触碰触控面或是悬浮于触控面。An embodiment of the present invention further provides an object analysis method for an optical touch system, wherein the optical touch system includes a panel, a first image sensing device, and a second image sensing device. The first image sensing device and the second image sensing device are respectively arranged at different positions on the panel, and have overlapping image sensing ranges. The object analysis method includes the following steps. First, the first image sensing device and the second image sensing device are driven to capture a first background image and a second background image corresponding to the touch surface of the panel. Then, the first image sensing device and the second image sensing device are driven to respectively capture a first image and a second image across the touch surface. The first image has a first object image corresponding to the pointer, and the second image has a second object image corresponding to the pointer. Next, a first image area corresponding to the first object image is defined in the first image. A second image area corresponding to the second object image is defined in the second image. Subsequently, it is judged whether the pointer touches the touch surface or floats on the touch surface according to the brightness difference between the plurality of pixels in the first image area and the second image area respectively.
本发明实施例还提供一种光学触控系统，且所述光学触控系统耦接一影像显示设备。所述光学触控系统包括一面板、至少一发光源、一反光镜、至少一反光单元、影像感测装置以及处理单元。所述面板具有一触控面。该至少一发光元件用以产生一光线照亮该触控面。所述反光镜用以产生该面板的镜像。该至少一反光单元用以反射该发光元件产生的该光线。影像感测装置用以撷取横跨该触控面的多张影像，且该多个影像的至少其中之一具有对应指示物的一物件影像以及一镜像。处理单元耦接影像感测装置以及该发光元件。当处理单元驱动该影像感测装置撷取横跨该触控面的一第一影像，且所述第一影像具有对应该指示物的该物件影像以及该镜像时，处理单元在该第一影像中定义对应该物件影像的一影像区域。处理单元根据影像区域内多个像素之间的亮度差异，判断该指示物是否触碰触控面或是悬浮于触控面。处理单元并根据判断结果，决定是否计算该指示物相对于该面板的一触控坐标。An embodiment of the present invention also provides an optical touch system, and the optical touch system is coupled to an image display device. The optical touch system includes a panel, at least one light source, a mirror, at least one reflective unit, an image sensing device and a processing unit. The panel has a touch surface. The at least one light emitting element is used for generating a light to illuminate the touch surface. The mirror is used to create a mirror image of the panel. The at least one reflective unit is used for reflecting the light generated by the light emitting element. The image sensing device is used to capture a plurality of images across the touch surface, and at least one of the plurality of images has an object image corresponding to the pointer and a mirror image. The processing unit is coupled to the image sensing device and the light emitting element. When the processing unit drives the image sensing device to capture a first image across the touch surface, and the first image has the object image corresponding to the pointer and the mirror image, the processing unit captures a first image on the first image Defines an image region corresponding to the object image in . The processing unit judges whether the indicator touches the touch surface or floats on the touch surface according to the brightness difference among the pixels in the image area. The processing unit determines whether to calculate a touch coordinate of the pointer relative to the panel according to the judgment result.
本发明实施例还提供一种非瞬时的计算机可读取媒体(non-transitorycomputer readable medium)，此非瞬时式计算机可读取媒体用以记录一组计算机可执行程序，当计算机可读取记录媒体被处理器读取时，处理器可执行上述光学触控系统的物件分析方法中的该多个步骤。The embodiment of the present invention also provides a non-transitory computer readable medium (non-transitory computer readable medium). The non-transitory computer readable medium is used to record a set of computer executable programs. When the computer readable recording medium When read by the processor, the processor can execute the steps in the object analysis method of the optical touch system.
综上所述，本发明实施例提供一种光学触控系统以及其物件分析方法，所述物件分析方法可根据所撷取的横跨触控面的影像中遮蔽区域的亮度分布信息，快速且准确地判断检测到的物件是触碰触控平面或悬浮于触控面，有效辨识指示物的触控状态。所述物件分析方法并可根据判断结果，决定是否计算检测到的物件的触控坐标，进而有效提升光学触控系统中触控点识别率与运行效率。To sum up, the embodiments of the present invention provide an optical touch system and its object analysis method. The object analysis method can quickly and accurately according to the brightness distribution information of the shadowed area in the captured image across the touch surface. Accurately determine whether the detected object touches the touch surface or floats on the touch surface, and effectively identifies the touch state of the pointer. The object analysis method can also determine whether to calculate the touch coordinates of the detected object according to the judgment result, so as to effectively improve the touch point recognition rate and operating efficiency in the optical touch system.
上文以概略地叙述本发明的技术特征及所达到的技术效果，为使能更进一步了解本发明的特征及技术内容，请参阅以下有关本发明的详细说明与附图，但是此等说明与所附图式仅是用来说明本发明，而非对本发明的权利范围作任何的限制。The technical characteristics and the technical effects achieved are briefly described above. For enabling a further understanding of the characteristics and technical contents of the present invention, please refer to the following detailed description and accompanying drawings of the present invention. The accompanying drawings are only used to illustrate the present invention, but not to limit the scope of rights of the present invention.
附图说明Description of drawings
图1是本发明实施例提供的光学触控系统的系统结构示意图。FIG. 1 is a schematic diagram of the system structure of an optical touch system provided by an embodiment of the present invention.
图2A是本发明实施例提供的影像感测装置所撷取的具有物件影像的示意图。FIG. 2A is a schematic diagram of an image of an object captured by the image sensing device provided by an embodiment of the present invention.
图2B是本发明实施例提供的影像感测装置所撷取另一具有物件影像的二维影像的示意图。FIG. 2B is a schematic diagram of another two-dimensional image with an object image captured by the image sensing device according to an embodiment of the present invention.
图3A是本发明实施例提供的影像感测装置撷取的背景影像及其对应的亮度曲线的示意图。3A is a schematic diagram of a background image captured by the image sensing device and its corresponding brightness curve according to an embodiment of the present invention.
图3B是本发明实施例提供的影像感测装置所撷取的具有物件影像的二维影像的示意图。FIG. 3B is a schematic diagram of a two-dimensional image with an object image captured by the image sensing device according to an embodiment of the present invention.
图3C是对应图3B所示的二维影像的亮度曲线的示意图。FIG. 3C is a schematic diagram of a brightness curve corresponding to the 2D image shown in FIG. 3B .
图4A～图4B分别是本发明另一实施例提供的影像感测装置所撷取的具有物件影像的二维影像的示意图。4A-4B are schematic diagrams of two-dimensional images with object images captured by an image sensing device according to another embodiment of the present invention.
图5A是本发明实施例提供的光学触控系统的操作示意图。FIG. 5A is a schematic diagram of the operation of the optical touch system provided by the embodiment of the present invention.
图5B是对应图5A的影像感测装置所撷取的部分影像的示意图。FIG. 5B is a schematic diagram of a partial image captured by the image sensing device corresponding to FIG. 5A .
图6是本发明实施例提供的光学触控系统的物件分析方法的流程示意图。FIG. 6 is a schematic flowchart of an object analysis method for an optical touch system provided by an embodiment of the present invention.
图7是本发明另一实施例提供的光学触控系统的物件分析方法的流程示意图。FIG. 7 is a schematic flowchart of an object analysis method for an optical touch system according to another embodiment of the present invention.
图8是本发明另一实施例提供的光学触控系统的物件分析方法的流程示意图。FIG. 8 is a schematic flowchart of an object analysis method for an optical touch system according to another embodiment of the present invention.
图9是本发明实施例提供的影像感测装置所撷取的具有物件影像的二维影像的示意图。FIG. 9 is a schematic diagram of a two-dimensional image with an object image captured by the image sensing device according to an embodiment of the present invention.
图10是本发明另一实施例提供的光学触控系统的物件分析方法的流程示意图。FIG. 10 is a schematic flowchart of an object analysis method for an optical touch system according to another embodiment of the present invention.
图11是本发明另一实施例提供的光学触控系统的物件分析方法的流程示意图。FIG. 11 is a schematic flowchart of an object analysis method for an optical touch system according to another embodiment of the present invention.
图12是本发明实施例提供的背景影像中强光区域界定方法的流程示意图。FIG. 12 is a schematic flowchart of a method for defining a strong light area in a background image provided by an embodiment of the present invention.
图13是本发明另一实施例提供的光学触控系统的系统结构示意图。FIG. 13 is a schematic diagram of the system structure of an optical touch system provided by another embodiment of the present invention.
图14A～图14B是本发明另一实施例提供的影像感测装置所撷取的具有物件影像的影像的示意图。14A-14B are schematic diagrams of images with object images captured by an image sensing device according to another embodiment of the present invention.
图15是本发明实施例提供的光学触控系统的物件分析方法的流程示意图。FIG. 15 is a schematic flowchart of an object analysis method for an optical touch system according to an embodiment of the present invention.
其中，附图标记说明如下：Wherein, the reference signs are explained as follows:
1、3：光学触控系统1, 3: Optical touch system
11：面板11: panel
110：触控面110: Touch surface
111：第一边缘111: First Edge
113：第二边缘113: Second Edge
115：第三边缘115: Third Edge
117：第四边缘117: Fourth Edge
120：发光元件120: light emitting element
130：反光镜130: Mirror
140：第一反光单元140: The first reflective unit
150：第二反光单元150: Second reflective unit
310：第三反光单元310: The third reflective unit
12：影像感测装置12: Image sensing device
12a：第一影像感测装置12a: the first image sensing device
12b：第二影像感测装置12b: the second image sensing device
13：处理单元13: Processing unit
14：存储单元14: storage unit
15：传输单元15: Transmission unit
16：影像显示设备16: Image display device
161：光标161: Cursor
2：使用者2: User
21：手指21: fingers
DR：背景区域DR: background area
BR：强光区域BR: Strong light area
H：触控感测区域的高度H: the height of the touch sensing area
P1～PN：像素P1～PN: pixel
F1～F8、FB：影像F1～F8, FB: Image
I21、I21’、I21a、I21b、I41、ITP、ITP’：物件影像I21, I21’, I21a, I21b, I41, ITP, ITP’: object image
LB、LB1、LB2：左边界LB, LB1, LB2: left border
RB、RB1、RB2：右边界RB, RB1, RB2: right border
H_UB：强光上边界H_UB: Hard Light Upper Boundary
H_LB：强光下边界H_LB: Hard Light Lower Boundary
IA、IA’、IA1、IA2：影像区域IA, IA’, IA1, IA2: Image area
IS：虚像空间IS: virtual image space
RS：实像空间RS: real image space
TP：触控点位置TP: touch point position
TP’：触控点的镜像位置TP': mirror position of the touch point
120’：发光元件的镜像120': mirror image of light-emitting element
140’：第一反光单元的镜像140': mirror image of the first reflective unit
150’：第二反光单元的镜像150': mirror image of the second reflective unit
SL：第一感测路线SL: First Sensing Line
SL’：第二感测路线SL’: second sensing line
D1、D2、D3：距离D1, D2, D3: Distance
A1、A2：夹角A1, A2: included angle
L：像素行数量L: number of pixel rows
VA：视野范围VA: field of view
i：第i像素行i: i-th pixel row
C10、C20、C30：曲线C10, C20, C30: curves
S601～S609：步骤流程S601～S609: step process
S701～S709：步骤流程S701～S709: step process
S801～S807：步骤流程S801～S807: step process
S1001～S1007：步骤流程S1001～S1007: Step flow
S1101～S1107：步骤流程S1101～S1107: Step flow
S1201～S1209：步骤流程S1201～S1209: Step flow
S1501～S1515：步骤流程S1501～S1515: Step process
具体实施方式Detailed ways
在下文中，将通过附图说明本发明的各种例示实施例来详细描述本发明。然而，本发明所述的概念可以有许多不同形式来体现，且不应解释为限于本文中所阐述的例示性实施例。此外，在图式中相同参考数字可用以表示类似的元件。Hereinafter, the present invention will be described in detail by illustrating various exemplary embodiments of the invention with reference to the accompanying drawings. However, the concepts described herein may be embodied in many different forms and should not be construed as limited to the illustrative embodiments set forth herein. Furthermore, the same reference numbers may be used to denote similar elements in the drawings.
本发明的光学触控系统可主动在影像感测装置所撷取到具有对应一指示物的物件影像的影像中定义一影像区域，并根据影像区域内的像素亮度分布信息，准确地判断靠近或接近光学触控系统的触控区域的该指示物是触碰(touching)光学触控系统的触控平面或是悬浮(hovering)于触控平面。以此，有效提升光学触控系统中触控点识别率与触控灵敏度的运行。The optical touch system of the present invention can actively define an image area in the image captured by the image sensing device and has an object image corresponding to a pointer, and accurately judge whether it is approaching or not according to the pixel brightness distribution information in the image area The pointer approaching the touch area of the optical touch system is touching or hovering on the touch plane of the optical touch system. In this way, the operation of touch point recognition rate and touch sensitivity in the optical touch system is effectively improved.
〔光学触控系统的实施例〕[Example of Optical Touch System]
请参照图1，图1显示本发明实施例提供的光学触控系统的系统结构示意图。光学触控系统1用以感测至少一指示物(pointer)的触控位置。在本实施例中，所述指示物为使用者2的手指21，但在其他实施方式中，所述指示物可例如为触控笔(stylus)或触控杆等触控物件，但本发明并不限制。Please refer to FIG. 1 , which shows a schematic diagram of the system structure of an optical touch system provided by an embodiment of the present invention. The optical touch system 1 is used for sensing the touch position of at least one pointer. In this embodiment, the pointer is the finger 21 of the user 2, but in other implementations, the pointer can be a touch object such as a stylus or a touch stick, but the present invention Not limited.
光学触控系统1包括面板11、影像感测装置12、发光元件120、反光镜130、第一反光单元140、第二反光单元150、处理单元13、存储单元14、传输单元15以及影像显示设备16。发光元件120、影像感测装置12、存储单元14、传输单元15以及影像显示设备16分别耦接于处理单元13。The optical touch system 1 includes a panel 11, an image sensing device 12, a light emitting element 120, a mirror 130, a first reflective unit 140, a second reflective unit 150, a processing unit 13, a storage unit 14, a transmission unit 15 and an image display device 16. The light emitting element 120 , the image sensing device 12 , the storage unit 14 , the transmission unit 15 and the image display device 16 are respectively coupled to the processing unit 13 .
简单来说，在光学触控系统1运行时，处理单元13会对应控制发光元件120、影像感测装置12、存储单元14以及传输单元15的运行。处理单元13并会根据影像感测装置12的感测结果，对应控制影像显示设备16上光标161的动作。To put it simply, when the optical touch system 1 is running, the processing unit 13 will correspondingly control the operation of the light emitting element 120 , the image sensing device 12 , the storage unit 14 and the transmission unit 15 . The processing unit 13 will correspondingly control the movement of the cursor 161 on the image display device 16 according to the sensing result of the image sensing device 12 .
影像感测装置12、发光元件120、反光镜130、第一反光单元140以及第二反光单元150皆配置在面板11上。所述面板11可例如为一白板(whiteboard)、透明板(例如玻璃板或塑料板)或一触控屏幕(touch screen)。The image sensing device 12 , the light emitting element 120 , the reflector 130 , the first reflective unit 140 and the second reflective unit 150 are all disposed on the panel 11 . The panel 11 can be, for example, a whiteboard, a transparent board (such as a glass board or a plastic board) or a touch screen.
在本实施例中，所述面板11为一反光镜或一反光面。所述面板11实质上为一块矩形板。所述面板11具有一触控面110，且触控面110的形状也为矩形。具体地说，触控面110具四条直线边缘，也即第一边缘111、第二边缘113、相对于第一边缘111的第三边缘115以及相对于第二边缘113的第四边缘117。第一边缘111与第二边缘113相交，形成第一角落(firstcorner)；第一边缘111与第四边缘117相交，形成第二角落(second corner)；第二边缘113与第三边缘115相交，形成第三角落(third corner)；第三边缘115与第四边缘117相交，形成第四角落(fourth corner)。In this embodiment, the panel 11 is a mirror or a reflective surface. The panel 11 is substantially a rectangular plate. The panel 11 has a touch surface 110 , and the shape of the touch surface 110 is also rectangular. Specifically, the touch surface 110 has four straight edges, namely a first edge 111 , a second edge 113 , a third edge 115 opposite to the first edge 111 , and a fourth edge 117 opposite to the second edge 113 . The first edge 111 intersects with the second edge 113 to form a first corner; the first edge 111 intersects with the fourth edge 117 to form a second corner; the second edge 113 intersects with the third edge 115, A third corner is formed; the third edge 115 intersects with the fourth edge 117 to form a fourth corner.
触控面110、发光元件120、反光镜130、第一反光单元140以及第二反光单元150所包围的区域为光学触控系统1的触控感测区TR。所述触控感测区TR具有一高度H，其中高度H是依据光学触控系统1的实际结构与操作需求来设置。The area surrounded by the touch surface 110 , the light emitting element 120 , the reflector 130 , the first reflective unit 140 and the second reflective unit 150 is the touch sensing region TR of the optical touch system 1 . The touch sensing region TR has a height H, wherein the height H is set according to the actual structure and operation requirements of the optical touch system 1 .
发光元件120是设置在触控面110的第一边缘111。发光元件120用以提供光学触控系统1运作时所需光源。发光元件120用以发出不可见光(invisible light)，例如红外光(infrared light)或紫外光(ultraviolet light)，照亮整个触控面110。The light emitting element 120 is disposed on the first edge 111 of the touch surface 110 . The light emitting element 120 is used to provide the light source required for the operation of the optical touch system 1 . The light emitting element 120 is used to emit invisible light, such as infrared light or ultraviolet light, to illuminate the entire touch surface 110 .
在一实施方式中，发光元件120可包括多个发光体，且该多个发光体是沿触控面110的第一边缘111排列。在另一实施方式中，发光元件120也可包括一发光体与一导光元件(light guide)，例如导光板。发光体将产生光线以散射方式散布至整个导光元件，并由导光元件将光线均匀射出至触控面110上。所述发光体可例如为红外光发光二极管(IR LED)或紫外光二极管(UV LED)。值得一提的是，发光元件120所发出的光线也可以是可见光(visible light)。要说明的是，发光元件120的实际实施方式可依据光学触控系统1的实际操作需求来设置，本实施例并不限制。In one embodiment, the light emitting element 120 may include a plurality of illuminants, and the plurality of illuminants are arranged along the first edge 111 of the touch surface 110 . In another embodiment, the light emitting element 120 may also include a luminous body and a light guide, such as a light guide plate. The light produced by the illuminant is diffused to the entire light guide element in a scattering manner, and the light is evenly emitted to the touch surface 110 by the light guide element. The illuminant can be, for example, an infrared light emitting diode (IR LED) or an ultraviolet light diode (UV LED). It is worth mentioning that the light emitted by the light emitting element 120 may also be visible light. It should be noted that the actual implementation of the light emitting element 120 can be set according to the actual operation requirements of the optical touch system 1 , which is not limited by this embodiment.
反光镜130是设置于触控面110的第四边缘117上，且反光镜130是凸出于触控面110上。具体地说，反光镜130在本实施例中是由触控面110往触控面110的上方延伸高度H。反光镜130包含一反光镜面，且反光镜面面向触控面110，以反射发光元件120发出的不可见光至触控面110。The reflective mirror 130 is disposed on the fourth edge 117 of the touch surface 110 , and the reflective mirror 130 protrudes from the touch surface 110 . Specifically, in this embodiment, the reflector 130 extends a height H from the touch surface 110 to above the touch surface 110 . The reflective mirror 130 includes a reflective mirror surface, and the reflective mirror surface faces the touch surface 110 to reflect the invisible light emitted by the light emitting element 120 to the touch surface 110 .
反光镜130同时用以形成对应触控感测区TR的镜像(mirror image)，并产生在触控面110上进行操作的指示物的镜像(未显示于图1)。反光镜130可以是利用一平面反射镜(plane mirror)来实现，且反光镜130的镜面朝向触控感测区TR。The reflector 130 is also used to form a mirror image corresponding to the touch sensing region TR, and to generate a mirror image of the pointer operating on the touch surface 110 (not shown in FIG. 1 ). The reflective mirror 130 may be realized by using a plane mirror, and the mirror surface of the reflective mirror 130 faces the touch sensing region TR.
第一反光单元140是设置于触控面110的第三边缘115上。The first reflective unit 140 is disposed on the third edge 115 of the touch surface 110 .
第二反光单元150是设置于触控面110的第二边缘113。第一反光单元140与第二反光单元150分别凸出于触控面110上。第一反光单元140与第二反光单元150可例如为一反光布，且分别朝向触控感测区TR，以反射发光元件120所发出的光线。第一反光单元140与第二反光单元150分别是由触控面110往触控面110的上方延伸高度H。The second reflective unit 150 is disposed on the second edge 113 of the touch surface 110 . The first reflective unit 140 and the second reflective unit 150 respectively protrude from the touch surface 110 . The first reflective unit 140 and the second reflective unit 150 can be, for example, a reflective cloth, and respectively face the touch sensing region TR to reflect the light emitted by the light emitting element 120 . The first reflective unit 140 and the second reflective unit 150 respectively extend a height H from the touch surface 110 to above the touch surface 110 .
在本实施例中，反光镜130、第一与第二反光单元140、150的高度皆为H，但应了解反光镜130、第一、第二反光单元140、150的高度也可依据光学触控系统1的实际操作需求而不相同。In this embodiment, the heights of the reflective mirror 130, the first and second reflective units 140, 150 are all H, but it should be understood that the heights of the reflective mirror 130, the first and second reflective units 140, 150 can also be based on optical contact The actual operation requirements of control system 1 are different.
第一反光单元140以及第二反光单元150可以采用回复反射材质(retro-reflective material)来达到反光效果，但本实施例并不以此为限，只要第一反光单元140以及第二反光单元150可将发光元件120的光线反射至触控面110，且优选不会形成触控感测区TR的镜像即可。也可以是由三个发光元件来替代，只要使这三个发光元件皆朝向并照射触控面110即可。The first reflective unit 140 and the second reflective unit 150 can use retro-reflective material to achieve the reflective effect, but this embodiment is not limited thereto, as long as the first reflective unit 140 and the second reflective unit 150 The light from the light emitting element 120 can be reflected to the touch surface 110 , and it is preferable not to form a mirror image of the touch sensing region TR. It can also be replaced by three light-emitting elements, as long as the three light-emitting elements are all facing and illuminating the touch surface 110 .
影像感测装置12是设置在触控面110上的第一角落。影像感测装置12也可以是设置触控面110上的第二角落或是触控面110的第一边缘111上，只要使影像感测装置12相对于与反光镜130的设置位置即可。The image sensing device 12 is disposed on the first corner of the touch surface 110 . The image sensing device 12 can also be disposed on the second corner of the touch surface 110 or on the first edge 111 of the touch surface 110 , as long as the image sensing device 12 is positioned relative to the mirror 130 .
影像感测装置12用以检测指示物(即使用者2的手指21)在触控感测区TR内的触控操作。具体地说，影像感测装置12用以撷取横跨触控面110，并包含触控面110、反光镜130、第一反光单元140以及第二反光单元150所包围的触控感测区TR的多张影像。该多个影像至少包含背景影像以及具有指示物的物件影像的影像。所述背景影像是在指示物未靠近面板11时，且影像感测装置12所撷取横跨触控面110会包含触控感测区TR的影像。The image sensing device 12 is used to detect the touch operation of the pointer (ie, the finger 21 of the user 2 ) in the touch sensing region TR. Specifically, the image sensing device 12 is used to capture the touch sensing area that spans the touch surface 110 and includes the touch surface 110 , the mirror 130 , the first reflective unit 140 and the second reflective unit 150 . Multiple images of TR. The plurality of images at least include images of a background image and an object image with a pointer. The background image is when the pointer is not close to the panel 11 , and the image captured by the image sensing device 12 across the touch surface 110 includes the touch sensing region TR.
影像感测装置12可进一步设置有滤光模块，(例如红外线滤光片(IR-passfilter))，以使影像感测装置12可仅接受特定波长的光线，例如红外线。The image sensing device 12 may further be provided with a filter module, such as an IR-pass filter, so that the image sensing device 12 can only receive light of a specific wavelength, such as infrared light.
影像感测装置12视野可设置成朝向触控面110倾斜，其倾斜角度可依据实际设置需求与影像撷取范围来设置，只要可使影像感测装置12撷取到横跨触控面110的触控感测区TR的影像即可。影像感测装置12的纵向视野优选可大于或等于触控感测区TR的高度H。The field of view of the image sensing device 12 can be set to be inclined towards the touch surface 110, and the inclination angle can be set according to the actual installation requirements and the image capture range, as long as the image sensing device 12 can capture images across the touch surface 110. The image of the touch sensing region TR is sufficient. The longitudinal field of view of the image sensing device 12 is preferably greater than or equal to the height H of the touch sensing region TR.
影像感测装置12可例如为互补式金属氧化物半导体(CMOS)或电荷耦合元件(CCD)，且于所属技术领域具有通常知识者可以依据实际使用情况来设计，本实施例在此不加以限制。The image sensing device 12 can be, for example, a complementary metal oxide semiconductor (CMOS) or a charge-coupled device (CCD), and those with ordinary knowledge in the art can design it according to actual usage conditions, and this embodiment is not limited here .
处理单元13用以根据影像感测装置12所产生对应触控面110的影像，判断指示物(即手指21)是否触碰(或接触)触控面110或是指示物悬浮于(hovering)触控面110上。处理单元13根据判断结果，决定是否计算该指示物(即手指21)相对于该触控面110的一触控坐标。处理单元13并利用传输单元15将具有对应指示物的触控坐标的相关信息传送至影像显示设备16，以操控影像显示设备16画面上光标161的动作。The processing unit 13 is used to determine whether the pointer (ie finger 21 ) touches (or touches) the touch surface 110 or whether the pointer is hovering on the touch surface 110 according to the image corresponding to the touch surface 110 generated by the image sensing device 12. Control surface 110 on. The processing unit 13 determines whether to calculate a touch coordinate of the pointer (ie, the finger 21 ) relative to the touch surface 110 according to the judgment result. The processing unit 13 also utilizes the transmission unit 15 to transmit the relevant information with the touch coordinates of the corresponding pointer to the image display device 16 , so as to control the movement of the cursor 161 on the screen of the image display device 16 .
处理单元13可以是依据默认的影像撷取频率，驱动影像感测装置12撷取横跨触控面110的该多个影像，并根据该多个影像判断是否有指示物接近触控感测区TR以及判断指示物(即手指21)是否触碰或悬浮于触控面110。所述影像撷取频率可以是依据光学触控系统1的实际操作以及工作环境(例如光学触控系统周遭的环境亮度)来设置，本实施例并不限制。此外，在其他实施方式中，处理单元13也可以驱动影像感测装置12连续不断地撷取横跨触控面110的该多个影像，并根据该多个影像持续不断地或是每隔一段时间(例如每3张影像或每2秒)中，检测指示物在触控感测区TR的触控操作。The processing unit 13 can drive the image sensing device 12 to capture the multiple images across the touch surface 110 according to the default image capture frequency, and judge whether there is a pointer approaching the touch sensing area according to the multiple images. TR and determine whether the pointer (namely the finger 21 ) touches or floats on the touch surface 110 . The image capture frequency can be set according to the actual operation of the optical touch system 1 and the working environment (such as the ambient brightness around the optical touch system), which is not limited in this embodiment. In addition, in other embodiments, the processing unit 13 can also drive the image sensing device 12 to continuously capture the multiple images across the touch surface 110, and continuously or at intervals based on the multiple images In time (for example, every 3 images or every 2 seconds), the touch operation of the pointer on the touch sensing area TR is detected.
存储单元14用以储存影像感测装置12所撷取的该多个影像以及判断指示物是触碰触控面110或是悬浮于触控面110的相关参数。存储单元14并可用以储存所计算指示物相对于触控面110的触控坐标。The storage unit 14 is used for storing the plurality of images captured by the image sensing device 12 and relevant parameters for determining whether the pointer touches the touch surface 110 or hovers over the touch surface 110 . The storage unit 14 can also be used to store the calculated touch coordinates of the pointer relative to the touch surface 110 .
简单来说，当处理单元13根据影像感测装置12所撷取的该多个影像之一，检测到一指示物(例如手指21)靠近触控面110时，处理单元13会主动在所撷取的该影像中定义相对于该指示物的物件影像的一影像区域。处理单元13根据该影像区域中多个像素之间的亮度差异，判断该指示物(例如手指21)是否触碰(或是接触)触控面110或是悬浮于该触控面110。In simple terms, when the processing unit 13 detects that an indicator (such as a finger 21 ) is close to the touch surface 110 according to one of the multiple images captured by the image sensing device 12, the processing unit 13 will actively An image area is defined in the acquired image relative to the object image of the pointer. The processing unit 13 determines whether the pointer (such as the finger 21 ) touches (or touches) the touch surface 110 or floats on the touch surface 110 according to the brightness difference among the pixels in the image area.
当处理单元13判断指示物(例如手指21)触碰触控面110时，处理单元13根据指示物在所撷取的影像的成像位置以及对应该指示物的镜像(由反光镜130镜射的影像)于影像的成像位置，计算该指示物相对于触控面110的触控坐标。特别说明的是，本发明技术领域具通常知识者应知，接触(contact)触控面110或是触碰(touch)触控面110在本文中皆具相同意义，故可交替使用。When the processing unit 13 judges that the pointing object (such as the finger 21) touches the touch surface 110, the processing unit 13 according to the imaging position of the pointing object in the captured image and the mirror image corresponding to the pointing object (mirrored by the mirror 130) Image) At the imaging position of the image, the touch coordinates of the pointer relative to the touch surface 110 are calculated. In particular, those skilled in the technical field of the present invention should know that both the contact (contact) touch surface 110 and the touch (touch) touch surface 110 have the same meaning herein, so they can be used interchangeably.
更进一步地说，请参照图2A～2B并同时参照图1。图2A与图2B分别显示本发明提供的影像感测装置所撷取的具有物件影像的二维影像的示意图。图2A为指示物(例如手指21)悬浮于触控面110的二维影像，而图2B为指示物(例如手指21)触碰触控面110的二维影像。More specifically, please refer to FIGS. 2A-2B and FIG. 1 at the same time. FIG. 2A and FIG. 2B respectively show schematic diagrams of two-dimensional images with object images captured by the image sensing device provided by the present invention. FIG. 2A is a two-dimensional image of a pointer (such as a finger 21 ) floating on the touch surface 110 , and FIG. 2B is a two-dimensional image of a pointer (such as a finger 21 ) touching the touch surface 110 .
由于影像感测装置12的纵向视野(也即影像感测装置12的纵向感测范围)大于触控感测区域TR的高度H，故如图2A所示，影像感测装置12所撷取的影像F1包含背景区域DR以及强光区域(bright region)BR。Since the longitudinal field of view of the image sensing device 12 (that is, the longitudinal sensing range of the image sensing device 12) is greater than the height H of the touch sensing region TR, as shown in FIG. 2A , the image captured by the image sensing device 12 The image F1 includes a background region DR and a bright region BR.
所述强光区域BR的纵向高度是由触控面110、反光镜130、第一反光单元140以及第二反光单元150所决定。具体地说，由于发光元件120、反光镜130、第一反光单元140与第二反光单元150会发射或反射光线，故会于影像感测装置12所撷取的影像形成亮度较高的亮区BR。所述背景区域DR则为触控面110、反光镜130、第一反光单元140以及第二反光单元150以外的区域，其中所述背景区域因并不具有用以反射发光元件120所发出的光线，故呈现暗色。另外，强光区域BR的界定方式会详述于后，故不在此赘述。The longitudinal height of the strong light area BR is determined by the touch surface 110 , the mirror 130 , the first reflective unit 140 and the second reflective unit 150 . Specifically, since the light-emitting element 120, the reflector 130, the first reflective unit 140, and the second reflective unit 150 emit or reflect light, a bright area with higher brightness will be formed in the image captured by the image sensing device 12. BR. The background area DR is the area other than the touch surface 110 , the reflector 130 , the first reflective unit 140 and the second reflective unit 150 , where the background area does not have a function to reflect the light emitted by the light emitting element 120 , so it appears dark. In addition, the manner of defining the strong light area BR will be described in detail later, so it will not be repeated here.
当使用者2的手指21接近或靠近触控面110，但未接触触控面110时，影像感测装置12所撷取的影像F1会包含对应手指21的物件影像I21、I21’以及由反光镜130镜射出对应手指21的镜像(未显示于图2A以及图2B)。When the finger 21 of the user 2 approaches or approaches the touch surface 110 but does not touch the touch surface 110, the image F1 captured by the image sensing device 12 will include the object images I21, I21' corresponding to the finger 21 and the object images I21 and I21' caused by the reflection. The mirror 130 mirrors an image corresponding to the finger 21 (not shown in FIGS. 2A and 2B ).
进一步地说，当使用者2的手指21遮蔽发光元件120以及反光镜130直射或反射的部分光线时，会于影像F1形成灰暗的物件影像I21(又称为物件光学信息、遮蔽点或暗点)以及由反光镜130镜射产生的对应手指21的镜像(又称为镜像光学信息、遮蔽点或暗点)。此外，由于本实施例中，触控面110为一反光镜，故影像感测装置12所撷取的影像F1也会同时包含由触控面110反射产生对应手指21的镜像，即物件影像I21’。所述影像F1具有M×N个像素，其中M、N为正整数。Furthermore, when the finger 21 of the user 2 blocks the light emitting element 120 and part of the light directly irradiated or reflected by the reflector 130, a dark object image I21 (also called object optical information, shading point or dark point) will be formed on the image F1. ) and the mirror image corresponding to the finger 21 generated by the mirror 130 (also called mirror optical information, shadow point or dark point). In addition, since in this embodiment, the touch surface 110 is a reflective mirror, the image F1 captured by the image sensing device 12 will also include the mirror image corresponding to the finger 21 reflected by the touch surface 110, that is, the object image I21 '. The image F1 has M×N pixels, wherein M and N are positive integers.
如图2A所示，当使用者2的手指21未接触触控面110，影像F1中对应手指21影像的物件影像I21与对应手指21镜像的物件影像I21’之间会不相连且相距一距离。所述距离为手指21的指尖与触控面110之间所具有的高度距离。如图2B所示，当使用者2的手指21接触或触碰触控面110时，影像感测装置12所撷取的影像F2所包含物件影像I21与物件影像I21’会相互连接。所述影像F2也具有M×N个像素。所述影像F1与F2所具有的像素数量是由影像感测装置12的分辨率来决定的。As shown in FIG. 2A, when the finger 21 of the user 2 does not touch the touch surface 110, the object image I21 corresponding to the image of the finger 21 in the image F1 and the object image I21' corresponding to the mirror image of the finger 21 will be disconnected and separated by a distance. . The distance is the height distance between the fingertip of the finger 21 and the touch surface 110 . As shown in FIG. 2B , when the finger 21 of the user 2 touches or touches the touch surface 110, the object image I21 and the object image I21' contained in the image F2 captured by the image sensing device 12 are connected to each other. The image F2 also has M×N pixels. The number of pixels of the images F1 and F2 is determined by the resolution of the image sensing device 12 .
接着，处理单元13会根据物件影像I21与I21’于影像F1或F2的成像位置以及光学触控系统1的一背景影像于影像F1或F2中定义一左边界LB以及一右边界RB，以于影像F1或F2定义对应物件影像I21与I21’的一影像区域IA。也就是，所述影像区域IA是由强光区域BR以及左边界LB以及右边界RB来定义。所述背景影像为影像感测装置12在手指21尚未靠近触控感测区TR时所撷取的影像。更具体地说，背景影像并不具有对应指示物的物件影像。因此，影像F1的强光区域BR内具有物件影像I21与I21’的位置的亮度会较背景影像相对应的强光区域的亮度低，故可据此来定义影像区域IA。Next, the processing unit 13 defines a left boundary LB and a right boundary RB in the image F1 or F2 according to the imaging positions of the object images I21 and I21' in the image F1 or F2 and a background image of the optical touch system 1, so as to The image F1 or F2 defines an image area IA corresponding to the object images I21 and I21'. That is, the image area IA is defined by the strong light area BR and the left boundary LB and the right boundary RB. The background image is an image captured by the image sensing device 12 when the finger 21 is not close to the touch sensing region TR. More specifically, the background image does not have an object image corresponding to the pointer. Therefore, the brightness of the positions with the object images I21 and I21' in the strong light area BR of the image F1 is lower than the brightness of the corresponding strong light area of the background image, so the image area IA can be defined accordingly.
如图2A所示，当手指21未接触控面110，因影像F1中物件影像I21与手指21镜像的物件影像I21’并不相互连接，从而影像区域IA内的多个像素的亮度分布会不均匀。也就是，位于影像区域IA内各像素行中该多个像素的像素值之间的变化或差异较大。而当指示物接触触控面110时，如图2B所示，因影像F2中物件影像I21与物件影像I21’相互连接，故影像F1的影像区域IA内的多个像素的亮度会均匀分布，也即位于影像区域IA内各该像素行中该多个像素的像素值之间的变化或差异较小。As shown in FIG. 2A, when the finger 21 does not touch the control surface 110, since the object image I21 in the image F1 and the object image I21' mirrored by the finger 21 are not connected to each other, the brightness distribution of multiple pixels in the image area IA will be different. uniform. That is, the variation or difference among the pixel values of the plurality of pixels in each pixel row in the image area IA is relatively large. When the pointer touches the touch surface 110, as shown in FIG. 2B , since the object image I21 and the object image I21′ in the image F2 are connected to each other, the brightness of the pixels in the image area IA of the image F1 will be evenly distributed. That is to say, the variation or difference among the pixel values of the plurality of pixels in each of the pixel rows in the image area IA is relatively small.
因此，处理单元13可根据影像F1或F2的影像区域IA内的多个像素行(即L个像素行)中该多个像素之间的亮度差异，判断手指21是触碰触控面110或是仅是悬浮于触控面110，其中L为正整数，且L小于N。Therefore, the processing unit 13 can determine whether the finger 21 touches the touch surface 110 or touches the touch surface 110 according to the brightness difference among the plurality of pixels in the plurality of pixel rows (that is, L pixel rows) in the image area IA of the image F1 or F2. It is only floating on the touch surface 110, wherein L is a positive integer, and L is smaller than N.
详细地说，在不需要计算分析对应该手指21于该触控面110上所产生的镜像的物件影像I21’的影像信息情况之下，处理单元13可根据影像F1或F2中影像区域IA内各像素行(即L个像素行)中多个像素的像素值(例如灰阶值)之间的变化差异值，例如各该像素行的变异值、各像素行中最大亮度值与最低亮度值之间的像素比值或差异值或各该像素行的平均像素值等，来判断手指21是否触碰触控面110或是悬浮于触控面110。In detail, without calculating and analyzing the image information of the object image I21' corresponding to the mirror image generated by the finger 21 on the touch surface 110, the processing unit 13 can according to the image information in the image area IA in the image F1 or F2 The variation value between the pixel values (such as grayscale values) of multiple pixels in each pixel row (that is, L pixel rows), such as the variation value of each pixel row, the maximum brightness value and the lowest brightness value in each pixel row Whether the finger 21 touches the touch surface 110 or hovers over the touch surface 110 is judged by the pixel ratio or difference between them or the average pixel value of each pixel row.
在一实施方式中，由于背景区域DR与强光区域BR之间亮度差异明显，而当手指21接触该触控面110时会遮蔽强光区域BR的光线，故使得对应被遮蔽的像素行的像素变异值变小。处理单元13可先计算于影像区域IA内各该像素行的该多个像素的像素变异值，当影像区域IA内各该像素行的该多个像素的像素变异值越小，即表示被遮蔽区域面积越大；而当影像区域IA内各该像素行的该多个像素的像素变异值越大，即表示遮蔽区域越小。因此，处理单元13会于具有最大像素变异值的该像素行的该像素变异值大于一预设像素变异值时，判定手指21是悬浮于触控面110。In one embodiment, since the brightness difference between the background region DR and the strong light region BR is obvious, and when the finger 21 touches the touch surface 110, the light in the strong light region BR will be blocked, so that the pixel row corresponding to the shaded The pixel variation value becomes smaller. The processing unit 13 may first calculate the pixel variation values of the plurality of pixels in each pixel row in the image area IA. When the pixel variation values of the plurality of pixels in each pixel row in the image area IA are smaller, it means that they are covered. The larger the area is; and the larger the pixel variation value of the plurality of pixels in each pixel row in the image area IA is, the smaller the masked area is. Therefore, the processing unit 13 determines that the finger 21 is floating on the touch surface 110 when the pixel variation value of the pixel row with the largest pixel variation value is greater than a preset pixel variation value.
在另一实施方式中，处理单元13可计算在影像区域IA内各该像素行最大像素值与最低像素值之间的像素比例值。处理单元13并于具有最大像素比例值的该像素行的该像素比例值大于一预设像素比例值(例如1)时，判定手指21是悬浮于触控面110。In another embodiment, the processing unit 13 may calculate the pixel ratio value between the maximum pixel value and the minimum pixel value of each pixel row in the image area IA. The processing unit 13 determines that the finger 21 is floating on the touch surface 110 when the pixel ratio value of the pixel row with the largest pixel ratio value is greater than a preset pixel ratio value (for example, 1).
在又一实施方式中，处理单元13也可计算于影像区域IA内各该像素行最大像素值与最低像素值之间的像素差值。处理单元13并于具有最小像素差值的该像素行的该像素差值大于一预设像素差值(例如零)时，判定手指21是悬浮于触控面110。In yet another embodiment, the processing unit 13 may also calculate the pixel difference between the maximum pixel value and the minimum pixel value of each pixel row in the image area IA. The processing unit 13 determines that the finger 21 is floating on the touch surface 110 when the pixel difference of the pixel row with the smallest pixel difference is greater than a preset pixel difference (for example, zero).
在又一实施方式中，处理单元13也可计算于影像区域IA内各该像素行的平均像素值。处理单元13并于具有最小平均像素值的该像素行的平均像素值小于一默认平均像素值时，判定手指21是触碰触控面110。In yet another embodiment, the processing unit 13 can also calculate the average pixel value of each pixel row in the image area IA. The processing unit 13 determines that the finger 21 touches the touch surface 110 when the average pixel value of the pixel row with the minimum average pixel value is smaller than a default average pixel value.
在再一实施方式中，处理单元13可于影像区域IA内定义一第一像素群组以及一第二像素群组，其中第一像素群组以及一第二像素群组是用以供处理单元13判断影像区域IA的亮度差异，以此判定指示物是触碰或悬浮于触控面110。In yet another embodiment, the processing unit 13 can define a first pixel group and a second pixel group in the image area IA, wherein the first pixel group and the second pixel group are used for the processing unit 13 Determine the brightness difference of the image area IA, so as to determine whether the pointer touches or floats on the touch surface 110 .
具体地说，第一像素群组为高亮度群组，且所述第一像素群组包括至少一高亮度像素，其中高亮度像素为影像区域IA内具有像素值大于预设阈值的像素。第二像素群组为低亮度群组，且所述第二像素群组包括至少一低亮度像素，其中低亮度像素为影像区域IA内具有像素值小于预设阈值的像素。所述默认阈值可以是依据影像中强光区域BR的平均亮度来来设置，例如为强光区域BR的平均亮度值的75％～90％，本实施例并不限制。Specifically, the first pixel group is a high-brightness group, and the first pixel group includes at least one high-brightness pixel, wherein the high-brightness pixel is a pixel in the image area IA with a pixel value greater than a preset threshold. The second pixel group is a low-brightness group, and the second pixel group includes at least one low-brightness pixel, wherein the low-brightness pixel is a pixel in the image area IA with a pixel value smaller than a preset threshold. The default threshold may be set according to the average brightness of the strong light region BR in the image, for example, 75%-90% of the average brightness value of the strong light region BR, which is not limited in this embodiment.
当处理单元13判定手指21是悬浮于触控面110时，处理单元13不计算指示物相对于面板11的触控面110的触控坐标。处理单元13可不输出任何触控坐标数据或是输出先前计算对应手指21触碰触控面110的触控坐标数据至影像显示设备16，以固定影像显示设备16上光标161的位置。When the processing unit 13 determines that the finger 21 is floating on the touch surface 110 , the processing unit 13 does not calculate the touch coordinates of the pointer relative to the touch surface 110 of the panel 11 . The processing unit 13 may not output any touch coordinate data or output previously calculated touch coordinate data corresponding to the finger 21 touching the touch surface 110 to the image display device 16 to fix the position of the cursor 161 on the image display device 16 .
当处理单元13判定手指21是触碰触控面110时，处理单元13根据手指21于影像中的成像位置与手指21镜像(即由反光镜130所镜射的镜像(未显示于图2A以及图2B))于影像的成像位置，计算指示物相对于面板11的触控面110的触控坐标。处理单元13并将计算触控坐标的相关数据传送至影像显示设备16，以控制影像显示设备16上光标161的动作，例如控制光标161的移动操作、书写(writing)操作或点选操作等。When the processing unit 13 determines that the finger 21 is touching the touch surface 110, the processing unit 13 mirrors the finger 21 according to the imaging position of the finger 21 in the image (that is, the mirror image reflected by the mirror 130 (not shown in FIGS. 2A and 2A ). FIG. 2B )) calculates the touch coordinates of the pointer relative to the touch surface 110 of the panel 11 at the imaging position of the image. The processing unit 13 transmits the related data of the calculated touch coordinates to the image display device 16 to control the action of the cursor 161 on the image display device 16 , such as controlling the movement operation, writing operation or clicking operation of the cursor 161 .
上述预设像素变异值、预设像素比例值、预设像素差值、默认平均像素值以及默认阈值都可以是预先储存于存储单元14，以供处理单元13读取。上述预设像素变异值、预设像素比例值、预设像素差值以及默认平均像素值可以是依据光学触控系统1的实际操作需求，例如触控灵敏度或影像感测装置12的感应度或噪声强度等，来设置。The above preset pixel variation value, preset pixel ratio value, preset pixel difference value, default average pixel value and default threshold value can all be pre-stored in the storage unit 14 for read by the processing unit 13 . The above preset pixel variation value, preset pixel ratio value, preset pixel difference value and default average pixel value may be based on the actual operation requirements of the optical touch system 1, such as touch sensitivity or the sensitivity of the image sensing device 12 or Noise intensity, etc., to set.
以下针对背景影像的撷取、强光区域BR的界定以及影像区域IA的界定做进一步地说明。请参照图3A～图3C并同时参照图1。图3A显示本发明实施例提供的影像感测装置撷取的背景影像及其对应的亮度曲线的示意图。图3B显示本发明实施例提供的影像感测装置所撷取的具有物件影像的二维影像的示意图。图3C显示对应图3B所示的二维影像的亮度曲线的示意图。曲线C10表示对应背景影像的背景亮度曲线。曲线C20表示默认亮度阈值曲线，其中曲线C20是根据曲线C10所获取的。曲线C30表示对应影像F1的亮度曲线。The capture of the background image, the definition of the strong light region BR and the definition of the image region IA will be further described below. Please refer to FIG. 3A to FIG. 3C and also refer to FIG. 1 . FIG. 3A shows a schematic diagram of a background image captured by an image sensing device according to an embodiment of the present invention and its corresponding luminance curve. FIG. 3B shows a schematic diagram of a 2D image with an object image captured by the image sensing device provided by an embodiment of the present invention. FIG. 3C is a schematic diagram of a brightness curve corresponding to the 2D image shown in FIG. 3B . Curve C10 represents a background luminance curve corresponding to the background image. A curve C20 represents a default brightness threshold curve, wherein the curve C20 is obtained according to the curve C10. The curve C30 represents the brightness curve corresponding to the image F1.
在光学触控系统1运行时，处理单元13会于指示物(例如手指21)尚未靠近或进入触控感测区域TR之前(例如光学触控系统1初启动时)，先驱动影像感测装置12感测并撷取横跨触控面110的背景影像FB。背景影像FB包含背景区域DR以及强光区域BR，其中背景影像FB具有M×N个像素。When the optical touch system 1 is running, the processing unit 13 will first drive the image sensing device before the pointer (such as the finger 21) approaches or enters the touch sensing region TR (such as when the optical touch system 1 is initially started). 12 senses and captures the background image FB across the touch surface 110 . The background image FB includes a background area DR and a strong light area BR, wherein the background image FB has M×N pixels.
处理单元13可先计算背景影像FB的平均亮度值。处理单元13再根据背景影像FB的平均亮度值与一默认权重值(例如1.2)设定一预设像素值。而后，处理单元13通过比较背景影像FB中每一像素行(pixel column)中的各个像素的像素值与预设像素值，于各像素行定义出一强光上边界H_UB以及一强光下边界H_LB，以此在背景影像FB中定义出强光区域BR。其中在强光上边界H_UB以及强光下边界H_LB之间的该多个像素值大于所述预设像素值。The processing unit 13 may first calculate the average brightness value of the background image FB. The processing unit 13 then sets a default pixel value according to the average brightness value of the background image FB and a default weight value (for example, 1.2). Then, the processing unit 13 defines a strong light upper boundary H_UB and a strong light lower boundary in each pixel row by comparing the pixel value of each pixel in each pixel column (pixel column) in the background image FB with the preset pixel value H_LB, so as to define a strong light area BR in the background image FB. Wherein the plurality of pixel values between the high light upper boundary H_UB and the high light lower boundary H_LB are larger than the preset pixel value.
另外，所述预设权重值可以依据背景影像FB的平均亮度值的一标准值差(standard deviation)来设置。In addition, the preset weight value can be set according to a standard deviation of the average brightness value of the background image FB.
在另一实施方式中，处理单元13也可以是计算背景影像FB中各该像素行中N个像素P1～PN的平均像素值。而后，处理单元13根据各该像素行的平均像素值与一预设权重值，对应设定各该像素行的预设像素值。处理单元13通过比较背景影像FB中每一像素行中的各个像素的像素值与预设像素值，并将各该像素行中具有亮度大于预设像素值的该多个像素所在的密集区块设为各该像素行的强光区块。处理单元13根据各该像素行的强光区块于背景影像FB中各像素行定义出强光上边界H_UB以及强光下边界H_LB。In another embodiment, the processing unit 13 may also calculate the average pixel value of the N pixels P1 -PN in each pixel row in the background image FB. Then, the processing unit 13 correspondingly sets the default pixel value of each pixel row according to the average pixel value of each pixel row and a preset weight value. The processing unit 13 compares the pixel value of each pixel in each pixel row in the background image FB with a preset pixel value, and calculates the dense block where the plurality of pixels with brightness greater than the preset pixel value in each pixel row are located. Set as the strong light block of each pixel row. The processing unit 13 defines a strong light upper boundary H_UB and a strong light lower boundary H_LB for each pixel row in the background image FB according to the strong light block of each pixel row.
在又一实施方式中，处理单元13也可以是计算背景影像FB中各该像素行中N个像素P1～PN的平均像素值。而后，处理单元13根据具有最大平均像素值的该像素行的平均像素值与上述预设权重值设定预设像素值。处理单元13再根据默认像素值于背景影像FB中各像素行定义出强光上边界H_UB以及强光下边界H_LB。In yet another embodiment, the processing unit 13 may also calculate the average pixel value of the N pixels P1 -PN in each pixel row in the background image FB. Then, the processing unit 13 sets a preset pixel value according to the average pixel value of the pixel row with the largest average pixel value and the preset weight value. The processing unit 13 then defines a strong light upper boundary H_UB and a strong light lower boundary H_LB for each pixel row in the background image FB according to default pixel values.
在影像FB中定义出强光区域BR后，处理单元13将背景影像FB对应转换为一背景亮度曲线(也即曲线C10)，以产生背景影像FB的背景亮度曲线数据。曲线C10中沿横轴向的各该亮度值是对应为背景影像FB的强光区域BR中各该像素行的亮度总和。换言之，背景亮度曲线(也即曲线C10)记录背景影像FB中沿各像素行方向分布的亮度曲线。After the strong light area BR is defined in the image FB, the processing unit 13 converts the background image FB into a background brightness curve (ie, the curve C10 ) to generate background brightness curve data of the background image FB. Each of the luminance values along the horizontal axis in the curve C10 corresponds to the sum of the luminance of each of the pixel rows in the strong light region BR of the background image FB. In other words, the background luminance curve (ie, the curve C10 ) records the luminance curve distributed along the direction of each pixel row in the background image FB.
详细地说，处理单元13可将背景影像FB中强光区域BR内各像素行的该多个像素的像素值相加，以作为该像素行的像素值。举例来说，曲线C10中第i个像素行的亮度为背景影像FB中的强光区域BR第i行中该多个像素的像素值的总和。In detail, the processing unit 13 may add the pixel values of the plurality of pixels in each pixel row in the strong light area BR in the background image FB to be the pixel value of the pixel row. For example, the brightness of the i-th pixel row in the curve C10 is the sum of the pixel values of the plurality of pixels in the i-th row of the strong light region BR in the background image FB.
此外，在再一实施方式中，也可不需要辨识出强光区域BR，通过于背景影像FB各像素行(例如第i个像素行)的N个像素中筛选出k个具有高亮度的像素(例如大于一预设像素阈值)，再计算该多个k个像素的像素值的总和，作为该像素行(例如第i个像素行)的像素值。亦或是，于背景影像FB各像素行(例如第i个像素行)的N个像素中筛选出k1个具有高亮度的像素(例如大于该预设像素阈值)以及k2个具有暗的像素(例如低于预设像素阈值)，再计算该k1个像素与k2个像素之间的差异的像素值的总和，作为该像素行(例如第i个像素行)的像素值。所述k、k1以及k2为正整数。In addition, in yet another embodiment, it may not be necessary to identify the strong light region BR, by selecting k pixels with high brightness from N pixels in each pixel row (for example, the i-th pixel row) of the background image FB ( For example, greater than a preset pixel threshold), and then calculate the sum of the pixel values of the plurality of k pixels as the pixel value of the pixel row (eg, the i-th pixel row). Alternatively, k1 pixels with high brightness (for example greater than the preset pixel threshold) and k2 pixels with darkness ( For example, the pixel value is lower than the preset pixel threshold), and then calculate the sum of the pixel values of the differences between the k1 pixels and the k2 pixels as the pixel value of the pixel row (eg, the i-th pixel row). The k, k1 and k2 are positive integers.
处理单元13还可以对曲线C10进行运算，以产生曲线C20作为背景影像FB的背景亮度曲线数据。曲线C20为曲线C10与一默认百分比(例如80％)的乘积。也就是说，曲线C20的亮度会较曲线C10的亮度低，并以此作为背景亮度数据，以于感测指示物的触碰状态及触控位置时，提供适当地亮度公差(tolerance)。The processing unit 13 can also perform operations on the curve C10 to generate the curve C20 as the background luminance curve data of the background image FB. The curve C20 is the product of the curve C10 and a default percentage (eg, 80%). That is to say, the brightness of the curve C20 is lower than the brightness of the curve C10, and this is used as background brightness data to provide proper brightness tolerance when sensing the touch state and touch position of the pointer.
在处理单元13接收到影像感测装置12输出影像(例如图2A所示的影像F1)后，处理单元13会先根据背景影像FB对应于影像F1定义出强光区域BR，如图3B所示。处理单元13并会将影像F1对应转换为亮度曲线(例如曲线C30)，以产生影像F1的亮度曲线数据。After the processing unit 13 receives the image output by the image sensing device 12 (such as the image F1 shown in FIG. 2A ), the processing unit 13 will first define a strong light area BR corresponding to the image F1 according to the background image FB, as shown in FIG. 3B . The processing unit 13 also converts the image F1 into a luminance curve (for example, the curve C30 ) to generate luminance curve data of the image F1 .
如图3C所示，处理单元13会比较曲线C30(即影像F1的亮度曲线)与曲线C20，以获取指示物的物件影像I21与I21’于影像F1的成像位置。详细地说，物件影像I21以及I21’是由指示物(例如手指21与由触控面110反射的手指21镜像)遮蔽发光元件120、反光镜130以及第一反射单元140直射或反射的部分光线所形成。因此，曲线C30中对应物件影像I21以及I21’于影像F1所在的区域内各该像素行的亮度会低于曲线C20相对应像素行的背景亮度值，而影像F1的其他区域内各该像素行的亮度会高于曲线C20中相对应像素行的背景亮度。As shown in FIG. 3C , the processing unit 13 compares the curve C30 (ie, the brightness curve of the image F1) with the curve C20 to obtain the imaging positions of the object images I21 and I21' of the pointer in the image F1. In detail, the object images I21 and I21' are part of the light rays that are directly irradiated or reflected by the light emitting element 120, the mirror 130, and the first reflection unit 140 blocked by the pointer (such as the finger 21 and the mirror image of the finger 21 reflected by the touch surface 110). formed. Therefore, in the curve C30 corresponding to the object images I21 and I21', the brightness of each pixel row in the area where the image F1 is located will be lower than the background brightness value of the corresponding pixel row in the curve C20, while the pixel row in other areas of the image F1 The luminance of will be higher than the background luminance of the corresponding pixel row in the curve C20.
从而，处理单元13通过比较曲线C30与曲线C20，即可获得物件影像I21与I21’于影像F1的影像成像范围，也即物件影像I21与I21’于影像F1中的左边界LB与右边界RB。接着，处理单元13根据影像F1的强光区域BR以及左边界LB与右边界RB定义出影像区域(如图2A的影像区域IA)。随后，处理单元13再对影像区域IA进行亮度分析，以此判断位于触控感测区TR内的指示物是否触碰或接触触控面110。Therefore, the processing unit 13 can obtain the image imaging range of the object images I21 and I21' in the image F1 by comparing the curve C30 and the curve C20, that is, the left boundary LB and the right boundary RB of the object images I21 and I21' in the image F1 . Next, the processing unit 13 defines an image area (such as the image area IA in FIG. 2A ) according to the strong light area BR, the left boundary LB, and the right boundary RB of the image F1. Subsequently, the processing unit 13 performs brightness analysis on the image area IA to determine whether the pointer in the touch sensing area TR touches or touches the touch surface 110 .
值得一提的是，上述触控面110也可为非反光镜面。如图4A与图4B所示，影像感测装置12所撷取横跨触控面110的影像则仅包含反光镜130、第一反光单元140、第二反光单元150所包围的区域但不包括触控面110所反射产生的镜像。图4A与图4B分别是本发明另一实施例提供的影像感测装置所撷取的具有物件影像的二维影像的示意图。It is worth mentioning that the above-mentioned touch surface 110 may also be a non-reflective mirror surface. As shown in FIG. 4A and FIG. 4B , the image captured by the image sensing device 12 across the touch surface 110 only includes the area surrounded by the reflective mirror 130 , the first reflective unit 140 , and the second reflective unit 150 but does not include The mirror image generated by the reflection of the touch surface 110 . 4A and 4B are respectively schematic diagrams of two-dimensional images with object images captured by an image sensing device according to another embodiment of the present invention.
如图4A所示，当指示物(例如手指21)接近面板11的触控面110时，影像感测装置12所撷取的影像F3仅包含手指21的指尖或指腹遮蔽反光镜130、第一反光单元140或第二反光单元150的物件影像I41、强光区域BR与背景区域DR。强光区域BR的高度是由反光镜130、第一反光单元140以及第二反光单元150所决定的。所述背景区域DR则为反光镜130、第一反光单元140以及第二反光单元150以外的背景区域。As shown in FIG. 4A , when a pointer (for example, a finger 21 ) approaches the touch surface 110 of the panel 11 , the image F3 captured by the image sensing device 12 only includes the fingertip or pad of the finger 21 shielding the mirror 130 , The object image I41 , the strong light area BR and the background area DR of the first light reflection unit 140 or the second light reflection unit 150 . The height of the strong light area BR is determined by the reflector 130 , the first reflective unit 140 and the second reflective unit 150 . The background area DR is the background area other than the reflective mirror 130 , the first reflective unit 140 and the second reflective unit 150 .
如图4B所示，当手指21接触触控面110时，影像感测装置12所撷取的影像F4中对应手指21的指尖或指腹的物件影像I41会涵盖到影像F4的影像区域IA’内最后一列像素。处理单元13于接收到影像F3或F4时，会于影像F3或F4中的强光区域BR对应定义影像区域IA’(即定义左、右边界)，以进行影像区域IA’内的亮度变异分析。处理单元13并根据影像区域IA’的亮度分析结果，判断指示物是触碰触控面110或是悬浮于触控面110。As shown in FIG. 4B, when the finger 21 touches the touch surface 110, the object image I41 corresponding to the fingertip or finger pulp of the finger 21 in the image F4 captured by the image sensing device 12 will cover the image area IA of the image F4. ' in the last column of pixels. When the processing unit 13 receives the image F3 or F4, it will define the image area IA' corresponding to the strong light area BR in the image F3 or F4 (that is, define the left and right boundaries), so as to analyze the brightness variation in the image area IA' . The processing unit 13 determines whether the pointer touches the touch surface 110 or floats on the touch surface 110 according to the brightness analysis result of the image area IA'.
现有光学触控系统1计算指示物的位置的方式会依据其实际结构(例如影像感测装置的数量、反光镜130的设置方式)与操作方式而改变，且为所属领域据通常知识者熟知的技术，故以下仅针对处理单元13计算位于触控感测区TR的指示物相对触控面110的触控坐标方式的一种计算方式做一简述。The method of calculating the position of the pointer in the existing optical touch system 1 will change according to its actual structure (such as the number of image sensing devices, the arrangement of the mirror 130 ) and the operation method, and is well known to those skilled in the art Therefore, the following is only a brief description of a calculation method for the processing unit 13 to calculate the touch coordinates of the pointer located in the touch sensing region TR relative to the touch surface 110 .
请参照图5A与图5B并同时参照图1，图5A是本发明实施例提供的光学触控系统的操作示意图。图5B是对应图5A的影像感测装置所撷取的部分影像的示意图。Please refer to FIG. 5A and FIG. 5B and FIG. 1 at the same time. FIG. 5A is a schematic diagram of the operation of the optical touch system provided by the embodiment of the present invention. FIG. 5B is a schematic diagram of a partial image captured by the image sensing device corresponding to FIG. 5A .
第一反光单元140相对于反光镜130的镜面镜射出第一反光单元镜像140’。第二反光单元150相对于反光镜130的镜面镜射(mirrored)第二反光单元镜像150’。发光元件120相对反光镜130的镜面镜射发光元件镜像120’。发光元件120、反光镜130、第一反光单元140、第二反光单元150共同界定一实像空间RS。发光元件镜像120’、反光镜130、第一反光单元镜像140’、第二反光单元镜像150’共同界定一虚像空间IS。触控点TP用以表示于实像空间RS内，指示物触碰触控面110的触控位置，而触控点TP’则用以表示于虚像空间IS内对应指示物触碰触控面110的触控位置。The first reflective unit 140 emits a mirror image 140' of the first reflective unit relative to the mirror surface of the reflective mirror 130. The second reflective unit 150 mirrors the mirror image 150' of the second reflective unit with respect to the mirror surface of the reflective mirror 130. The light-emitting element 120 mirrors the mirror image 120' of the light-emitting element with respect to the mirror surface of the reflector 130. The light emitting element 120, the reflector 130, the first reflective unit 140, and the second reflective unit 150 jointly define a real image space RS. The mirror image 120' of the light emitting element, the mirror 130, the mirror image 140' of the first reflective unit, and the mirror image 150' of the second reflective unit jointly define a virtual image space IS. The touch point TP is used to indicate the touch position where the pointer touches the touch surface 110 in the real image space RS, and the touch point TP' is used to indicate that the corresponding pointer touches the touch surface 110 in the virtual image space IS. touch position.
影像感测装置12的横向视野VA横跨触控面110，且横向视野VA至少包含实像空间RS及虚像空间IS。影像感测装置12撷取实像空间RS、虚像空间IS及位于实像空间RS的触控感测区TR内的指示物(例如图1的手指21)，并产生影像F5。如图5B所示，影像F5具有手指21的指尖或指腹遮敝发光元件120、反光镜130、第一反光单元140、第二反光单元150及/或触控面110部分直射或反射所形成的物件影像ITP以及通过反光镜130镜面所镜射的物件影像ITP’。The lateral field of view VA of the image sensing device 12 spans the touch surface 110 , and the lateral field of view VA at least includes the real image space RS and the virtual image space IS. The image sensing device 12 captures the real image space RS, the virtual image space IS, and the pointer (such as the finger 21 in FIG. 1 ) located in the touch sensing region TR of the real image space RS, and generates an image F5. As shown in FIG. 5B , the image F5 has the fingertip or finger pulp of the finger 21 shielding the light-emitting element 120 , the reflector 130 , the first reflective unit 140 , the second reflective unit 150 and/or the part of the touch surface 110 that is directly irradiated or reflected. The formed object image ITP and the object image ITP′ mirrored by the mirror 130 .
具体地说，当任一指示物，例如手指21，进入位于实像空间RS的触控感测区TR时，影像感测装置12依据第一感测路线(first sensing path)SL撷取对应指示物(例如手指21)影像，而指示物(例如手指21)会于影像F5形成物件影像ITP。同时间，影像感测装置12依据第二感测路线(second sensing path)SL’撷取该指示物(例如手指21)相对反光镜130镜面镜射在虚像空间IS内该指示物的镜像，而指示物的镜像于影像F5形成物件影像ITP’。Specifically, when any pointer, such as a finger 21, enters the touch sensing region TR located in the real image space RS, the image sensing device 12 captures the corresponding pointer according to the first sensing path SL. (such as the finger 21 ) image, and the pointer (such as the finger 21 ) will form the object image ITP in the image F5. At the same time, the image sensing device 12 captures the mirror image of the pointer (such as the finger 21 ) reflected in the virtual image space IS by the mirror 130 according to the second sensing path SL′, and The mirror image of the pointer forms the object image ITP' in the image F5.
所述存储单元14可预先储存具有一物件影像(未显示)位于一参考影像FREF(未显示)的一维坐标位置以及对应的感测路线与第二反光单元150之间夹角的相对关系。存储单元14还可预先储存有触控面110的的第二边缘113与第四边缘117间的距离D1。The storage unit 14 can pre-store a relative relationship between a one-dimensional coordinate position of an object image (not shown) located in a reference image FREF (not shown) and the angle between the corresponding sensing route and the second reflective unit 150 . The storage unit 14 can also pre-store the distance D1 between the second edge 113 and the fourth edge 117 of the touch surface 110 .
处理单元13可根据该影像F5中物件影像ITP、ITP’的一维位置(即触控点TP、TP’)分别求出第一夹角A1及第二夹角A2。处理单元13并利用三角函数关系，计算指示物于触控感测区TR的触控点的二维平面坐标，以获取对应指示物相对于触控面110的触控坐标。The processing unit 13 can respectively calculate the first included angle A1 and the second included angle A2 according to the one-dimensional positions of the object images ITP, ITP' in the image F5 (that is, the touch points TP, TP'). The processing unit 13 calculates the two-dimensional plane coordinates of the touch point of the pointer on the touch sensing region TR by using the trigonometric function relationship, so as to obtain the touch coordinates of the corresponding pointer relative to the touch surface 110 .
更详细地说，再参考图1并同时参考图5A，触控面110可设置一直角坐标系统。所述直角坐标系统以影像感测装置12的所在位置作为直角坐标系统的原点，触控面110的第二边缘113作为直角坐标系统的X轴，而第一边缘111作为直角坐标系的Y轴。从而，对应指示物触控的触控点TP位于直角坐标系统的坐标则可表示为(D2,D3)，其中D2表示触控点TP相对于第一边缘111的距离，而D3表示触控点TP相对于第二边缘113的距离。In more detail, referring to FIG. 1 and FIG. 5A at the same time, the touch surface 110 may be set in a rectangular coordinate system. The Cartesian coordinate system takes the position of the image sensing device 12 as the origin of the Cartesian coordinate system, the second edge 113 of the touch surface 110 serves as the X-axis of the Cartesian coordinate system, and the first edge 111 serves as the Y-axis of the Cartesian coordinate system. . Therefore, the coordinates of the touch point TP corresponding to the pointer touch located in the Cartesian coordinate system can be expressed as (D2, D3), wherein D2 represents the distance of the touch point TP relative to the first edge 111, and D3 represents the touch point TP is the distance from the second edge 113 .
由此，处理单元13可先利用三角函数计算获取出第一感测路线SL与触控面110的第二边缘113之间的第一夹角A1以及第二感测路线SL’与触控面110的第二边缘113间的第二夹角A2。处理单元13利用下列公式(1)计算D2，Thus, the processing unit 13 can first calculate and obtain the first angle A1 between the first sensing route SL and the second edge 113 of the touch surface 110 and the relationship between the second sensing route SL′ and the touch surface by using trigonometric functions. The second included angle A2 between the second edges 113 of 110 . The processing unit 13 calculates D2 using the following formula (1),
其中D2表示触控点TP与第一边缘111之间的距离；H为反光镜130的高度；A1为第一感测路线SL与触控面110的第二边缘113之间的第一夹角；A2为第二感测路线SL’与触控面110的第二边缘113间的第二夹角。Wherein D2 represents the distance between the touch point TP and the first edge 111; H is the height of the mirror 130; A1 is the first angle between the first sensing line SL and the second edge 113 of the touch surface 110 A2 is the second angle between the second sensing line SL′ and the second edge 113 of the touch surface 110 .
而后，处理单元13计算D2·tanA1，以获取触控点TP的Y-轴坐标。所述触控点TP的二维坐标为(D2,D2·tanA1)。Then, the processing unit 13 calculates D2·tanA1 to obtain the Y-axis coordinate of the touch point TP. The two-dimensional coordinates of the touch point TP are (D2, D2·tanA1).
特别说明的是，实际实施时，影像感测装置12可进一步包含一透镜或是透镜模块，且透镜用以调整影像感测装置12的横向视野VA，以此使影像感测装置12能够完整地撷取实像空间RS及虚像空间IS的影像。In particular, in actual implementation, the image sensing device 12 may further include a lens or a lens module, and the lens is used to adjust the lateral field of view VA of the image sensing device 12, so that the image sensing device 12 can be completely Images of the real image space RS and the virtual image space IS are captured.
另外，若对应指示物于实像空间RS的物件影像ITP与虚像空间IS的物件影像ITP’(即物件影像ITP的镜像)重叠时，处理单元13可先获得对应实像空间RS的物件影像ITP与虚像空间IS的物件影像ITP’的单独影像，再进行触控坐标运算。上述获取单独影像的方法有很多种，并且该多个方法均适用于本发明，包含但不限于改变光学触控系统的照明模式与照明结构，使影像感测装置12在撷取不产生镜像(即物件影像ITP’)，或是隔离产生镜像的光线，仅使实像空间RS的物件影像ITP的光线投射在影像感测装置12上，或是缩短虚像空间IS的物件影像ITP’的高度，并将部分不与物件影像ITP的影像重叠的影像作为实像空间RS的物件影像ITP的单独影像等。In addition, if the object image ITP in the real image space RS corresponding to the pointer overlaps with the object image ITP' in the virtual image space IS (ie, the mirror image of the object image ITP), the processing unit 13 can first obtain the object image ITP and the virtual image corresponding to the real image space RS A separate image of the object image ITP' in the space IS is used for touch coordinate calculation. There are many methods for acquiring a single image above, and these methods are all applicable to the present invention, including but not limited to changing the lighting mode and lighting structure of the optical touch system, so that the image sensing device 12 does not produce a mirror image when capturing ( That is, the object image ITP'), or isolate the light that generates the mirror image, so that only the light of the object image ITP in the real image space RS is projected on the image sensing device 12, or shorten the height of the object image ITP' in the virtual image space IS, and Part of the image that does not overlap with the image of the object image ITP is used as a separate image of the object image ITP in the real image space RS.
应了解的是，如前述，光学触控系统计算或取得触控点的方式为现有技术，且本发明技术领域具有通常知识者也可利用三角函数配合其他位置计算方式，例如中国台湾专利申请案第098120274号(相应案美国专利公告第US8269158 B2号)中所揭露的计算方式来获取触控点TP的二维坐标，上述计算触控点TP的二维坐标的方式仅为一种例示性的，本发明并不以此为限。It should be understood that, as mentioned above, the method of calculating or obtaining the touch point by the optical touch system is an existing technology, and those with ordinary knowledge in the technical field of the present invention can also use trigonometric functions to cooperate with other position calculation methods, such as the patent application in Taiwan, China No. 098120274 (corresponding U.S. Patent Publication No. US8269158 B2) to obtain the two-dimensional coordinates of the touch point TP, the above method of calculating the two-dimensional coordinates of the touch point TP is only an example Yes, the present invention is not limited thereto.
此外，在本实施例中，处理单元13可以是以微控制器(microcontroller)或嵌入式控制器(embedded controller)等处理芯片利用程序代码编译方式来实现，但本实施例并不限制。存储单元14可以是利用闪存芯片、只读存储器芯片或随机存取存储器芯片等易失性或非易失性存储芯片来实现，但本实施例并不以此为限。而传输单元15可以是利用有线传输或无线传输方式(例如蓝牙传输)将触控坐标信息传送至影像显示设备16，但本实施例并不以此为限。In addition, in this embodiment, the processing unit 13 can be realized by compiling program codes with a processing chip such as a microcontroller (microcontroller) or an embedded controller (embedded controller), but this embodiment is not limited. The storage unit 14 may be implemented by using volatile or non-volatile memory chips such as flash memory chips, read-only memory chips, or random access memory chips, but this embodiment is not limited thereto. The transmission unit 15 may transmit the touch coordinate information to the image display device 16 by wired transmission or wireless transmission (such as Bluetooth transmission), but this embodiment is not limited thereto.
在其他实施方式中，若光学触控系统1的发光元件120是以被动光源来取代，例如反光镜，则可另于触控面110的周围(例如第一边缘111与第二边缘113交界处)设置至少一发光体，再由发光元件120以及反光镜130反射发光体射出的光线至整个触控面110上。In other embodiments, if the light-emitting element 120 of the optical touch system 1 is replaced by a passive light source, such as a reflector, it can be placed around the touch surface 110 (for example, at the junction of the first edge 111 and the second edge 113 ) to set at least one luminous body, and then reflect the light emitted by the luminous body to the entire touch surface 110 by the light emitting element 120 and the reflector 130 .
在另一实施方式中，发光元件120可以是固定于影像感测装置12上。举例来说，发光元件120可采用黏合(sticking)、螺丝锁固(screwing)或扣合(fastening)的方式与影像感测装置12结合，从而固定在影像感测装置12上。In another embodiment, the light emitting element 120 may be fixed on the image sensing device 12 . For example, the light emitting element 120 can be combined with the image sensing device 12 by means of sticking, screwing or fastening, so as to be fixed on the image sensing device 12 .
在又一实施方式中，光学触控系统1可不具有发光元件120，而影像感测装置12可配置一照明装置(例如具有红外线发光二极管的红外线照明装置)。影像感测装置12并可进一步设置有红外线滤光模块，(例如红外线滤光片(IR-pass filter))，以使影像感测装置12可通过红外线滤光模块撷取触控面110的影像。In yet another embodiment, the optical touch system 1 may not have the light emitting element 120 , and the image sensing device 12 may be configured with an illumination device (for example, an infrared illumination device having an infrared light emitting diode). The image sensing device 12 can further be provided with an infrared filter module (such as an infrared filter (IR-pass filter)), so that the image sensing device 12 can capture the image of the touch surface 110 through the infrared filter module. .
此外，在本实施例中，光学触控系统1的面板11与影像显示设备16为相互独立的元件，但在其他实施方式中，面板11也可与影像显示设备16的显示屏幕相互结合。In addition, in this embodiment, the panel 11 of the optical touch system 1 and the image display device 16 are independent components, but in other implementations, the panel 11 can also be combined with the display screen of the image display device 16 .
举例来说，当面板11为触控屏幕(如透明触控屏幕)时，影像显示器16的显示屏幕可作为面板11。而反光镜130、第一反光单元140以及第二反光单元150可对应设置于影像显示设备16的显示屏幕上。For example, when the panel 11 is a touch screen (such as a transparent touch screen), the display screen of the image display 16 can be used as the panel 11 . The reflective mirror 130 , the first reflective unit 140 and the second reflective unit 150 can be correspondingly arranged on the display screen of the image display device 16 .
图1中，面板11为一矩形形状，且发光元件120、反光镜130、第一反光单元140以及第二反光单元150为相互垂直地设置于面板11的四边，但在其他实施方式中，面板11也可为其他几何形状，例如方形、圆形等，而发光元件120、反光镜130、第一反光单元140以及第二反光单元150对应设置于面板11上。In Fig. 1, the panel 11 is a rectangular shape, and the light-emitting element 120, the reflector 130, the first reflective unit 140 and the second reflective unit 150 are arranged on the four sides of the panel 11 perpendicular to each other, but in other embodiments, the panel 11 can also be other geometric shapes, such as square, circular, etc., and the light emitting element 120 , reflector 130 , first reflective unit 140 and second reflective unit 150 are correspondingly disposed on the panel 11 .
要说明的是，面板11、影像感测装置12、发光元件120、反光镜130、第一反光单元140、第二反光单元150、处理单元13、存储单元14、传输单元15以及影像显示设备16的种类、实体结构及/或实施方式是依据光学触控系统1的种类、实体结构及/或实施方式来设置，本发明并不限制。It should be noted that the panel 11, the image sensing device 12, the light emitting element 120, the mirror 130, the first reflective unit 140, the second reflective unit 150, the processing unit 13, the storage unit 14, the transmission unit 15 and the image display device 16 The types, physical structures and/or implementations of the optical touch system 1 are set according to the types, physical structures and/or implementations of the optical touch system 1 , which are not limited by the present invention.
〔光学触控系统的物件分析方法的实施例〕[Example of Object Analysis Method for Optical Touch System]
由上述的实施例，本发明另可归纳出一种物件分析方法，此方法可应用适用于图1实施例的光学触控系统。所述物件分析方法可根据影像感测装置所检测到的对应指示物的影像的亮度变化，判断指示物是触控光学触控系统的触控面或是悬浮于该触控面。According to the above-mentioned embodiments, the present invention can also generalize an object analysis method, which can be applied to the optical touch system in the embodiment shown in FIG. 1 . The object analysis method can determine whether the pointer is the touch surface of the touch optical touch system or is suspended on the touch surface according to the brightness change of the image corresponding to the pointer detected by the image sensing device.
请参考图6并同时参考图1、图2A以及图2B。图6显示本发明实施例提供的光学触控系统的物件分析方法的流程示意图。处理单元13于光学触控系统1操作时，会根据一默认的影像撷取频率，驱动影像感测装置12撷取横跨面板11的触控面110的多张影像，以检测是否有指示物靠近。所述影像撷取频率可以是依据光学触控系统1的实际操作以及工作环境(例如光学触控系统周遭的环境亮度)来设置，本实施例并不限制。Please refer to FIG. 6 and also refer to FIG. 1 , FIG. 2A and FIG. 2B . FIG. 6 shows a schematic flowchart of an object analysis method for an optical touch system provided by an embodiment of the present invention. When the optical touch system 1 is in operation, the processing unit 13 will drive the image sensing device 12 to capture multiple images across the touch surface 110 of the panel 11 according to a default image capture frequency, so as to detect whether there is an indicator near. The image capture frequency can be set according to the actual operation of the optical touch system 1 and the working environment (such as the ambient brightness around the optical touch system), which is not limited in this embodiment.
在步骤S601中，当处理单元13驱动影像感测装置12撷取横跨面板11的触控面110的第一影像，其中第一影像具有对应一指示物(例如手指)的物件影像，例如图2A的影像F1或是图2B的影像F2。处理单元13并将第一影像的影像数据储存于存储单元14。In step S601, when the processing unit 13 drives the image sensing device 12 to capture a first image across the touch surface 110 of the panel 11, wherein the first image has an object image corresponding to a pointer (such as a finger), for example, as shown in FIG. The image F1 of 2A or the image F2 of FIG. 2B. The processing unit 13 stores the image data of the first image in the storage unit 14 .
其次，在步骤S603中，处理单元13会根据预先撷取的背景影像的背景亮度曲线数据，于第一影像中定义出对应指示物的物件影像的左边界LB及右边界RB，以于第一影像中定义对应物件影像的影像区域IA。Next, in step S603, the processing unit 13 defines the left boundary LB and the right boundary RB of the object image corresponding to the indicator in the first image according to the background luminance curve data of the background image captured in advance, so that in the first image An image area IA corresponding to the object image is defined in the image.
详细地说，处理单元13可先根据背景影像于第一影像中定义出强光区域BR。而后，处理单元13再将第一图像映射转换为亮度曲线数据。如前述，处理单元13可计算位于第一影像中强光区域的各该像素行的多个像素的像素值总和，也即计算第一影像中强光区域BR内各该像素行的的亮度总和，也产生对应第一影像的亮度曲线数据。随后，处理单元13比较背景亮度曲线数据与亮度曲线数据，于第一影像定义物件影像的左边界LB及右边界RB。In detail, the processing unit 13 may first define the strong light region BR in the first image according to the background image. Then, the processing unit 13 converts the first image map into brightness curve data. As mentioned above, the processing unit 13 can calculate the sum of the pixel values of the plurality of pixels located in each pixel row in the strong light area in the first image, that is, calculate the sum of the luminance of each pixel row in the strong light area BR in the first image. , also generating brightness curve data corresponding to the first image. Subsequently, the processing unit 13 compares the background luminance curve data and the luminance curve data, and defines the left boundary LB and the right boundary RB of the object image in the first image.
接着，在步骤S605中，处理单元13根据影像区域IA中多个像素值之间的亮度差异，判断指示物是否触碰触控面110或是悬浮于触控面110。当处理单元13判断指示物触碰触控面110，执行步骤S607。反之，当处理单元13判断指示物是悬浮于触控面110，则执行步骤S609。Next, in step S605 , the processing unit 13 determines whether the pointer touches the touch surface 110 or floats on the touch surface 110 according to the brightness difference among the pixel values in the image area IA. When the processing unit 13 determines that the pointer touches the touch surface 110 , step S607 is executed. On the contrary, when the processing unit 13 determines that the pointer is floating on the touch surface 110, step S609 is performed.
具体地说，当处理单元13计算出影像区域IA的亮度变异较大时，处理单元13即可判定指示物是悬浮于触控面110并执行步骤S609。而当处理单元13计算出影像区域IA的亮度分布均匀，也即变异较小时，当处理单元13即可判定指示物是触碰触控面110而执行步骤S607。Specifically, when the processing unit 13 calculates that the brightness variation of the image area IA is large, the processing unit 13 can determine that the pointer is floating on the touch surface 110 and execute step S609. And when the processing unit 13 calculates that the brightness distribution of the image area IA is uniform, that is, the variation is small, the processing unit 13 can determine that the pointer is touching the touch surface 110 and execute step S607.
在步骤S607中，若处理单元13判定指示物触碰触控面110时，处理单元13即会根据指示物于第一影像的成像位置(即物件影像I21的成像位置)与反射镜130镜射出对应指示物的镜像于第一影像的成像位置，计算指示物相对于触控面110的触控坐标。随后，处理单元13并利用传输单元15将触控坐标的相关信息(包含触控面110的分辨率)传送至影像显示设备16，以对应控制影像显示设备16的显示屏幕上光标161的动作，例如于显示屏幕的移动动作。In step S607, if the processing unit 13 determines that the pointer touches the touch surface 110, the processing unit 13 will reflect the imaging position of the pointer in the first image (that is, the imaging position of the object image I21) and the mirror 130 to project Corresponding to the imaging position of the mirror image of the pointer on the first image, the touch coordinates of the pointer relative to the touch surface 110 are calculated. Subsequently, the processing unit 13 uses the transmission unit 15 to transmit the relevant information of the touch coordinates (including the resolution of the touch surface 110) to the image display device 16, so as to correspondingly control the movement of the cursor 161 on the display screen of the image display device 16, For example, in the mobile action of the display screen.
在步骤S609中，若处理单元13判定指示物是悬浮于触控面110，则处理单元13不计算指示物相对于触控面110的触控坐标。In step S609 , if the processing unit 13 determines that the pointer is floating on the touch surface 110 , the processing unit 13 does not calculate the touch coordinates of the pointer relative to the touch surface 110 .
以下针对处理单元13判断指示物是悬浮于触控面110或是触碰触控面110的具体实施方式做进一步说明。The specific implementation manner in which the processing unit 13 determines whether the pointer is floating on the touch surface 110 or touches the touch surface 110 will be further described below.
在一具体实施方式中，处理单元13可通过将影像区域内的像素依据亮度分群组，再通过比较不同亮度群组之间的亮度差异来判断指示物是悬浮于触控面110或是触碰触控面110。In a specific embodiment, the processing unit 13 can determine whether the pointer is floating on the touch surface 110 or touch the touch surface 110 by grouping the pixels in the image area according to the brightness, and then comparing the brightness difference between different brightness groups. Touch the touch surface 110 .
请参考图7并同时参考图1以及图2A与图2B。图7显示本发明另一实施例提供的光学触控系统的物件分析方法的流程示意图。图7的步骤可在处理单元13执行图6的步骤S605时执行。Please refer to FIG. 7 and also refer to FIG. 1 and FIGS. 2A and 2B . FIG. 7 shows a schematic flowchart of an object analysis method for an optical touch system according to another embodiment of the present invention. The steps in FIG. 7 may be executed when the processing unit 13 executes step S605 in FIG. 6 .
在步骤S701中，处理单元13于所撷取的第一影像的影像区域IA内定义第一像素群组以及第二像素群组。第一像素群组以及第二像素群组分别用以供处理单元13分析判断影像区域IA的亮度差异。更详细地说，所述第一像素群组包括至少一高亮度像素，所述第二像素群组包括至少一低亮度像素。所述高亮度像素为影像区域IA内具有像素值大于预设阈值的像素。所述低亮度像素为影像区域IA内具有像素值小于预设阈值的像素。所述默认阈值可以是依据影像中强光区域BR的平均亮度来来设置，例如为强光区域BR的平均亮度值的75％～90％，但本实施例并不以此为限。In step S701, the processing unit 13 defines a first pixel group and a second pixel group in the captured image area IA of the first image. The first pixel group and the second pixel group are respectively used for the processing unit 13 to analyze and determine the brightness difference of the image area IA. More specifically, the first pixel group includes at least one high-brightness pixel, and the second pixel group includes at least one low-brightness pixel. The high-brightness pixels are pixels in the image area IA with pixel values greater than a preset threshold. The low-brightness pixels are pixels in the image area IA with pixel values smaller than a preset threshold. The default threshold can be set according to the average brightness of the strong light region BR in the image, for example, 75%-90% of the average brightness value of the strong light region BR, but this embodiment is not limited thereto.
在步骤S703中，处理单元13根据第一影像的影像区域IA内的第一像素群组以及第二像素群组，分别计算第一像素群组的平均像素值与第二像素群组的平均像素值。处理单元13会分别计算第一像素群组该多个像素的像素值的平均以作为第一像素群组的平均像素值以及第二像素群组该多个像素的像素值的平均以作为第二像素群组的平均像素值。In step S703, the processing unit 13 respectively calculates the average pixel value of the first pixel group and the average pixel value of the second pixel group according to the first pixel group and the second pixel group in the image area IA of the first image. value. The processing unit 13 will respectively calculate the average of the pixel values of the plurality of pixels in the first pixel group as the average pixel value of the first pixel group and the average of the pixel values of the plurality of pixels in the second pixel group as the second Average pixel value for a group of pixels.
在步骤S705中，处理单元13判断第一像素群组的平均像素值与第二像素群组的平均像素值之间的比值是否大于一预设像素比例值(例如约为1)。具体地说，处理单元13可先根据第一像素群组的平均像素值与第二像素群组的平均像素值计算第一像素群组的平均像素值与第二像素群组的平均像素值之间的比值。随后，处理单元13比较第一像素群组的平均像素值与第二像素群组的平均像素值之间的比值与预设像素比例值。In step S705, the processing unit 13 determines whether the ratio between the average pixel value of the first pixel group and the average pixel value of the second pixel group is greater than a preset pixel ratio value (for example, about 1). Specifically, the processing unit 13 can first calculate the average pixel value of the first pixel group and the average pixel value of the second pixel group according to the average pixel value of the first pixel group and the average pixel value of the second pixel group. ratio between. Subsequently, the processing unit 13 compares the ratio between the average pixel value of the first pixel group and the average pixel value of the second pixel group with a preset pixel ratio.
若处理单元13计算出第一像素群组的平均像素值与第二像素群组的平均像素值之间的比值大于预设像素比例值(例如1)，即执行步骤S707。反之，若处理单元13计算出第一像素群组的平均像素值与第二像素群组的平均像素值之间的比值小于或等于预设像素比例值(例如约为1)，即执行步骤S709。If the processing unit 13 calculates that the ratio between the average pixel value of the first pixel group and the average pixel value of the second pixel group is greater than a preset pixel ratio (for example, 1), step S707 is executed. On the contrary, if the processing unit 13 calculates that the ratio between the average pixel value of the first pixel group and the average pixel value of the second pixel group is less than or equal to the preset pixel ratio value (for example, about 1), step S709 is executed. .
在步骤S707中，当第一像素群组的平均像素值与第二像素群组的平均像素值之间的比值大于预设像素比例值(例如1)，即表示第一影像的影像区域IA的亮度分布并不均匀，即亮度差异较大，故处理单元13会判定指示物并未接触触控面110，而是悬浮于触控面110。In step S707, when the ratio between the average pixel value of the first pixel group and the average pixel value of the second pixel group is greater than a preset pixel ratio value (for example, 1), it means that the image area IA of the first image is The brightness distribution is not uniform, that is, the brightness difference is large, so the processing unit 13 will determine that the pointer is not in contact with the touch surface 110 , but is suspended on the touch surface 110 .
请再参考图2A，以图2A作为第一影像来做举例说明。当指示物是悬浮于触控面110，影像区域IA内的亮度分布会不均匀，并且具有最大像素值的像素与具有最低像素值的像素之间的亮度差异较大。Please refer to FIG. 2A again, and take FIG. 2A as the first image for illustration. When the pointer is floating on the touch surface 110, the brightness distribution in the image area IA will be uneven, and the brightness difference between the pixel with the largest pixel value and the pixel with the lowest pixel value is relatively large.
在步骤S709中，当第一像素群组的平均像素值与第二像素群组的平均像素值之间的比值小于或等于预设像素比例值(例如1)，即表示第一影像的影像区域IA的亮度分布均匀，且亮度差异较小，故处理单元13会判定指示物接触或触碰触控面110。处理单元13并根据指示物与其镜像于影像的成像位置计算指示物于光学触控系统1的触控坐标，以对应控制影像显示设备16的显示屏幕上的光标161动作。In step S709, when the ratio between the average pixel value of the first pixel group and the average pixel value of the second pixel group is less than or equal to the preset pixel ratio value (for example, 1), it means the image area of the first image The brightness distribution of the IA is uniform, and the brightness difference is small, so the processing unit 13 determines that the pointer touches or touches the touch surface 110 . The processing unit 13 calculates the touch coordinates of the pointer on the optical touch system 1 according to the imaging position of the pointer and its mirror image in the image, so as to correspondingly control the action of the cursor 161 on the display screen of the image display device 16 .
举例来说，请再参考图2B，当指示物是接触或触碰触控面110，第一影像的影像区域IA内的亮度分布实质上会很均匀，而具有最大像素值的像素与具有最低像素值的像素之间的亮度差异会很小，甚至趋近于零。For example, please refer to FIG. 2B again. When the pointer touches or touches the touch surface 110, the luminance distribution in the image area IA of the first image is substantially uniform, and the pixel with the largest pixel value is the same as the pixel with the lowest pixel value. The difference in brightness between pixels of pixel values will be very small, even approaching zero.
据此，处理单元13可根据第一像素群组以及第二像素群组之间的亮度变异来判断指示物是触碰触控面110或是悬浮于触控面110。Accordingly, the processing unit 13 can determine whether the pointer is touching the touch surface 110 or floating on the touch surface 110 according to the brightness variation between the first pixel group and the second pixel group.
在另一具体实施方式中，处理单元13可通过分析第一影像的影像区域IA内各该像素行中该多个像素的像素值变异，来判断指示物是悬浮于触控面110或是触碰触控面110。请参考图8与图9并同时参考图1与图2B。图8显示本发明另一实施例提供的光学触控系统的物件分析方法的流程示意图。图9显示本发明实施例提供的影像感测装置所撷取的具有物件影像的二维影像的示意图。图8的步骤可以是在处理单元13执行图6的步骤S605时执行。In another specific implementation manner, the processing unit 13 can determine whether the pointer is suspended on the touch surface 110 or is touched by analyzing the pixel value variation of the plurality of pixels in each pixel row in the image area IA of the first image. Touch the touch surface 110 . Please refer to FIG. 8 and FIG. 9 and also refer to FIG. 1 and FIG. 2B . FIG. 8 shows a schematic flowchart of an object analysis method for an optical touch system according to another embodiment of the present invention. FIG. 9 shows a schematic diagram of a 2D image with an object image captured by the image sensing device provided by an embodiment of the present invention. The steps in FIG. 8 may be executed when the processing unit 13 executes step S605 in FIG. 6 .
在步骤S801中，处理单元13根据撷取的影像F6计算第一影像的影像区域IA内各该像素行中最大像素值与一最小像素值之间的像素比例值。处理单元13会于由第一影像的影像区域IA的左边界LB至右边界RB，依序计算各该像素行中最大像素值与一最小像素值之间的像素比例值。In step S801, the processing unit 13 calculates the pixel ratio between the maximum pixel value and a minimum pixel value in each pixel row in the image area IA of the first image according to the captured image F6. The processing unit 13 sequentially calculates the pixel ratio value between the maximum pixel value and a minimum pixel value in each pixel row from the left boundary LB to the right boundary RB of the image area IA of the first image.
在步骤S803中，处理单元13判断影像区域中IA具有最大像素比例值的该像素行的像素比例值是否大于上述预设像素比例值(例如约1)。当处理单元13判定具有最大像素比例值的该像素行的像素比例值大于上述预设像素比例值(例如1)，执行步骤S805。反之，当处理单元13判定具有最大像素比例值的该像素行的像素比例值小于或等于上述预设像素比例值(例如约1)，执行步骤S807。In step S803, the processing unit 13 determines whether the pixel ratio value of the pixel row with the largest pixel ratio value in the IA in the image area is greater than the preset pixel ratio value (for example, about 1). When the processing unit 13 determines that the pixel ratio value of the pixel row with the largest pixel ratio value is greater than the preset pixel ratio value (for example, 1), step S805 is executed. On the contrary, when the processing unit 13 determines that the pixel ratio value of the pixel row with the largest pixel ratio value is less than or equal to the preset pixel ratio value (for example, about 1), step S807 is executed.
在步骤S805中，处理单元13会因具有最大像素比例值的该像素行的亮度差异过大，而判定指示物是悬浮于触控面110。而在步骤S807中，处理单元13会因最大像素比例值的该像素行的亮度差异较小，而判定指示物是触碰触控面110。In step S805 , the processing unit 13 determines that the pointer is floating on the touch surface 110 because the brightness difference of the pixel row with the largest pixel ratio value is too large. In step S807 , the processing unit 13 determines that the pointer touches the touch surface 110 because the brightness difference of the pixel row with the maximum pixel ratio value is small.
举例来说，如图9所示，由于影像F6的影像区域IA内被指示物的物件影像I21、I21’遮蔽的面积较小，故影像F6的影像区域IA的亮度差异明显较大，从而具有最大像素比例值的该像素行的像素比例值会大于上述预设像素比例值，故处理单元13会判定指示物是悬浮于该触控面110。For example, as shown in FIG. 9, since the area covered by the object images I21, I21' of the pointer in the image area IA of the image F6 is relatively small, the brightness difference of the image area IA of the image F6 is obviously larger, thus having The pixel ratio value of the pixel row with the maximum pixel ratio value is greater than the preset pixel ratio value, so the processing unit 13 determines that the pointer is floating on the touch surface 110 .
另举例来说，若第一影像为图2B所示的影像F2，则影像F2影像区域IA内被指示物的物件影像I21、I21’遮蔽的面积较大，故影像区域IA的亮度差异较小。从而，影像区域IA内具有最大像素比例值的该像素行的像素比例值会小于或是等于上述预设像素比例值，故处理单元13会判定指示物是触碰触控面110。For another example, if the first image is the image F2 shown in FIG. 2B, the area covered by the object images I21, I21' of the pointer in the image area IA of the image F2 is relatively large, so the brightness difference in the image area IA is small. . Therefore, the pixel ratio value of the pixel row with the largest pixel ratio value in the image area IA is less than or equal to the preset pixel ratio value, so the processing unit 13 determines that the pointer is touching the touch surface 110 .
处理单元13并根据指示物与其镜像于影像的成像位置计算指示物于光学触控系统1的触控坐标，以对应控制影像显示设备16的显示屏幕上的光标161动作。The processing unit 13 calculates the touch coordinates of the pointer on the optical touch system 1 according to the imaging position of the pointer and its mirror image in the image, so as to correspondingly control the action of the cursor 161 on the display screen of the image display device 16 .
在又一具体实施方式中，处理单元13可通过分析影像区域IA内各该像素行中最大像素值与最低像素值之间的像素值差异，并以此判断指示物是悬浮于触控面110或是触碰触控面110。请参照图10并同时参照图9与图2B。图10显示本发明另一实施例提供的光学触控系统的物件分析方法的流程示意图。图10的步骤可以是在处理单元13执行图6的步骤S605时执行。In yet another specific implementation, the processing unit 13 can determine whether the pointer is floating on the touch surface 110 by analyzing the difference in pixel values between the maximum pixel value and the minimum pixel value in each pixel row in the image area IA. Or touch the touch surface 110 . Please refer to FIG. 10 and also refer to FIG. 9 and FIG. 2B . FIG. 10 shows a schematic flowchart of an object analysis method for an optical touch system according to another embodiment of the present invention. The steps in FIG. 10 may be executed when the processing unit 13 executes step S605 in FIG. 6 .
在步骤S1001中，处理单元13可根据所撷取的第一影像计算第一影像的该影像区域IA中每一像素行中最大像素值与最低像素值之间的一像素差值。处理单元13会于由第一影像的该影像区域的左边界LB至右边界RB，依序计算各该像素行中最大像素值与一最小像素值之间的像素值差异(即亮度值差异)。In step S1001, the processing unit 13 may calculate a pixel difference between the maximum pixel value and the minimum pixel value in each pixel row in the image area IA of the first image according to the captured first image. The processing unit 13 will sequentially calculate the pixel value difference (ie brightness value difference) between the maximum pixel value and a minimum pixel value in each pixel row from the left boundary LB to the right boundary RB of the image area of the first image. .
在步骤S1003中，判断第一影像的该影像区域IA内具有最小像素差值的像素行的该像素差值是否大于一预设像素差值(例如零)。当处理单元13判定具有最小像素差值的该像素行的像素差值大于所述预设像素差值(例如零)，执行步骤S1005。反之，当处理单元13判定具有最小像素差值的该像素行的像素差值小于或等于上述预设像素差值(例如零)，执行步骤S1007。In step S1003, it is determined whether the pixel difference value of the pixel row with the smallest pixel difference value in the image area IA of the first image is greater than a preset pixel difference value (eg, zero). When the processing unit 13 determines that the pixel difference value of the pixel row with the smallest pixel difference value is greater than the preset pixel difference value (for example, zero), step S1005 is executed. On the contrary, when the processing unit 13 determines that the pixel difference value of the pixel row having the smallest pixel difference value is less than or equal to the preset pixel difference value (for example, zero), step S1007 is executed.
在步骤S1005中，处理单元13会因具有最小像素差值的该像素行的亮度差异过大，而判定指示物是悬浮于触控面110。而在步骤S1007中，处理单元13会因最小像素差值的该像素行的亮度差异较小，而判定指示物是触碰触控面110。In step S1005 , the processing unit 13 determines that the pointer is floating on the touch surface 110 because the brightness difference of the pixel row with the smallest pixel difference value is too large. In step S1007 , the processing unit 13 determines that the pointer touches the touch surface 110 because the brightness difference of the pixel row with the minimum pixel difference value is small.
举例来说，以第一影像为图9所示的影像F6，由于影像F6的影像区域IA内被指示物的物件影像I21、I21’遮蔽的面积较小，故影像F6的影像区域IA内任一像素行之间的亮度差异会较大，故具有最小像素差值的该像素行的像素差值会大于上述预设像素差值，故处理单元13会判定指示物是悬浮于该触控面110。For example, taking the first image as the image F6 shown in FIG. 9, since the area covered by the object images I21, I21' of the pointer in the image area IA of the image F6 is relatively small, any area in the image area IA of the image F6 The brightness difference between a pixel row will be larger, so the pixel difference value of the pixel row with the smallest pixel difference value will be greater than the above-mentioned preset pixel difference value, so the processing unit 13 will determine that the pointer is floating on the touch surface 110.
另举例来说，若第一影像为图2B所示的影像F2，则影像F2影像区域IA内被指示物的物件影像I21、I21’遮蔽的面积较大，故影像F6的影像区域IA内任一像素行之间的亮度差异较小。从而，影像F6的影像区域IA内具有最小像素差值的该像素行的像素差值会小于上述预设像素差值，故处理单元13会判定指示物触碰触控面110。For another example, if the first image is the image F2 shown in FIG. 2B, the area covered by the object images I21, I21' of the pointer in the image area IA of the image F2 is relatively large, so any image in the image area IA of the image F6 The brightness difference between rows of a pixel is small. Therefore, the pixel difference of the pixel row with the smallest pixel difference in the image area IA of the image F6 is smaller than the preset pixel difference, so the processing unit 13 determines that the pointer touches the touch surface 110 .
在再一具体实施方式中，处理单元13可通过分析影像区域内各该像素行中的平均像素值(也即平均亮度值)，并以此判断指示物是悬浮于触控面110或是触碰触控面110。请参照图11并同时参照图9与图2B。图11显示本发明另一实施例提供的光学触控系统的物件分析方法的流程示意图。图11的步骤可以是在处理单元13执行图6的步骤S605时执行。In yet another specific implementation, the processing unit 13 can analyze the average pixel value (that is, the average brightness value) in each pixel row in the image area to determine whether the pointer is floating on the touch surface 110 or touch Touch the touch surface 110 . Please refer to FIG. 11 and also refer to FIG. 9 and FIG. 2B . FIG. 11 shows a schematic flowchart of an object analysis method for an optical touch system according to another embodiment of the present invention. The steps in FIG. 11 may be executed when the processing unit 13 executes step S605 in FIG. 6 .
在步骤S1101中，处理单元13可根据所撷取的第一影像(图9的影像F6)计算第一影像的该影像区域IA中每一像素行的一平均像素值。处理单元13会于由第一影像的该影像区域的左边界LB至右边界RB，依序计算各该像素行的平均像素值。In step S1101, the processing unit 13 may calculate an average pixel value of each pixel row in the image area IA of the first image according to the captured first image (image F6 in FIG. 9 ). The processing unit 13 sequentially calculates the average pixel value of each pixel row from the left boundary LB to the right boundary RB of the image region of the first image.
在步骤S1103中，判断第一影像的该影像区域IA内具有最小平均像素值的像素行的该平均像素值是否大于一默认平均像素值(例如是背景影像中强光区域内任一像素行的平均像素值)。当处理单元13判定具有最小平均像素值的像素行的该平均像素值大于上述默认平均像素值，执行步骤S1105。反之，当处理单元13判定具有最小平均像素值的像素行的该平均像素值小于或等于上述默认平均像素值，执行步骤S1107。In step S1103, it is determined whether the average pixel value of the pixel row having the smallest average pixel value in the image area IA of the first image is greater than a default average pixel value (for example, any pixel row in the strong light area in the background image) average pixel value). When the processing unit 13 determines that the average pixel value of the pixel row with the minimum average pixel value is greater than the default average pixel value, step S1105 is executed. On the contrary, when the processing unit 13 determines that the average pixel value of the pixel row with the minimum average pixel value is less than or equal to the default average pixel value, step S1107 is executed.
在步骤S1105中，处理单元13会因具有最小平均像素值的像素行的平均像素值较大，表示影像区域IA的亮度过大，而判定指示物是悬浮于触控面110。而在步骤S1107中，处理单元13会因具有最小平均像素值的像素行的平均像素值较小，表示影像区域的亮度较小，而判定指示物是触碰触控面110。In step S1105 , the processing unit 13 determines that the pointer is floating on the touch surface 110 because the pixel row with the smallest average pixel value has a larger average pixel value, indicating that the brightness of the image area IA is too large. In step S1107 , the processing unit 13 determines that the pointer touches the touch surface 110 because the average pixel value of the pixel row with the smallest average pixel value is smaller, indicating that the brightness of the image area is smaller.
举例来说，若第一影像为图9所示的影像F6，由于影像F6的影像区域IA内被指示物的物件影像I21、I21’遮蔽的面积较小，故影像F6的影像区域IA内任一像素行之间的平均像素值较大，故具有最小平均像素值的该像素行的平均像素值会大于上述默认平均像素值，故处理单元13会判定指示物是悬浮于该触控面110。For example, if the first image is the image F6 shown in FIG. 9, since the area covered by the object images I21, I21' of the pointer in the image area IA of the image F6 is relatively small, any area in the image area IA of the image F6 The average pixel value between a pixel row is relatively large, so the average pixel value of the pixel row with the smallest average pixel value will be greater than the above-mentioned default average pixel value, so the processing unit 13 will determine that the pointer is floating on the touch surface 110 .
另举例来说，若第一影像为图2B所示的影像F2，则影像F2影像区域IA内被指示物的物件影像I21、I21’遮蔽的面积较大，故影像F6的影像区域IA内任一像素行之间的平均像素值较小。影像F6的影像区域IA内具有最小平均像素值的该像素行的平均像素值值会小于上述默认像素平均像素值，故处理单元13会判定指示物是触碰触控面110。For another example, if the first image is the image F2 shown in FIG. 2B, the area covered by the object images I21, I21' of the pointer in the image area IA of the image F2 is relatively large, so any image in the image area IA of the image F6 The average pixel value between one pixel row is smaller. The average pixel value of the pixel row with the smallest average pixel value in the image area IA of the image F6 is smaller than the default pixel average pixel value, so the processing unit 13 determines that the pointer is touching the touch surface 110 .
所述预设像素比例值、预设像素差值以及默认平均像素值可依据实际应用需求以固件方式预先设计于处理单元13。所述预设像素比例值、预设像素差值以及默认平均像素值也可以是依据或是预先储存于存储单元14，并供处理单元13于操作时读取应用。The preset pixel ratio value, preset pixel difference value and default average pixel value can be pre-designed in the processing unit 13 by firmware according to actual application requirements. The preset pixel ratio value, preset pixel difference value and default average pixel value can also be based on or pre-stored in the storage unit 14, and can be read and used by the processing unit 13 during operation.
此外，上述预设像素比例值、预设像素差值以及默认平均像素值可以是依据光学触控系统的实际操作需求，例如感测指示物触碰触控面的灵敏度、发光元件产生的亮度、影像感测装置的感应度与噪声强度以及光学触控系统1周遭的环境亮度等来设定，且于所属技术领域具通常知识者应可根据上述说明来分别对应设定适当的预设像素比例值、预设像素差值以及默认平均像素值，以精确地定义出检测的影像区域范围。因此，本发明并不限制上述预设像素比例值、预设像素差值以及默认平均像素值等的具体设定与实施方式。In addition, the aforementioned preset pixel ratio value, preset pixel difference value, and default average pixel value may be based on the actual operation requirements of the optical touch system, such as the sensitivity of sensing an object touching the touch surface, the brightness generated by the light-emitting element, The sensitivity and noise intensity of the image sensing device and the ambient brightness around the optical touch system 1 are set, and those with ordinary knowledge in the technical field should be able to set appropriate preset pixel ratios according to the above descriptions. Value, preset pixel difference value and default average pixel value to precisely define the detected image area range. Therefore, the present invention does not limit the specific setting and implementation of the aforementioned preset pixel ratio value, preset pixel difference value, and default average pixel value.
上述图6的物件分析方法与图7、图8、图10以及图11关于影像区域的分析方法可以是通过固件程序设计方式写入于处理单元13的处理芯片来实现，以使处理单元13于运作时执行图6、图7、图8、图10所述的演算方法，本发明并不限制。此外，在实际应用上，处理单元13也可在执行执行图6的步骤S605时依序执行图7、图8、图10以及图11所述指示物触控状态的判断方式。要说明的是，图6、图7、图8、图10以及图11仅用于说明本实施例提供的物件分析方法的实施方式，并非用以限定本发明。The above-mentioned object analysis method in FIG. 6 and the analysis methods in FIG. 7 , FIG. 8 , FIG. 10 and FIG. 11 on the image area can be realized by writing the processing chip in the processing unit 13 through firmware programming, so that the processing unit 13 can During operation, the calculation methods described in FIG. 6 , FIG. 7 , FIG. 8 , and FIG. 10 are executed, which is not limited by the present invention. In addition, in practical application, the processing unit 13 may also sequentially execute the judgment method of the touch state of the pointer described in FIG. 7 , FIG. 8 , FIG. 10 and FIG. 11 when executing step S605 of FIG. 6 . It should be noted that FIG. 6 , FIG. 7 , FIG. 8 , FIG. 10 and FIG. 11 are only used to illustrate the implementation of the object analysis method provided in this embodiment, and are not intended to limit the present invention.
本实施例另提供强光区域的界定与背景亮度曲线数据产生方法。请参照图12并同时参照图1、图3A与图3B。图12显示本发明实施例提供的背景影像中强光区域界定方法的流程示意图。This embodiment also provides a method for defining the strong light area and generating background brightness curve data. Please refer to FIG. 12 and also refer to FIG. 1 , FIG. 3A and FIG. 3B . FIG. 12 shows a schematic flowchart of a method for defining a strong light area in a background image provided by an embodiment of the present invention.
在步骤S1201中，在指示物尚未靠近面板11的触控面110上的触控感测区TR之前(例如于光学触控系统1初启动时)，驱动影像感测装置12撷取横跨触控面110的触控面的背景影像FB。所述背景影像FB包含背景区域DR以及强光区域BR。In step S1201, before the pointer approaches the touch sensing region TR on the touch surface 110 of the panel 11 (for example, when the optical touch system 1 is initially started), the image sensing device 12 is driven to capture images across the touch area. The background image FB of the touch surface of the control surface 110 . The background image FB includes a background area DR and a strong light area BR.
所述强光区域BR的纵向高度是由触控面110、反光镜130、第一反光单元140以及第二反光单元150所决定。所述背景区域DR则是涵盖触控面110、反光镜130、第一反光单元140以及第二反光单元150以外的背景区域(包含触控感测区域TR的实像与镜像区域)。The longitudinal height of the strong light area BR is determined by the touch surface 110 , the mirror 130 , the first reflective unit 140 and the second reflective unit 150 . The background region DR covers the background region (including the real image and the mirror region of the touch sensing region TR) except the touch surface 110 , the mirror 130 , the first reflective unit 140 and the second reflective unit 150 .
在步骤S1203中，比较背景影像FB中每一像素行中的各该像素值与一预设像素值。所述预设像素值可如前述实施例所述是根据背景影像FB的平均亮度值与默认权重值(例如1.2)来设定。所述默认权重值是依据光学触控系统1的实际操作需求(例如影像感测装置的影像感测能力或是光学触控系统周遭的环境亮度等)来设定。所述预设像素值也可如前述实施例所述是根据背景影像FB中各该像素行的平均亮度值与默认权重值(例如1.2)来设定对应各该像素行的预设像素值，本实施例并不限制。In step S1203, each pixel value in each pixel row in the background image FB is compared with a preset pixel value. The preset pixel value can be set according to the average brightness value and default weight value (for example, 1.2) of the background image FB as described in the foregoing embodiments. The default weight value is set according to the actual operation requirements of the optical touch system 1 (such as the image sensing capability of the image sensing device or the ambient brightness around the optical touch system, etc.). The preset pixel value can also be set according to the average luminance value and the default weight value (for example, 1.2) of each pixel row in the background image FB as described in the above-mentioned embodiment to set the default pixel value corresponding to each pixel row, This embodiment is not limiting.
在步骤S1205中，在背景影像FB中各该像素行定义出一强光上边界H_UB以及一强光下边界H_LB，其中在强光上边界H_UB以及强光下边界H_LB之间的至少一像素值大于上述预设像素值。In step S1205, a strong light upper boundary H_UB and a strong light lower boundary H_LB are defined for each pixel row in the background image FB, wherein at least one pixel value between the strong light upper boundary H_UB and the strong light lower boundary H_LB greater than the preset pixel value above.
具体地说，处理单元13可通过比较背景影像FB中每一像素行中的各个像素的像素值与预设像素值，并根据各该像素行中具有亮度大于预设像素值的该多个像素所在的密集区块定义强光上边界H_UB以及一强光下边界H_LB。Specifically, the processing unit 13 can compare the pixel value of each pixel in each pixel row in the background image FB with the preset pixel value, and according to the plurality of pixels in each pixel row that have brightness greater than the preset pixel value The dense block where it is located defines a strong light upper boundary H_UB and a strong light lower boundary H_LB.
在步骤S1207中，处理单元13根据强光上边界H_UB以及一强光下边界H_LB于该背景影像FB中定义一强光区域。In step S1207, the processing unit 13 defines a strong light area in the background image FB according to the high light upper boundary H_UB and a strong light lower boundary H_LB.
而后，在步骤S1209中，处理单元13计算背景影像FB中强光区域BR内每一像素行中多个像素值的亮度总和，以产生背景亮度曲线数据。具体地说，处理单元13会将背景影像FB中强光区域BR内各像素行的该多个像素的像素值相加，以作为该像素行的亮度值。处理单元13并将背景亮度曲线数据储存于存储单元14。Then, in step S1209 , the processing unit 13 calculates the brightness sum of multiple pixel values in each pixel row in the strong light area BR in the background image FB to generate background brightness curve data. Specifically, the processing unit 13 adds the pixel values of the plurality of pixels in each pixel row in the strong light area BR in the background image FB to be the brightness value of the pixel row. The processing unit 13 stores the background brightness curve data in the storage unit 14 .
在另一实施方式中，处理单元13也可如前述所说再根据一预设百分比(例如80％)，产生具有较低亮度的背景亮度曲线，以提供亮度公差。处理单元13并根据计算的背景亮度曲线对应产生背景亮度曲线数据。In another embodiment, the processing unit 13 can also generate a background brightness curve with a lower brightness according to a preset percentage (for example, 80%) as mentioned above, so as to provide a brightness tolerance. The processing unit 13 correspondingly generates background brightness curve data according to the calculated background brightness curve.
上述图12的强光区域与背景亮度数据产生方法也可以是通过固件程序设计方式写入于处理单元13的处理芯片来实现，且图12仅用于说明本实施例提供的强光区域与背景亮度数据产生方法的一具体实施方式，并非用以限定本发明。The above-mentioned strong light area and background brightness data generation method in FIG. 12 can also be implemented by writing the processing chip in the processing unit 13 through firmware programming, and FIG. 12 is only used to illustrate the strong light area and background provided by this embodiment. A specific implementation of the brightness data generation method is not intended to limit the present invention.
〔光学触控系统的另一实施例〕[Another embodiment of the optical touch system]
请同时参照图13、图14A与图14B，图13显示本发明另一实施例提供的光学触控系统的系统结构示意图。图14A～图14B是本发明另一实施例提供的影像感测装置所撷取的具有物件影像的影像的示意图。Please refer to FIG. 13 , FIG. 14A and FIG. 14B at the same time. FIG. 13 shows a schematic diagram of the system structure of an optical touch system provided by another embodiment of the present invention. 14A-14B are schematic diagrams of images with object images captured by an image sensing device according to another embodiment of the present invention.
图13的光学触控系统3与图1的光学触控系统1的差异在于图13的光学触控系统3包含两个影像感测装置，如第一影像感测装置12a与第二影像感测装置12b，以避免单一影像感测装置因其设置位置或发光元件的设置位置造成视野死角(blind spot)而导致误判。此外，图13的光学触控系统3的反光镜130是由一第三反光单310来替换。而触控面110、发光元件120、第一反光单元140、第二反光单元150以及第三反光单310所包围的区域为光学触控系统3的触控感测区TR。所述触控感测区TR具有一高度H，且高度H是依据光学触控系统3的实际结构与操作需求来设置。The difference between the optical touch system 3 in FIG. 13 and the optical touch system 1 in FIG. 1 is that the optical touch system 3 in FIG. 13 includes two image sensing devices, such as a first image sensing device 12a and a second image sensing device The device 12b is used to avoid misjudgment caused by a blind spot caused by a single image sensing device due to its installation position or the installation position of the light emitting element. In addition, the reflector 130 of the optical touch system 3 in FIG. 13 is replaced by a third reflector 310 . The area surrounded by the touch surface 110 , the light emitting element 120 , the first reflective unit 140 , the second reflective unit 150 and the third reflective unit 310 is the touch sensing region TR of the optical touch system 3 . The touch sensing region TR has a height H, and the height H is set according to the actual structure and operation requirements of the optical touch system 3 .
更进一步地说，所述第一影像感测装置12a是设置于触控面110的第一边缘111与第二边缘113相交的第一角落。所述第二影像感测装置12b是设置于触控面110的第一边缘111与第四边缘117相交的第二角落。第一影像感测装置12a与该第二影像感测装置12b是分别设置于面板11上不同位置，且具有重叠的影像感测范围，以此提高光学触控系统3的触控识别率。Furthermore, the first image sensing device 12 a is disposed at a first corner where the first edge 111 and the second edge 113 of the touch surface 110 intersect. The second image sensing device 12 b is disposed at a second corner where the first edge 111 and the fourth edge 117 of the touch surface 110 intersect. The first image sensing device 12 a and the second image sensing device 12 b are respectively disposed at different positions on the panel 11 and have overlapping image sensing ranges, so as to improve the touch recognition rate of the optical touch system 3 .
所述第一影像感测装置12a与第二影像感测装置12b分别撷取横跨触控面110的影像，且可包含或不包含触控面110。所述第一影像感测装置12a与第二影像感测装置12b的纵向视野优选大于触控感测区TR的高度H，以完整地撷取指示物的影像。The first image sensing device 12 a and the second image sensing device 12 b respectively capture images across the touch surface 110 , and may or may not include the touch surface 110 . The vertical field of view of the first image sensing device 12a and the second image sensing device 12b is preferably greater than the height H of the touch sensing region TR, so as to completely capture the image of the pointer.
在本实施例中，触控面110为非反光镜面，不会产生反射影像，故第一影像感测装置12a与第二影像感测装置12b所撷取横跨触控面110的影像仅包第一反光单元140、第二反光单元150、第三反光单元310所包围的区域，但不包括由触控面110镜射产生的影像。In this embodiment, the touch surface 110 is a non-reflective mirror surface, which does not generate reflected images, so the images across the touch surface 110 captured by the first image sensing device 12a and the second image sensing device 12b only include The area surrounded by the first reflective unit 140 , the second reflective unit 150 , and the third reflective unit 310 does not include the image generated by the mirroring of the touch surface 110 .
简单来说，处理单元13可分别根据一默认的影像撷取频率驱动第一影像感测装置12a与第二影像感测装置12b撷取取横跨触控面110的多张影像。该多个影像用以供处理单元13感测到指示物，例如使用者2的手指21或触控笔，是否进入触控感测区TR以及指示物于触控感测区TR的相关操作。In simple terms, the processing unit 13 can respectively drive the first image sensing device 12 a and the second image sensing device 12 b to capture multiple images across the touch surface 110 according to a default image capture frequency. The multiple images are used for the processing unit 13 to sense whether the pointer, such as the finger 21 or the stylus of the user 2, enters the touch sensing region TR and related operations of the pointer on the touch sensing region TR.
详细地说，第一影像感测装置12a会撷取包含指示物(例如手指21的指尖与指腹)遮蔽光线而于第一影像F7形成物件影像I21a。第二影像感测装置12b会撷取包含指示物(例如手指21的指尖与指腹)遮蔽光线而于第二影像F8形成物件影像I21b。第一影像F7与第二影像F8分别包含强光区域BR以及背景区域DR，其中强光区域BR的界定方式以详述于前述实施例，故不再赘述。In detail, the first image sensing device 12a captures the shaded light including the pointer (such as the fingertip and finger pulp of the finger 21) to form the object image I21a in the first image F7. The second image sensing device 12b captures the shaded light including the pointer (such as the fingertip and finger pulp of the finger 21) to form the object image I21b in the second image F8. The first image F7 and the second image F8 respectively include a strong light area BR and a background area DR, and the definition of the strong light area BR is described in the foregoing embodiments in detail, so it will not be repeated here.
处理单元13可根据第一影像感测装置12a与第二影像感测装置12b的感测结果(及第一影像F7与第二影像F8)来判断指示物是触碰触控面110或是悬浮于触控面110。The processing unit 13 can determine whether the pointer is touching the touch surface 110 or floating according to the sensing results of the first image sensing device 12a and the second image sensing device 12b (and the first image F7 and the second image F8). on the touch surface 110 .
当第一影像感测装置12a与第二影像感测装置12b的感测结果同时显示指示物是触碰触控面110时，处理单元13判定指示物是触碰触控面110。而当第一影像感测装置12a与第二影像感测装置12b的感测结果的任一显示指示物是悬浮于触控面110时，处理单元13判定指示物是悬浮于触控面110。When the sensing results of the first image sensing device 12 a and the second image sensing device 12 b simultaneously show that the pointer is touching the touch surface 110 , the processing unit 13 determines that the pointer is touching the touch surface 110 . When any indicator displayed in the sensing results of the first image sensing device 12 a and the second image sensing device 12 b is floating on the touch surface 110 , the processing unit 13 determines that the pointer is floating on the touch surface 110 .
当处理单元13判定指示物是触碰触控面110时，处理单元13根据指示物(例如手指21)于第一影像F7与第二影像F8的成像位置，计算指示物相对于触控面110的触控坐标。处理单元13并将计算触控坐标的相关数据传送至影像显示设备16，以控制影像显示设备16上光标161的动作。When the processing unit 13 determines that the pointer is touching the touch surface 110, the processing unit 13 calculates the position of the pointer relative to the touch surface 110 according to the imaging positions of the pointer (such as a finger 21) in the first image F7 and the second image F8. The touch coordinates of . The processing unit 13 transmits the related data of calculating the touch coordinates to the image display device 16 to control the movement of the cursor 161 on the image display device 16 .
为了能更了解光学触控系统3的操作方式，本发明提供一种应用于光学触控系统3的物件分析方法。请参照图15并同时参照图13、图14A与图14B，图15显示本发明实施例提供的光学触控系统的物件分析方法的流程示意图。In order to better understand the operation mode of the optical touch system 3 , the present invention provides an object analysis method applied to the optical touch system 3 . Please refer to FIG. 15 and FIG. 13 , FIG. 14A and FIG. 14B at the same time. FIG. 15 shows a schematic flowchart of an object analysis method for an optical touch system provided by an embodiment of the present invention.
在步骤S1501中，处理单元13先于指示物尚未进入触控测区TR(例如光学触控系统3初启动或是尚未检测到指示物)时，分别驱动第一影像感测装置12a以及第二影像感测装置12b撷取横跨面板11的触控面110的第一背景影像FB1(图未示出)以及第二背景影像FB2(图未示出)。In step S1501, the processing unit 13 respectively drives the first image sensing device 12a and the second image sensing device 12a before the pointer enters the touch detection area TR (for example, the optical touch system 3 is initially activated or the pointer has not been detected). The image sensing device 12 b captures a first background image FB1 (not shown) and a second background image FB2 (not shown) across the touch surface 110 of the panel 11 .
在步骤S1503中，处理单元13驱动第一影像感测装置12a以及第二影像感测装置12b分别再次撷取横跨触控面110的第一影像F7及第二影像F8。所述第一影像F7具有对应该指示物(例如手指21的指尖与指腹)的第一物件影像I21a，而该第二影像具有对应该指示物的第二物件影像I21b。In step S1503 , the processing unit 13 drives the first image sensing device 12 a and the second image sensing device 12 b to recapture the first image F7 and the second image F8 across the touch surface 110 respectively. The first image F7 has a first object image I21a corresponding to the pointer (such as the fingertip and finger pulp of the finger 21), and the second image has a second object image I21b corresponding to the pointer.
在步骤S1505中，处理单元13通过比较第一影像F7与对应的第一背景影像FB1，在第一影像F7中定义出对应第一物件影像I21a的第一左边界LB1及第一右边界RB1，以在第一影像F7中定义对应第一物件影像I21a的第一影像区域IA1。In step S1505, the processing unit 13 defines a first left boundary LB1 and a first right boundary RB1 corresponding to the first object image I21a in the first image F7 by comparing the first image F7 with the corresponding first background image FB1, The first image area IA1 corresponding to the first object image I21a is defined in the first image F7.
在步骤S1507中，处理单元13通过比较第二影像F8与对应的第二背景影像FB2，在第二影像F8中定义出对应第二物件影像I21b的第二左边界LB2及第二右边界RB2，以在第二影像F8中定义对应第二物件影像I21b的第二影像区域IA2。In step S1507, the processing unit 13 defines a second left boundary LB2 and a second right boundary RB2 corresponding to the second object image I21b in the second image F8 by comparing the second image F8 with the corresponding second background image FB2, The second image area IA2 corresponding to the second object image I21b is defined in the second image F8.
在步骤S1509中，处理单元13分别根据第一影像区域IA1以及第二影像区域IA2中多个像素值之间的亮度差异，判断该指示物是否触碰该触控面110或是悬浮于触控面110。In step S1509, the processing unit 13 judges whether the pointer touches the touch surface 110 or is suspended on the touch surface according to the brightness difference between the pixel values in the first image area IA1 and the second image area IA2 respectively. Surface 110.
在步骤S1511中，若第一影像区域IA1以及第二影像区域IA2的亮度差异同时显示指示物是触碰触控面110时，则判定该指示物是触碰该触控面110并执行步骤S1515。In step S1511, if the brightness difference between the first image area IA1 and the second image area IA2 simultaneously shows that the pointer touches the touch surface 110, it is determined that the pointer touches the touch surface 110 and step S1515 is executed. .
在步骤S1513中，若第一影像区域IA1以及第二影像区域IA2的任一的亮度差异显示指示物是悬浮于触控表面110时，处理单元13判定该指示物是悬浮于触控面110，且处理单元13不计算该指示物相对于触控面110的触控坐标。In step S1513, if the brightness difference between the first image area IA1 and the second image area IA2 indicates that the pointer is floating on the touch surface 110, the processing unit 13 determines that the pointer is floating on the touch surface 110, And the processing unit 13 does not calculate the touch coordinates of the pointer relative to the touch surface 110 .
在一实施方式中，当处理单元13可以是根据第一影像区域IA1内的第一像素群组与第二像素群组之间的亮度差异与第二影像区域IA2内的第三像素群组与第四像素群组之间的亮度差异，判断该指示物是触碰该触控面110或是悬浮于该触控面110。In one embodiment, when the processing unit 13 can be based on the brightness difference between the first pixel group and the second pixel group in the first image area IA1 and the brightness difference between the third pixel group and the second pixel group in the second image area IA2 The difference in brightness between the fourth pixel groups determines whether the pointer touches the touch surface 110 or floats on the touch surface 110 .
具体地说，所述第一像素群组与第三像素群组分别包括至少一高亮度像素，而所述第二像素群组与第四像素群组分别包括至少一低亮度像素。所述高亮度像素为第一影像区域IA1或第二影像区域IA2内具有像素值大于预设阈值的像素。所述低亮度像素为第一影像区域IA1或第二影像区域IA2内具有像素值小于预设阈值的像素。Specifically, the first pixel group and the third pixel group respectively include at least one high-brightness pixel, and the second pixel group and the fourth pixel group respectively include at least one low-brightness pixel. The high-brightness pixels are pixels in the first image area IA1 or the second image area IA2 with pixel values greater than a preset threshold. The low-brightness pixels are pixels in the first image area IA1 or the second image area IA2 with pixel values smaller than a preset threshold.
在另一实施方式中，处理单元13可通过计算于第一影像区域IA1或第二影像区域IA2内各该像素行最大像素值与最低像素值之间的像素比例值或像素差值，或是计算第一影像区域IA1或第二影像区域IA2内各该像素行的平均像素值，来判断第一影像区域IA1或第二影像区域IA2内的亮度分布是否均匀或亮度差异是否过大。In another embodiment, the processing unit 13 can calculate the pixel ratio value or the pixel difference value between the maximum pixel value and the minimum pixel value of each pixel row in the first image area IA1 or the second image area IA2, or Calculate the average pixel value of each pixel row in the first image area IA1 or the second image area IA2 to determine whether the brightness distribution in the first image area IA1 or the second image area IA2 is uniform or whether the brightness difference is too large.
当处理单元13判断第一影像区域IA1或第二影像区域IA2的任一所具有的亮度不均匀或亮度差异是否过大(即最大与最小像素值差异过大)，即判定指示物是悬浮于触控面110。When the processing unit 13 judges whether the brightness unevenness or brightness difference of any one of the first image area IA1 or the second image area IA2 is too large (that is, the difference between the maximum and minimum pixel values is too large), it is determined that the indicator is suspended Touch surface 110 .
当处理单元13同时判断第一影像区域IA1或第二影像区域IA2所具有的亮度均匀，或是最大与最小像素值所具有亮度差异较小，即可判定指示物是触碰触控面110。When the processing unit 13 simultaneously determines that the brightness of the first image area IA1 or the second image area IA2 is uniform, or that the brightness difference between the maximum and minimum pixel values is small, it can determine that the pointer is touching the touch surface 110 .
在步骤S1515中，处理单元13根据第一影像F7中第一物件影像I21a的成像位置以及第二影像F8中第二物件影像I21b的成像位置，计算指示物相对于该触控面110的触控坐标。处理单元13并将计算触控坐标的相关数据传送至影像显示设备16，以控制影像显示设备16上光标161的动作，例如控制光标161的移动操作、书写操作或点选操作等。In step S1515, the processing unit 13 calculates the touch position of the pointer relative to the touch surface 110 according to the imaging position of the first object image I21a in the first image F7 and the imaging position of the second object image I21b in the second image F8. coordinate. The processing unit 13 transmits the related data of the calculated touch coordinates to the image display device 16 to control the action of the cursor 161 on the image display device 16 , such as controlling the cursor 161 to move, write or click.
上述触控坐标计算方式同样可以是利用三角函数来计算，其详细计算方式类似于前述实施例所述内容，且属于现有技术，在此即不予以赘述。The above-mentioned touch coordinate calculation method can also be calculated by using trigonometric functions, and its detailed calculation method is similar to that described in the foregoing embodiments, and belongs to the prior art, so it will not be repeated here.
值得一提的是，所述第一与第二影像感测装置12a、12b可例如为互补式金属氧化物半导体(CMOS)或电荷耦合元件(CCD)，且在所属技术领域具有通常知识者可以依据实际使用情况来设计，本实施例在此不加以限制。It is worth mentioning that the first and second image sensing devices 12a, 12b can be, for example, Complementary Metal Oxide Semiconductor (CMOS) or Charge Coupled Device (CCD), and those skilled in the art can It is designed according to actual usage conditions, and is not limited in this embodiment.
此外，为了增加第一、第二及第三反光单元140、150、310的反光效果，在其他实施方式中，可选择增设与发光元件120相同结构的另一发光元件照射触控面110。此新增的发光元件可例如与第二影像感测装置12b整合设置于第二角落。新增的发光元件可以采用黏合(sticking)、螺丝锁固(screwing)或扣合(fastening)的方式固定于影像感测装置12b上。In addition, in order to increase the reflective effect of the first, second and third reflective units 140 , 150 , 310 , in other embodiments, another light-emitting element with the same structure as the light-emitting element 120 may be added to illuminate the touch surface 110 . The added light-emitting element can be integrated with the second image sensing device 12b and disposed at the second corner, for example. The newly added light emitting element can be fixed on the image sensing device 12b by means of sticking, screwing or fastening.
由此，光学触控系统3可通过增设两个影像感测装置，提升光学触控系统3的触控识别率。但在其他实施方式中，光学触控系统3也可包含三个、四个或多个影像感测装置，且该多个个影像感测装置分别设置于不同位置，且具有重叠的视野，来提升光学触控系统3的触控识别率。换言之，光学触控系统3中影像感测装置的设置数量与设置位置是依据光学触控系统3的实际结构与操作需求来设计，本实施例并不限制。Therefore, the optical touch system 3 can increase the touch recognition rate of the optical touch system 3 by adding two image sensing devices. However, in other embodiments, the optical touch system 3 may also include three, four or more image sensing devices, and the plurality of image sensing devices are respectively arranged at different positions and have overlapping fields of view, to Improve the touch recognition rate of the optical touch system 3 . In other words, the number and location of the image sensing devices in the optical touch system 3 are designed according to the actual structure and operation requirements of the optical touch system 3 , which are not limited by this embodiment.
上述图15的物件分析方法也可以是通过固件程序设计方式写入于处理单元13的处理芯片来实现，且图15仅用于说明本实施例提供的物件分析方法的实施方式，并非用以限定本发明。The above-mentioned object analysis method in FIG. 15 can also be implemented by writing the processing chip in the processing unit 13 through firmware programming, and FIG. 15 is only used to illustrate the implementation of the object analysis method provided in this embodiment, and is not intended to limit this invention.
另外，本发明也可利用一种计算机可读取记录媒体，储存前述图6与图15所述的物件分析方法、图12所述的强光区域界定方法以及图7、图8、图10以及图11所述的物件分系判断方法等的计算机程序码，以于计算机可读取记录媒体被一处理器读取时执行前述的步骤。此计算机可读取媒体可以是软盘、硬盘、光盘、随身碟、磁带、可由网络存取的数据库或熟知此项技术者可轻易思及具有相同功能的储存媒体。In addition, the present invention can also use a computer-readable recording medium to store the object analysis method described in FIG. 6 and FIG. 15, the strong light area definition method described in FIG. The objects described in FIG. 11 are computer program codes such as a judging method to execute the aforementioned steps when the computer readable recording medium is read by a processor. The computer-readable medium can be a floppy disk, hard disk, optical disk, pen drive, magnetic tape, database accessible from the network, or a storage medium with the same function that those skilled in the art can easily think of.
〔实施例的可能功效〕[Possible efficacy of the embodiment]
综上所述，光学触控系统以及其物件分析方法，所述物件分析方法会于指示物靠近或位于光学触控系统的触控感测区时，自动撷取对应指示物的影像。光学触控系统并可根据影像中指示物遮蔽部分光线所形成的物件影像的亮度分布信息，快速且准确地判断所检测到的指示物是接触或触控面板的触控面或悬浮于该触控面。所述物件分析方法可根据判断结果，决定是否计算检测到的物件的触控坐标，进而有效提升光学触控系统中触控点识别率与运行效率。To sum up, the optical touch system and its object analysis method, the object analysis method will automatically capture the image of the corresponding pointer when the pointer is close to or located in the touch sensing area of the optical touch system. The optical touch system can quickly and accurately determine whether the detected indicator is in contact with the touch surface of the touch panel or suspended on the touch panel according to the brightness distribution information of the object image formed by the indicator blocking part of the light in the image. control surface. The object analysis method can determine whether to calculate the touch coordinates of the detected object according to the judgment result, thereby effectively improving the touch point recognition rate and operating efficiency in the optical touch system.
上文所揭示的概念与特定实施例可作为基础，并通过适当地予以修改或设计其他系统结构、制程或系统操作方式而实现与本发明相同的目的。因此，以上所述仅为本发明的实施例，其并非用以局限本发明的专利范围。本发明技术领域具有通常知识者应可了解，上述结构并无法脱离所附的权利要求书所提出的本发明的精神和范围。The concepts and specific embodiments disclosed above can be used as a basis, and the same purpose as the present invention can be achieved by appropriately modifying or designing other system structures, processes or system operation methods. Therefore, the above descriptions are only examples of the present invention, and are not intended to limit the patent scope of the present invention. Those with ordinary knowledge in the technical field of the present invention should understand that the above structure cannot depart from the spirit and scope of the present invention set forth in the appended claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410043884.9ACN104808865B (en) | 2014-01-29 | 2014-01-29 | Optical touch system and object analysis method thereof |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410043884.9ACN104808865B (en) | 2014-01-29 | 2014-01-29 | Optical touch system and object analysis method thereof |
| Publication Number | Publication Date |
|---|---|
| CN104808865A CN104808865A (en) | 2015-07-29 |
| CN104808865Btrue CN104808865B (en) | 2018-03-23 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410043884.9AExpired - Fee RelatedCN104808865B (en) | 2014-01-29 | 2014-01-29 | Optical touch system and object analysis method thereof |
| Country | Link |
|---|---|
| CN (1) | CN104808865B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI718378B (en)* | 2018-05-23 | 2021-02-11 | 友達光電股份有限公司 | Optical detection device and detection method thereof |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120075253A1 (en)* | 2010-09-29 | 2012-03-29 | Pixart Imaging Inc. | Optical touch system and object detection method therefor |
| CN103076925A (en)* | 2011-10-26 | 2013-05-01 | 原相科技股份有限公司 | Optical touch system, optical sensing module and method for operating optical touch system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI420357B (en)* | 2009-08-28 | 2013-12-21 | Pixart Imaging Inc | Touch system and pointer coordinate detecting method therefor |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120075253A1 (en)* | 2010-09-29 | 2012-03-29 | Pixart Imaging Inc. | Optical touch system and object detection method therefor |
| CN103076925A (en)* | 2011-10-26 | 2013-05-01 | 原相科技股份有限公司 | Optical touch system, optical sensing module and method for operating optical touch system |
| Publication number | Publication date |
|---|---|
| CN104808865A (en) | 2015-07-29 |
| Publication | Publication Date | Title |
|---|---|---|
| TWI534687B (en) | Optical touch detection system and object analyzation method thereof | |
| TWI520036B (en) | Object detection method and calibration apparatus of optical touch system | |
| US8786576B2 (en) | Three-dimensional space touch apparatus using multiple infrared cameras | |
| JP5308359B2 (en) | Optical touch control system and method | |
| US9454260B2 (en) | System and method for enabling multi-display input | |
| US9501160B2 (en) | Coordinate detection system and information processing apparatus | |
| US9471180B2 (en) | Optical touch panel system, optical apparatus and positioning method thereof | |
| TWI511008B (en) | Touch detection method and optical touch system thereof | |
| US20130127704A1 (en) | Spatial touch apparatus using single infrared camera | |
| US9489085B2 (en) | Optical touch panel system and positioning method thereof | |
| US9007346B2 (en) | Handwriting system and sensing method thereof | |
| CN104808865B (en) | Optical touch system and object analysis method thereof | |
| CN103076928B (en) | The electronic whiteboard spot identification method and device of imageing sensor is combined based on light film | |
| US20140085264A1 (en) | Optical touch panel system, optical sensing module, and operation method thereof | |
| CN102043543B (en) | Optical touch system and method thereof | |
| TW201617814A (en) | Optical touch screen | |
| CN104699327A (en) | Optical touch system and suspension judgment method thereof | |
| KR101356835B1 (en) | Apparatus and method for multi-touch sensing using total internal reflection | |
| TWI536228B (en) | An inductive motion-detective device | |
| CN102298468B (en) | Object image capturing device and method for capturing object image of pointer | |
| CN104915065A (en) | Object detection method and calibration device for optical touch system | |
| KR101358842B1 (en) | Detecting Module for Detecting Touch Point Selectively By Plural Methods and Screen Input Device Having the Same | |
| CN102364418A (en) | An optical touch positioning system and method |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20180323 Termination date:20200129 |