技术领域technical field
本发明涉及眼动跟踪技术领域，特别涉及一种解决多台眼动仪红外干扰的装置及其控制方法。The invention relates to the technical field of eye movement tracking, in particular to a device for solving infrared interference of multiple eye movement instruments and a control method thereof.
背景技术Background technique
眼动跟踪技术，也称为视线追踪技术，是利用机械、电子、光学等各种检测手段获取受试者当前“视觉注意”的方向的技术。它广泛应用于人机交互、医学、市场营销与广告、工效学、虚拟现实和军事等领域。Eye tracking technology, also known as eye-tracking technology, is a technology that uses various detection methods such as machinery, electronics, and optics to obtain the direction of the subject's current "visual attention". It is widely used in fields such as human-computer interaction, medicine, marketing and advertising, ergonomics, virtual reality and military.
眼动追踪技术按照系统构成和检测方法可以分为头戴式和非头戴式两种，也称侵入式和非侵入式。按照系统工作光照环境，可分为红外光照系统和自然光照系统。头戴式眼动仪的优点视野范围比较广，对被试头部活动范围没有限制，但需要配戴辅助装置，因而检测不到被试在自然状态下的眼动数据，并且采集过程视景总处于不断变化中，导致后期眼动数据分析工作庞大繁复；非头戴式红外光照眼动仪由摄像头式眼动仪采集硬件和配套计算分析软件组成，被试不需要配戴任何辅助装置，后期的眼动数据分析工作相对简单，但缺点是单个眼动仪检测覆盖的视野范围相对较小，尤其是无法满足宽视角场景的应用需要。为了解决单个眼动仪检测视野范围较小的问题，可以将多台眼动仪联合应用。Eye tracking technology can be divided into head-mounted and non-head-mounted types according to system composition and detection methods, also known as invasive and non-invasive. According to the working lighting environment of the system, it can be divided into infrared lighting system and natural lighting system. The advantage of the head-mounted eye tracker is that the field of view is relatively wide, and there is no limit to the range of movement of the subject's head, but it needs to wear an auxiliary device, so the eye movement data of the subject in a natural state cannot be detected, and the visual field of the process is collected It is always in constant change, resulting in a huge and complicated analysis of eye movement data in the later stage; the non-head-mounted infrared light eye tracker is composed of camera-type eye tracker acquisition hardware and supporting calculation and analysis software, and the subjects do not need to wear any auxiliary devices. The later analysis of eye movement data is relatively simple, but the disadvantage is that the detection range of a single eye tracker is relatively small, especially it cannot meet the application needs of wide viewing angle scenes. In order to solve the problem of a small detection field of view of a single eye tracker, multiple eye trackers can be used jointly.
将多个眼动仪联合应用，如何解决各个眼动仪的红外干扰问题是非常关键。多台非头戴式红外光照眼动仪协同工作时，由于互相红外干扰导致设备无法正常获取眼部图像信息。本发明就是为解决上述问题而提出。The joint application of multiple eye trackers, how to solve the problem of infrared interference of each eye tracker is very critical. When multiple non-head-mounted infrared light eye trackers work together, the equipment cannot normally acquire eye image information due to mutual infrared interference. The present invention is proposed in order to solve the above-mentioned problems.
发明内容Contents of the invention
本发明的目的在于针对上述多台非头戴式眼动仪之间的红外线干扰问题，提供一种防多台眼动仪联合应用时红外干扰的装置及其控制方法。The purpose of the present invention is to provide a device and a control method for preventing infrared interference when a plurality of eye trackers are jointly used to solve the problem of infrared interference among the above-mentioned multiple non-head-mounted eye trackers.
本发明所解决的技术问题可以采用以下技术方案来实现：The technical problem solved by the present invention can adopt following technical scheme to realize:
一种解决多台眼动仪红外干扰的装置，其特征在于，包括调光膜、开关控制器和控制装置，至少两台非头戴式眼动仪分别按照视野范围的需要及单台眼动仪的视角范围,进行眼动仪摄像头的布放，所述调光膜设置在所述眼动仪摄像头上，每一所述调光膜的电源开关通过一所述开关控制器与所述控制装置连接。A device for solving infrared interference of multiple eye trackers, characterized in that it includes a light-adjustable film, a switch controller and a control device, and at least two non-head-mounted eye trackers are respectively in accordance with the needs of the field of view and a single eye tracker. The viewing angle range of the eye tracker is used to lay out the camera of the eye tracker. The dimming film is arranged on the camera of the eye tracker. The power switch of each dimming film is connected with the control by a switch controller device connection.
在本发明的一个优选实施例中，所述非头戴式眼动仪为三台，总视角范围为左右各45°,上下各38°。这样布局可以满足特定的操作任务的完成。In a preferred embodiment of the present invention, there are three non-head-mounted eye trackers, and the total viewing angle ranges are 45° left and right, and 38° up and down. This layout can meet the completion of specific operational tasks.
在本发明的一个优选实施例中，所述调光膜包括一对相对设置的透明导电膜和填充在所述一对透明导电膜中间的液晶/聚合物混合材料层，所述一对透明导电膜分别与电源的两极连接。In a preferred embodiment of the present invention, the dimming film includes a pair of opposite transparent conductive films and a liquid crystal/polymer hybrid material layer filled in the middle of the pair of transparent conductive films, and the pair of transparent conductive films The membranes are respectively connected to the two poles of the power supply.
一种如上述任一技术方案所述的解决多台眼动仪红外干扰的装置的控制方法，其特征在于，包括以下步骤：A control method for a device for solving infrared interference of multiple eye trackers as described in any one of the above technical solutions, characterized in that it includes the following steps:
(1)开始阶段，打开所有调光膜；(1) At the beginning, open all dimming films;
(2)当某个非头戴式眼动仪跟踪到人眼并有眼动数据输出时，向控制装置发送命令，使得只有该非头戴式眼动仪上的调光膜处于通电打开状态，其他非头戴式眼动仪上的调光膜处于断电关闭状态，此时，只有该非头戴式眼动仪一直处于跟踪和输出状态；(2) When a non-head-mounted eye tracker tracks the human eye and has eye movement data output, send a command to the control device so that only the dimming film on the non-head-mounted eye tracker is powered on , the dimming film on other non-head-mounted eye trackers is in the power-off state, at this time, only the non-head-mounted eye tracker is always in the tracking and output state;
(3)当步骤(2)中的非头戴式眼动仪跟丢时，向控制装置发送命令，使得所有非头戴式眼动仪上的调光膜处于通电打开状态，此时所有非头戴式眼动仪一起跟踪人眼，如果有某个非头戴式眼动仪找到人眼，则进入步骤(2)。(3) When the non-head-mounted eye trackers in step (2) are lost, send a command to the control device so that the dimming films on all non-head-mounted eye trackers are powered on. At this time, all non-head-mounted eye trackers The head-mounted eye tracker tracks the human eye together, and if a non-head-mounted eye tracker finds the human eye, go to step (2).
由于采用了如上的技术方案，本发明不但彻底解决了多台眼动仪器红外线的干扰问题，而且任何时刻都只有一台眼动仪在工作也解决了多台眼动仪协同工作后续复杂大量的数据融合问题。本发明对眼动仪的个数没有严格限制，可以根据操作任务要求而调整眼动仪的数量。本发明为需要扩大视野范围的多台眼动仪器协同工作的推广起了很好的推动作用。Due to the adoption of the above technical solution, the present invention not only completely solves the problem of infrared interference of multiple eye trackers, but also solves the complex and massive follow-up problems of multiple eye trackers working together at any time. data fusion problem. The present invention does not strictly limit the number of eye trackers, and the number of eye trackers can be adjusted according to the requirements of operation tasks. The invention plays a very good role in promoting the cooperative work of multiple eye movement instruments that need to expand the field of view.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1是本发明一种实施例的结构原理图。Fig. 1 is a structural schematic diagram of an embodiment of the present invention.
图2是本发明一种实施例的调光膜的结构示意图。Fig. 2 is a schematic structural diagram of a light-adjusting film according to an embodiment of the present invention.
图3是本发明一种实施例的调光膜的工作原理图。Fig. 3 is a working principle diagram of a light-adjusting film according to an embodiment of the present invention.
具体实施方式detailed description
为了使本发明实现的技术手段、创作特征、达成目的与功效易于明白了解，下面进一步阐述本发明。In order to make the technical means, creative features, objectives and effects achieved by the present invention easy to understand, the present invention will be further elaborated below.
参见图1所示的一种解决多台眼动仪红外干扰的装置，包括调光膜300、开关控制器400和控制装置200，至少两台非头戴式眼动仪100分别按照视野范围的需要及单台眼动仪的视角范围,进行眼动仪摄像头的布放。本实施例中的非头戴式眼动仪100为三台，总视角范围为左右各45°,上下各38°，这样布局可以满足特定的操作任务的完成。非头戴式眼动仪100的结构与现有技术的大致一样，在这就不赘述。控制装置200优选为PC。See Figure 1 for a device for solving infrared interference of multiple eye trackers, including a dimming film 300, a switch controller 400 and a control device 200, at least two non-head-mounted eye trackers 100 according to the range of vision According to the viewing angle range of a single eye tracker, the camera of the eye tracker is arranged. There are three non-head-mounted eye trackers 100 in this embodiment, and the total viewing angle range is 45° left and right, and 38° up and down, so that the layout can meet the completion of specific operation tasks. The structure of the non-head-mounted eye tracker 100 is roughly the same as that of the prior art, and will not be repeated here. The control device 200 is preferably a PC.
在每一台非头戴式眼动仪100的摄像头表面110贴附有一调光膜300，每一调光膜300的电源开关通过一开关控制器400与控制装置200连接。开关控制器400优选为逆变器控制板，其一端通过USB接在控制装置200上，与控制装置200进行RS232串口通信；另一端与调光膜300的电源开关连接，控制调光膜300的通断。A light-adjustable film 300 is attached to the camera surface 110 of each non-head-mounted eye tracker 100 , and the power switch of each light-adjustable film 300 is connected to the control device 200 through a switch controller 400 . The switch controller 400 is preferably an inverter control board, one end of which is connected to the control device 200 via USB, and performs RS232 serial communication with the control device 200; on and off.
参见图2和图3所示，本实施例中的调光膜300包括一对相对设置的透明导电膜310和填充在一对透明导电膜310中间的液晶/聚合物混合材料层320，一对透明导电膜310分别与电源330的两极连接。一对透明导电膜310包括PET膜311和设置在PET膜内表面的ITO导电层312。当调光膜300通电时(开启状态)，在电场作用下液晶/聚合物混合材料层320分子有序排列，材料折射率趋于一致，大幅抑制光散射，调光膜300呈现无色透明状态；当调光膜300断电时(关闭状态)，液晶/聚合物混合材料层320分子无序取向，材料微观折射率失配，调光膜300产生强烈光散射，外观表现为乳白色或茶色或黑色不透明薄膜；当调节调光膜300的供电电压，可实现调光膜的渐变调光。2 and 3, the dimming film 300 in this embodiment includes a pair of opposite transparent conductive films 310 and a liquid crystal/polymer hybrid material layer 320 filled in the middle of the pair of transparent conductive films 310. The transparent conductive film 310 is respectively connected to two poles of the power supply 330 . The pair of transparent conductive films 310 includes a PET film 311 and an ITO conductive layer 312 disposed on the inner surface of the PET film. When the dimming film 300 is energized (open state), the molecules of the liquid crystal/polymer hybrid material layer 320 are arranged in an orderly manner under the action of the electric field, and the refractive index of the material tends to be consistent, greatly suppressing light scattering, and the dimming film 300 is in a colorless and transparent state ; When the dimming film 300 is powered off (closed state), the molecules of the liquid crystal/polymer hybrid material layer 320 are oriented in disorder, the microscopic refractive index of the material is mismatched, and the dimming film 300 produces strong light scattering, and the appearance is milky white or brown or Black opaque film; when the power supply voltage of the dimming film 300 is adjusted, the gradual dimming of the dimming film can be realized.
测试时，将调光膜300贴在窗户上，观察断电和通电情况下调光膜透光率的变化。开态透光率，大于75％，关态透光率5％；响应时间：关态(off态)至开态(on态)低于5ms,开态(on态)至关态(off态)低于50ms，通电状态视角150°。During the test, stick the dimming film 300 on the window, and observe the change of light transmittance of the dimming film when the power is off and on. On-state light transmittance, greater than 75%, off-state light transmittance 5%; response time: off state (off state) to on state (on state) less than 5ms, on state (on state) to off state (off state ) is less than 50ms, and the viewing angle is 150° in the power-on state.
为了方便表达及控制，针对三台非头戴式眼动仪100，分别依次将调光膜定义为调光膜1、2、3，在开关控制器400中设置命令如下表1：For the convenience of expression and control, for the three non-head-mounted eye trackers 100, the dimming films are respectively defined as dimming films 1, 2, and 3 in sequence, and the commands set in the switch controller 400 are as follows in Table 1:
表1Table 1
一种解决多台眼动仪红外干扰的装置的控制方法，包括以下步骤：A control method for a device for solving infrared interference of multiple eye trackers, comprising the following steps:
(1)开始阶段，打开所有调光膜；(1) At the beginning, open all dimming films;
(2)当某个非头戴式眼动仪(假设是调光膜1对应的非头戴式眼动仪)跟踪到人眼并有眼动数据输出时，向串口发送命令oc1，使得只有该非头戴式眼动仪上的调光膜(即调光膜1)处于通电打开状态，其他非头戴式眼动仪上的调光膜处于断电关闭状态，此时，只有该非头戴式眼动仪一直处于跟踪和输出状态；(2) When a non-head-mounted eye tracker (assuming it is the non-head-mounted eye tracker corresponding to the dimming film 1) tracks the human eye and has eye movement data output, send the command oc1 to the serial port so that only The dimming film (that is, the dimming film 1) on the non-head-mounted eye tracker is in the power-on state, and the dimming films on other non-head-mounted eye trackers are in the power-off and closed state. At this time, only the non-head-mounted eye tracker The head-mounted eye tracker is always in the tracking and output state;
(3)当步骤(2)中的非头戴式眼动仪跟丢时，向串口发送命令oc4，使得所有非头戴式眼动仪上的调光膜处于通电打开状态，此时所有非头戴式眼动仪一起跟踪人眼，如果有某个非头戴式眼动仪找到人眼，则进入步骤(2)。(3) When the non-head-mounted eye tracker in step (2) loses track, send the command oc4 to the serial port, so that the dimming film on all non-head-mounted eye trackers is powered on, and at this time all non-head-mounted eye trackers The head-mounted eye tracker tracks the human eye together, and if a non-head-mounted eye tracker finds the human eye, go to step (2).
由于发送指令过程中将占用串口，因此如果同时有两条命令需要发送，后发送的命令将由于串口被占用而被屏蔽。以上过程可以保证同一时刻只有一台非头戴式眼动仪处于跟踪状态，防止了其余未跟踪到人眼的非头戴式眼动仪对工作中的眼动仪产生红外干扰。Since the serial port will be occupied during the sending of the command, if two commands need to be sent at the same time, the command sent later will be blocked because the serial port is occupied. The above process can ensure that only one non-head-mounted eye tracker is in the tracking state at the same time, preventing the other non-head-mounted eye trackers that have not tracked the human eye from causing infrared interference to the working eye tracker.
本发明不但彻底解决了多台眼动仪器红外线的干扰问题，而且任何时刻都只有一台眼动仪在工作也解决了多台眼动仪协同工作后续复杂大量的数据融合问题。本发明且对眼动仪的个数没有严格限制。本发明为需要扩大视野范围的多台眼动仪器协同工作的推广起了很好的推动作用。The invention not only completely solves the problem of infrared interference of multiple eye trackers, but also solves the problem of complex and massive data fusion after multiple eye trackers work together when only one eye tracker is working. The present invention does not strictly limit the number of eye trackers. The invention plays a very good role in promoting the cooperative work of multiple eye movement instruments that need to expand the field of view.
以上显示和描述了本发明的基本原理和主要特征和本发明的优点。本行业的技术人员应该了解，本发明不受上述实施例的限制，上述实施例和说明书中描述的只是说明本发明的原理，在不脱离本发明精神和范围的前提下，本发明还会有各种变化和改进，这些变化和改进都落入要求保护的本发明范围内。本发明要求保护范围由所附的权利要求书及其等效物界定。The basic principles and main features of the present invention and the advantages of the present invention have been shown and described above. Those skilled in the industry should understand that the present invention is not limited by the above-mentioned embodiments. What are described in the above-mentioned embodiments and the description only illustrate the principle of the present invention. Without departing from the spirit and scope of the present invention, the present invention will also have Variations and improvements all fall within the scope of the claimed invention. The protection scope of the present invention is defined by the appended claims and their equivalents.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710303958.1ACN107102738B (en) | 2017-05-03 | 2017-05-03 | Device for solving infrared interference of multiple eye-movement instruments and control method thereof |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710303958.1ACN107102738B (en) | 2017-05-03 | 2017-05-03 | Device for solving infrared interference of multiple eye-movement instruments and control method thereof |
| Publication Number | Publication Date |
|---|---|
| CN107102738Atrue CN107102738A (en) | 2017-08-29 |
| CN107102738B CN107102738B (en) | 2024-04-05 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710303958.1AActiveCN107102738B (en) | 2017-05-03 | 2017-05-03 | Device for solving infrared interference of multiple eye-movement instruments and control method thereof |
| Country | Link |
|---|---|
| CN (1) | CN107102738B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110171427A (en)* | 2019-05-30 | 2019-08-27 | 北京七鑫易维信息技术有限公司 | The method, apparatus and system of Eye-controlling focus |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101581874A (en)* | 2009-03-27 | 2009-11-18 | 北京航空航天大学 | Tele-immersion teamwork device based on multi-camera acquisition |
| CN102006461A (en)* | 2010-11-18 | 2011-04-06 | 无锡中星微电子有限公司 | Joint tracking detection system for cameras |
| CN204595327U (en)* | 2014-12-26 | 2015-08-26 | 成都理想境界科技有限公司 | Head-mounted display apparatus |
| CN104950476A (en)* | 2014-03-26 | 2015-09-30 | 北京汉王智通科技有限公司 | Electronic control dimming unit for camera device and camera device |
| CN207301972U (en)* | 2017-05-03 | 2018-05-01 | 中国人民解放军海军医学研究所 | A kind of device for solving more eye tracker Infrared jammings |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101581874A (en)* | 2009-03-27 | 2009-11-18 | 北京航空航天大学 | Tele-immersion teamwork device based on multi-camera acquisition |
| CN102006461A (en)* | 2010-11-18 | 2011-04-06 | 无锡中星微电子有限公司 | Joint tracking detection system for cameras |
| CN104950476A (en)* | 2014-03-26 | 2015-09-30 | 北京汉王智通科技有限公司 | Electronic control dimming unit for camera device and camera device |
| CN204595327U (en)* | 2014-12-26 | 2015-08-26 | 成都理想境界科技有限公司 | Head-mounted display apparatus |
| CN207301972U (en)* | 2017-05-03 | 2018-05-01 | 中国人民解放军海军医学研究所 | A kind of device for solving more eye tracker Infrared jammings |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110171427A (en)* | 2019-05-30 | 2019-08-27 | 北京七鑫易维信息技术有限公司 | The method, apparatus and system of Eye-controlling focus |
| Publication number | Publication date |
|---|---|
| CN107102738B (en) | 2024-04-05 |
| Publication | Publication Date | Title |
|---|---|---|
| CN104704419B (en) | Backlight for watching the 3-D view from display from variable viewing angle | |
| CN205942090U (en) | Wearable equipment and unmanned aerial vehicle system | |
| US20150177514A1 (en) | System, method, and computer program product for a pinlight see-through near-eye display | |
| US20180164882A1 (en) | Electronic Device With Adjustable Reflective Display | |
| CN106326880A (en) | Pupil center point positioning method | |
| CN205982834U (en) | Multi -mode wear -type visual device | |
| CN107076998A (en) | Wearable device and UAS | |
| CN101566899A (en) | Multi-point triggering method and system based on linear array laser | |
| CN104731338A (en) | Closed type augmented and virtual reality system and method | |
| CN105911697A (en) | Pancharatnam-Berry phase liquid crystal lens-based smart glasses | |
| CN107656716A (en) | Content display method and device and electronic equipment | |
| CN207301972U (en) | A kind of device for solving more eye tracker Infrared jammings | |
| CN105227882B (en) | A kind of display methods and corresponding intrument | |
| CN106932948A (en) | reflecting screen device and three-dimensional display system | |
| CN107102738A (en) | The device and its control method of a kind of many eye tracker Infrared jammings of solution | |
| CN103853510A (en) | Multi-screen projection display control system and method of handheld electronic device | |
| CN106291914A (en) | Display floater and driving method thereof and display device | |
| Colombo et al. | Mixed reality to design lower limb prosthesis | |
| CN205563453U (en) | Sight tracking and human eye region-of-interest positioning system | |
| Liu et al. | SIA-SLAM: a robust visual SLAM associated with semantic information in dynamic environments | |
| CN204479879U (en) | Display screen | |
| CN205656369U (en) | Liquid crystal light valve wears display device | |
| Sun et al. | Research on learning progress tracking of multimedia port user based on improved CamShift algorithm | |
| CN206115038U (en) | Be bare regulating unit , light regulator spare and wear display device | |
| CN206757204U (en) | A three-dimensional display device |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |