基于虚拟显示(virtual reality，VR)，增强现实(augmented reality，AR)，混合现实(mixed reality，MR)等近眼显示技术的显示设备近年来得到了广泛的应用，而佩戴这些显示设备的舒适程度是许多用户所关心的问题。一般来说，成年人双目之间的瞳孔距离在51毫米到77毫米之间，变化量有26毫米，为了让用户有更好的视觉体验，头戴显示设备需要适应不同瞳距的用户。Display devices based on near-eye display technologies such as virtual reality (VR), augmented reality (AR), mixed reality (mixed reality, MR) have been widely used in recent years, and the comfort level of wearing these display devices is A question of concern to many users. Generally speaking, the interpupillary distance between the eyes of an adult is between 51 mm and 77 mm, with a variation of 26 mm. In order to allow users to have a better visual experience, head-mounted display devices need to adapt to users with different interpupillary distances.

传统的方案中，会在显示设备上增加一个机械结构，用户手动调节该机械结构以适应自己的瞳距。In the traditional solution, a mechanical structure is added to the display device, and the user manually adjusts the mechanical structure to suit his pupil distance.

上述通过手动调节的方式会耗费用户很多时间，并且每更换一个用户都需要重新手动调节，操作非常繁琐。The above-mentioned manual adjustment method will consume a lot of time for the user, and each user needs to manually adjust again, and the operation is very cumbersome.

发明内容Contents of the invention

本申请实施例提供了一种近眼显示装置，用于快速适应用户瞳距，提升用户体验。An embodiment of the present application provides a near-eye display device for quickly adapting to a user's interpupillary distance and improving user experience.

有鉴于此，本申请第一方面提供了一种近眼显示装置，该装置包括：人眼追踪设备以及一个或两个光学系统。In view of this, the first aspect of the present application provides a near-eye display device, which includes: a human eye tracking device and one or two optical systems.

其中，人眼追踪设备用于追踪用户的瞳孔，并确定瞳孔的位置。Wherein, the human eye tracking device is used to track the user's pupil and determine the position of the pupil.

每个光学系统包括：光投影机、光融合器、光反射器和电致动器。Each optical system includes: a light projector, a light fuser, a light reflector and an electric actuator.

光投影机用于发射待呈现给瞳孔的图像对应的光束。A light projector is used to emit light beams corresponding to the image to be presented to the pupil.

光反射器用于对光投影机发射的光束进行反射。The light reflector is used to reflect the light beam emitted by the light projector.

光融合器用于将光反射器反射的光束汇聚到瞳孔中。The light fuser is used to focus the light beam reflected by the light reflector into the pupil.

电致动器用于根据瞳孔的位置确定光反射器的第一调整值，并将光反射器从当前位置调整到第一调整值所指示的位置。The electric actuator is used to determine a first adjustment value of the light reflector according to the position of the pupil, and adjust the light reflector from a current position to a position indicated by the first adjustment value.

本实现方式中用户佩戴上近眼显示设备后，近眼显示设备就会自动根据用户的瞳孔位置对光反射器的位置进行调节，以将光学系统的出瞳位置与瞳孔的位置对准，从而使得近眼显示装置可以适应不同用户的瞳距，这个过程用户无需手动执行任何操作，既快速又方便，提升了用户体验。In this implementation mode, after the user wears the near-eye display device, the near-eye display device will automatically adjust the position of the light reflector according to the user's pupil position, so as to align the exit pupil position of the optical system with the pupil position, so that the near-eye The display device can adapt to the interpupillary distance of different users. During this process, the user does not need to perform any manual operation, which is fast and convenient, and improves the user experience.

在一种可能的实现方式中，电致动器用于从第一映射表中查找与瞳孔的位置对应的光反射器的第一调整值。In a possible implementation manner, the electric actuator is used to look up the first adjustment value of the light reflector corresponding to the position of the pupil from the first mapping table.

本实现方式提供了一种确定光反射器的第一调整值的方式，提高了方案的可实现性。This implementation manner provides a manner for determining the first adjustment value of the light reflector, which improves the feasibility of the solution.

在一种可能的实现方式中，人眼追踪设备还用于根据瞳孔的位置确定瞳孔距离。In a possible implementation manner, the human eye tracking device is further configured to determine the pupillary distance according to the positions of the pupils.

电致动器用于从第二映射表中查找与瞳孔距离对应的光反射器的第一调整值。The electric actuator is used to look up the first adjustment value of the light reflector corresponding to the pupil distance from the second mapping table.

本实现方式提供了另一种确定光反射器的第一调整值的方式，提高了方案的灵活性。This implementation manner provides another manner of determining the first adjustment value of the light reflector, which improves the flexibility of the solution.

在一种可能的实现方式中，电致动器还用于根据瞳孔的位置确定光融合器的第二调整值，并将光融合器从当前位置调整到第二调整值所指示的位置。In a possible implementation manner, the electric actuator is also used to determine a second adjustment value of the optical fuser according to the position of the pupil, and adjust the optical fuser from a current position to a position indicated by the second adjustment value.

需要说明的是，电致动器可以从第一映射表中查找与瞳孔位置对应的光融合器的第二调整值，或者从第二映射表中查找与瞳孔距离对应的光融合器的第二调整值，或者通过其他方式确定光融合器的第二调整值。It should be noted that the electric actuator can look up the second adjustment value of the optical fuser corresponding to the pupil position from the first mapping table, or look up the second adjustment value of the optical fuser corresponding to the pupil distance from the second mapping table. adjustment value, or determine the second adjustment value of the optical fuser by other means.

本实现方式中，电致动器除了可以对光反射器进行调节，还可以对光融合器进行调节，提高了方案的灵活性。In this implementation manner, in addition to adjusting the light reflector, the electric actuator can also adjust the light fuser, which improves the flexibility of the solution.

在一种可能的实现方式中，光投影机包括：激光器以及光扫描器。In a possible implementation manner, the optical projector includes: a laser and an optical scanner.

激光器用于产生多个不同波长的光束。Lasers are used to generate multiple beams of different wavelengths.

光扫描器用于按照预设时序与预设路径对多个不同波长的光束进行二维扫描，以得到图像对应的光束。The optical scanner is used to two-dimensionally scan multiple light beams with different wavelengths according to preset timing and preset paths, so as to obtain the light beams corresponding to the image.

电致动器还用于根据瞳孔的位置确定光扫描器的第三调整值，并将光扫描器从当前位置调整到第三调整值所指示的位置。The electric actuator is also used to determine a third adjustment value of the optical scanner according to the position of the pupil, and adjust the optical scanner from the current position to the position indicated by the third adjustment value.

需要说明的是，电致动器可以从第一映射表中查找与瞳孔位置对应的光扫描器的第三调整值，或者从第二映射表中查找与瞳孔距离对应的光扫描器的第三调整值，或者通过其他方式确定光扫描器的第三调整值。It should be noted that the electric actuator can look up the third adjustment value of the optical scanner corresponding to the pupil position from the first mapping table, or look up the third adjustment value of the optical scanner corresponding to the pupil distance from the second mapping table. adjustment value, or determine the third adjustment value of the optical scanner in other ways.

本实现方式中，电致动器除了可以对光反射器进行调节，还可以对光扫描器进行调节，提高了方案的灵活性。In this implementation manner, in addition to adjusting the optical reflector, the electric actuator can also adjust the optical scanner, which improves the flexibility of the solution.

在一种可能的实现方式中，人眼追踪设备还用于根据瞳孔的位置确定瞳孔距离。当瞳孔距离大于目标距离时，电致动器用于控制光扫描器朝着靠近激光器的方向移动。当瞳孔距离小于目标距离时，电制动器用于控制光扫描器朝着远离激光器的方向移动，其中，目标距离为左眼显示光学系统的出瞳位置与右眼显示光学系统的出瞳位置之间的距离。In a possible implementation manner, the human eye tracking device is further configured to determine the pupillary distance according to the positions of the pupils. When the pupillary distance is greater than the target distance, an electrical actuator is used to control the light scanner to move closer to the laser. When the pupil distance is smaller than the target distance, the electric actuator is used to control the optical scanner to move away from the laser, wherein the target distance is between the exit pupil position of the left-eye display optical system and the exit pupil position of the right-eye display optical system the distance.

本实现方式提供了一种电致动器对光扫描器进行调节的具体方式，提高了方案的可实现性。This implementation mode provides a specific way for the electric actuator to adjust the optical scanner, which improves the feasibility of the solution.

在一种可能的实现方式中，两个光学系统包括左眼显示光学系统以及右眼显示光学系统，人眼追踪设备还用于根据瞳孔的位置确定瞳孔距离。In a possible implementation manner, the two optical systems include a left-eye display optical system and a right-eye display optical system, and the eye tracking device is further configured to determine the pupillary distance according to the positions of the pupils.

当瞳孔距离大于目标距离时，左眼显示光学系统中的电致动器用于控制左眼显示光学系统中的光反射器在第一平面上从当前位置逆时针转动到第一调整值所指示的位置，目标距离为左眼显示光学系统的出瞳位置与右眼显示光学系统的出瞳位置之间的距离，When the pupillary distance is greater than the target distance, the electric actuator in the left-eye display optical system is used to control the light reflector in the left-eye display optical system to rotate counterclockwise from the current position to the position indicated by the first adjustment value on the first plane. position, the target distance is the distance between the exit pupil position of the left eye display optical system and the exit pupil position of the right eye display optical system,

当瞳孔距离大于目标距离时，右眼显示光学系统中的电致动器用于控制右眼显示光学系统中的光反射器在第一平面上从当前位置顺时针转动到第一调整值所指示的位置。When the pupil distance is greater than the target distance, the electric actuator in the right-eye display optical system is used to control the light reflector in the right-eye display optical system to rotate clockwise from the current position to the position indicated by the first adjustment value on the first plane. Location.

需要说明的是，瞳间线指的是两个瞳孔之间的连线，听眶线是眶下缘至外耳门中心的连线，所述用户的瞳间线和听眶线所在的平面平行于所述第一平面，例如所述用户的瞳间线和听眶线所在的平面可以是人体水平面等。It should be noted that the interpupillary line refers to the connection between the two pupils, and the auditory-orbital line is the connection from the infraorbital edge to the center of the outer ear door. The user's interpupillary line is parallel to the plane where the auditory-orbital line is located. On the first plane, for example, the plane where the interpupillary line and the auditory-orbital line of the user are located may be a human body level or the like.

本实现方式提供了一种电致动器对光反射器进行调节的方式，提高了方案的可实现性。This implementation manner provides a manner in which the electric actuator adjusts the light reflector, which improves the feasibility of the solution.

当用户的瞳孔在第一平面上逆时针转动时，左眼显示光学系统中的电致动器用于控制左眼显示光学系统中的光反射器在第一平面上从当前位置逆时针转动到第一调整值所指示的位置。When the user's pupil rotates counterclockwise on the first plane, the electric actuator in the left-eye display optical system is used to control the light reflector in the left-eye display optical system to rotate counterclockwise from the current position to the second position on the first plane. A position indicated by an adjustment value.

当用户的瞳孔在第一平面上逆时针转动时，右眼显示光学系统中的电致动器用于控制右眼显示光学系统中的光反射器在第一平面上从当前位置逆时针转动到第一调整值所指示的位置。When the user's pupil rotates counterclockwise on the first plane, the electric actuator in the right-eye display optical system is used to control the light reflector in the right-eye display optical system to rotate counterclockwise from the current position to the second position on the first plane. A position indicated by an adjustment value.

或者，or,

当用户的瞳孔在第二平面上逆时针转动时，左眼显示光学系统中的电致动器用于在第二平面上控制左眼显示光学系统中的光反射器从当前位置逆时针转动到第一调整值所指示的位置。When the user's pupil rotates counterclockwise on the second plane, the electric actuator in the left-eye display optical system is used to control the light reflector in the left-eye display optical system to rotate counterclockwise from the current position to the second plane on the second plane. A position indicated by an adjustment value.

当用户的瞳孔在第二平面上逆时针转动时，右眼显示光学系统中的电致动器用于在第二平面上控制右眼显示光学系统中的光反射器从当前位置顺时针转动到第一调整值所指示的位置。When the user's pupil rotates counterclockwise on the second plane, the electric actuator in the right-eye display optical system is used to control the light reflector in the right-eye display optical system to rotate clockwise from the current position to the second plane on the second plane. A position indicated by an adjustment value.

需要说明的是，瞳间线指的是两个瞳孔之间的连线，听眶线是眶下缘至外耳门中心的连线，所述用户的瞳间线和听眶线所在的平面平行于所述第一平面，例如所述用户的瞳间线和听眶线所在的平面可以是人体水平面等。第二平面垂直与听眶线，例如可以是人体冠状面等。It should be noted that the interpupillary line refers to the connection between the two pupils, and the auditory-orbital line is the connection from the infraorbital edge to the center of the outer ear door. The user's interpupillary line is parallel to the plane where the auditory-orbital line is located. On the first plane, for example, the plane where the interpupillary line and the auditory-orbital line of the user are located may be a human body level or the like. The second plane is perpendicular to the orbital line, for example, it may be a coronal plane of a human body.

本实现方式提供了另一种电致动器对光反射器进行调节的方式，提高了方案的灵活性。This implementation mode provides another way for the electric actuator to adjust the light reflector, which improves the flexibility of the solution.

本申请第二方面提供了一种近眼显示装置，该装置包括：人眼追踪设备以及一个或两个光学系统。人眼追踪设备用于追踪用户的瞳孔，并确定瞳孔的位置。The second aspect of the present application provides a near-eye display device, which includes: a human eye tracking device and one or two optical systems. The eye tracking device is used to track the user's pupil and determine the position of the pupil.

光投影机用于发射待呈现给用户的图像对应的光束。The light projector is used to emit light beams corresponding to the image to be presented to the user.

电致动器用于根据瞳孔的位置确定光融合器的第一调整值，并将光融合器从当前位置调整到第一调整值所指示的位置。The electric actuator is used to determine the first adjustment value of the optical fuser according to the position of the pupil, and adjust the optical fuser from the current position to the position indicated by the first adjustment value.

本实现方式中用户佩戴上近眼显示设备后，近眼显示设备就会自动根据用户的瞳孔位置对光融合器的位置进行调节，以将光学系统的出瞳位置与瞳孔的位置对准，从而使得近眼显示装置可以适应不同用户的瞳距，这个过程用户无需手动执行任何操作，既快速又方便，提升了用户体验。In this implementation mode, after the user wears the near-eye display device, the near-eye display device will automatically adjust the position of the optical fuser according to the user's pupil position, so as to align the exit pupil position of the optical system with the pupil position, so that the near-eye The display device can adapt to the interpupillary distance of different users. During this process, the user does not need to perform any manual operation, which is fast and convenient, and improves the user experience.

在一种可能的实现方式中，电致动器用于从第一映射表中查找与瞳孔的位置对应的光融合器的第一调整值。In a possible implementation manner, the electric actuator is used to look up the first adjustment value of the optical fuser corresponding to the position of the pupil from the first mapping table.

本实现方式提供了一种确定光融合器的第一调整值的方式，提高了方案的可实现性。This implementation manner provides a manner for determining the first adjustment value of the optical combiner, which improves the feasibility of the solution.

电致动器用于从第二映射表中查找与瞳孔距离对应的融合器的第一调整值。The electric actuator is used to look up the first adjustment value of the fuser corresponding to the pupillary distance from the second mapping table.

本实现方式提供了另一种确定光融合器的第一调整值的方式，提高了方案的灵活性。This implementation manner provides another manner of determining the first adjustment value of the optical fuser, which improves the flexibility of the solution.

电致动器还用于根据瞳孔的位置确定光扫描器的第二调整值，并将光扫描器从当前位置调整到第二调整值所指示的位置。The electric actuator is also used to determine a second adjustment value of the optical scanner according to the position of the pupil, and adjust the optical scanner from the current position to the position indicated by the second adjustment value.

需要说明的是，电致动器可以从第一映射表中查找与瞳孔位置对应的光扫描器的第二调整值，或者从第二映射表中查找与瞳孔距离对应的光扫描器的第二调整值，或者通过其他方式确定光扫描器的第二调整值。It should be noted that the electric actuator can look up the second adjustment value of the optical scanner corresponding to the pupil position from the first mapping table, or look up the second adjustment value of the optical scanner corresponding to the pupil distance from the second mapping table. adjustment value, or determine the second adjustment value of the optical scanner by other means.

本实现方式中，电致动器除了可以对光融合器进行调节，还可以对光扫描器进行调节，提高了方案的灵活性。In this implementation manner, in addition to adjusting the optical fuser, the electric actuator can also adjust the optical scanner, which improves the flexibility of the solution.

在一种可能的实现方式中，人眼追踪设备还用于根据瞳孔的位置确定瞳孔距离。当瞳孔距离大于目标距离时，电致动器用于控制光扫描器朝着靠近激光器的方向移动，当瞳孔距离小于目标距离时，电制动器用于控制光扫描器朝着远离激光器的方向移动，其中，目标距离为左眼显示光学系统的出瞳位置与右眼显示光学系统的出瞳位置之间的距离。In a possible implementation manner, the human eye tracking device is further configured to determine the pupillary distance according to the positions of the pupils. When the pupil distance is greater than the target distance, the electric actuator is used to control the optical scanner to move toward the laser, and when the pupil distance is smaller than the target distance, the electric actuator is used to control the optical scanner to move away from the laser, wherein , the target distance is the distance between the exit pupil position of the left-eye display optical system and the exit pupil position of the right-eye display optical system.

在一种可能的实现方式中，两个光学系统包括左眼显示光学系统以及右眼显示光学系统。In a possible implementation manner, the two optical systems include a left-eye display optical system and a right-eye display optical system.

人眼追踪设备还用于根据瞳孔的位置确定瞳孔距离。Eye tracking devices are also used to determine pupillary distance based on the position of the pupils.

当瞳孔距离大于目标距离时，左眼显示光学系统中的电致动器用于在第一平面上控制左眼显示光学系统中的光融合器从当前位置顺时针转动到第一调整值所指示的位置，目标距离为左眼显示光学系统的出瞳位置与右眼显示光学系统的出瞳位置之间的距离。When the pupil distance is greater than the target distance, the electric actuator in the left-eye display optical system is used to control the optical fuser in the left-eye display optical system to rotate clockwise from the current position to the position indicated by the first adjustment value on the first plane. The target distance is the distance between the exit pupil position of the left-eye display optical system and the exit pupil position of the right-eye display optical system.

当瞳孔距离大于目标距离时，右眼显示光学系统中的电致动器用于在第一平面上控制右眼显示光学系统中的光融合器从当前位置逆时针转动到第一调整值指示的位置。When the pupil distance is greater than the target distance, the electric actuator in the right-eye display optical system is used to control the optical fuser in the right-eye display optical system to rotate counterclockwise from the current position to the position indicated by the first adjustment value on the first plane .

本实现方式提供了一种电致动器对光融合器进行调节的方式，提高了方案的可实现性。This implementation mode provides a mode in which the electric actuator adjusts the optical fuser, which improves the feasibility of the solution.

当用户的瞳孔在第一平面上逆时针转动时，左眼显示光学系统中的电致动器用于在第一平面上控制左眼显示光学系统中的光融合器从当前位置顺时针转动到第一调整值所指示的位置。When the user's pupil rotates counterclockwise on the first plane, the electric actuator in the left-eye display optical system is used to control the optical fuser in the left-eye display optical system to rotate clockwise from the current position to the first plane. A position indicated by an adjustment value.

当用户的瞳孔在第一平面上逆时针转动时，右眼显示光学系统中的电致动器用于在第一平面上控制右眼显示光学系统中的光融合器从当前位置顺时针转动到第一调整值所指示的位置。When the pupil of the user rotates counterclockwise on the first plane, the electric actuator in the right-eye display optical system is used to control the optical fuser in the right-eye display optical system to rotate clockwise from the current position to the first plane on the first plane. A position indicated by an adjustment value.

或者，or,

当用户的瞳孔在第二平面上逆时针转动时，左眼显示光学系统中的电致动器用于在第二平面上控制左眼显示光学系统中的光融合器从当前位置顺时针转动到第一调整值所指示的位置。When the pupil of the user rotates counterclockwise on the second plane, the electric actuator in the left-eye display optical system is used to control the optical fuser in the left-eye display optical system to rotate clockwise from the current position to the second plane on the second plane. A position indicated by an adjustment value.

当用户的瞳孔在第二平面上逆时针转动时，右眼显示光学系统中的电致动器用于在第二平面上控制右眼显示光学系统中的光融合器从当前位置逆时针转动到第一调整值所指示的位置。When the user's pupil rotates counterclockwise on the second plane, the electric actuator in the right-eye display optical system is used to control the optical fuser in the right-eye display optical system to rotate counterclockwise from the current position to the second plane on the second plane. A position indicated by an adjustment value.

需要说明的是，瞳间线指的是两个瞳孔之间的连线，听眶线是眶下缘至外耳门中心的连线，所述用户的瞳间线和听眶线所在的平面平行于所述第一平面，所述用户的瞳间线和听眶线所在的平面可以是人体水平面等。第二平面垂直与听眶线，例如可以是人体冠状面等。It should be noted that the interpupillary line refers to the connection between the two pupils, and the auditory-orbital line is the connection from the infraorbital edge to the center of the outer ear door. The user's interpupillary line is parallel to the plane where the auditory-orbital line is located. On the first plane, the plane where the interpupillary line and the auditory-orbital line of the user are located may be a human body level or the like. The second plane is perpendicular to the orbital line, for example, it may be a coronal plane of a human body.

本实现方式提供了另一种电致动器对光融合器进行调节的方式，提高了方案的灵活性。This implementation method provides another way for the electric actuator to adjust the optical fuser, which improves the flexibility of the solution.

从以上技术方案可以看出，本申请实施例具有以下优点：It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

本申请实施例提供了一种近眼显示装置，该装置包括：人眼追踪设备以及一个或两个光学系统。其中，每个光学系统包括：光投影机、光融合器、光反射器和电致动器。人眼追踪设备用于追踪用户的瞳孔，并确定瞳孔的位置，电致动器用于根据瞳孔的位置确定光反射器的第一调整值，并将光反射器从当前位置调整到第一调整值所指示的位置。也就是说，本申请中用户佩戴上近眼显示设备后，近眼显示设备就会自动根据用户的瞳孔位置对光反射器的位置进行调节，以将光学系统的出瞳位置与瞳孔的位置对准，从而使得近眼显示装置可以适应不同用户的瞳距，这个过程用户无需手动执行任何操作，既快速又方便，提升了用户体验。An embodiment of the present application provides a near-eye display device, which includes: a human eye tracking device and one or two optical systems. Wherein, each optical system includes: a light projector, a light fuser, a light reflector and an electric actuator. The human eye tracking device is used to track the pupil of the user and determine the position of the pupil, and the electric actuator is used to determine the first adjustment value of the light reflector according to the position of the pupil, and adjust the light reflector from the current position to the first adjustment value the indicated location. That is to say, after the user wears the near-eye display device in this application, the near-eye display device will automatically adjust the position of the light reflector according to the user's pupil position, so as to align the exit pupil position of the optical system with the pupil position, Therefore, the near-eye display device can adapt to the pupil distances of different users, and the user does not need to perform any manual operations during this process, which is fast and convenient, and improves user experience.

附图说明Description of drawings

为了更清楚地说明本申请实施例的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例。In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Apparently, the drawings in the following description are only some embodiments of the present application.

图1为本申请实施例中近眼显示装置的一个实施例示意图；FIG. 1 is a schematic diagram of an embodiment of a near-eye display device in an embodiment of the present application;

图2为本申请实施例中近眼显示装置的另一实施例示意图；Fig. 2 is a schematic diagram of another embodiment of the near-eye display device in the embodiment of the present application;

图3为本申请实施例中电致动器对光反射器进行调节的一个场景示意图；FIG. 3 is a schematic diagram of a scene where an electric actuator adjusts a light reflector in an embodiment of the present application;

图4为本申请实施例中近眼显示装置的另一实施例示意图；Fig. 4 is a schematic diagram of another embodiment of the near-eye display device in the embodiment of the present application;

图5为本申请实施例中电致动器对光融合器进行调节的一个场景示意图；Fig. 5 is a schematic diagram of a scene where the electric actuator adjusts the optical fuser in the embodiment of the present application;

图6为本申请实施例中光反射器的一个结构示意图。FIG. 6 is a schematic structural diagram of a light reflector in an embodiment of the present application.

具体实施方式Detailed ways

下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, not all of them.

为了使本技术领域的人员更好地理解本申请方案，下面将结合本申请实施例中的附图，对本申请实施例进行描述。In order to enable those skilled in the art to better understand the solutions of the present application, the following will describe the embodiments of the present application with reference to the drawings in the embodiments of the present application.

本申请中提及的“第一”或“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。此外，本申请文件中提及的“包括”或“具有”及其任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。The "first" or "second" mentioned in the present application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. In addition, "comprising" or "having" and any variations thereof mentioned in the application documents are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to Those steps or elements are not explicitly listed, but may include other steps or elements not explicitly listed or inherent to the process, method, product or apparatus.

需要说明的是，本发明实施例中的近眼显示装置指的是基于近眼显示技术的显示设备，如VR头显、AR眼镜等。本申请实施例中的近眼显示装置包括人眼追踪设备以及一个光学系统，用于实现单目近眼显示。近眼显示装置也可以包括人眼追踪设备以及两个光学系统，这两个光学系统分别为左眼显示光学系统以及右眼显示光学系统，用于双目近眼显示。下面实施例将以近眼显示装置包括两个光学系统为例进行说明。It should be noted that the near-eye display device in the embodiment of the present invention refers to a display device based on a near-eye display technology, such as a VR head-mounted display, AR glasses, and the like. The near-eye display device in the embodiment of the present application includes a human eye tracking device and an optical system for realizing monocular near-eye display. The near-eye display device may also include a human eye tracking device and two optical systems, which are respectively a left-eye display optical system and a right-eye display optical system, for binocular near-eye display. The following embodiments will be described by taking the near-eye display device including two optical systems as an example.

请参阅图1，本申请实施例中近眼显示装置100的一个实施例包括：人眼追踪设备101、左眼显示光学系统102和右眼显示光学系统103。Please refer to FIG. 1 , an embodiment of a near-eye display device 100 in the embodiment of the present application includes: a human eye tracking device 101 , a left-eye display optical system 102 and a right-eye display optical system 103 .

其中，人眼追踪设备101用于确定追踪用户的瞳孔，并确定瞳孔的位置。Wherein, the human eye tracking device 101 is used to determine and track the pupil of the user, and determine the position of the pupil.

左眼显示光学系统102包括：第一光投影机1021、第一光融合器1023、第一光反射器1022和第一电致动器1024。The left-eye display optical system 102 includes: a first light projector 1021 , a first light fuser 1023 , a first light reflector 1022 and a first electric actuator 1024 .

第一光投影机1021用于发射待呈现给左眼瞳孔的图像对应的光束。The first light projector 1021 is used to emit a light beam corresponding to an image to be presented to the pupil of the left eye.

第一光反射器1022用于对第一光投影机1021发射的光束进行反射。The first light reflector 1022 is used for reflecting the light beam emitted by the first light projector 1021 .

第一光融合器1023用于将第一光反射器1022反射的光束汇聚到用户的左眼瞳孔中。The first light combiner 1023 is used to converge the light beam reflected by the first light reflector 1022 into the pupil of the user's left eye.

第一电致动器1024用于根据左眼瞳孔的位置确定第一光反射器的第一调整值，并将第一光反射器1022从当前位置调整到第一光反射器的第一调整值所指示的位置。The first electric actuator 1024 is used to determine the first adjustment value of the first light reflector according to the position of the pupil of the left eye, and adjust the first light reflector 1022 from the current position to the first adjustment value of the first light reflector the indicated location.

右眼显示光学系统103包括：第二光投影机1031、第二光融合器1033、第二光反射器1032和第二电致动器1034。The right-eye display optical system 103 includes: a second light projector 1031 , a second light fuser 1033 , a second light reflector 1032 and a second electric actuator 1034 .

第二光投影机1031用于发射待呈现给右眼瞳孔的图像对应的光束。The second light projector 1031 is used to emit light beams corresponding to the image to be presented to the pupil of the right eye.

第二光反射器1032用于对第二光投影机1031发射的光束进行反射。The second light reflector 1032 is used for reflecting the light beam emitted by the second light projector 1031 .

第二光融合器1033用于将第二光反射器1032反射的光束汇聚到用户的右眼瞳孔中。The second light fuser 1033 is used to converge the light beam reflected by the second light reflector 1032 into the pupil of the user's right eye.

第二电致动器1034用于根据右眼瞳孔的位置确定第二光反射器的第一调整值，并将第二光反射器1032从当前位置整到第二光反射器的第一调整值所指示的位置。应理解，本实施例中第一调整值泛指光反射器的调整值，并不是一个特定的值，左眼显示光学系统中光反射器(即第一光反射器)的第一调整值与右眼显示光学系统中光反射器(即第二光反射器)的第一调整值可以相同也可以不相同。The second electric actuator 1034 is used to determine the first adjustment value of the second light reflector according to the position of the pupil of the right eye, and adjust the second light reflector 1032 from the current position to the first adjustment value of the second light reflector the indicated location. It should be understood that the first adjustment value in this embodiment generally refers to the adjustment value of the light reflector, and is not a specific value. The first adjustment value of the light reflector (that is, the first light reflector) in the left-eye display optical system The first adjustment values of the light reflectors (that is, the second light reflectors) in the right-eye display optical system may be the same or different.

在一种可能的设计中，电致动器除了用于对光反射器的位置进行调节，还用于对光融合器的位置进行调节，即第一电致动器1024还用于根据左眼瞳孔的位置第一光融合器1023的第二调整值，并将第一光融合器1023从当前位置调整到第二调整值所指示的位置。第二电致动器1034还用于根据右眼瞳孔的位置确定第二光融合器1033的第二调整值，并将第二光融合器1033从当前位置调整到第二调整值所指示的位置。In one possible design, the electric actuator is not only used to adjust the position of the light reflector, but also used to adjust the position of the light fuser, that is, the first electric actuator 1024 is also used to adjust the position of the light fuser according to the left eye The pupil position is the second adjustment value of the first optical fuser 1023, and the first optical fuser 1023 is adjusted from the current position to the position indicated by the second adjustment value. The second electric actuator 1034 is also used to determine the second adjustment value of the second optical fusion device 1033 according to the position of the pupil of the right eye, and adjust the second optical fusion device 1033 from the current position to the position indicated by the second adjustment value .

应理解，本实施例中第二调整值泛指光融合器的调整值，并不是一个特定的值，左眼显示光学系统中光融合器(即第一光融合器)的第二调整值与右眼显示光学系统中光融合器(即第二光融合器)的第二调整值可以相同也可以不相同。It should be understood that the second adjustment value in this embodiment generally refers to the adjustment value of the optical fusion device, not a specific value. The second adjustment value of the optical fusion device (ie, the first optical fusion device) in the left-eye display optical system is the The second adjustment value of the optical fuser (that is, the second optical fuser) in the right-eye display optical system may be the same or different.

在一种可能的设计中，光投影机可以由激光器和光扫描器组成，即第一光投影机1021包括：第一激光器10211以及第一光扫描器10212。第二光投影机1031包括：第二激光器10311以及第二光扫描器10312。In a possible design, the optical projector may be composed of a laser and an optical scanner, that is, the first optical projector 1021 includes: a first laser 10211 and a first optical scanner 10212 . The second light projector 1031 includes: a second laser 10311 and a second light scanner 10312 .

其中，第一激光器10211用于产生多个不同波长的光束。Wherein, the first laser 10211 is used to generate multiple beams of different wavelengths.

第一光扫描器10212用于按照预设时序和预设路径对第一激光器产生的光束进行二维扫描以得到待呈现给左眼瞳孔的图像对应的光束。The first light scanner 10212 is configured to two-dimensionally scan the light beam generated by the first laser according to a preset timing and a preset path to obtain a light beam corresponding to an image to be presented to the pupil of the left eye.

第二激光器10311用于产生多个不同波长的光束。The second laser 10311 is used to generate multiple beams of different wavelengths.

第二光扫描器10312用于按照预设时序和预设路径对第二激光器产生的光束进行二维扫描以得到待呈现给右眼瞳孔的图像对应的光束。第一电致动器1024还用于根据瞳孔的位置确定第一光扫描器10212的第三调整值，并将第一光扫描器从当前位置调整到第三调整值所指示的位置。The second optical scanner 10312 is configured to two-dimensionally scan the light beam generated by the second laser according to the preset timing and preset path to obtain the light beam corresponding to the image to be presented to the pupil of the right eye. The first electric actuator 1024 is also used to determine a third adjustment value of the first light scanner 10212 according to the position of the pupil, and adjust the first light scanner from the current position to the position indicated by the third adjustment value.

第二电致动器1034还用于根据瞳孔的位置确定第二光扫描器10312的第三调整值，并将第二光扫描器从当前位置调整到第三调整值所指示的位置。The second electric actuator 1034 is also used to determine a third adjustment value of the second light scanner 10312 according to the position of the pupil, and adjust the second light scanner from the current position to the position indicated by the third adjustment value.

应理解，本实施例中第三调整值泛指光扫描器的调整值，并不是一个特定的值，左眼显示光学系统中光扫描器器(即第一光扫描器)的第三调整值与右眼显示光学系统中光扫描器(即第二光扫描器)的第三调整值可以相同也可以不相同。在一种可能的设计中，左眼显示光学系统102还包括：第一半透半反镜1025，用于将第一光反射器1022反射的部分光束透传到第一光融合器1023中，并将第一光反射器1022反射的另一部分光反射到用户左眼瞳孔中。右眼显示光学系统103还包括：第二半透半反镜1035，用于将第二光反射器1032反射的部分光束透传到第二光融合器1033中，并将第二光反射器1032反射的另一部分光反射到用户右眼瞳孔中。It should be understood that the third adjustment value in this embodiment generally refers to the adjustment value of the optical scanner, and is not a specific value. The left eye displays the third adjustment value of the optical scanner (ie, the first optical scanner) in the optical system It may or may not be the same as the third adjustment value of the optical scanner (ie, the second optical scanner) in the right-eye display optical system. In a possible design, the left-eye display optical system 102 further includes: a first half-mirror 1025, configured to transmit part of the light beam reflected by the first light reflector 1022 to the first light fusion unit 1023, And reflect another part of the light reflected by the first light reflector 1022 into the pupil of the user's left eye. The right-eye display optical system 103 also includes: a second half-mirror 1035, which is used to transmit part of the light beam reflected by the second light reflector 1032 to the second light fusion unit 1033, and transmit the light beam reflected by the second light reflector 1032 Another portion of the reflected light is reflected into the pupil of the user's right eye.

本实施例中，不管是左眼显示光学系统还是右眼显示光学系统，光从光投影机发出，经过光反射器反射，光反射器反射的光一部分经过半透半反镜透传到光融合器，再经过光融合器汇聚到用户瞳孔，另一部分直接反射到用户瞳孔中，从而使得用户瞳孔可以呈现对应图像，然后用户的大脑对呈现在左眼瞳孔和右眼瞳孔的图像进行融合，从而产生有空间感的三维视觉效果，实现近眼显示，如图2所示。In this embodiment, no matter it is the left-eye display optical system or the right-eye display optical system, the light is emitted from the light projector and reflected by the light reflector. Then, it converges to the user's pupil through the optical fusion device, and the other part is directly reflected into the user's pupil, so that the user's pupil can present the corresponding image, and then the user's brain fuses the images presented in the left eye pupil and the right eye pupil, thus Generate a three-dimensional visual effect with a sense of space and realize near-eye display, as shown in Figure 2.

在用户使用近眼显示装置100的过程中，近眼显示装置100中的人眼追踪设备101可以自动追踪用户瞳孔，确定左眼瞳孔和右眼瞳孔的位置后，第一电致动器1024和第二电致动器1034可以通过如下几种方式改变左眼显示光学系统以及右眼显示光学系统的出瞳位置，使得左眼显示光学系统的出瞳位置和左眼瞳孔的位置对准，右眼显示光学系统的出瞳位置和右眼瞳孔的位置对准。When the user is using the near-eye display device 100, the human eye tracking device 101 in the near-eye display device 100 can automatically track the user's pupils, and after determining the positions of the left eye pupil and the right eye pupil, the first electric actuator 1024 and the second electric actuator 1024 The electric actuator 1034 can change the exit pupil positions of the left eye display optical system and the right eye display optical system in the following ways, so that the exit pupil position of the left eye display optical system is aligned with the position of the left eye pupil, and the right eye display The position of the exit pupil of the optical system is aligned with the position of the pupil of the right eye.

(一)、调节光反射器的位置。(1) Adjust the position of the light reflector.

1、第一电致动器1024从第一映射表中查找与左眼瞳孔的位置对应的第一光反射器1022的第一调整值，并将第一光反射器1022从当前位置调整到第一调整值所指示的位置。第二电致动器1034从第一映射表中查找与右眼瞳孔的位置对应的第二光反射器1032的第一调整值，并将第二光反射器1032从当前位置调整到第一调整值所指示的位置。1. The first electric actuator 1024 looks up the first adjustment value of the first light reflector 1022 corresponding to the position of the left eye pupil from the first mapping table, and adjusts the first light reflector 1022 from the current position to the first adjustment value. A position indicated by an adjustment value. The second electric actuator 1034 looks up the first adjustment value of the second light reflector 1032 corresponding to the position of the right eye pupil from the first mapping table, and adjusts the second light reflector 1032 from the current position to the first adjustment value. The location indicated by the value.

具体地，电致动器可以通过如下方式将光反射器从当前位置调整到第一调整值所指示的位置。Specifically, the electric actuator can adjust the light reflector from the current position to the position indicated by the first adjustment value in the following manner.

当用户的瞳孔在第一平面上逆时针转动时，第一电致动器1024在控制第一光反射器1022在第一平面上从当前位置逆时针转动到第一光反射器1022的第一调整值所指示的位置，第二电致动器1034在控制第二光反射器1032在第一平面上从当前位置逆时针转动到第二光反射器1032的第一调整值所指示的位置。When the pupil of the user rotates counterclockwise on the first plane, the first electric actuator 1024 controls the first light reflector 1022 to rotate counterclockwise from the current position to the first position of the first light reflector 1022 on the first plane. At the position indicated by the adjustment value, the second electric actuator 1034 is controlling the second light reflector 1032 to rotate counterclockwise from the current position to the position indicated by the first adjustment value of the second light reflector 1032 on the first plane.

当用户的瞳孔在第一平面上顺时针转动时，第一电致动器1024在控制第一光反射器1022在第一平面上从当前位置顺时针转动到第一光反射器1022的第一调整值所指示的位置，第二电致动器1034在控制第二光反射器1032在第一平面上从当前位置顺时针转动到第二光反射器1032的第一调整值所指示的位置。When the pupil of the user rotates clockwise on the first plane, the first electric actuator 1024 controls the first light reflector 1022 to rotate clockwise from the current position to the first position of the first light reflector 1022 on the first plane. At the position indicated by the adjustment value, the second electric actuator 1034 is controlling the second light reflector 1032 to rotate clockwise from the current position to the position indicated by the first adjustment value of the second light reflector 1032 on the first plane.

当用户的瞳孔在第二平面上逆时针转动时，第一电致动器1024控制第一光反射器1022在第二平面上从当前位置逆时针转动到第一光反射器1022的第一调整值所指示的位置,第二电致动器1034控制第二光反射器1032在第二平面上从当前位置顺时针转动到第二光反射器1032的第一调整值所指示的位置。When the user's pupil rotates counterclockwise on the second plane, the first electric actuator 1024 controls the first adjustment of the first light reflector 1022 from the current position to the first adjustment of the first light reflector 1022 on the second plane The second electric actuator 1034 controls the second light reflector 1032 to rotate clockwise from the current position to the position indicated by the first adjustment value of the second light reflector 1032 on the second plane.

当用户的瞳孔在第二平面上顺时针转动时，第一电致动器1024控制第一光反射器1022在第二平面上从当前位置顺时针转动到第一光反射器1022的第一调整值所指示的位置,第二电致动器1034控制第二光反射器1032在第二平面上从当前位置逆时针转动到第二光反射器1032的第一调整值所指示的位置。When the user's pupil rotates clockwise on the second plane, the first electric actuator 1024 controls the first light reflector 1022 to rotate clockwise from the current position to the first adjustment of the first light reflector 1022 on the second plane The second electric actuator 1034 controls the second light reflector 1032 to rotate counterclockwise from the current position to the position indicated by the first adjustment value of the second light reflector 1032 on the second plane.

2、人眼追踪设备根据瞳孔的位置确定瞳孔距离，第一电致动器1024从第二映射表中查找与该瞳孔距离对应的第一光反射器1022的第一调整值，并将第一光反射器1022从当前位置调整到第一调整值所指示的位置。第二电致动器1034从第二映射表中查找与该瞳孔距离对应的第二光反射器1032的第一调整值，并将第二光反射器1032从当前位置调整到第一调整值所指示的位置。2. The human eye tracking device determines the pupillary distance according to the position of the pupil, and the first electric actuator 1024 looks up the first adjustment value of the first light reflector 1022 corresponding to the pupillary distance from the second mapping table, and sets the first The light reflector 1022 is adjusted from the current position to the position indicated by the first adjustment value. The second electric actuator 1034 looks up the first adjustment value of the second light reflector 1032 corresponding to the pupil distance from the second mapping table, and adjusts the second light reflector 1032 from the current position to the first adjustment value. indicated location.

具体地，电致动器可以通过如下方式调整光反射器。Specifically, the electric actuator can adjust the light reflector as follows.

若该瞳孔距离大于目标距离，则第一电致动器1024驱动第一光反射器1022在第一平面上从当前位置逆时针转动到第一调整值所指示的位置。第二电致动器1034驱动第二光反射器1032在第一平面上从当前位置顺时针转动到第一调整值所指示的位置。If the pupil distance is greater than the target distance, the first electric actuator 1024 drives the first light reflector 1022 to rotate counterclockwise from the current position to the position indicated by the first adjustment value on the first plane. The second electric actuator 1034 drives the second light reflector 1032 to rotate clockwise from the current position to the position indicated by the first adjustment value on the first plane.

若该瞳孔距离小于目标距离，则第一电致动器1024驱动第一光反射器1022在第一平面上从当前位置顺时针转动到第一调整值所指示的位置。第二电致动器1034驱动第二光反射器1032在第一平面上从当前位置逆时针转动到第一调整值所指示的位置。If the pupil distance is smaller than the target distance, the first electric actuator 1024 drives the first light reflector 1022 to rotate clockwise from the current position to the position indicated by the first adjustment value on the first plane. The second electric actuator 1034 drives the second light reflector 1032 to rotate counterclockwise from the current position to the position indicated by the first adjustment value on the first plane.

下面举例进行说明，第二映射表如下表1所示，其中，表1的光反射器的角度指的是以初始位置为原点所偏转的角度。当用户佩戴上近眼显示装置100时，人眼追踪设备101计算出用户的瞳孔距离，第一电致动器1024查询该第二映射表确定该瞳孔距离对应的第一光反射器1022的角度，然后将第一光反射器1022转动到该角度对应的位置，第二电致动器1034查询该映射表确定该瞳孔距离对应的第二反射器1032的角度，然后将第二反射器1032转动到该角度对应的位置，比如，瞳孔距离为53毫米，第一电致动器1024根据第二映射表确定第一反射器1022的角度为20°，第二电致动器1034根据映射表确定第二放射器1032的角度为-20°，第一反射器1022当前的角度为0°，第二反射器1032当前的角度为0°，即第一反射器1022和第二反射器1032位于初始位置，第一电致动器1024顺时针转动第一反射器1022，使第一反射器1022偏转20°，第二电致动器1034逆时针转动第二反射器1032，使第一反射器1022偏转20°。The following is an example for illustration. The second mapping table is shown in Table 1 below, wherein the angle of the light reflector in Table 1 refers to the deflected angle based on the initial position as the origin. When the user wears the near-eye display device 100, the eye tracking device 101 calculates the pupil distance of the user, and the first electric actuator 1024 queries the second mapping table to determine the angle of the first light reflector 1022 corresponding to the pupil distance, Then the first light reflector 1022 is rotated to the position corresponding to the angle, and the second electric actuator 1034 queries the mapping table to determine the angle of the second reflector 1032 corresponding to the pupil distance, and then the second reflector 1032 is rotated to The position corresponding to the angle, for example, the pupillary distance is 53 mm, the first electric actuator 1024 determines that the angle of the first reflector 1022 is 20° according to the second mapping table, and the second electric actuator 1034 determines the first reflector 1022 according to the mapping table. The angle of the second emitter 1032 is -20°, the current angle of the first reflector 1022 is 0°, and the current angle of the second reflector 1032 is 0°, that is, the first reflector 1022 and the second reflector 1032 are at the initial position , the first electric actuator 1024 rotates the first reflector 1022 clockwise to deflect the first reflector 1022 by 20°, and the second electric actuator 1034 rotates the second reflector 1032 counterclockwise to deflect the first reflector 1022 20°.

表1Table 1

(二)、调节光反射器和光融合器的位置。(2) Adjust the positions of the light reflector and the light fuser.

3、第一电致动器1024从第一映射表中查找与左眼瞳孔的位置对应的第一光反射器1022的第一调整值以及第一光融合器1023的第二调整值，将第一光反射器1022从当前位置调整到第一调整值所指示的位置，并将第一光融合器1023从当前位置调整到第二调整值所指示的位置。第二电致动器1034从第一映射表中查找与右眼瞳孔的位置对应的第二光反射器1032的第一调整值以及第二光融合器1033的第二调整值，将第二光反射器1032从当前位置调整到第一调整值所指示的位置，并将第二光融合器1033从当前位置调整到第二调整值所指示的位置。3. The first electric actuator 1024 looks up the first adjustment value of the first light reflector 1022 and the second adjustment value of the first light fusion device 1023 corresponding to the position of the left eye pupil from the first mapping table, and sets the A light reflector 1022 is adjusted from the current position to a position indicated by a first adjustment value, and the first optical fuser 1023 is adjusted from the current position to a position indicated by a second adjustment value. The second electric actuator 1034 looks up the first adjustment value of the second light reflector 1032 and the second adjustment value of the second light fusion device 1033 corresponding to the position of the pupil of the right eye from the first mapping table, and converts the second light The reflector 1032 is adjusted from the current position to the position indicated by the first adjustment value, and the second optical fuser 1033 is adjusted from the current position to the position indicated by the second adjustment value.

具体地，电致动器可以通过如下方式调整光反射器和光融合器：Specifically, the electric actuator can adjust the light reflector and the light fuser by:

当用户的瞳孔在第一平面上逆时针转动时，第一电致动器1024在控制第一光反射器1022在第一平面上从当前位置逆时针转动到第一光反射器1022的第一调整值所指示的位置，并控制第一光融合器1023在第一平面上顺时针转动到第二调整值所指示的位置。第二电致动器1034在控制第二光反射器1032在第一平面上从当前位置逆时针转动到第二光反射器1032的第一调整值所指示的位置，并控制第二光融合器1033在第一平面上顺时针转动到第二调整值所指示的位置。When the pupil of the user rotates counterclockwise on the first plane, the first electric actuator 1024 controls the first light reflector 1022 to rotate counterclockwise from the current position to the first position of the first light reflector 1022 on the first plane. adjust the position indicated by the value, and control the first optical fuser 1023 to rotate clockwise on the first plane to the position indicated by the second adjusted value. The second electric actuator 1034 controls the second light reflector 1032 to rotate counterclockwise from the current position to the position indicated by the first adjustment value of the second light reflector 1032 on the first plane, and controls the second light fuser 1033 rotates clockwise on the first plane to the position indicated by the second adjustment value.

当用户的瞳孔在第一平面上顺时针转动时，第一电致动器1024在控制第一光反射器1022在第一平面上从当前位置顺时针转动到第一光反射器1022的第一调整值所指示的位置，并控制第一光融合器1023在第一平面上逆时针转动到第二调整值所指示的位置。第二电致动器1034在控制第二光反射器1032在第一平面上从当前位置顺时针转动到第二光反射器1032的第一调整值所指示的位置，并控制第二光融合器1033在第一平面上逆时针转动到第二调整值所指示的位置。When the pupil of the user rotates clockwise on the first plane, the first electric actuator 1024 controls the first light reflector 1022 to rotate clockwise from the current position to the first position of the first light reflector 1022 on the first plane. Adjust the position indicated by the value, and control the first optical fuser 1023 to rotate counterclockwise on the first plane to the position indicated by the second adjusted value. The second electric actuator 1034 controls the second light reflector 1032 to rotate clockwise from the current position to the position indicated by the first adjustment value of the second light reflector 1032 on the first plane, and controls the second light fuser 1033 rotates counterclockwise on the first plane to the position indicated by the second adjustment value.

当用户的瞳孔在第二平面上逆时针转动时，第一电致动器1024控制第一光反射器1022在第二平面上从当前位置逆时针转动到第一光反射器1022的第一调整值所指示的位置,并控制第一光融合器1023在第二平面上顺时针转动到第二调整值所指示的位置。第二电致动器1034控制第二光反射器1032在第二平面上从当前位置顺时针转动到第二光反射器1032的第一调整值所指示的位置,并控制第二光融合器1033在第二平面上逆时针转动到第二调整值所指示的位置。When the user's pupil rotates counterclockwise on the second plane, the first electric actuator 1024 controls the first adjustment of the first light reflector 1022 from the current position to the first adjustment of the first light reflector 1022 on the second plane value, and control the first optical fuser 1023 to rotate clockwise on the second plane to the position indicated by the second adjustment value. The second electric actuator 1034 controls the second light reflector 1032 to rotate clockwise from the current position to the position indicated by the first adjustment value of the second light reflector 1032 on the second plane, and controls the second light fuser 1033 Turn counterclockwise on the second plane to the position indicated by the second adjustment value.

当用户的瞳孔在第二平面上顺时针转动时，第一电致动器1024控制第一光反射器1022在第二平面上从当前位置顺时针转动到第一光反射器1022的第一调整值所指示的位置,并控制第一光融合器1023在第二平面上逆时针转动到第二调整值所指示的位置。第二电致动器1034控制第二光反射器1032在第二平面上从当前位置逆时针转动到第二光反射器1032的第一调整值所指示的位置,并控制第二光融合器1033在第二平面上顺时针转动到第二调整值所指示的位置。When the user's pupil rotates clockwise on the second plane, the first electric actuator 1024 controls the first light reflector 1022 to rotate clockwise from the current position to the first adjustment of the first light reflector 1022 on the second plane value, and control the first optical fuser 1023 to rotate counterclockwise on the second plane to the position indicated by the second adjustment value. The second electric actuator 1034 controls the second light reflector 1032 to rotate counterclockwise from the current position to the position indicated by the first adjustment value of the second light reflector 1032 on the second plane, and controls the second light fuser 1033 Turn clockwise in the second plane to the position indicated by the second adjustment value.

4、人眼追踪设备根据瞳孔的位置确定瞳孔距离，第一电致动器1024从第二映射表中查找与该瞳孔距离对应的第一光反射器1022的第一调整值以及第一光融合器1023的第二调整值，将第一光反射器1022从当前位置调整到第一调整值所指示的位置，并将第一光融合器1023从当前位置调整到第二调整值所指示的位置。第二电致动器1034从第二映射表中查找与该瞳孔距离对应的第二光反射器1032的第一调整值以及第二光融合器1033的第二调整值，将第二光反射器1032从当前位置调整到第一调整值所指示的位置，并将第二光融合器1033从当前位置调整到第二调整值所指示的位置。4. The human eye tracking device determines the pupillary distance according to the position of the pupil, and the first electric actuator 1024 looks up the first adjustment value of the first light reflector 1022 corresponding to the pupillary distance and the first optical fusion from the second mapping table. adjust the first light reflector 1022 from the current position to the position indicated by the first adjustment value, and adjust the first optical fuser 1023 from the current position to the position indicated by the second adjustment value . The second electric actuator 1034 looks up the first adjustment value of the second light reflector 1032 corresponding to the pupil distance and the second adjustment value of the second light fusion device 1033 from the second mapping table, and the second light reflector 1032 adjusts from the current position to the position indicated by the first adjustment value, and adjusts the second optical fuser 1033 from the current position to the position indicated by the second adjustment value.

若该瞳孔距离大于目标距离，则第一电致动器1024驱动第一光反射器1022在第一平面上从当前位置逆时针转动到第一调整值所指示的位置，并且驱动第一光融合器1023在第一平面上从当前位置顺时针转动到第二调整值所指示的位置。第二电致动器1034驱动第二光反射器1032在第一平面上顺时针转动到第一调整值所指示的位置，并且驱动第二光融合器1033在第一平面上逆时针转动到第二调整值所指示的位置。If the pupil distance is greater than the target distance, the first electric actuator 1024 drives the first light reflector 1022 to rotate counterclockwise from the current position to the position indicated by the first adjustment value on the first plane, and drives the first optical fusion The indicator 1023 rotates clockwise from the current position to the position indicated by the second adjustment value on the first plane. The second electric actuator 1034 drives the second optical reflector 1032 to rotate clockwise on the first plane to the position indicated by the first adjustment value, and drives the second optical fuser 1033 to rotate counterclockwise to the first position on the first plane. The position indicated by the second adjustment value.

若该瞳孔距离小于目标距离，则第一电致动器1024驱动第一光反射器1022在第一平面上顺时针转动到第一调整值所指示的位置，并且驱动第一光融合器1023在第一平面上逆时针转动到第二调整值所指示的位置。第二电致动器1034驱动第二光反射器1032在第一平面上逆时针转动到第一调整值所指示的位置，并且驱动第二光融合器1033在第一平面上顺时针转动到第二调整值所指示的位置。If the pupil distance is less than the target distance, the first electric actuator 1024 drives the first optical reflector 1022 to rotate clockwise on the first plane to the position indicated by the first adjustment value, and drives the first optical fuser 1023 to Turn counterclockwise on the first plane to the position indicated by the second adjustment value. The second electric actuator 1034 drives the second optical reflector 1032 to rotate counterclockwise on the first plane to the position indicated by the first adjustment value, and drives the second optical fuser 1033 to rotate clockwise to the first position on the first plane. The position indicated by the second adjustment value.

(三)、调节光反射器和光扫描器的位置。(3) Adjusting the positions of the optical reflector and the optical scanner.

5、第一电致动器1024从第一映射表中查找与左眼瞳孔的位置对应的第一光反射器1022的第一调整值以及第一光扫描器10212的第三调整值，将第一光反射器1022从当前位置调整到第一调整值所指示的位置，并将第一光扫描器10212从当前位置调整到第三调整值所指示的位置。第二电致动器1034从第一映射表中查找与右眼瞳孔的位置对应的第二光反射器1032的第一调整值以及第二光扫描器10312的第三调整值，将第二光反射器1032从当前位置调整到第一调整值所指示的位置，并将第二光扫描器10312从当前位置调整到第三调整值所指示的位置。5. The first electric actuator 1024 searches the first mapping table for the first adjustment value of the first light reflector 1022 and the third adjustment value of the first light scanner 10212 corresponding to the position of the left eye pupil, and sets the A light reflector 1022 is adjusted from the current position to the position indicated by the first adjustment value, and the first light scanner 10212 is adjusted from the current position to the position indicated by the third adjustment value. The second electric actuator 1034 looks up the first adjustment value of the second light reflector 1032 and the third adjustment value of the second light scanner 10312 corresponding to the position of the pupil of the right eye from the first mapping table, and converts the second light The reflector 1032 is adjusted from the current position to the position indicated by the first adjustment value, and the second light scanner 10312 is adjusted from the current position to the position indicated by the third adjustment value.

6、人眼追踪设备根据瞳孔的位置确定瞳孔距离，第一电致动器1024从第二映射表中查找与该瞳孔距离对应的第一光反射器1022的第一调整值以及第一光扫描器10212的第三调整值，将第一光反射器1022从当前位置调整到第一调整值所指示的位置，并将第一光扫描器10212从当前位置调整到第三调整值所指示的位置。第二电致动器1034从第二映射表中查找与该瞳孔距离对应的第二光反射器1032的第一调整值以及第二光扫描器10312的第三调整值，将第二光反射器1032从当前位置调整到第一调整值所指示的位置，并将第二光扫描器10312从当前位置调整到第三调整值所指示的位置。6. The human eye tracking device determines the pupillary distance according to the position of the pupil, and the first electric actuator 1024 looks up the first adjustment value of the first light reflector 1022 corresponding to the pupillary distance and the first light scan value from the second mapping table. adjust the first light reflector 1022 from the current position to the position indicated by the first adjustment value, and adjust the first light scanner 10212 from the current position to the position indicated by the third adjustment value . The second electric actuator 1034 looks up the first adjustment value of the second light reflector 1032 corresponding to the pupil distance and the third adjustment value of the second light scanner 10312 from the second mapping table, and the second light reflector 1032 adjusts from the current position to the position indicated by the first adjustment value, and adjusts the second optical scanner 10312 from the current position to the position indicated by the third adjustment value.

具体地，当瞳孔距离大于目标距离时，第一电致动器1024控制第一光反射器1022以及第二电致动器1034控制第二光反射器1032转动的方式与前述方法2所描述的方式类似，此处不再赘述，结合第一光反射器1022和第二光反射器1032的转动，第一电致动器1024还会控制第一光扫描器10212朝着靠近第一激光器10211的方向移动到第三调整值所指示的位置，第二电致动器1034还会控制第二光扫描器10312朝着靠近第二激光器10311的方向移动到第三调整值所指示的位置。Specifically, when the pupillary distance is greater than the target distance, the first electric actuator 1024 controls the first light reflector 1022 and the second electric actuator 1034 controls the rotation of the second light reflector 1032 in the same manner as described in Method 2 above. The method is similar, and will not be repeated here. In combination with the rotation of the first light reflector 1022 and the second light reflector 1032, the first electric actuator 1024 will also control the first light scanner 10212 to move toward the position close to the first laser 10211. The direction moves to the position indicated by the third adjustment value, and the second electric actuator 1034 also controls the second optical scanner 10312 to move toward the direction close to the second laser 10311 to the position indicated by the third adjustment value.

当瞳孔距离小于目标距离时，第一电致动器1024控制第一光反射器1022以及第二电致动器1034控制第二光反射器1032转动的方式与前述方法2所描述的方式类似，此处不再赘述，结合第一光反射器1022和第二光反射器1032的转动，第一电致动器1024还会控制第一光扫描器10212朝着远离第一激光器10211的方向移动到第三调整值所指示的位置，第二电致动器1034还会控制第二光扫描器10312朝着远离第二激光器10311的方向移动到第三调整值所指示的位置。When the pupillary distance is smaller than the target distance, the first electric actuator 1024 controls the first light reflector 1022 and the second electric actuator 1034 controls the rotation of the second light reflector 1032 in a manner similar to that described in method 2 above, No more details here, combined with the rotation of the first light reflector 1022 and the second light reflector 1032, the first electric actuator 1024 will also control the first light scanner 10212 to move away from the first laser 10211 to At the position indicated by the third adjustment value, the second electric actuator 1034 also controls the second optical scanner 10312 to move away from the second laser 10311 to the position indicated by the third adjustment value.

(四)、调节光反射器、光融合器和光扫描器的位置。(4) Adjust the positions of the light reflector, the light fuser and the light scanner.

7、第一电致动器1024从第一映射表中查找与左眼瞳孔的位置对应的第一光反射器1022的第一调整值，第一光融合器1023的第二调整值以及第一光扫描器10212的第三调整值，将第一光反射器1022从当前位置调整到第一调整值所指示的位置，将第一光融合器1023从当前位置调整到二调整值所指示的位置，并将第一光扫描器10212从当前位置调整到第三调整值所指示的位置。第二电致动器1034从第一映射表中查找与右眼瞳孔的位置对应的第二光反射器1032的第一调整值，第二光融合器1033的第二调整值以及第二光扫描器10312的第三调整值，将第二光反射器1032从当前位置调整到第一调整值所指示的位置，将第二光融合器1033从当前位置调整到二调整值所指示的位置，并将第二光扫描器10312从当前位置调整到第三调整值所指示的位置。7. The first electric actuator 1024 searches the first mapping table for the first adjustment value of the first light reflector 1022 corresponding to the position of the left eye pupil, the second adjustment value of the first light fusion device 1023 and the first The third adjustment value of the optical scanner 10212 is to adjust the first optical reflector 1022 from the current position to the position indicated by the first adjustment value, and to adjust the first optical fuser 1023 from the current position to the position indicated by the second adjustment value , and adjust the first optical scanner 10212 from the current position to the position indicated by the third adjustment value. The second electric actuator 1034 looks up the first adjustment value of the second light reflector 1032 corresponding to the position of the right eye pupil from the first mapping table, the second adjustment value of the second light fusion device 1033 and the second light scanning adjust the second optical reflector 1032 from the current position to the position indicated by the first adjustment value, and adjust the second optical fuser 1033 from the current position to the position indicated by the second adjustment value, and Adjust the second light scanner 10312 from the current position to the position indicated by the third adjustment value.

8、人眼追踪设备根据瞳孔的位置确定瞳孔距离，第一电致动器1024从第二映射表中查找与该瞳孔距离对应的第一光反射器1022的第一调整值，第一光融合器1023的第二调整值以及第一光扫描器10212的第三调整值，将第一光反射器1022从当前位置调整到第一调整值所指示的位置，将第一光融合器1023从当前位置调整到二调整值所指示的位置，并将第一光扫描器10212从当前位置调整到第三调整值所指示的位置。第二电致动器1034从第二映射表中查找与瞳孔距离对应的第二光反射器1032的第一调整值，第二光融合器1033的第二调整值以及第二光扫描器10312的第三调整值，将第二光反射器1032从当前位置调整到第一调整值所指示的位置，将第二光融合器1033从当前位置调整到二调整值所指示的位置，并将第二光扫描器10312从当前位置调整到第三调整值所指示的位置。8. The human eye tracking device determines the pupillary distance according to the position of the pupil, the first electric actuator 1024 looks up the first adjustment value of the first light reflector 1022 corresponding to the pupillary distance from the second mapping table, and the first optical fusion The second adjustment value of the reflector 1023 and the third adjustment value of the first optical scanner 10212 adjust the first optical reflector 1022 from the current position to the position indicated by the first adjustment value, and adjust the first optical reflector 1023 from the current position to the position indicated by the first adjustment value. The position is adjusted to the position indicated by the second adjustment value, and the first optical scanner 10212 is adjusted from the current position to the position indicated by the third adjustment value. The second electric actuator 1034 looks up the first adjustment value of the second optical reflector 1032 corresponding to the pupil distance, the second adjustment value of the second optical fusion device 1033 and the second adjustment value of the second optical scanner 10312 from the second mapping table. The third adjustment value is to adjust the second light reflector 1032 from the current position to the position indicated by the first adjustment value, adjust the second optical fuser 1033 from the current position to the position indicated by the second adjustment value, and adjust the second optical reflector 1033 from the current position to the position indicated by the second adjustment value. The optical scanner 10312 is adjusted from the current position to the position indicated by the third adjustment value.

具体地，当瞳孔距离大于目标距离时，第一电致动器1024控制第一光反射器1022以及第一光融合器1023，第二电致动器1034控制第二光反射器1032以及第二光融合器1033转动的方式与前述方法4所描述的方式类似，此处不再赘述，结合第一光反射器1022、第一光融合器1023、第二光反射器1032以及第二光融合器1033的转动，第一电致动器1024还会控制第一光扫描器10212朝着靠近第一激光器10211的方向移动到第三调整值所指示的位置，第二电致动器1034还会控制第二光扫描器10312朝着靠近第二激光器10311的方向移动到第三调整值所指示的位置。Specifically, when the pupil distance is greater than the target distance, the first electric actuator 1024 controls the first light reflector 1022 and the first light fusion device 1023, and the second electric actuator 1034 controls the second light reflector 1032 and the second The rotation mode of the optical fusion device 1033 is similar to the method described in the aforementioned method 4, and will not be repeated here. In combination with the first optical reflector 1022, the first optical fusion device 1023, the second optical reflection device 1032 and the second optical fusion device 1033, the first electric actuator 1024 will also control the first optical scanner 10212 to move toward the direction close to the first laser 10211 to the position indicated by the third adjustment value, and the second electric actuator 1034 will also control The second optical scanner 10312 moves toward the direction close to the second laser 10311 to the position indicated by the third adjustment value.

当瞳孔距离大于目标距离时，第一电致动器1024控制第一光反射器1022以及第一光融合器1023，第二电致动器1034控制第二光反射器1032以及第二光融合器1033转动的方式与前述方法4所描述的方式类似，此处不再赘述，结合第一光反射器1022、第一光融合器1023、第二光反射器1032以及第二光融合器1033的转动，第一电致动器1024还会控制第一光扫描器10212朝着远离第一激光器10211的方向移动到第三调整值所指示的位置，第二电致动器1034还会控制第二光扫描器10312朝着远离第二激光器10311的方向移动到第三调整值所指示的位置。When the pupil distance is greater than the target distance, the first electric actuator 1024 controls the first light reflector 1022 and the first light fusion device 1023, and the second electric actuator 1034 controls the second light reflector 1032 and the second light fusion device The way 1033 rotates is similar to the way described in the aforementioned method 4, and will not be repeated here, in combination with the rotation of the first light reflector 1022, the first light fusion device 1023, the second light reflector 1032 and the second light fusion device 1033 , the first electric actuator 1024 will also control the first light scanner 10212 to move away from the first laser 10211 to the position indicated by the third adjustment value, and the second electric actuator 1034 will also control the second light scanner 10211 The scanner 10312 moves away from the second laser 10311 to the position indicated by the third adjustment value.

需要说明的是，上述各个实现方式中的第一映射表可以是测试人员将眼球模型的瞳孔移动到不同的位置，通过近眼显示装置根据不同位置的瞳孔进行计算得到的，也可以是测试人员依据经验设定并输入到近眼显示装置的，还可以是近眼显示装置从其他设备中获取的，具体本申请不作限定。还应理解，近眼显示装置可以配置有一个第一映射表，用于第一电致动器1024以及第二电致动器1034查询调整值，近眼显示装置也可以配置有两个第一映射表，一个用于第一电致动器1024查询调整值，另一个用于第二电致动器查询调整值。It should be noted that the first mapping table in each of the above implementations may be obtained by the tester moving the pupil of the eyeball model to different positions, and calculated according to the pupils in different positions by the near-eye display device, or it may be obtained by the tester based on What is set by experience and input to the near-eye display device may also be obtained by the near-eye display device from other devices, which is not limited in this application. It should also be understood that the near-eye display device may be configured with a first mapping table for the first electric actuator 1024 and the second electric actuator 1034 to query the adjustment value, and the near-eye display device may also be configured with two first mapping tables , one for the first electric actuator 1024 to query the adjustment value, and the other for the second electric actuator to query the adjustment value.

上述各个实现方式中的第二映射表可以是测试人员通过近眼显示装置对不同瞳距的眼球模型进行测试计算得到的，也可以是测试人员依据经验设定并输入到近眼显示装置的，还可以是近眼显示装置从其他设备中获取的，具体本申请不作限定。还应理解，近眼显示装置可以配置有一个第二映射表，用于第一电致动器1024以及第二电致动器1034查询调整值，近眼显示装置也可以配置有两个第二映射表，一个用于第一电致动器1024查询调整值，另一个用于第二电致动器查询调整值。The second mapping table in each of the above implementations may be obtained by the tester through the near-eye display device to test and calculate eyeball models with different interpupillary distances, or may be set by the tester based on experience and input into the near-eye display device, or The near-eye display device is obtained from other devices, which is not limited in this application. It should also be understood that the near-eye display device may be configured with a second mapping table for the first electric actuator 1024 and the second electric actuator 1034 to query the adjustment value, and the near-eye display device may also be configured with two second mapping tables , one for the first electric actuator 1024 to query the adjustment value, and the other for the second electric actuator to query the adjustment value.

还需要说明的是，本实施例以及后续实施例中用户的瞳间线和听眶线所在的平面平行于第一平面，第二平面垂直于用户的听眶线所在的直线，具体地，当用户身体直立，面向前方，两眼平视正前方时，第一平面可以理解为平行与人体横切面的平面，第二平面可以理解为平行与人体冠状面的平面。It should also be noted that in this embodiment and subsequent embodiments, the plane where the user's interpupillary line and the auditory-orbital line are located is parallel to the first plane, and the second plane is perpendicular to the straight line where the user's auditory-orbital line is located. Specifically, when When the user is standing upright, facing forward, and looking straight ahead with both eyes, the first plane can be understood as a plane parallel to the cross-section of the human body, and the second plane can be understood as a plane parallel to the coronal plane of the human body.

还需要说明的是，本实施例以及后续实施例中目标瞳距指的是左眼显示光学系统当前的出瞳位置与右眼显示光学系统当前的出瞳位置之间的距离。It should also be noted that the target interpupillary distance in this embodiment and subsequent embodiments refers to the distance between the current exit pupil position of the left-eye display optical system and the current exit pupil position of the right-eye display optical system.

应理解，上述各个实现方式中，电致动器除了可以从第一映射表查找瞳孔位置对应的光反射器的第一调整值，也可以通过如下公式计算与瞳孔位置对应的光反射器的第一调整值：It should be understood that in each of the above implementations, in addition to looking up the first adjustment value of the light reflector corresponding to the pupil position from the first mapping table, the electric actuator can also calculate the first adjustment value of the light reflector corresponding to the pupil position through the following formula: An adjustment value:

a·tan2θ＝c (1)。a·tan2θ=c (1).

其中，c为初始瞳孔位置到当前瞳孔位置的位移，a为光反射器到光扫描器的距离，θ为光反射器相对于初始位置所偏转的角度。Wherein, c is the displacement from the initial pupil position to the current pupil position, a is the distance from the light reflector to the light scanner, and θ is the deflection angle of the light reflector relative to the initial position.

具体地，人眼追踪设备101可以确定用户的瞳孔位置，人眼追踪设备计算出该瞳孔位置与初始瞳孔位置的距离c，电致动器确定当前光反射器与光扫描器的距离a，然后依据上述公式(1)计算出θ，将光反射器转动到相对于初始位置偏转θ的位置。Specifically, the human eye tracking device 101 can determine the user's pupil position, the human eye tracking device calculates the distance c between the pupil position and the initial pupil position, the electric actuator determines the distance a between the current optical reflector and the optical scanner, and then θ is calculated according to the above formula (1), and the light reflector is rotated to a position deflected by θ relative to the initial position.

电致动器也可以通过上述公式(1)计算出于瞳孔位置对应的第一光反射器的第一调整值以及第一光扫描器的第三调整值，具体地，人眼追踪设备计算出瞳孔位置与初始位置的距离c后，电致动器移动光扫描器并且，转动光反射器，使得移动后光扫描器与光反射器的距离a，以及偏转后光反射器相对于初始位置偏转的角度θ满足上述公式(1)。The electric actuator can also calculate the first adjustment value of the first optical reflector corresponding to the pupil position and the third adjustment value of the first optical scanner through the above formula (1). Specifically, the human eye tracking device calculates After the distance c between the pupil position and the initial position, the electric actuator moves the optical scanner and rotates the optical reflector, so that the distance a between the optical scanner and the optical reflector after moving, and the deflected optical reflector deflects relative to the initial position The angle θ satisfies the above formula (1).

如图3所示，图3为用户左眼的瞳孔及近眼显示装置的俯视图，系统预先设定左眼瞳孔的初始位置在E₁，第一光扫描器10212的位置在Q₁，第一光反射器1022的初始位置在P₂₁，Q₁与P₂₁的距离a等于6mm，此时左眼显示光学系统102的出射光位置在O₁，经过第一光融合器1023汇聚后，汇聚在I₁处，位于E₁的左眼瞳孔获得视网膜投影，看到第一图像。用户戴上近眼显示装置后，人眼追踪设备101检测到用户左眼瞳孔位置在E₂，人眼追踪设备101计算出E₁到E₂的位移c为-2.1mm，根据上述公式(1)计算得到θ＝-20°，第一电致动器1024逆时针转动第一光反射器1022，使得第一光反射器1022偏转20°到位置P₂₂，此时，左眼显示光学系统102的出射光位置在O₂，经过第一光融合器1023聚光后，汇聚在I₂处，位于E₂的左眼瞳孔获得视网膜投影，看到第一图像。As shown in Figure 3, Figure 3 is a top view of the pupil of the user's left eye and the near-eye display device. The system presets the initial position of the pupil of the left eye at E₁ , the position of the_first optical scanner The initial position of the reflector 1022 is at_P21 , and the distance_a between Q1 and_P21 is equal to 6 mm. At this time, the position of the outgoing light of the left_- eye display optical system 102 is at O1. At₁ , the pupil of the left eye at E1 obtains_a retinal projection and sees the first image. After the user puts on the near-eye display device, the eye tracking device 101 detects that the pupil of the user's left eye is at E₂ , and the eye tracking device 101 calculates that the displacement c from E₁ to E₂ is -2.1mm, according to the above formula (1) Calculated to get θ=-20°, the first electric actuator 1024 rotates the first light reflector 1022 counterclockwise, so that the first light reflector 1022 deflects 20° to the position P₂₂ , at this time, the left eye displays the position of the optical system 102 The outgoing light is located at O₂ . After being condensed by the first light combiner 1023 , it converges at I₂ . The pupil of the left eye located at E₂ obtains retinal projection and sees the first image.

应理解，近眼显示装置也可以是预先利用眼球模型通过上述方式配置好第一映射表，记录下不同的瞳孔位置所对应的光反射器的位置，如上述图3所示，左眼瞳孔位置E₁对应的第一光反射器1022的位置为P₂₁，左眼瞳孔位置E₂对应的第一光反射器1022的位置为P₂₂，则当检测到用户左眼瞳孔位于E₁时，第一电致动器1024将第一光反射器1022偏转到位置P₂₁，当检测到用户左眼瞳孔位于E₂时，第一电致动器1024将第一光反射器1022偏转到位置P₂₂。It should be understood that the near-eye display device may also configure the first mapping table in advance by using the eyeball model in the above-mentioned manner, and record the positions of the light reflectors corresponding to different pupil positions. As shown in FIG. 3 above, the left-eye pupil position E The position of the first light reflector 1022 corresponding to₁ is P₂₁ , and the position of the first light reflector 1022 corresponding to the left eye pupil position E₂ is P₂₂ , then when it is detected that the user’s left eye pupil is located at E₁ , the first The electric actuator 1024 deflects the first light reflector 1022 to a position P₂₁ , and when it is detected that the pupil of the user's left eye is located at E₂ , the first electric actuator 1024 deflects the first light reflector 1022 to a position P₂₂ .

其次，本申请实施例中的电致动器可以通过多种方式确定调节器件的调整值，可以通过多种方式改变光学系统的出瞳位置，使得出瞳位置与瞳孔位置对准，提高了方案的灵活性。Secondly, the electric actuator in the embodiment of the present application can determine the adjustment value of the adjustment device in a variety of ways, and can change the exit pupil position of the optical system in a variety of ways, so that the exit pupil position is aligned with the pupil position, which improves the solution. flexibility.

请参阅图4，本申请实施例中近眼显示装置200的另一个实施例包括：Please refer to FIG. 4, another embodiment of the near-eye display device 200 in the embodiment of the present application includes:

人眼追踪设备201、左眼显示光学系统202和右眼显示光学系统203。A human eye tracking device 201 , a left-eye display optical system 202 and a right-eye display optical system 203 .

其中，人眼追踪设备201用于确定追踪用户的瞳孔，并确定瞳孔的位置。Wherein, the human eye tracking device 201 is used to determine and track the pupil of the user, and determine the position of the pupil.

左眼显示光学系统202包括：第一光投影机2021、第一光融合器2023、第一光反射器2022和第一电致动器2024。The left-eye display optical system 202 includes: a first light projector 2021 , a first light fuser 2023 , a first light reflector 2022 and a first electric actuator 2024 .

第一光投影机2021用于发射待呈现给左眼瞳孔的图像对应的光束。The first light projector 2021 is used to emit a light beam corresponding to an image to be presented to the pupil of the left eye.

第一光反射器2022用于对第一光投影机2021发射的光束进行反射。The first light reflector 2022 is used for reflecting the light beam emitted by the first light projector 2021 .

第一光融合器2023用于将第一光反射器2022反射的光束汇聚到用户的左眼瞳孔中。The first light combiner 2023 is used to converge the light beam reflected by the first light reflector 2022 into the pupil of the user's left eye.

第一电致动器2024用于根据左眼瞳孔的位置确定第一光融合器的第一调整值，并将第一光融合器2022从当前位置调整到第一光融合器的第一调整值所指示的位置。The first electric actuator 2024 is used to determine the first adjustment value of the first optical fusion device according to the position of the pupil of the left eye, and adjust the first optical fusion device 2022 from the current position to the first adjustment value of the first optical fusion device the indicated location.

右眼显示光学系统203包括：第二光投影机2031、第二光融合器2033、第二光反射器2032和第二电致动器2034。The right-eye display optical system 203 includes: a second light projector 2031 , a second light fuser 2033 , a second light reflector 2032 and a second electric actuator 2034 .

第二光投影机2031用于发射待呈现给右眼瞳孔的图像对应的光束。The second light projector 2031 is used to emit light beams corresponding to the image to be presented to the pupil of the right eye.

第二光反射器2032用于对第二光投影机2031发射的光束进行反射。The second light reflector 2032 is used for reflecting the light beam emitted by the second light projector 2031 .

第二光融合器2033用于将第二光反射器2032反射的光束汇聚到用户的右眼瞳孔中。The second light fusion device 2033 is used to converge the light beam reflected by the second light reflector 2032 into the pupil of the user's right eye.

第二电致动器2034用于根据右眼瞳孔的位置确定第二光融合器的第一调整值，并将第二光融合器2032从当前位置整到第二光融合器的第一调整值所指示的位置。The second electric actuator 2034 is used to determine the first adjustment value of the second optical fusion device according to the position of the pupil of the right eye, and adjust the second optical fusion device 2032 from the current position to the first adjustment value of the second optical fusion device the indicated location.

应理解，本实施例中第一调整值泛指光融合器的调整值，并不是一个特定的值，左眼显示光学系统中光融合器(即第一光融合器)的第一调整值与右眼显示光学系统中光融合器(即第二光融合器)的第一调整值可以相同也可以不相同。It should be understood that the first adjustment value in this embodiment generally refers to the adjustment value of the optical fusion device, not a specific value. The first adjustment value of the optical fusion device (that is, the first optical fusion device) in the left eye display optical system The first adjustment values of the optical fuser (that is, the second optical fuser) in the right-eye display optical system may be the same or different.

在一种可能的设计中，左眼显示光学系统202还包括：第一半透半反镜2025，用于将第一光反射器2022反射的部分光束透传到第一光融合器2023中，并将第一光反射器2022反射的另一部分光反射到用户左眼瞳孔中。右眼显示光学系统203还包括：第二半透半反镜2035，用于将第二光反射器2032反射的部分光束透传到第二光融合器2033中，并将第二光反射器2032反射的另一部分光反射到用户右眼瞳孔中。In a possible design, the left-eye display optical system 202 further includes: a first half-mirror 2025, configured to transmit part of the light beam reflected by the first light reflector 2022 to the first light fusion unit 2023, And reflect another part of the light reflected by the first light reflector 2022 into the pupil of the user's left eye. The right-eye display optical system 203 also includes: a second half-mirror 2035, which is used to transmit part of the light beam reflected by the second light reflector 2032 to the second light fusion unit 2033, and transmit the light beam reflected by the second light reflector 2032 Another portion of the reflected light is reflected into the pupil of the user's right eye.

在一种可能的设计中，光投影机可以由激光器和光扫描器组成，即第一光投影机2021包括：第一激光器20211以及第一光扫描器20212。第二光投影机2031包括：第二激光器20311以及第二光扫描器20312。In a possible design, the optical projector may be composed of a laser and an optical scanner, that is, the first optical projector 2021 includes: a first laser 20211 and a first optical scanner 20212 . The second light projector 2031 includes: a second laser 20311 and a second light scanner 20312 .

其中，第一激光器20211用于产生多个不同波长的光束。Wherein, the first laser 20211 is used to generate multiple beams of different wavelengths.

第一光扫描器20212用于按照预设时序和预设路径对第一激光器产生的光束进行二维扫描以得到待呈现给左眼瞳孔的图像对应的光束。The first light scanner 20212 is configured to two-dimensionally scan the light beam generated by the first laser according to a preset time sequence and a preset path to obtain a light beam corresponding to an image to be presented to the pupil of the left eye.

第二激光器20311用于产生多个不同波长的光束。The second laser 20311 is used to generate multiple beams of different wavelengths.

第二光扫描器20312用于按照预设时序和预设路径对第二激光器产生的光束进行二维扫描以得到待呈现给右眼瞳孔的图像对应的光束。The second optical scanner 20312 is configured to two-dimensionally scan the light beam generated by the second laser according to the preset timing and preset path to obtain the light beam corresponding to the image to be presented to the pupil of the right eye.

第一电致动器2024还用于根据瞳孔的位置确定第一光扫描器20212的第二调整值，并将第一光扫描器从当前位置调整到第二调整值所指示的位置。The first electric actuator 2024 is also used to determine the second adjustment value of the first light scanner 20212 according to the position of the pupil, and adjust the first light scanner from the current position to the position indicated by the second adjustment value.

第二电致动器2034还用于根据瞳孔的位置确定第二光扫描器20312的第二调整值，并将第二光扫描器从当前位置调整到第三调整值所指示的位置。The second electric actuator 2034 is also used to determine the second adjustment value of the second light scanner 20312 according to the position of the pupil, and adjust the second light scanner from the current position to the position indicated by the third adjustment value.

应理解，本实施例中第二调整值泛指光扫描器的调整值，并不是一个特定的值，左眼显示光学系统中光扫描器器(即第一光扫描器)的第二调整值与右眼显示光学系统中光扫描器(即第二光扫描器)的第二调整值可以相同也可以不相同。It should be understood that the second adjustment value in this embodiment generally refers to the adjustment value of the optical scanner, not a specific value, and the left eye displays the second adjustment value of the optical scanner (ie, the first optical scanner) in the optical system The second adjustment value of the optical scanner (ie, the second optical scanner) in the right-eye display optical system may be the same as or different from that of the second adjustment value.

在用户使用近眼显示装置200的过程中，近眼显示装置200中的人眼追踪设备201可以自动追踪用户瞳孔，确定左眼瞳孔和右眼瞳孔的位置后，第一电致动器2024和第二电致动器2034可以通过如下几种方式改变左眼显示光学系统以及右眼显示光学系统的出瞳位置，使得左眼显示光学系统的出瞳位置和左眼瞳孔的位置对准，右眼显示光学系统的出瞳位置和右眼瞳孔的位置对准：When the user is using the near-eye display device 200, the human eye tracking device 201 in the near-eye display device 200 can automatically track the user's pupils, and after determining the positions of the left eye pupil and the right eye pupil, the first electric actuator 2024 and the second electric actuator 2024 The electric actuator 2034 can change the exit pupil positions of the left-eye display optical system and the right-eye display optical system in the following ways, so that the exit pupil position of the left-eye display optical system is aligned with the position of the left-eye pupil, and the right-eye display The exit pupil position of the optical system is aligned with the pupil position of the right eye:

(一)、调节光融合器的位置。(1) Adjust the position of the optical fuser.

1、第一电致动器2024从第一映射表中查找与左眼瞳孔的位置对应的第一光融合器2023的第一调整值，并将第一光融合器2023从当前位置调整到第一调整值所指示的位置。第二电致动器2034从第一映射表中查找与右眼瞳孔的位置对应的第二光融合器2033的第一调整值，并将第二光融合器2033从当前位置调整到第一调整值所指示的位置。1. The first electric actuator 2024 looks up the first adjustment value of the first optical fuser 2023 corresponding to the position of the left eye pupil from the first mapping table, and adjusts the first optical fuser 2023 from the current position to the first adjustment value of the first optical fuser 2023. A position indicated by an adjustment value. The second electric actuator 2034 looks up the first adjustment value of the second optical fusion device 2033 corresponding to the position of the right eye pupil from the first mapping table, and adjusts the second optical fusion device 2033 from the current position to the first adjustment value. The location indicated by the value.

具体地，电致动器可以通过如下方式将光融合器从当前位置调整到第一调整值所指示的位置：Specifically, the electric actuator can adjust the optical fuser from the current position to the position indicated by the first adjustment value in the following manner:

当定用户的瞳孔在第一平面上逆时针转动时，第一电致动器2024驱动第一光融合器2023在第一平面上顺时针转动到第一调整值所指示的位置，第二电致动器2034驱动第二光融合器2033在第一平面顺时针转动到第一调整值所指示的位置。When the user's pupil rotates counterclockwise on the first plane, the first electric actuator 2024 drives the first optical fuser 2023 to rotate clockwise on the first plane to the position indicated by the first adjustment value, and the second electric actuator The actuator 2034 drives the second optical fuser 2033 to rotate clockwise on the first plane to the position indicated by the first adjustment value.

当定用户的瞳孔在第一平面上顺时针转动时，第一电致动器2024驱动第一光融合器2023在第一平面上逆时针转动到第一调整值所指示的位置，第二电致动器2034驱动第二光融合器2033在第一平面逆时针转动到第一调整值所指示的位置。When the user's pupil rotates clockwise on the first plane, the first electric actuator 2024 drives the first optical fuser 2023 to rotate counterclockwise on the first plane to the position indicated by the first adjustment value, and the second electric actuator The actuator 2034 drives the second optical fuser 2033 to rotate counterclockwise on the first plane to the position indicated by the first adjustment value.

当确定用户的瞳孔在第二平面上逆时针转动时，第一电致动器2024驱动第一光融合器2023在第二平面上顺时针转动到第一调整值所指示的位置,第二电致动器2034驱动第二光融合器2033在第二平面上逆时针转动到第一调整值所指示的位置。When it is determined that the pupil of the user rotates counterclockwise on the second plane, the first electric actuator 2024 drives the first optical fuser 2023 to rotate clockwise on the second plane to the position indicated by the first adjustment value, and the second electric actuator 2024 The actuator 2034 drives the second optical fuser 2033 to rotate counterclockwise on the second plane to the position indicated by the first adjustment value.

当确定用户的瞳孔在第二平面上顺时针转动时，第一电致动器2024驱动第一光融合器2023在第二平面上逆时针转动到第一调整值所指示的位置,第二电致动器2034驱动第二光融合器2033在第二平面上顺时针转动到第一调整值所指示的位置。When it is determined that the user's pupil rotates clockwise on the second plane, the first electric actuator 2024 drives the first optical fuser 2023 to rotate counterclockwise on the second plane to the position indicated by the first adjustment value, and the second electric actuator 2024 The actuator 2034 drives the second optical fuser 2033 to rotate clockwise on the second plane to the position indicated by the first adjustment value.

2、人眼追踪设备根据瞳孔的位置确定瞳孔距离，第一电致动器2024从第二映射表中查找与该瞳孔距离对应的第一光融合器2023的第一调整值，并将第一光融合器2023从当前位置调整到第一调整值所指示的位置。第二电致动器2034从第二映射表中查找与该瞳孔距离对应的第二光融合器2033的第一调整值，并将第二光融合器2033从当前位置调整到第一调整值所指示的位置。2. The human eye tracking device determines the pupillary distance according to the position of the pupil, and the first electric actuator 2024 looks up the first adjustment value of the first optical fuser 2023 corresponding to the pupillary distance from the second mapping table, and sets the first The optical fuser 2023 is adjusted from the current position to the position indicated by the first adjustment value. The second electric actuator 2034 looks up the first adjustment value of the second optical fusion device 2033 corresponding to the pupil distance from the second mapping table, and adjusts the second optical fusion device 2033 from the current position to the first adjustment value. indicated location.

若该瞳孔距离大于目标距离，则第一电致动器2024驱动第一光融合器2023在第一平面上顺时针转动到第一调整值所指示的位置，第二电致动器2034驱动第二光融合器2033在第一平面上逆时针转动到第一调整值所指示的位置。If the pupil distance is greater than the target distance, the first electric actuator 2024 drives the first optical fusion device 2023 to rotate clockwise on the first plane to the position indicated by the first adjustment value, and the second electric actuator 2034 drives the first The two optical fusers 2033 rotate counterclockwise on the first plane to the position indicated by the first adjustment value.

若该瞳孔距离小于目标距离，则第一电致动器2024驱动第一光融合器2023在第一平面上逆时针转动到第一调整值所指示的位置，第二电致动器2034驱动第二光融合器2033在第一平面上顺时针转动到第一调整值所指示的位置。If the pupillary distance is smaller than the target distance, the first electric actuator 2024 drives the first optical fuser 2023 to rotate counterclockwise on the first plane to the position indicated by the first adjustment value, and the second electric actuator 2034 drives the first The two optical fusers 2033 rotate clockwise on the first plane to the position indicated by the first adjustment value.

(二)、调节光融合器和光扫描器的位置。(2) Adjust the positions of the optical fuser and the optical scanner.

3、第一电致动器2024从第一映射表中查找与左眼瞳孔的位置对应的第一光融合器2023的第一调整值以及第一光扫描器20212的第二调整值，将第一光融合器2023从当前位置调整到第一调整值所指示的位置，并将第一光扫描器20212从当前位置调整到第二调整值所指示的位置。第二电致动器2034从第一映射表中查找与右眼瞳孔的位置对应的第二光融合器2033的第一调整值以及第二光扫描器20312的第二调整值，将第二光融合器2033从当前位置调整到第一调整值所指示的位置，并将第二光扫描器20312从当前位置调整到第二调整值所指示的位置。3. The first electric actuator 2024 searches the first mapping table for the first adjustment value of the first optical fuser 2023 and the second adjustment value of the first optical scanner 20212 corresponding to the position of the left eye pupil, and sets the An optical fuser 2023 is adjusted from the current position to the position indicated by the first adjustment value, and the first optical scanner 20212 is adjusted from the current position to the position indicated by the second adjustment value. The second electric actuator 2034 searches the first mapping table for the first adjustment value of the second optical fuser 2033 and the second adjustment value of the second optical scanner 20312 corresponding to the position of the pupil of the right eye, and converts the second optical The fuser 2033 adjusts from the current position to the position indicated by the first adjustment value, and adjusts the second light scanner 20312 from the current position to the position indicated by the second adjustment value.

4、人眼追踪设备根据瞳孔的位置确定瞳孔距离，第一电致动器2024从第二映射表中查找与该瞳孔距离对应的第一光融合器2023的第一调整值以及第一光扫描器20212的第二调整值，将第一光融合器2023从当前位置调整到第一调整值所指示的位置，并将第一光扫描器20212从当前位置调整到第二调整值所指示的位置。第二电致动器2034从第二映射表中查找与该瞳孔距离对应的第二光融合器2033的第一调整值以及第二光扫描器20312的第二调整值，将第二光融合器2033从当前位置调整到第一调整值所指示的位置，并将第二光扫描器20312从当前位置调整到第二调整值所指示的位置。4. The human eye tracking device determines the pupillary distance according to the position of the pupil, and the first electric actuator 2024 looks up the first adjustment value of the first optical fuser 2023 corresponding to the pupillary distance and the first optical scan from the second mapping table. adjust the first optical fusion device 2023 from the current position to the position indicated by the first adjustment value, and adjust the first optical scanner 20212 from the current position to the position indicated by the second adjustment value . The second electric actuator 2034 looks up the first adjustment value of the second optical fusion device 2033 corresponding to the pupil distance and the second adjustment value of the second optical scanner 20312 from the second mapping table, and the second optical fusion device 2033 adjusts from the current position to the position indicated by the first adjustment value, and adjusts the second optical scanner 20312 from the current position to the position indicated by the second adjustment value.

具体地，当瞳孔距离大于目标距离时，第一电致动器2024控制第一光融合器2023以及第二电致动器2034控制第二光融合器2033转动的方式与前述方法2所描述的方式类似，此处不再赘述，结合第一光融合器2023和第二光融合器2033的转动，第一电致动器2024还会控制第一光扫描器20212朝着靠近第一激光器20211的方向移动到第二调整值所指示的位置，第二电致动器2034还会控制第二光扫描器20312朝着靠近第二激光器20311的方向移动到第二调整值所指示的位置。Specifically, when the pupillary distance is greater than the target distance, the first electric actuator 2024 controls the first optical fuser 2023 and the second electric actuator 2034 controls the rotation of the second optical fuser 2033 in the same way as described in the aforementioned method 2. The method is similar, and will not be repeated here. In combination with the rotation of the first optical fuser 2023 and the second optical fuser 2033, the first electric actuator 2024 will also control the first optical scanner 20212 to move toward the position close to the first laser 20211. The direction moves to the position indicated by the second adjustment value, and the second electric actuator 2034 also controls the second optical scanner 20312 to move toward the direction close to the second laser 20311 to the position indicated by the second adjustment value.

当瞳孔距离小于目标距离时，第一电致动器2024控制第一光融合器2023以及第二电致动器2034控制第二光融合器2033转动的方式与前述方法2所描述的方式类似，此处不再赘述，结合第一光融合器2023和第二光反射器2033的转动，第一电致动器2024还会控制第一光扫描器20212朝着远离第一激光器20211的方向移动到第二调整值所指示的位置，第二电致动器2034还会控制第二光扫描器20312朝着远离第二激光器20311的方向移动到第二调整值所指示的位置。When the pupillary distance is smaller than the target distance, the first electric actuator 2024 controls the first optical fuser 2023 and the second electric actuator 2034 controls the rotation of the second optical fuser 2033 in a manner similar to that described in method 2 above, No more details here, combined with the rotation of the first optical fuser 2023 and the second optical reflector 2033, the first electric actuator 2024 will also control the first optical scanner 20212 to move away from the first laser 20211 to At the position indicated by the second adjustment value, the second electric actuator 2034 also controls the second optical scanner 20312 to move away from the second laser 20311 to the position indicated by the second adjustment value.

应理解，上述各个实现方式中，电致动器除了可以从第一映射表查找瞳孔位置对应的光融合器的第一调整值，也可以通过如下公式计算与瞳孔位置对应的光融合器的第一调整值：It should be understood that, in each of the above-mentioned implementation manners, in addition to looking up the first adjustment value of the optical fuser corresponding to the pupil position from the first mapping table, the electric actuator can also calculate the first adjustment value of the optical fuser corresponding to the pupil position through the following formula: An adjustment value:

δ＝-tan^-1(c/(d+b))/2 (2)。δ = -tan^-1 (c/(d+b))/2 (2).

其中，c为初始瞳孔位置到当前瞳孔位置的位移，d为光融合器与半透半反镜的距离，b为半透半反镜到瞳孔位置的距离，δ为光融合器相对于初始位置偏转的角度。Among them, c is the displacement from the initial pupil position to the current pupil position, d is the distance between the light fuser and the half-mirror, b is the distance from the half-mirror to the pupil position, and δ is the distance between the light fuser and the half-mirror relative to the initial position The angle of deflection.

具体地，人眼追踪设备201可以确定用户的瞳孔位置，人眼追踪设备计算出该瞳孔位置与初始瞳孔位置的距离c，电致动器确定光融合器与半透半反镜的距离d以及半透半反镜到该瞳孔位置的距离b，然后根据上述公式(2)计算出δ，将光融合器转动到相对于初始位置偏转δ的位置。Specifically, the human eye tracking device 201 can determine the user's pupil position, the human eye tracking device calculates the distance c between the pupil position and the initial pupil position, the electric actuator determines the distance d between the optical fuser and the half mirror, and The distance b from the half-mirror to the pupil position, and then calculate δ according to the above formula (2), and rotate the light fuser to a position deflected by δ relative to the initial position.

如图5所示，图5为用户左眼的瞳孔及近眼显示装置的俯视图，系统预先设定左眼瞳孔的初始位置在E₃，第一光融合器2023的初始位置在M₁，左眼显示光学系统的半反半透镜的位置在N₁，M₁到N₁的距离d为20mm，N₁到E₃的距离b为5mm。用户戴上近眼显示装置后，人眼追踪设备201检测到用户左眼瞳孔位置在E₄，计算出E₃到E₄的位移c为-3.5mm，根据上述公式(2)计算得到δ＝4°，即第一电致动器2024顺时针转动第一光融合器2023，使得第一光融合器2023偏转4°到位置M₂。As shown in Figure 5, Figure 5 is a top view of the pupil of the user's left eye and the near-eye display device. The system presets the initial position of the left eye pupil at E₃ , the initial position of the first optical fuser 2023 at M₁ , and the left eye The half mirror of the display optical system is located at N₁ , the distance d from M₁ to N₁ is 20 mm, and the distance b from N₁ to E₃ is 5 mm. After the user puts on the near-eye display device, the human eye tracking device 201 detects that the position of the pupil of the user's left eye is at E₄ , and calculates that the displacement c from E₃ to E₄ is -3.5 mm, and δ=4 is calculated according to the above formula (2). °, that is, the first electric actuator 2024 rotates the first optical fuser 2023 clockwise, so that the first optical fuser 2023 deflects 4° to the position M₂ .

应理解，近眼显示装置也可以是预先利用眼球模型通过上述方式配置好映射表，记录下不同的瞳孔位置所对应的光融合器的位置，如上述图4所示，左眼瞳孔位置E₃对应的第一光融合器2023的位置为M₁，左眼瞳孔位置E₄对应的第一光融合器2023的位置为M₂，则当检测到用户左眼瞳孔位于E₃时，第一电致动器2024将第一光融合器2023偏转到位置M₁，当检测到用户左眼瞳孔位于E₂时，第一电致动器2024将第一光融合器2023偏转到位置M₂。It should be understood that the near-eye display device can also use the eyeball model to configure the mapping table in the above-mentioned manner in advance, and record the positions of the light fusers corresponding to different pupil positions. As shown in FIG. 4 above, the left_- eye pupil position E3 corresponds to The position of the first optical fusion device 2023 is M₁ , and the position of the first optical fusion device 2023 corresponding to the left eye pupil position E₄ is M₂ , then when it is detected that the user's left eye pupil is located at E₃ , the first electric The actuator 2024 deflects the first optical fuser 2023 to the position M₁ , and when it is detected that the pupil of the user's left eye is located at E₂ , the first electric actuator 2024 deflects the first optical fuser 2023 to the position M₂ .

本申请实施例提供了一种近眼显示装置，该装置包括：人眼追踪设备以及一个或两个光学系统。其中，每个光学系统包括：光投影机、光融合器、光反射器和电致动器。人眼追踪设备用于追踪用户的瞳孔，并确定瞳孔的位置，电致动器用于根据瞳孔的位置确定光融合器的第一调整值，并将光融合器从当前位置调整到第一调整值所指示的位置。也就是说，本申请中用户佩戴上近眼显示设备后，近眼显示设备就会自动根据用户的瞳孔位置对光反射器的位置进行调节，以将光学系统的出瞳位置与瞳孔的位置对准，从而使得近眼显示装置可以适应不同用户的瞳距，这个过程用户无需手动执行任何操作，既快速又方便，提升了用户体验。An embodiment of the present application provides a near-eye display device, which includes: a human eye tracking device and one or two optical systems. Wherein, each optical system includes: a light projector, a light fuser, a light reflector and an electric actuator. The human eye tracking device is used to track the pupil of the user and determine the position of the pupil, and the electric actuator is used to determine the first adjustment value of the optical fusion device according to the position of the pupil, and adjust the optical fusion device from the current position to the first adjustment value the indicated location. That is to say, after the user wears the near-eye display device in this application, the near-eye display device will automatically adjust the position of the light reflector according to the user's pupil position, so as to align the exit pupil position of the optical system with the pupil position, Therefore, the near-eye display device can adapt to the pupil distances of different users, and the user does not need to perform any manual operations during this process, which is fast and convenient, and improves user experience.

需要说明的是，上述图1或图4对应光学系统中的激光器包括至少三颗半导体激光芯片，这些半导体激光芯片采用一体封装而成，采用自由空间、光波导、光纤等光学器件实现多路激光光束的发射。It should be noted that the laser in the optical system corresponding to Figure 1 or Figure 4 above includes at least three semiconductor laser chips. emission of beams.

或者光学系统中的激光器包括多谐振腔一体式封装泵浦激光器，该激光器可以产生多个波长激光，具体可以通过非线性晶体转换得到所需的不同波长的激光。Alternatively, the laser in the optical system includes a multi-resonator integrated packaged pump laser, which can generate multiple wavelengths of laser light, and specifically can obtain required laser light of different wavelengths through nonlinear crystal conversion.

应理解，上述图1对应光学系统中的激光器还可以是其他能够对光束进行合束、整形和调制的其他类型的封装光源，具体本申请不作限定。It should be understood that the lasers in the optical system corresponding to FIG. 1 above may also be other types of packaged light sources capable of combining, shaping and modulating beams, which are not limited in this application.

上述图1或图4对应光学系统中的光扫描器可以是二维微机电系统(micro-electro-mechanical system，MEMS)扫描振镜，该MEMS扫描振镜的驱动方式可以是电磁、静电、压电、电热等方式驱动。该光扫描器也可以是二维反射扫描装置，该二维反射扫描装置可以通过兰姆波等方式驱动。该光扫描器还可以是其他具有高频二维扫描功能的设备，具体本申请不作限定。The optical scanner in the optical system corresponding to Fig. 1 or Fig. 4 above can be a two-dimensional micro-electro-mechanical system (micro-electro-mechanical system, MEMS) scanning vibrating mirror, and the driving mode of the MEMS scanning vibrating mirror can be electromagnetic, electrostatic, piezoelectric, etc. Driven by electricity, electric heating, etc. The optical scanner can also be a two-dimensional reflective scanning device, which can be driven by Lamb waves or the like. The optical scanner may also be other devices with a high-frequency two-dimensional scanning function, which is not limited in this application.

上述图1或图4对应光学系统中光融合器，又称为光耦合器，具有对特定波长分别进行选择性汇聚或发散的功能，该功能可以通过在自由曲面镜片表面作波长选择镀膜来实现，也可以通过在透明薄膜中加工维纳结构或进行全息干涉曝光来实现。其中，特定波长可以包括红光对应的波长，绿光对应的波长和蓝光对应的波长，还可以包括是其他颜色的光对应的波长，具体此处不作限定。The above-mentioned Figure 1 or Figure 4 corresponds to the optical combiner in the optical system, also known as the optical coupler, which has the function of selectively converging or diverging specific wavelengths respectively. This function can be realized by making wavelength selective coating on the surface of the free-form lens , can also be realized by processing Wiener structures in transparent films or performing holographic interference exposure. Wherein, the specific wavelength may include a wavelength corresponding to red light, a wavelength corresponding to green light, and a wavelength corresponding to blue light, and may also include wavelengths corresponding to light of other colors, which are not limited herein.

上述图1或图4对应近眼显示装置中的人眼追踪设备可以包括：传感器和处理器，该传感器用于获取用户的眼部区域图像，该处理器用于对眼部区域图像进行分析得到用户的瞳孔信息，如瞳孔位置，瞳孔距离，注视方向等。The human eye tracking device in the near-eye display device corresponding to FIG. 1 or FIG. 4 above may include: a sensor and a processor, the sensor is used to acquire the image of the user's eye region, and the processor is used to analyze the image of the eye region to obtain the user's Pupil information, such as pupil position, pupil distance, gaze direction, etc.

其中，人眼追踪设备中的传感器可以包括近红外(near infrared，NIR)光源和照相机，该NIR光源可以通过到单独的激光或发光二极管(light emitting diode，LED)实现，也可以集成在光投影机的光源中。Wherein, the sensor in the human eye tracking device may include a near infrared (near infrared, NIR) light source and a camera, and the NIR light source may be realized by a separate laser or light emitting diode (light emitting diode, LED), and may also be integrated in a light projection in the light source of the machine.

或者传感器包括NIR和针对该NIR的光探测器，(photo detector，PD)，该NIR光源可以集成在光投影机的光源中，可选地，该PD与光学系统的光扫描器和光融合器的相对位置是固定的。可选地，该PD可以以高频采集指定NIR波长的光强值。Or the sensor includes NIR and a photo detector for the NIR, (photo detector, PD), the NIR light source can be integrated in the light source of the light projector, optionally, the PD and the light scanner of the optical system and the light fusion device The relative position is fixed. Optionally, the PD can collect light intensity values of specified NIR wavelengths at high frequency.

或者传感器包括NIR和针对该NIR的光扫描器，该光扫描器具有高频二维扫描功能，可以通过电磁、静电、压电、电热等方式驱动，该NIR光源集成在光投影机的光源中。Or the sensor includes NIR and an optical scanner for the NIR, the optical scanner has a high-frequency two-dimensional scanning function, and can be driven by electromagnetic, electrostatic, piezoelectric, electrothermal, etc., and the NIR light source is integrated in the light source of the light projector .

传感器还可以是其他能够采集人眼区域图像的成像设备，具体本申请不作限定。The sensor may also be other imaging devices capable of collecting images of the human eye area, which is not limited in this application.

上述图1或图4对应光学系统中的光反射器可以是微机电(micro electromechanical system，MEMS)反射镜，即光反射器包括：MEMS反射镜面，第一转轴结构和第二转轴结构，如图6所示。具体地，该MEMS反射镜可以通过电磁、静电、电压、电热等方式驱动，对应地，电致动器可以根据瞳孔位置，通过上述前述任意一种方式驱动MEMS反射镜面绕第一转轴结构和/或第二转轴结构转动。以电磁驱动式的MEMS反射镜为例，当未施加驱动电流时，反射镜面保持在初始位置。当施加驱动电流时，MEMS反射镜面会在电磁力驱动下绕第一转轴和第二转轴偏转到新的位置。偏转到预期位置后，通过驱动电路控制驱动电流，可以使反射镜面在偏转位置处相对光路静止，从而起到对准用户瞳孔进行视网膜投影的作用。The light reflector in the corresponding optical system of above-mentioned Fig. 1 or Fig. 4 can be microelectromechanical system (micro electromechanical system, MEMS) reflector, namely light reflector comprises: MEMS reflector surface, the first rotating shaft structure and the second rotating shaft structure, as shown in the figure 6. Specifically, the MEMS mirror can be driven by electromagnetic, electrostatic, voltage, electrothermal, etc. Correspondingly, the electric actuator can drive the MEMS mirror surface around the first rotation axis structure and/or in any of the above-mentioned ways according to the pupil position Or the second rotating shaft structure rotates. Taking the electromagnetically driven MEMS mirror as an example, when no driving current is applied, the mirror surface remains at the initial position. When a driving current is applied, the MEMS mirror surface will be deflected to a new position around the first rotation axis and the second rotation axis under the drive of electromagnetic force. After deflecting to the expected position, the driving current is controlled by the driving circuit, so that the reflective mirror surface can be kept stationary relative to the optical path at the deflected position, so as to perform retinal projection on the user's pupil.

需要说明的是，上述图1或图4对应实施例中的人眼追踪设备可以是在用户使用近眼显示装置的过程中持续工作，即实时追踪用户的瞳孔，获取用户的瞳孔信息。人眼追踪设备也可以是在用户开始使用近眼显示装置时工作，即只获取用户开始使用时的瞳孔信息，电致动器根据该瞳孔信息完成调节后，即停止工作，即停止对该用户的瞳孔的追踪。具体地，人眼追踪设备可以通过如下方式确定用户开始使用近眼显示装置：当检测到用户通过手动启动近眼显示装置的操作或者检测到启动近眼现实装置的传感器信号时，确定用户开始使用近眼显示装置，其中手动启动近眼显示装置的操作可以是按下、滑动按钮、触摸按钮、拨动按钮、发出特定语音指令或特定手势等，启动近眼现实装置的传感器信号可以是重力传感器信号、陀螺仪信号、光线探测器信号、声音探测器信号、距离感应器信号等。It should be noted that the human eye tracking device in the embodiment corresponding to FIG. 1 or FIG. 4 may continue to work when the user is using the near-eye display device, that is, to track the user's pupil in real time and obtain the user's pupil information. The human eye tracking device can also work when the user starts to use the near-eye display device, that is, only obtains the pupil information when the user starts using it, and the electric actuator stops working after the adjustment is completed according to the pupil information, that is, stops the user's eye tracking device. Pupil tracking. Specifically, the human eye tracking device may determine that the user starts using the near-eye display device in the following manner: when it detects that the user manually starts the operation of the near-eye display device or detects a sensor signal for starting the near-eye display device, it determines that the user starts using the near-eye display device , where the operation of manually starting the near-eye display device can be pressing, sliding a button, touching a button, toggling a button, issuing a specific voice command or a specific gesture, etc., and the sensor signal for starting the near-eye display device can be a gravity sensor signal, a gyroscope signal, Light detector signal, sound detector signal, distance sensor signal, etc.

需要说明的是，上述图1或图4仅示出了一个人眼追踪设备，分别与左眼显示光学系统中的电致动器和右眼显示光学系统中的电致动器连接，但是在实际应用中，近眼显示装置也可以有两个人眼追踪设备，一个和左眼显示光学系统中的电致动器连接，另一个和右眼显示光学系统中的电致动器连接，具体本申请不作限定。It should be noted that the above-mentioned Fig. 1 or Fig. 4 only shows a human eye tracking device, which is respectively connected with the electric actuator in the left-eye display optical system and the electric actuator in the right-eye display optical system, but in In practical applications, the near-eye display device can also have two human eye tracking devices, one is connected to the electric actuator in the left-eye display optical system, and the other is connected to the electric actuator in the right-eye display optical system. Not limited.

还需要说明的是，上述图1或图4对应光学系统中的光投影机除了可以由激光器以及光扫描器组成，还可以是发光二极管(light emitting diode，LED)光投影机，或者液晶显示器(liquid crystal display，LCD)光投影机，或者由光源和液晶附硅(liquidcrystal on silicon，LCOS)光投影机，或者由激光器和数字光学处理(digital lightprocessing，DLP)光投影机组成，或者其他能够生成图像对应的光束的器件，具体本申请不作限定。It should also be noted that, in addition to being composed of a laser and an optical scanner, the light projector in the optical system corresponding to the above-mentioned FIG. 1 or FIG. 4 can also be a light emitting diode (light emitting diode, LED) light projector, or a liquid crystal display ( A liquid crystal display (LCD) light projector, or a light source and a liquid crystal on silicon (LCOS) light projector, or a laser and a digital light processing (DLP) light projector, or other capable of generating The device of the light beam corresponding to the image is not limited in this application.

在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product.

所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本发明实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存储的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质，(例如，软盘、硬盘、磁带)、光介质(例如，DVD)、或者半导体介质(例如固态硬盘Solid State Disk(SSD))等。The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, all or part of the processes or functions according to the embodiments of the present invention will be generated. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server, or data center Transmission to another website site, computer, server, or data center by wired (eg, coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be stored by a computer, or a data storage device such as a server or a data center integrated with one or more available media. The available medium may be a magnetic medium (for example, a floppy disk, a hard disk, or a magnetic tape), an optical medium (for example, DVD), or a semiconductor medium (for example, a Solid State Disk (SSD)).

在本申请所提供的几个实施例中，应该理解到，所揭露装置，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed device may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(英文全称：Read-OnlyMemory，英文缩写：ROM)、随机存取存储器(英文全称：Random Access Memory，英文缩写：RAM)、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or part of the contribution to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, server, or network device, etc.) execute all or part of the steps described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (English full name: Read-OnlyMemory, English abbreviation: ROM), random access memory (English full name: Random Access Memory, English abbreviation: RAM), disk Or various media such as CDs that can store program codes.

以上所述，以上实施例仅用以说明本申请的技术方案，而非对其限制。尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换。而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。As mentioned above, the above embodiments are only used to illustrate the technical solution of the present application, not to limit it. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions described in the foregoing embodiments can still be modified, or some technical features thereof can be equivalently replaced. However, these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.