CN114374831A - Interactive system - Google Patents

Abstract

The invention discloses an interactive system. The interactive system comprises an electronic device, a first image display device and a second image display device. The electronic device transmits the first image information to the first image display equipment for displaying. The electronic device transmits the second image information to the second image display equipment for displaying. The second image information is displayed in a space on one side of the second image display device by the second image display device in three-dimensional. The three-dimensional second image information interacts with at least one object.

Description

Translated fromChinese

互动系统Interactive system

技术领域technical field

本发明涉及一种互动系统，尤其涉及一种直接与三维图像信息进行互动的互动系统。The invention relates to an interactive system, in particular to an interactive system that directly interacts with three-dimensional image information.

背景技术Background technique

在目前扩增实境(Augmented Reality)或是虚拟现实(Virtual Reality)的领域，多数都需要利用用户的身心感官与电子装置进行物理性的互动，而不是直观的利用道具或是手部与三维的图像信息进行互动。In the current field of Augmented Reality or Virtual Reality, most of them need to use the user's physical and mental senses to interact with electronic devices physically, rather than intuitively using props or hands and three-dimensional interactive image information.

因此，如何提供一种可以让用户直接与三维图像信息进行互动的互动系统，已成为该项事业所欲解决的重要课题之一。Therefore, how to provide an interactive system that allows users to directly interact with 3D image information has become one of the important issues to be solved by this project.

发明内容SUMMARY OF THE INVENTION

本发明所要解决的技术问题在于，针对现有技术的不足提供一种互动系统，包括一电子装置、一第一影像图像显示设备以及一第二影像图像显示设备，电子装置包括一控制器、一存储模块、一连接模块；一第一图像显示设备电性连接所述电子装置，所述第一图像显示设备是一二维图像显示设备，用于显示一二维图像信息；一第二图像显示设备连接所述电子装置，所述第二图像显示设备是一三维图像显示设备；其中，所述电子装置设置有一程序，所述程序至少提供一第一图像信息以及一第二图像信息，所述控制器传送所述第一图像信息至所述第一图像显示设备进行显示，所述控制器传送所述第二图像信息至所述第二图像显示设备进行显示，所述第二图像信息通过所述第二图像显示设备，在所述第二图像显示设备的一侧的空间中显示所述第二图像信息的三维图像信息；其中，所述三维的第二图像信息至少与一物体进行互动。The technical problem to be solved by the present invention is to provide an interactive system in view of the shortcomings of the prior art, which includes an electronic device, a first image image display device and a second image image display device, and the electronic device includes a controller, a a storage module, a connection module; a first image display device electrically connected to the electronic device, the first image display device is a two-dimensional image display device for displaying a two-dimensional image information; a second image display device The device is connected to the electronic device, and the second image display device is a three-dimensional image display device; wherein, the electronic device is provided with a program, the program at least provides a first image information and a second image information, the The controller transmits the first image information to the first image display device for display, the controller transmits the second image information to the second image display device for display, and the second image information passes through the The second image display device displays three-dimensional image information of the second image information in a space on one side of the second image display device; wherein the three-dimensional second image information interacts with at least one object.

优选地，还包括：一传感器，设置在所述电子装置、所述第一图像显示设备或是所述第二图像显示设备上，用于检测所述物体的至少一物体三维坐标值，所述传感器将所述至少一物体三为坐标值传送到所述控制器，所述控制器根据所述至少一物体三维坐标值以及所述三维的第二图像信息的多个第一三维坐标值，决定所述三维的第二图像信息的多个第二三维坐标值。Preferably, it further includes: a sensor, disposed on the electronic device, the first image display device or the second image display device, for detecting at least one three-dimensional coordinate value of the object, the The sensor transmits the three-dimensional coordinate value of the at least one object to the controller, and the controller determines according to the three-dimensional coordinate value of the at least one object and a plurality of first three-dimensional coordinate values of the three-dimensional second image information. A plurality of second three-dimensional coordinate values of the three-dimensional second image information.

优选地，所述第一图像显示设备设置在所述电子装置的一侧，所述第二图像显示设备设置在所述电子装置上。Preferably, the first image display device is arranged on one side of the electronic device, and the second image display device is arranged on the electronic device.

优选地，所述第二图像显示设备包括：一平面显示模块；一透镜阵列层；以及一微结构层；其中，所述平面显示模块具有一显示面，所述平面显示模块提供至少一图像信息，通过所述透镜阵列层以及所述微结构层进行显示，所述透镜阵列层设置于所述平面显示模块的显示面上，接收所述图像信息的光线进行调整，所述透镜阵列层包含多个透镜，所述透镜阵列层用于调控光场，所述微结构层设置于所述透镜阵列层上，所述微结构层包括多个微结构，所述微结构层用于调制光线角度方向，所述微结构层接收穿透所述透镜阵列层的光线进行调整，以使所述第二图像显示设备显示漂浮在所述第二图像显示设备一侧的空间中的三维图像信息。Preferably, the second image display device includes: a flat display module; a lens array layer; and a microstructure layer; wherein the flat display module has a display surface, and the flat display module provides at least one image information , display through the lens array layer and the microstructure layer, the lens array layer is arranged on the display surface of the flat display module, and receives the light of the image information for adjustment, and the lens array layer includes multiple a lens, the lens array layer is used to modulate the light field, the microstructure layer is disposed on the lens array layer, the microstructure layer includes a plurality of microstructures, and the microstructure layer is used to modulate the angular direction of light , the microstructure layer receives the light penetrating the lens array layer and adjusts, so that the second image display device displays three-dimensional image information floating in the space on one side of the second image display device.

优选地，所述透镜阵列层的所述透镜符合造镜者公式：1/f＝(n-1)(1/R1+1/R2)，其中R1和R2分别为所述透镜两边的曲率半径，f是透镜焦距，n是透镜折射率。Preferably, the lenses of the lens array layer conform to the lens maker's formula: 1/f=(n-1)(1/R1+1/R2), where R1 and R2 are the radii of curvature of the two sides of the lens, respectively , f is the focal length of the lens, and n is the refractive index of the lens.

优选地，所述微结构层是一动态光学组件层，所述微结构层具有一微结构功能模式以及一无微结构功能模式，当所述微结构层切换为所述微结构功能模式时，能用于调制光线角度方向。Preferably, the microstructure layer is a dynamic optical component layer, the microstructure layer has a microstructure function mode and a microstructure-free function mode, when the microstructure layer is switched to the microstructure function mode, Can be used to modulate the angular direction of light rays.

优选地，所述微结构层是一液晶透镜阵列层，包括多个微结构液晶透镜，所述透镜阵列层是一液晶透镜阵列层，包括多个光学调整液晶透镜。Preferably, the microstructure layer is a liquid crystal lens array layer comprising a plurality of microstructure liquid crystal lenses, and the lens array layer is a liquid crystal lens array layer comprising a plurality of optical adjustment liquid crystal lenses.

优选地，所述透镜阵列层包括一第一结构透镜阵列层以及一第二结构透镜阵列层，所述第一结构透镜阵列层具有透镜结构，能用于调控光场，所述第二结构透镜阵列层则不具有透镜结构。Preferably, the lens array layer includes a first structure lens array layer and a second structure lens array layer, the first structure lens array layer has a lens structure and can be used for adjusting the light field, and the second structure lens The array layer does not have a lens structure.

优选地，所述第二图像显示设备还包括一电子束传感器，所述电子装置或是所述第二图像显示设备根据所述三维的第二图像信息与所述物体的互动状况，以使所述电子束传感器提供一电子束至所述物体。Preferably, the second image display device further includes an electron beam sensor, and the electronic device or the second image display device is based on the interaction state of the three-dimensional second image information and the object to make all the The electron beam sensor provides an electron beam to the object.

优选地，所述电子装置或是所述第二图像显示设备提供多个控制信号至所述物体的一电子互动手套，以使所述电子互动手套的多个触觉反馈组件进行动作。Preferably, the electronic device or the second image display device provides a plurality of control signals to an electronic interactive glove of the object, so that a plurality of haptic feedback components of the electronic interactive glove act.

本发明还公开了一种互动系统，包括一电子装置、一三维图像显示设备及一传感器。电子装置包括一控制器、一存储模块以及一连接模块；一三维图像显示设备，所述电子装置的所述连接模块连接所述三维图像显示设备；以及一传感器，设置在所述电子装置或是所述三维图像显示设备上，用于检测一物体的多个物体三维坐标值；其中，所述电子装置设置有一程序，所述程序存储在所述存储模块中，所述程序至少提供一图像信息，所述控制器传送所述图像信息至所述三维图像显示设备进行显示，所述控制器传送所述图像信息至所述三维显示设备进行显示，所述图像信息通过所述三维图像显示设备，在所述三维图像显示设备的一侧的空间中显示一三维图像信息；其中，所述三维图像信息至少与所述物体进行互动；其中，所述传感器将所述多个物体三维坐标值传送到所述控制器，所述控制器根据所述多个物体三维坐标值以及所述第二图像信息的三维图像信息的多个第一三维坐标值，决定所述三维图像信息的多个第二三维坐标值；其中，所述三维图像信息的所述多个第二三维坐标值决定所述三维图像信息与所述物体互动时的一动作。The invention also discloses an interactive system, comprising an electronic device, a three-dimensional image display device and a sensor. The electronic device includes a controller, a storage module and a connection module; a three-dimensional image display device, the connection module of the electronic device is connected to the three-dimensional image display device; and a sensor, arranged on the electronic device or The three-dimensional image display device is used to detect multiple three-dimensional coordinate values of an object; wherein, the electronic device is provided with a program, the program is stored in the storage module, and the program provides at least one image information , the controller transmits the image information to the three-dimensional image display device for display, the controller transmits the image information to the three-dimensional display device for display, and the image information passes through the three-dimensional image display device, A three-dimensional image information is displayed in a space on one side of the three-dimensional image display device; wherein, the three-dimensional image information interacts with at least the object; wherein the sensor transmits the three-dimensional coordinate values of the plurality of objects to The controller determines a plurality of second three-dimensional coordinates of the three-dimensional image information according to the three-dimensional coordinate values of the plurality of objects and a plurality of first three-dimensional coordinate values of the three-dimensional image information of the second image information Coordinate values; wherein, the plurality of second three-dimensional coordinate values of the three-dimensional image information determine an action when the three-dimensional image information interacts with the object.

优选地，所述三维图像显示设备还包括一电子束传感器，所述电子装置或是所述三维图像显示设备根据所述三维图像信息与所述物体的互动状况，以使所述电子束传感器提供一电子束至所述物体。Preferably, the three-dimensional image display device further includes an electron beam sensor, and the electronic device or the three-dimensional image display device interacts with the object according to the three-dimensional image information, so that the electron beam sensor can provide an electron beam to the object.

优选地，所述电子装置或是所述三维图像显示设备提供多个控制信号至设置在所述物体上的一电子互动装置，以使所述电子互动装置的多个触觉反馈组件进行动作。Preferably, the electronic device or the three-dimensional image display device provides a plurality of control signals to an electronic interactive device disposed on the object, so as to cause the haptic feedback components of the electronic interactive device to act.

本发明的其中一有益效果在于，本发明所提供的互动系统可以让用户直观地与三维图像信息进行互动而产生相对应的动作与变化，无须穿戴各类型扩增实境的电子装置。One of the beneficial effects of the present invention is that the interactive system provided by the present invention allows the user to intuitively interact with the three-dimensional image information to generate corresponding actions and changes, without wearing various types of augmented reality electronic devices.

为使能更进一步了解本发明的特征及技术内容，请参阅以下有关本发明的详细说明与附图，然而所提供的附图仅用于提供参考与说明，并非用来对本发明加以限制。For further understanding of the features and technical content of the present invention, please refer to the following detailed description and accompanying drawings of the present invention. However, the accompanying drawings are only for reference and description, not for limiting the present invention.

附图说明Description of drawings

图1是本发明第一实施例的互动系统的示意图。FIG. 1 is a schematic diagram of an interactive system according to a first embodiment of the present invention.

图2A是本发明第一实施例的互动系统的功能方块图。FIG. 2A is a functional block diagram of the interactive system according to the first embodiment of the present invention.

图2B是本发明第一实施例的互动系统的另一功能方块图。FIG. 2B is another functional block diagram of the interactive system according to the first embodiment of the present invention.

图3是本发明第一实施例的互动系统的另一示意图。FIG. 3 is another schematic diagram of the interactive system according to the first embodiment of the present invention.

图4是本发明第二图像显示设备的结构示意图。FIG. 4 is a schematic structural diagram of a second image display device of the present invention.

图5是第二图像显示设备显示一第二图像信息的示意图。FIG. 5 is a schematic diagram of a second image display device displaying a second image information.

图6是第二图像信息与一物体互动的示意图。FIG. 6 is a schematic diagram of the interaction between the second image information and an object.

图7是第二图像信息与一物体互动的另一示意图。FIG. 7 is another schematic diagram of the interaction between the second image information and an object.

图8是第二图像信息与一物体互动的另一示意图。FIG. 8 is another schematic diagram of the interaction between the second image information and an object.

图9是第二图像信息与一物体互动的另一示意图。FIG. 9 is another schematic diagram of the interaction between the second image information and an object.

图10是第二图像信息根据第一实体以及第二实体显示的示意图。FIG. 10 is a schematic diagram of displaying the second image information according to the first entity and the second entity.

图11是第二图像信息根据第一实体以及第二实体显示的示意图。FIG. 11 is a schematic diagram of displaying the second image information according to the first entity and the second entity.

图12是本发明第二实施例的互动系统的示意图。FIG. 12 is a schematic diagram of an interactive system according to a second embodiment of the present invention.

图13是本发明第二实施例的互动系统的另一示意图。FIG. 13 is another schematic diagram of the interactive system according to the second embodiment of the present invention.

图14是本发明第二实施例的互动系统的另一示意图。FIG. 14 is another schematic diagram of the interactive system according to the second embodiment of the present invention.

图15是本发明第二实施例的互动系统的另一示意图。FIG. 15 is another schematic diagram of the interactive system according to the second embodiment of the present invention.

图16是本发明第三实施例的互动系统的示意图。FIG. 16 is a schematic diagram of an interactive system according to a third embodiment of the present invention.

图17是本发明第三实施例的互动系统的另一示意图。FIG. 17 is another schematic diagram of the interactive system according to the third embodiment of the present invention.

具体实施方式Detailed ways

以下是通过特定的具体实施例来说明本发明所公开有关“互动系统”的实施方式，本领域技术人员可由本说明书所公开的内容了解本发明的优点与效果。本发明可通过其他不同的具体实施例加以施行或应用，本说明书中的各项细节也可基于不同观点与应用，在不背离本发明的构思下进行各种修改与变更。另外，本发明的附图仅为简单示意说明，并非依实际尺寸的描绘，事先声明。以下的实施方式将进一步详细说明本发明的相关技术内容，但所公开的内容并非用以限制本发明的保护范围。另外，本文中所使用的术语“或”，应视实际情况可能包括相关联的列出项目中的任一个或者多个的组合。The following are specific specific embodiments to illustrate the implementation of the "interactive system" disclosed in the present invention, and those skilled in the art can understand the advantages and effects of the present invention from the content disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and various details in this specification can also be modified and changed based on different viewpoints and applications without departing from the concept of the present invention. In addition, the drawings of the present invention are merely schematic illustrations, and are not drawn according to the actual size, and are stated in advance. The following embodiments will further describe the related technical contents of the present invention in detail, but the disclosed contents are not intended to limit the protection scope of the present invention. In addition, the term "or", as used herein, should include any one or a combination of more of the associated listed items, as the case may be.

[第一实施例][First Embodiment]

请参阅图1、图2A、图2B、图3，图1是本发明第一实施例的互动系统的示意图。图2A是本发明第一实施例的互动系统的功能方块图。图2B是本发明第一实施例的互动系统的另一功能方块图。图3是本发明第一实施例的互动系统的另一示意图。Please refer to FIG. 1 , FIG. 2A , FIG. 2B , and FIG. 3 . FIG. 1 is a schematic diagram of an interactive system according to a first embodiment of the present invention. FIG. 2A is a functional block diagram of the interactive system according to the first embodiment of the present invention. FIG. 2B is another functional block diagram of the interactive system according to the first embodiment of the present invention. FIG. 3 is another schematic diagram of the interactive system according to the first embodiment of the present invention.

请参阅图1，互动系统SYS1包括一电子装置1、一第一图像显示设备2以及一第二图像显示设备3。电子装置1是一计算机系统，包括一控制器11、一存储模块12以及一连接模块13。Please refer to FIG. 1 , the interactive system SYS1 includes an electronic device 1 , a firstimage display device 2 and a secondimage display device 3 . The electronic device 1 is a computer system including acontroller 11 , astorage module 12 and aconnection module 13 .

第一图像显示设备2电性连接电子装置1。第一图像显示设备2是一二维图像显示设备，用于显示一二维图像信息。第二图像显示设备3连接电子装置1。第二图像显示设备3是一三维图像显示设备。在本实施例中，第二图像显示设备3可以通过有线通信方式或是无线通信方式与电子装置1进行连接。第二图像显示设备3可以利用一Wi-Fi通信单元、一蓝牙通信单元、一紫蜂通信单元(Zigbee)、一LoRa通信单元、一Sigfox通信单元或是一NB-IoT通信单元与电子装置1进行通信连接。The firstimage display device 2 is electrically connected to the electronic device 1 . The firstimage display device 2 is a two-dimensional image display device for displaying a two-dimensional image information. The secondimage display apparatus 3 is connected to the electronic device 1 . The secondimage display device 3 is a three-dimensional image display device. In this embodiment, the secondimage display device 3 can be connected to the electronic device 1 through wired communication or wireless communication. The secondimage display device 3 can utilize a Wi-Fi communication unit, a Bluetooth communication unit, a Zigbee communication unit (Zigbee), a LoRa communication unit, a Sigfox communication unit or an NB-IoT communication unit and the electronic device 1 Make a communication connection.

电子装置1还包括一通信模块14。电子装置1可以利用通信模块14连接第一图像显示设备2以及第二图像显示设备3。通信模块14可以是一有线通信模块或是一无线通信模块。当通信模块14是一无线通信模块时，通信模块14可以是一Wi-Fi通信模块、一蓝牙通信模块、一紫蜂通信模块(Zigbee)、一LoRa通信模块、一Sigfox通信模块或是一NB-IoT通信模块。The electronic device 1 further includes acommunication module 14 . The electronic device 1 can use thecommunication module 14 to connect the firstimage display device 2 and the secondimage display device 3 . Thecommunication module 14 may be a wired communication module or a wireless communication module. When thecommunication module 14 is a wireless communication module, thecommunication module 14 can be a Wi-Fi communication module, a Bluetooth communication module, a Zigbee communication module (Zigbee), a LoRa communication module, a Sigfox communication module or an NB -IoT communication module.

控制器11是一中央处理器(CPU)、一图形处理器(GPU)、特殊应用集成电路(ASIC)或是一微处理器(MCU)。存储模块12是一闪存、一只读存储器、一可规划只读存储器、一电可改写只读存储器、一可擦可规划只读存储器或是一电可擦可规划只读存储器。Thecontroller 11 is a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC) or a microprocessor (MCU). Thestorage module 12 is a flash memory, a read-only memory, a programmable read-only memory, an electrically rewritable read-only memory, an erasable and programmable read-only memory, or an electrically erasable and programmable read-only memory.

电子装置1设置有一程序，程序至少提供一第一图像信息G1以及一第二图像信息G2。此外，程序也可以由云端服务器提供给电子装置1。控制器11传送第一图像信息G1至第一图像显示设备2进行显示。控制器1传送第二图像信息G2至第二图像显示设备3进行显示。第二图像信息G1通过第二图像显示设备3，在第二图像显示设备3的一侧的空间中显示一三维的第二图像信息G2。其中，三维的第二图像信息G2至少与一物体进行互动。例如：使用者的手部、使用者的手指、使用者的手掌、工具、玩具或是道具等。在其他实施例中，第一图像显示设备2也可以用于显示三维图像信息。The electronic device 1 is provided with a program, and the program at least provides a first image information G1 and a second image information G2. In addition, the program may also be provided to the electronic device 1 by a cloud server. Thecontroller 11 transmits the first image information G1 to the firstimage display device 2 for display. The controller 1 transmits the second image information G2 to the secondimage display device 3 for display. The second image information G1 displays a three-dimensional second image information G2 in a space on one side of the secondimage display device 3 through the secondimage display device 3 . The three-dimensional second image information G2 interacts with at least one object. For example: the user's hand, the user's finger, the user's palm, a tool, a toy or a prop, etc. In other embodiments, the firstimage display device 2 may also be used to display three-dimensional image information.

此外，互动系统SYS1还包括一传感器7。在本实施例中，传感器7设置在电子装置1、第一图像显示设备2或是第二图像显示设备3上，用于检测一物体的一物体三维坐标值。在本实施例中，传感器7是一图像提取单元(CCD)。传感器7还可以包括一视线追踪功能，以追踪人类或是动物的视线。In addition, the interactive system SYS1 also includes a sensor 7 . In this embodiment, the sensor 7 is disposed on the electronic device 1, the firstimage display device 2 or the secondimage display device 3, and is used to detect the three-dimensional coordinate value of an object of an object. In this embodiment, the sensor 7 is an image pickup unit (CCD). The sensor 7 may also include a gaze tracking function to track the gaze of humans or animals.

传感器7会将至少一物体三维坐标值传送到控制器11。控制器11根据至少一物体三维坐标值以及三维的第二图像信息G2的三维的第二图像信息的多个第一三维坐标值，决定三维的第二图像信息G2的多个第二三维坐标值。也就是，传感器7会检测物体的物体三维坐标值，并与三维的第二图像信息G2的多个第一三维坐标值一同比对判断，以决定三维的第二图像信息G2的多个第二三维坐标值。此时，三维的第二图像信息G2的多个第一三维坐标值与三维的第二图像信息G2的多个第二三维坐标值相同或是不相同。The sensor 7 transmits at least one three-dimensional coordinate value of the object to thecontroller 11 . Thecontroller 11 determines a plurality of second three-dimensional coordinate values of the three-dimensional second image information G2 according to the three-dimensional coordinate value of at least one object and a plurality of first three-dimensional coordinate values of the three-dimensional second image information of the three-dimensional second image information G2 . That is, the sensor 7 will detect the object three-dimensional coordinate value of the object, and make a comparison judgment with a plurality of first three-dimensional coordinate values of the three-dimensional second image information G2 to determine a plurality of second three-dimensional second image information G2. 3D coordinate value. At this time, the plurality of first three-dimensional coordinate values of the three-dimensional second image information G2 and the plurality of second three-dimensional coordinate values of the three-dimensional second image information G2 are the same or different.

当三维的第二图像信息G2的多个第一三维坐标值与三维的第二图像信息G2的多个第二三维坐标值是不相同时，三维的第二图像信息G2是产生与原先的三维的第二图像信息G2不同的动作。When the multiple first three-dimensional coordinate values of the three-dimensional second image information G2 and the multiple second three-dimensional coordinate values of the three-dimensional second image information G2 are different, the three-dimensional second image information G2 is generated from the original three-dimensional The second image information G2 acts differently.

如图1所示，第一图像显示设备2、第二图像显示设备3是与电子装置1分开设置。在图1中，电子装置1是一桌面计算机。第一图像显示设备2是一液晶显示器、一微型发光二极管显示(MicroLED DISPLAY)或是一有机发光二极管显示器(OLED DISPLAY)。As shown in FIG. 1 , the firstimage display device 2 and the secondimage display device 3 are provided separately from the electronic device 1 . In FIG. 1, the electronic device 1 is a desktop computer. The firstimage display device 2 is a liquid crystal display, a micro light emitting diode display (MicroLED DISPLAY) or an organic light emitting diode display (OLED DISPLAY).

请参阅图2B，在其他实施例中，互动系统SYS2还可以包括一麦克风MP、一扬声器SP以及一连接装置CON。电子装置1的控制器11电性连接存储模块12、连接模块13以及通信模块14。电子装置1的连接模块13连接连接装置CON。连接装置CON连接麦克风MP、扬声器SP、第二图像显示设备3以及传感器7。Referring to FIG. 2B , in other embodiments, the interactive system SYS2 may further include a microphone MP, a speaker SP, and a connection device CON. Thecontroller 11 of the electronic device 1 is electrically connected to thestorage module 12 , theconnection module 13 and thecommunication module 14 . Theconnection module 13 of the electronic device 1 is connected to the connection device CON. The connection means CON connects the microphone MP, the speaker SP, the secondimage display device 3 and the sensor 7 .

在本实施例中，连接装置CON、麦克风MP、扬声器SP、第二图像显示设备3以及传感器7可以设置在同一装置中。In this embodiment, the connection device CON, the microphone MP, the speaker SP, the secondimage display device 3 and the sensor 7 may be provided in the same device.

麦克风MP是用于接收一音频信息。当麦克风MP接收到一控制音频信息时，麦克风MP会通过连接装置CON以及连接装置13传送控制音频信号到控制器11以进行分析。控制器11会进一步分析控制音频信息中的控制要求信号，例如旋转、坐下、跳跃。接着，控制器11会根据控制要求信号进一步控制显示在第二图像显示设备3的三维的第二图像信息G2的动作。如此一来，使用者可以通过声音与三维的第二图像信息G2进行互动。此外，控制器11则可以传送对应三维的第二图像信息G2的互动音频信息到扬声器SP以进行播放，提升使用者更全面的互动体验。The microphone MP is used to receive an audio message. When the microphone MP receives a control audio signal, the microphone MP transmits the control audio signal to thecontroller 11 through the connection device CON and theconnection device 13 for analysis. Thecontroller 11 will further analyze the control request signal in the control audio information, such as rotating, sitting, jumping. Next, thecontroller 11 further controls the action of the three-dimensional second image information G2 displayed on the secondimage display device 3 according to the control request signal. In this way, the user can interact with the three-dimensional second image information G2 through sound. In addition, thecontroller 11 can transmit the interactive audio information corresponding to the three-dimensional second image information G2 to the speaker SP for playback, thereby enhancing the user's more comprehensive interactive experience.

如图3所示，第一图像显示设备2则是设置在电子装置1的一侧，第二图像显示设备3设置在电子装置1上。在图3中，电子装置1是一笔记本电脑。也就是，电子装置1是一双屏幕的笔记本电脑。As shown in FIG. 3 , the firstimage display device 2 is arranged on one side of the electronic device 1 , and the secondimage display device 3 is arranged on the electronic device 1 . In FIG. 3, the electronic device 1 is a notebook computer. That is, the electronic device 1 is a dual-screen notebook computer.

在本实施例中，互动系统SYS1的第一图像信息G1以及第二图像信息G2是可拼接的两个图像信息，例如不同区域的地图。不过，第一图像信息G1以及第二图像信息G2也可以只是内容上相关联的两个图像信息，例如图3中的第二图像信息G2是一虚拟键盘，而第一图像信息G1则是音符跳跃图像。此外，在本实施例中，第二图像信息G2还可以是一弹珠，第一图像信息G1则是弹珠台的弹跳路径。In this embodiment, the first image information G1 and the second image information G2 of the interactive system SYS1 are two pieces of image information that can be spliced, such as maps of different regions. However, the first image information G1 and the second image information G2 can also be only two image information related in content. For example, the second image information G2 in FIG. 3 is a virtual keyboard, and the first image information G1 is a musical note. Jump image. In addition, in this embodiment, the second image information G2 may also be a marble, and the first image information G1 is a bouncing path of the pachinko table.

请参阅图4，图4是本发明第二图像显示设备的结构示意图。Please refer to FIG. 4 , which is a schematic structural diagram of a second image display device of the present invention.

第二图像显示设备3包括一平面显示模块31、一透镜阵列层32以及一微结构层33。The secondimage display device 3 includes aflat display module 31 , alens array layer 32 and amicrostructure layer 33 .

平面显示模块31具有一显示面311。平面显示模块31用于提供二维的第二图像信息G2，通过透镜阵列层32以及微结构层33进行显示一三维的第二图像信息G2。Theflat display module 31 has adisplay surface 311 . Theflat display module 31 is configured to provide two-dimensional second image information G2, and display a three-dimensional second image information G2 through thelens array layer 32 and themicrostructure layer 33.

透镜阵列层32设置于平面显示模块31的显示面311上，接收二维的第二图像信息G2的光线进行调整，透镜阵列层32包含多个透镜321。透镜阵列层32用于调控光场。Thelens array layer 32 is disposed on thedisplay surface 311 of theflat display module 31 , and receives light from the two-dimensional second image information G2 for adjustment. Thelens array layer 32 includes a plurality oflenses 321 . Thelens array layer 32 is used to modulate the light field.

微结构层33设置于透镜阵列层32上。微结构层33包括多个微结构。微结构层33用于调制光线角度方向。微结构层33接收穿透透镜阵列层32的光线进行调整，以使第二图像显示设备3显示漂浮在第二图像显示设备3一侧的空间中的三维图像信息。Themicrostructure layer 33 is disposed on thelens array layer 32 . Themicrostructure layer 33 includes a plurality of microstructures. Themicrostructure layer 33 is used to modulate the angular direction of the light. Themicrostructure layer 33 receives light passing through thelens array layer 32 and is adjusted so that the secondimage display device 3 displays three-dimensional image information floating in a space on one side of the secondimage display device 3 .

透镜阵列层32的透镜321符合造镜者公式：1/f＝(n-1)(1/R1+1/R2)，其中R1和R2分别为透镜321两边的曲率半径，f是透镜焦距，n是透镜折射率。Thelens 321 of thelens array layer 32 conforms to the lens maker's formula: 1/f=(n-1)(1/R1+1/R2), where R1 and R2 are the radii of curvature on both sides of thelens 321 respectively, f is the focal length of the lens, n is the lens refractive index.

此外，微结构层33是一动态光学组件层。也就是，微结构层33具有一微结构功能模式以及一无微结构功能模式。微结构层33可以根据一控制信号进行调整为微结构功能模式以及无微结构功能模式。当微结构层33切换为微结构功能模式时，能用于调制光线角度方向。当微结构层33切换为无微结构功能模式时，则第二图像显示设备3用于显示二维图像信息，不会显示漂浮在第二图像显示设备3一侧的空间中的三维图像信息。微结构层33是一液晶透镜阵列层(Liquid Lens Layer)，包括多个微结构液晶透镜，透镜阵列层也是一液晶透镜阵列层(Liquid Lens Layer)，包括多个光学调整液晶透镜。也就是，第二图像显示设备3是一至少包括两层液晶透镜阵列层的显示设备，在其他实施例中，第二图像显示设备3可以包括更多层液晶透镜阵列层进行光线调整。再者，在其他实施例中，第二图像显示设备3可以在不同区域设置不同数量的第二图像显示设备3进行光线调整。此外，透镜阵列层32包括一第一结构透镜阵列层(图未示)以及一第二结构透镜阵列层(图未示)。第一结构透镜阵列层(图未示)具有透镜结构，能用于调控光场，第二结构透镜阵列层(图未示)则不具有透镜结构。In addition, themicrostructure layer 33 is a dynamic optical element layer. That is, themicrostructure layer 33 has a microstructure functional mode and a microstructure-free functional mode. Themicrostructure layer 33 can be adjusted into a microstructure function mode and a non-microstructure function mode according to a control signal. When themicrostructure layer 33 is switched to the microstructure function mode, it can be used to modulate the angular direction of the light. When themicrostructure layer 33 is switched to the non-microstructure function mode, the secondimage display device 3 is used to display two-dimensional image information, and will not display three-dimensional image information floating in the space on one side of the secondimage display device 3 . Themicrostructure layer 33 is a liquid crystal lens layer, including a plurality of microstructure liquid crystal lenses, and the lens array layer is also a liquid lens layer, including a plurality of optical adjustment liquid crystal lenses. That is, the secondimage display device 3 is a display device including at least two liquid crystal lens array layers. In other embodiments, the secondimage display device 3 may include more liquid crystal lens array layers for light adjustment. Furthermore, in other embodiments, the secondimage display device 3 may set different numbers of secondimage display devices 3 in different regions to perform light adjustment. In addition, thelens array layer 32 includes a first structured lens array layer (not shown) and a second structured lens array layer (not shown). The lens array layer of the first structure (not shown in the figure) has a lens structure, which can be used to control the light field, and the lens array layer of the second structure (not shown in the figure) does not have a lens structure.

请参阅图5、图6以及图7，图5是第二图像显示设备显示一第二图像信息的示意图。图6是第二图像信息与一物体互动的示意图。图7是第二图像信息与一物体互动的另一示意图。Please refer to FIG. 5 , FIG. 6 and FIG. 7 . FIG. 5 is a schematic diagram of the second image display device displaying a second image information. FIG. 6 is a schematic diagram of the interaction between the second image information and an object. FIG. 7 is another schematic diagram of the interaction between the second image information and an object.

三维的第二图像信息G2是一宠物狗。图6中的第二图像信息G2的多个第一三维坐标值G2C1-G2C3可以通过传感器7进行检测，或是由控制器11直接由第二图像信息G2的数据中取得。The three-dimensional second image information G2 is a pet dog. The plurality of first three-dimensional coordinate values G2C1-G2C3 of the second image information G2 in FIG. 6 can be detected by the sensor 7, or directly obtained by thecontroller 11 from the data of the second image information G2.

此外，图6中的手指的多个三维坐标值FC1-FC3，也可以由传感器7检测得到。此外，手指的多个三维坐标值FC1-FC3是在一段时间中的多个三维坐标值。In addition, the plurality of three-dimensional coordinate values FC1 - FC3 of the finger in FIG. 6 can also be detected by the sensor 7 . Also, the plurality of three-dimensional coordinate values FC1-FC3 of the finger are a plurality of three-dimensional coordinate values over a period of time.

电子装置1的控制器11可以根据手指的多个三维坐标值FC1-FC3以及第二图像信息G2的多个第一三维坐标值G2C1-G2C3，进行决定第二图像信息G2的第二三维坐标值G2C1’-G2C3’，进而决定第二图像信息G2的动作或是形变状态。Thecontroller 11 of the electronic device 1 may determine the second three-dimensional coordinate value of the second image information G2 according to the plurality of three-dimensional coordinate values FC1-FC3 of the finger and the plurality of first three-dimensional coordinate values G2C1-G2C3 of the second image information G2. G2C1'-G2C3', and further determine the action or deformation state of the second image information G2.

请参阅图8以及图9，图8与图9是第二图像信息与一物体互动的示意图。Please refer to FIG. 8 and FIG. 9 . FIG. 8 and FIG. 9 are schematic diagrams of the interaction between the second image information and an object.

三维的第二图像信息G2-1-G2-3是一组打地鼠的图像，用户可以利用道具Tool，对多个三维的第二图像信息G2-1-G2-3进行打击。此时，电子装置1的控制器11可以根据道具Tool的多个三维坐标值TC1-TC3以及三维的第二图像信息G2-1的多个第一三维坐标值G2-1C1-G2-1C3进行计算，以决定第二图像信息G2-1的动作以及第二图像信息G2-1的多个第二三维坐标值G2-1C1’-G2-1C3’。The three-dimensional second image information G2-1-G2-3 is a group of images of whack-a-mole, and the user can use the prop Tool to strike multiple three-dimensional second image information G2-1-G2-3. At this time, thecontroller 11 of the electronic device 1 may perform the calculation according to the multiple three-dimensional coordinate values TC1-TC3 of the tool Tool and the multiple first three-dimensional coordinate values G2-1C1-G2-1C3 of the three-dimensional second image information G2-1 , to determine the action of the second image information G2-1 and a plurality of second three-dimensional coordinate values G2-1C1'-G2-1C3' of the second image information G2-1.

请参阅图10以及图11，图10是第二图像信息根据第一实体以及第二实体显示的示意图。图11是第二图像信息根据第一实体以及第二实体显示的示意图。Please refer to FIG. 10 and FIG. 11 , FIG. 10 is a schematic diagram of displaying the second image information according to the first entity and the second entity. FIG. 11 is a schematic diagram of displaying the second image information according to the first entity and the second entity.

在图10以及图11中，当第一实体SB1以及第二实体SB2设置在第二图像显示设备3上，第二图像信息G2才会显示在第二图像显示设备3的上方。也就是，第二图像信息G2是与第一实体SB1以及第二实体SB2有关联性。传感器7可以检测第一实体SB1以及第二实体SB2的设置位置，才通知电子装置1或是第二图像显示设备3，以提供第二图像信息G2。电子装置1或是第二图像显示设备3可以通过电子卷标(RFID)、光感应、电容感应、电压感应、雷达感应等方式对第一实体SB1以及第二实体SB2的电子卷标RD1-RD3的检测。传感器7也可以是电子卷标传感器、光传感器、电容传感器、电压传感器或是雷达传感器。In FIGS. 10 and 11 , when the first entity SB1 and the second entity SB2 are set on the secondimage display device 3 , the second image information G2 is displayed above the secondimage display device 3 . That is, the second image information G2 is related to the first entity SB1 and the second entity SB2. The sensor 7 can detect the setting positions of the first entity SB1 and the second entity SB2, and then notify the electronic device 1 or the secondimage display device 3 to provide the second image information G2. The electronic device 1 or the secondimage display device 3 can detect the electronic tags RD1-RD3 of the first entity SB1 and the second entity SB2 by means of electronic tags (RFID), light sensing, capacitive sensing, voltage sensing, radar sensing, etc. detection. The sensor 7 may also be an electronic label sensor, a light sensor, a capacitive sensor, a voltage sensor or a radar sensor.

再者，第一实体SB1以及第二实体SB2的数量以及形式可以根据实际需求进行调整，在本发明中不做限制。此外，可以根据第一实体SB1以及第二实体SB2的摆放位置不同，而显示不同的第二图像信息G2。而且，电子装置1或是第二图像显示设备3可以控制第二图像信息G2可以在第一活动区域AA1或是其他活动区域进行活动。也就是，第二图像信息G2可以通过一故事方式与第一实体SB1以及第二实体SB2进行互动。Furthermore, the number and form of the first entity SB1 and the second entity SB2 can be adjusted according to actual requirements, which are not limited in the present invention. In addition, different second image information G2 may be displayed according to different placement positions of the first entity SB1 and the second entity SB2. Moreover, the electronic device 1 or the secondimage display device 3 can control the second image information G2 to be active in the first active area AA1 or other active areas. That is, the second image information G2 can interact with the first entity SB1 and the second entity SB2 through a story.

[第二实施例][Second Embodiment]

请参阅图12，图12是本发明第二实施例的互动系统的示意图。互动系统SYS2可以只包括电子装置1以及三维图像显示设备3’。在本实施例中，电子装置1与三维图像显示设备3’的结构与功能与先前实施例中的电子装置1以及第二图像显示设备3相同，在此不做限制。Please refer to FIG. 12 , which is a schematic diagram of an interactive system according to a second embodiment of the present invention. The interactive system SYS2 may only include the electronic device 1 and the three-dimensional image display device 3'. In this embodiment, the structures and functions of the electronic device 1 and the three-dimensional image display device 3' are the same as those of the electronic device 1 and the secondimage display device 3 in the previous embodiments, which are not limited herein.

电子装置1可以提供一图像信息给三维图像显示设备3’，进行三维图像信息的显示，并利用一物体与所显示的浮空三维图像信息进行互动。类似地，互动系统SYS2还包括一传感器7，可以设置在电子装置1或是三维图像显示设备3’。The electronic device 1 can provide an image information to the three-dimensional image display device 3', display the three-dimensional image information, and use an object to interact with the displayed floating three-dimensional image information. Similarly, the interactive system SYS2 also includes a sensor 7, which may be provided in the electronic device 1 or the three-dimensional image display device 3'.

类似地，互动系统SYS3还可以包括一麦克风MP、一扬声器SP。电子装置1的连接模块13连接麦克风MP、扬声器SP、三维图像显示设备3’以及传感器7。Similarly, the interactive system SYS3 may also include a microphone MP and a speaker SP. Theconnection module 13 of the electronic device 1 is connected to the microphone MP, the speaker SP, the three-dimensional image display device 3', and the sensor 7.

类似地，在本实施例中，麦克风MP、扬声器SP、三维图像显示设备3’以及传感器7可以设置在同一装置中。Similarly, in the present embodiment, the microphone MP, the speaker SP, the three-dimensional image display device 3', and the sensor 7 may be provided in the same apparatus.

麦克风MP是用于接收一音频信息。当麦克风MP接收到一控制音频信息时，麦克风MP会通过连接装置CON以及连接装置13传送控制音频信号到控制器11以进行分析。控制器11会进一步分析控制音频信息中的控制要求信号，例如旋转、坐下、跳跃。接着，控制器11会根据控制要求信号进一步控制显示在第二图像显示设备3的三维的第二图像信息G2的动作。如此一来，使用者可以通过声音与三维的第二图像信息G2进行互动。此外，控制器11则可以传送对应三维的第二图像信息G2的互动音频信息到扬声器SP以进行播放，提升使用者更全面的互动体验。The microphone MP is used to receive an audio message. When the microphone MP receives a control audio signal, the microphone MP transmits the control audio signal to thecontroller 11 through the connection device CON and theconnection device 13 for analysis. Thecontroller 11 will further analyze the control request signal in the control audio information, such as rotating, sitting, jumping. Next, thecontroller 11 further controls the action of the three-dimensional second image information G2 displayed on the secondimage display device 3 according to the control request signal. In this way, the user can interact with the three-dimensional second image information G2 through sound. In addition, thecontroller 11 can transmit the interactive audio information corresponding to the three-dimensional second image information G2 to the speaker SP for playback, thereby enhancing the user's more comprehensive interactive experience.

请参阅图13、图14以及图15，图13是本发明第二实施例的互动系统的另一示意图。图14是本发明第二实施例的互动系统的另一示意图。图15是本发明第二实施例的互动系统的另一示意图。Please refer to FIG. 13 , FIG. 14 and FIG. 15 . FIG. 13 is another schematic diagram of the interactive system according to the second embodiment of the present invention. FIG. 14 is another schematic diagram of the interactive system according to the second embodiment of the present invention. FIG. 15 is another schematic diagram of the interactive system according to the second embodiment of the present invention.

图13的第一电子装置ED1是一笔记本电脑。图14的第二电子装置ED2则是一智能手机。图15的第三电子装置ED3则是一平板计算机。也就是，图13至图15中不同的第一电子装置ED1、第二电子装置ED2以及第三电子装置ED3可以连接本发明的三维图像显示设备3’，以显示三维图像信息。The first electronic device ED1 of FIG. 13 is a notebook computer. The second electronic device ED2 in FIG. 14 is a smart phone. The third electronic device ED3 in FIG. 15 is a tablet computer. That is, the different first electronic device ED1, second electronic device ED2 and third electronic device ED3 in Figs. 13 to 15 can be connected to the three-dimensional image display device 3' of the present invention to display three-dimensional image information.

在其他实施例中，电子装置ED1-ED3也可以与三维图像显示设备3’设置在同一壳体中，或是共同设置为一电子装置，在本实施例中不做限制。In other embodiments, the electronic devices ED1-ED3 and the three-dimensional image display device 3' may also be arranged in the same casing, or be jointly arranged as an electronic device, which is not limited in this embodiment.

[第三实施例][Third Embodiment]

请参阅图16以及图17，图16是本发明第三实施例的互动系统的示意图。图17是本发明第三实施例的互动系统的另一示意图。Please refer to FIG. 16 and FIG. 17 . FIG. 16 is a schematic diagram of an interactive system according to a third embodiment of the present invention. FIG. 17 is another schematic diagram of the interactive system according to the third embodiment of the present invention.

请参阅图16，三维图像显示设备3’还可以包括一电子束传感器37’，当使用者手部与浮空的三维图像信息进行互动的时候，可以发出一道电子束到用户手部，以与使用者手部互动。Referring to FIG. 16 , the three-dimensionalimage display device 3 ′ may further include anelectron beam sensor 37 ′, when the user's hand interacts with the floating three-dimensional image information, an electron beam can be sent to the user's hand to interact with the user's hand. User hand interaction.

请参阅图17，使用者可以穿戴上一电子互动手套，包括多个触感组件(图未示)，电子互动手套ECL与三维图像显示设备3’通信连接，可以接收三维图像显示设备3’、电子装置ED3或是服务器(图未示)的控制信号。Referring to FIG. 17, the user can wear an electronic interactive glove, which includes a plurality of tactile components (not shown). The electronic interactive glove ECL is connected to the three-dimensional image display device 3' in communication and can receive the three-dimensional image display device 3', electronic The device ED3 is also a control signal of a server (not shown).

也就是，当用户戴上电子互动手套ECL与三维图像显示设备3’显示的浮空的三维图像信息进行互动的时候，三维图像显示设备3’、电子装置ED3或是服务器(图未示)可以根据使用者与浮空的三维图像信息互动的状态，提供多个控制信号给电子互动手套ECL的多个触觉反馈组件(图未示)，以提供多种不同的触觉感受给使用者。在本实施例中，触觉反馈组件(图未示)是一压电组件。That is, when the user wears the electronic interactive gloves ECL to interact with the floating 3D image information displayed by the 3D image display device 3', the 3D image display device 3', the electronic device ED3 or the server (not shown) can According to the state of the user interacting with the floating 3D image information, multiple control signals are provided to multiple tactile feedback components (not shown) of the electronic interactive glove ECL, so as to provide multiple different tactile sensations to the user. In this embodiment, the haptic feedback component (not shown) is a piezoelectric component.

[实施例的有益效果][Advantageous effects of the embodiment]

本发明的其中一有益效果在于，本发明所提供的互动系统可以让用户直观地与三维图像信息进行互动而产生相对应的动作与变化，无须穿戴各类型扩增实境的电子装置。One of the beneficial effects of the present invention is that the interactive system provided by the present invention allows the user to intuitively interact with the three-dimensional image information to generate corresponding actions and changes, without wearing various types of augmented reality electronic devices.

以上所公开的内容仅为本发明的优选可行实施例，并非因此局限本发明的权利要求，所以凡是运用本发明说明书及附图内容所做的等效技术变化，均包含于本发明的权利要求内。The contents disclosed above are only preferred feasible embodiments of the present invention, and are not intended to limit the claims of the present invention. Therefore, any equivalent technical changes made by using the contents of the description and drawings of the present invention are included in the claims of the present invention. Inside.

Claims (13)

1. An interactive system, comprising:

an electronic device, including a controller, a storage module, a connection module;

the first image display equipment is electrically connected with the electronic device, and the first image display equipment is a two-dimensional image display equipment and is used for displaying two-dimensional image information; and

the second image display device is connected with the electronic device and is a three-dimensional image display device;

the electronic device is provided with a program, the program at least provides first image information and second image information, the controller transmits the first image information to the first image display device for display, the controller transmits the second image information to the second image display device for display, and the second image information displays three-dimensional image information of the second image information in a space on one side of the second image display device through the second image display device;

and the three-dimensional second image information at least interacts with an object.

2. The interactive system of claim 1, further comprising:

the sensor is arranged on the electronic device, the first image display device or the second image display device and used for detecting at least one object three-dimensional coordinate value of the object, the sensor transmits the at least one object three-dimensional coordinate value to the controller, and the controller determines a plurality of second three-dimensional coordinate values of the three-dimensional second image information according to the at least one object three-dimensional coordinate value and a plurality of first three-dimensional coordinate values of the three-dimensional second image information.

3. The interactive system of claim 2, wherein the first image display device is disposed on a side of the electronic apparatus and the second image display device is disposed on the electronic apparatus.

4. The interactive system of claim 3, wherein the second image display device comprises:

a flat display module;

a lens array layer; and

a microstructure layer;

the planar display module is provided with a display surface, the planar display module provides at least one image information, the lens array layer and the microstructure layer are displayed, the lens array layer is arranged on the display surface of the planar display module and receives the light of the image information to be adjusted, the lens array layer comprises a plurality of lenses and is used for regulating and controlling a light field, the microstructure layer is arranged on the lens array layer and comprises a plurality of microstructures, the microstructure layer is used for modulating the angle direction of the light, and the microstructure layer receives the light penetrating through the lens array layer to be adjusted so that the second image display device displays three-dimensional image information floating in the space on one side of the second image display device.

5. The interactive system of claim 4, wherein the lenses of the lens array layer conform to a lens maker formula: (n-1) (1/R1+1/R2), where R1 and R2 are the radii of curvature on both sides of the lens, respectively, f is the lens focal length, and n is the lens refractive index.

6. The interactive system of claim 5, wherein the microstructured layer is a dynamic optical element layer, the microstructured layer having a microstructured functional mode and a non-microstructured functional mode, the microstructured layer being operable to modulate the angular direction of light when switched to the microstructured functional mode.

7. The interactive system of claim 6, wherein the micro-structured layer is a liquid crystal lens array layer comprising a plurality of micro-structured liquid crystal lenses, and the lens array layer is a liquid crystal lens array layer comprising a plurality of optically tuned liquid crystal lenses.

8. The interactive system of claim 7, wherein the lens array layer comprises a first structured lens array layer having lens structures for manipulating the light field and a second structured lens array layer having no lens structures.

9. The interactive system as claimed in claim 1, wherein the second image display device further comprises an electron beam sensor, and the electronic device or the second image display device provides an electron beam to the object according to the interaction condition of the three-dimensional second image information and the object.

10. The interactive system of claim 1, wherein the electronic device or the second image display device provides control signals to an electronic interactive glove of the object to actuate haptic feedback elements of the electronic interactive glove.

11. An interactive system, comprising:

an electronic device, including a controller, a storage module and a connection module;

the connecting module of the electronic device is connected with the three-dimensional image display equipment; and

the sensor is arranged on the electronic device or the three-dimensional image display equipment and used for detecting a plurality of object three-dimensional coordinate values of an object;

the electronic device is provided with a program, the program is stored in the storage module and at least provides image information, the controller transmits the image information to the three-dimensional image display equipment for display, the controller transmits the image information to the three-dimensional display equipment for display, and the image information displays three-dimensional image information in a space on one side of the three-dimensional image display equipment through the three-dimensional image display equipment;

wherein the three-dimensional image information interacts with at least the object;

wherein the sensor transmits the plurality of object three-dimensional coordinate values to the controller, and the controller determines a plurality of second three-dimensional coordinate values of the three-dimensional image information according to the plurality of object three-dimensional coordinate values and a plurality of first three-dimensional coordinate values of the three-dimensional image information of the image information;

wherein the second three-dimensional coordinate values of the three-dimensional image information determine an action when the three-dimensional image information interacts with the object.

12. The interactive system of claim 11, wherein the three-dimensional image display device further comprises an electron beam sensor, and the electronic device or the three-dimensional image display device provides an electron beam to the object according to the interaction condition between the three-dimensional image information and the object.

13. The interactive system of claim 11, wherein the electronic device or the three-dimensional image display device provides control signals to an electronic interactive device disposed on the object to actuate haptic feedback elements of the electronic interactive device.

Images