Movatterモバイル変換


[0]ホーム

URL:


CN111258420A - Information interaction method, head-mounted device and medium - Google Patents

Information interaction method, head-mounted device and medium
Download PDF

Info

Publication number
CN111258420A
CN111258420ACN202010031835.9ACN202010031835ACN111258420ACN 111258420 ACN111258420 ACN 111258420ACN 202010031835 ACN202010031835 ACN 202010031835ACN 111258420 ACN111258420 ACN 111258420A
Authority
CN
China
Prior art keywords
input
sub
area
user
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010031835.9A
Other languages
Chinese (zh)
Other versions
CN111258420B (en
Inventor
陈喆
杨庆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co LtdfiledCriticalVivo Mobile Communication Co Ltd
Priority to CN202010031835.9ApriorityCriticalpatent/CN111258420B/en
Publication of CN111258420ApublicationCriticalpatent/CN111258420A/en
Application grantedgrantedCritical
Publication of CN111258420BpublicationCriticalpatent/CN111258420B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Classifications

Landscapes

Abstract

Translated fromChinese

本发明实施例公开了一种信息交互方法、头戴式设备及介质,涉及通信技术领域,能够解决现有技术中存在的信息分享过程较为繁琐,操作不便的问题。该方法包括:接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入;响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数,能够实现快速地分享信息,操作简便。

Figure 202010031835

The embodiments of the present invention disclose an information interaction method, a head-mounted device and a medium, which relate to the technical field of communication and can solve the problems of complicated information sharing process and inconvenient operation in the prior art. The method includes: receiving a first input from a user on a first sub-area of a virtual object displayed on a virtual screen; in response to the first input, sending first information to a first contact associated with the first sub-area ; wherein, the virtual object includes a first display area, the first display area includes N sub-areas, the N sub-areas include the first sub-area, different sub-areas are associated with different contacts, N A positive integer, which can quickly share information and is easy to operate.

Figure 202010031835

Description

Translated fromChinese
信息交互方法、头戴式设备及介质Information interaction method, head-mounted device and medium

技术领域technical field

本发明实施例涉及通信技术领域,尤其涉及一种信息交互方法、头戴式设备及介质。Embodiments of the present invention relate to the field of communications technologies, and in particular, to an information interaction method, a head-mounted device, and a medium.

背景技术Background technique

在现有的即时通讯软件的交互逻辑中,如果需要对文本、图片、音视等频信息在用户之间进行传输和分享,需要在屏幕上通过手指进行大量的点击、划动等操作才能完成,过程繁琐,操作不便。In the interaction logic of the existing instant messaging software, if it is necessary to transmit and share video information such as text, pictures, audio and video among users, it is necessary to perform a large number of clicks, swipes and other operations on the screen with fingers. , the process is cumbersome and inconvenient to operate.

发明内容SUMMARY OF THE INVENTION

本发明实施例提供一种信息交互方法,能够解决现有技术中存在的信息分享过程较为繁琐,操作不便的问题。The embodiments of the present invention provide an information interaction method, which can solve the problems of complicated information sharing process and inconvenient operation in the prior art.

为了解决上述技术问题,本发明是这样实现的:In order to solve the above-mentioned technical problems, the present invention is achieved in this way:

第一方面,本发明实施例提供了一种信息交互方法,包括:In a first aspect, an embodiment of the present invention provides an information interaction method, including:

接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入;receiving a first input from the user to the first sub-region of the virtual object displayed on the virtual screen;

响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;in response to the first input, sending first information to a first contact associated with the first sub-area;

其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数。The virtual object includes a first display area, the first display area includes N sub-areas, the N sub-areas include the first sub-area, different sub-areas are associated with different contacts, and N is Integer.

第二方面,本发明实施例提供了一种头戴式设备,包括:In a second aspect, an embodiment of the present invention provides a head-mounted device, including:

第一接收模块,用于接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入;a first receiving module, configured to receive a user's first input to the first sub-region of the virtual object displayed on the virtual screen;

第一发送模块,用于响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;a first sending module, configured to send first information to a first contact associated with the first sub-area in response to the first input;

其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数。The virtual object includes a first display area, the first display area includes N sub-areas, the N sub-areas include the first sub-area, different sub-areas are associated with different contacts, and N is Integer.

第三方面,本发明实施例提供了一种头戴式设备,包括处理器、存储器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述计算机程序被所述处理器执行时实现如第一方面所述的信息交互方法的步骤。In a third aspect, an embodiment of the present invention provides a head-mounted device, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program is processed by the processor The steps of implementing the information interaction method described in the first aspect when the device is executed.

第四方面,本发明实施例提供了一种计算机可读存储介质,所述计算机可读存储介质上存储计算机程序,所述计算机程序被处理器执行时实现如第一方面所述的信息交互方法的步骤。In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the information interaction method according to the first aspect is implemented A step of.

在本发明实施例中,头戴式设备通过接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入;响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数,能够实现快速地分享信息,操作简便。In this embodiment of the present invention, the head-mounted device receives a first input from a user to a first sub-region of a virtual object displayed on a virtual screen; and in response to the first input, sends first information to the first A first contact associated with a sub-area; wherein the virtual object includes a first display area, the first display area includes N sub-areas, the N sub-areas include the first sub-area, and the different sub-areas Areas are associated with different contacts, N is a positive integer, which can quickly share information and is easy to operate.

附图说明Description of drawings

图1为本发明实施例提供的信息交互方法的流程图;1 is a flowchart of an information interaction method provided by an embodiment of the present invention;

图2为本发明实施例提供的信息交互方法的虚拟对象的示意图;2 is a schematic diagram of a virtual object of an information interaction method provided by an embodiment of the present invention;

图3为本发明实施例提供的信息交互方法的向联系人发送信息的示意图;3 is a schematic diagram of sending information to a contact according to an information interaction method provided by an embodiment of the present invention;

图4为本发明实施例提供的信息交互方法的显示信息内容的示意图;4 is a schematic diagram of displaying information content of an information interaction method provided by an embodiment of the present invention;

图5(a)为本发明实施例提供的信息交互方法的设置虚拟对象的显示位置的示意图;5(a) is a schematic diagram of setting a display position of a virtual object according to an information interaction method provided by an embodiment of the present invention;

图5(b)为本发明实施例提供的信息交互方法的显示在目标区域的虚拟对象的示意图;5(b) is a schematic diagram of a virtual object displayed in a target area according to an information interaction method provided by an embodiment of the present invention;

图6为本发明实施例提供的头戴式设备的结构示意图;6 is a schematic structural diagram of a head-mounted device provided by an embodiment of the present invention;

图7为本发明实施例提供的头戴式设备的硬件示意图。FIG. 7 is a schematic diagram of hardware of a head-mounted device according to an embodiment of the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

本发明的说明书和权利要求书中的术语“第一”、“第二”、“第三”和“第四”等是用于区别不同的对象,而不是用于描述对象的特定顺序。例如,第一输入、第二输入、第三输入和第四输入等是用于区别不同的输入,而不是用于描述输入的特定顺序。The terms "first", "second", "third" and "fourth" in the description and claims of the present invention are used to distinguish different objects, rather than to describe a specific order of the objects. For example, the first input, the second input, the third input, and the fourth input, etc. are used to distinguish different inputs, rather than to describe a specific order of the inputs.

在本发明实施例中,“示例性的”或者“例如”等词用于表示作例子、例证或说明。本发明实施例中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言,使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。In the embodiments of the present invention, words such as "exemplary" or "for example" are used to mean serving as an example, illustration or illustration. Any embodiments or designs described as "exemplary" or "such as" in the embodiments of the present invention should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present the related concepts in a specific manner.

在本发明实施例的描述中,除非另有说明,“多个”的含义是指两个或者两个以上,例如,多个处理单元是指两个或者两个以上的处理单元;多个元件是指两个或者两个以上的元件等。In the description of the embodiments of the present invention, unless otherwise stated, the meaning of "plurality" refers to two or more, for example, a plurality of processing units refers to two or more processing units; a plurality of elements Refers to two or more elements, etc.

本发明实施例提供一种信息交互方法,通过接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入;响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数,因此通过该方案,能够实现快速地分享信息,操作简便。能够解决现有技术中存在的信息分享过程较为繁琐,操作不便的问题。An embodiment of the present invention provides an information interaction method, by receiving a first input from a user to a first sub-area of a virtual object displayed on a virtual screen; in response to the first input, sending first information to the first A first contact associated with a sub-area; wherein the virtual object includes a first display area, the first display area includes N sub-areas, the N sub-areas include the first sub-area, and the different sub-areas Areas are associated with different contacts, and N is a positive integer. Therefore, through this solution, information can be shared quickly and the operation is simple. The problem of complicated information sharing process and inconvenient operation in the prior art can be solved.

虚拟现实(Virtual Reality,VR)技术,是一种创建和体验虚拟世界的计算机仿真系统技术。它利用计算机生成一种模拟环境,利用多源信息融合的交互式的三维动态视景和实体行为的系统仿真使用户沉浸到该环境中。Virtual reality (Virtual Reality, VR) technology is a computer simulation system technology for creating and experiencing virtual worlds. It uses a computer to generate a simulated environment, and uses the interactive three-dimensional dynamic visual and entity behavior system simulation of multi-source information fusion to immerse the user in the environment.

增强现实(Augmented Reality,AR)技术,是一种将真实世界信息和虚拟世界信息综合在一起的技术,通过各种传感设备将虚拟信息内容在真实世界中叠加,能够在同一个画面以及空间中同时体现出真实世界内容和虚拟的信息内容,实现用户和虚拟环境的自然交互。Augmented Reality (AR) technology is a technology that integrates real world information and virtual world information, and superimposes virtual information content in the real world through various sensing devices, which can be displayed in the same screen and space. Both real-world content and virtual information content are reflected in the system to realize the natural interaction between users and the virtual environment.

AR眼镜通过光波导等光学成像元件将成像系统移动到眼镜镜片外的地方,避免了成像系统对外界视线的阻挡。光波导是一种引导光波在其内部传播的类似光纤的高透介质,其将成像系统输出的光和真实场景的反射光融为一体后传送到人眼,利用计算机视觉算法,对摄像头采集到的手部图像信息进行处理和分析,可以实现手部跟踪和识别。The AR glasses move the imaging system to a place outside the glasses lens through optical imaging elements such as optical waveguides, which avoids the blocking of the outside vision by the imaging system. Optical waveguide is a highly transparent medium similar to optical fiber that guides light waves to propagate inside it. It integrates the light output from the imaging system and the reflected light of the real scene and transmits it to the human eye. Using computer vision algorithms, the camera collects the light. The hand image information is processed and analyzed, and hand tracking and recognition can be realized.

混合现实(Mixed Reality,MR),将虚拟信息与真实世界的视图相结合,或将真实世界对象的虚拟表示添加到虚拟环境中。Mixed Reality (MR) combines virtual information with a real-world view, or adds virtual representations of real-world objects to a virtual environment.

本发明实施例中的头戴式设备可以为VR眼镜、AR眼镜、MR眼镜、或VR头盔、AR头盔、MR头盔等。The head-mounted device in the embodiment of the present invention may be VR glasses, AR glasses, MR glasses, or VR helmets, AR helmets, MR helmets, and the like.

根据相关技术,各种头戴式设备可以感测加速度、角加速度或倾斜的方向,并显示与感测到的信息相对应的屏幕。因此头戴式设备可以基于用户的移动来改变并显示屏幕。According to the related art, various head-mounted devices can sense acceleration, angular acceleration, or the direction of inclination, and display a screen corresponding to the sensed information. The head mounted device can thus change and display the screen based on the user's movement.

需要说明的是,本发明实施例中的第一头戴式设备与第二头戴式设备可以为相同头戴式设备(如,均为AR眼镜),也可以为不同头戴式设备(如,第一头戴式设备为AR眼镜,第二头戴式设备为VR头盔),本发明实施例对此不作限定。It should be noted that the first head-mounted device and the second head-mounted device in this embodiment of the present invention may be the same head-mounted device (for example, both are AR glasses), or may be different head-mounted devices (for example, , the first head-mounted device is AR glasses, and the second head-mounted device is a VR helmet), which is not limited in this embodiment of the present invention.

本发明实施例中的所述虚拟屏幕为头戴式设备的虚拟现实屏幕、增强现实屏幕、或混合现实屏幕。The virtual screen in the embodiment of the present invention is a virtual reality screen, an augmented reality screen, or a mixed reality screen of a head-mounted device.

本发明实施例中的虚拟屏幕,可以为采用AR技术显示内容时,能够用于显示投射设备投射的内容的任意载体。其中,该投射设备可以为采用AR技术的投射设备,例如本发明实施例中的头戴式设备或AR设备。The virtual screen in the embodiment of the present invention may be any carrier that can be used to display the content projected by the projection device when the AR technology is used to display the content. The projection device may be a projection device using AR technology, such as a head-mounted device or an AR device in the embodiment of the present invention.

当采用AR技术在虚拟屏幕显示内容时,投射设备可以将投射设备获取(或内部集成的)的虚拟场景,或虚拟场景和现实场景投射至虚拟屏幕上,使得虚拟屏幕可以显示这些内容,从而向用户展示现实场景与虚拟场景叠加的效果。When AR technology is used to display content on a virtual screen, the projection device can project the virtual scene acquired (or internally integrated) by the projection device, or the virtual scene and the real scene onto the virtual screen, so that the virtual screen can display the content, so as to show the content to the virtual screen. The user shows the effect of superimposing the real scene and the virtual scene.

结合AR技术应用的不同场景,虚拟屏幕通常可以为电子设备(例如手机)的显示屏、AR眼镜的镜片、汽车的挡风玻璃、房间的墙壁等任意可能的载体。Combined with different scenarios of AR technology application, the virtual screen can usually be any possible carrier such as the display screen of an electronic device (such as a mobile phone), the lens of AR glasses, the windshield of a car, the wall of a room, etc.

下面分别以虚拟屏幕为电子设备的显示屏、AR眼镜的镜片,以及汽车的挡风玻璃为例,对采用AR技术在虚拟屏幕上显示内容的过程进行示例性的说明。The following is an exemplary description of the process of using AR technology to display content on a virtual screen, taking the virtual screen as the display screen of an electronic device, the lenses of AR glasses, and the windshield of a car as examples.

一种示例中,当虚拟屏幕为电子设备的显示屏时,投射设备可以为该电子设备。电子设备可以通过其摄像头采集电子设备所处区域中的现实场景,并将该现实场景显示在电子设备的显示屏上,然后电子设备可以将其获取(或内部集成的)的虚拟场景投射到电子设备的显示屏上,从而使得该虚拟场景可以叠加显示在该现实场景中,进而使得用户可以通过电子设备的显示屏看到现实场景和虚拟场景叠加后的效果。In one example, when the virtual screen is a display screen of an electronic device, the projection device may be the electronic device. The electronic device can capture the real scene in the area where the electronic device is located through its camera, and display the real scene on the display screen of the electronic device, and then the electronic device can project the acquired (or internally integrated) virtual scene to the electronic device. On the display screen of the device, the virtual scene can be superimposed and displayed on the real scene, so that the user can see the superimposed effect of the real scene and the virtual scene through the display screen of the electronic device.

另一种示例中,当虚拟屏幕为AR眼镜的镜片时,投射设备可以为该AR眼镜。当用户佩戴眼镜时,用户可以通过AR眼镜的镜片看到其所处区域中的现实场景,并且AR眼镜可以将其获取(或内部集成的)的虚拟场景投射到AR眼镜的镜片上,从而使得用户可以通过AR眼镜的镜片看到现实场景和虚拟场景叠加后的显示效果。In another example, when the virtual screen is a lens of AR glasses, the projection device may be the AR glasses. When the user wears glasses, the user can see the real scene in the area where he is through the lenses of the AR glasses, and the AR glasses can project the virtual scene acquired (or integrated inside) onto the lenses of the AR glasses, so that Users can see the superimposed display effect of the real scene and the virtual scene through the lenses of the AR glasses.

又一种示例中,当虚拟屏幕为汽车的挡风玻璃时,投射设备可以为任意电子设备。当用户位于汽车内时,用户可以通过汽车的挡风玻璃看到其所处区域中的现实场景,并且投射设备可以将其获取(或内部集成的)的虚拟场景投射到汽车的挡风玻璃上,从而使得用户可以通过汽车的挡风玻璃看到现实场景和虚拟场景叠加后的显示效果。In another example, when the virtual screen is a windshield of a car, the projection device can be any electronic device. When the user is in the car, the user can see the real scene in the area where he is located through the windshield of the car, and the projection device can project the virtual scene acquired (or integrated inside) onto the windshield of the car , so that the user can see the superimposed display effect of the real scene and the virtual scene through the windshield of the car.

当然,本发明实施例中,也可以不限定虚拟屏幕的具体形式,例如其可能为非载体的现实空间。这种情况下,当用户位于现实空间中时,用户可以直接看到该现实空间中的现实场景,并且投射设备可以将其获取(或内部集成的)的虚拟场景投射到现实空间中,从而使得用户在现实空间中可以看到现实场景和虚拟场景叠加后的显示效果。Of course, in this embodiment of the present invention, the specific form of the virtual screen may not be limited, for example, it may be a real space other than a carrier. In this case, when the user is located in the real space, the user can directly see the real scene in the real space, and the projection device can project the acquired (or internally integrated) virtual scene into the real space, so that the The user can see the display effect after the real scene and the virtual scene are superimposed in the real space.

本发明实施例中的所述虚拟对象为虚拟信息中的对象,可选地,所述虚拟对象是在头戴式设备的屏幕或镜头上显示的与用户正在观看的周围环境相对应、但不作为显示器外部的物理体现存在的内容。The virtual object in this embodiment of the present invention is an object in virtual information. Optionally, the virtual object is displayed on the screen or lens of the head-mounted device and corresponds to the surrounding environment that the user is watching, but does not Content that exists as a physical manifestation external to the display.

所述虚拟对象可以为AR对象。需要说明的是,AR对象可以理解为:AR设备对现实对象进行分析,以得到现实对象的特征信息(例如现实对象的类型信息、现实对象的外观信息(例如结构、颜色、形状等)和现实对象在空间中的位置信息等),并根据该特征信息在AR设备中构建的AR模型。The virtual object may be an AR object. It should be noted that AR objects can be understood as: AR devices analyze real objects to obtain characteristic information of real objects (such as type information of real objects, appearance information of real objects (such as structure, color, shape, etc.) and real objects. The position information of the object in space, etc.), and the AR model constructed in the AR device according to the feature information.

可选地,本发明实施例中,上述目标虚拟对象具体可以为虚拟图像、虚拟图案、虚拟字符或虚拟图片等。Optionally, in this embodiment of the present invention, the target virtual object may specifically be a virtual image, a virtual pattern, a virtual character, or a virtual picture.

本发明实施例中的头戴式设备可以为具有操作系统的头戴式设备。该操作系统可以为安卓(Android)操作系统,可以为ios操作系统,还可以为其他可能的操作系统,本发明实施例不作具体限定。The head-mounted device in the embodiment of the present invention may be a head-mounted device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present invention.

本发明实施例提供的信息交互方法的执行主体可以为上述的头戴式设备,也可以为该头戴式设备中能够实现该方法的功能模块和/或功能实体,具体的可以根据实际使用需求确定,本发明实施例不作限定。下面以头戴式设备为例,对本发明实施例提供的信息交互方法进行示例性的说明。The execution subject of the information interaction method provided by the embodiment of the present invention may be the above-mentioned head-mounted device, or may be a functional module and/or functional entity in the head-mounted device capable of implementing the method, and the specific implementation may be based on actual usage requirements. It is determined that the embodiments of the present invention are not limited. The information interaction method provided by the embodiment of the present invention is exemplarily described below by taking a head-mounted device as an example.

参考图1所示,本发明实施例提供了一种信息交互方法,应用于头戴式设备,该方法可以包括下述的步骤101-步骤102。Referring to FIG. 1 , an embodiment of the present invention provides an information interaction method, which is applied to a head-mounted device, and the method may include the following steps 101 to 102 .

步骤101、接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入。Step 101: Receive a first input from a user to a first sub-region of a virtual object displayed on a virtual screen.

可选地,所述第一输入包括但不限于滑动输入、点击输入、拖动输入、长按输入、悬浮触控输入、语音输入等中的至少一种,具体根据实际需要设定,本发明实施例不作限定。第一输入也可以是第一操作。在执行所述第一输入时,可以是单点输入,如采用单根手指进行滑动输入、点击输入等;也可以是多点输入,如同时采用两根手指进行滑动输入、点击输入等。Optionally, the first input includes but is not limited to at least one of sliding input, click input, drag input, long press input, floating touch input, voice input, etc. The embodiment is not limited. The first input may also be the first operation. When executing the first input, it may be single-point input, such as sliding input with a single finger, click input, etc.; or multi-point input, such as sliding input and click input with two fingers at the same time.

可选地,所述头戴式设备包括摄像头,所述摄像头用于采集用户的手部图像,通过手势识别技术得到用户的手势动作。Optionally, the head-mounted device includes a camera, and the camera is used to collect an image of the user's hand, and obtain the user's gesture action through a gesture recognition technology.

步骤102、响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;Step 102, in response to the first input, sending first information to a first contact associated with the first sub-area;

其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数。The virtual object includes a first display area, the first display area includes N sub-areas, the N sub-areas include the first sub-area, different sub-areas are associated with different contacts, and N is Integer.

可选地,所述第一信息包括但不限于文件、文本的等,比如视频,图片,音频、文字等。Optionally, the first information includes but is not limited to files, texts, etc., such as videos, pictures, audios, texts, and the like.

可选地,用户将第一信息放入第一子区域,所述第一子区域高亮显示后,用户松手放开第一信息,即可将所述第一信息发送至第一联系人。Optionally, the user puts the first information into the first sub-area, and after the first sub-area is highlighted, the user releases the first information, and the first information can be sent to the first contact.

在本发明实施例中,头戴式设备通过接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入;响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数,能够实现快速地分享信息,操作简便。In this embodiment of the present invention, the head-mounted device receives a first input from a user to a first sub-region of a virtual object displayed on a virtual screen; and in response to the first input, sends first information to the first A first contact associated with a sub-area; wherein the virtual object includes a first display area, the first display area includes N sub-areas, the N sub-areas include the first sub-area, and the different sub-areas Areas are associated with different contacts, N is a positive integer, which can quickly share information and is easy to operate.

可选地,所述方法还包括:所述N个区域通过分隔标识分隔。Optionally, the method further includes: the N regions are separated by a separation identifier.

可选地,所述分隔标识为不透明的线,不透明是指先线的透明度小于100%,如图2中的204;或所述分隔标识为具有一定宽度的空隙等。Optionally, the separation is marked as an opaque line, and opaque means that the transparency of the first line is less than 100%, such as 204 in FIG. 2 ; or the separation is marked as a gap with a certain width, or the like.

可选地,步骤101之前,还包括:Optionally, before step 101, it further includes:

步骤1001、在所述虚拟对象的第二显示区,显示M个标识,每个所述标识指示不同的信息;其中,所述M个标识包括第一标识,所述第一标识指示所述第一信息,M为正整数。Step 1001. In the second display area of the virtual object, display M marks, each of which indicates different information; wherein the M marks include a first mark, and the first mark indicates the first mark. A message, M is a positive integer.

可选地,在第二显示区包括不同的信息,比如文本、音视频文件等,这些信息通过对应的标识显示在第二显示区,所述标识可以是图标、符号等,每个标识指示不同的信息。Optionally, different information is included in the second display area, such as text, audio and video files, etc., and these information are displayed in the second display area through corresponding signs. The signs can be icons, symbols, etc., and each sign indicates a different Information.

可选地,第一显示区用于显示联系人的区域,第二显示区是用于显示不同的信息的区域。Optionally, the first display area is an area for displaying contacts, and the second display area is an area for displaying different information.

可选地,用户可以左右拨动所述标识,来查看由于第二显示区的空间限制而没有显示出来的标识。示例性地,如图2所示,在第二显示区显示有3个标识:“A.txt”、“B.mp3”、“C.mp4”,用户向左滑动2032“C.mp4”,则这三个标识都向左移动,在第二显示区可以显示一个新的标识,比如“D.jpg”。可选地,用户也可以通过调整第二显示区的大小,改变第二显示区中显示的标识的数量。Optionally, the user can toggle the logo left and right to view the logo that is not displayed due to the space limitation of the second display area. Exemplarily, as shown in FIG. 2, there are 3 signs displayed in the second display area: "A.txt", "B.mp3", "C.mp4", the user slides 2032 "C.mp4" to the left, Then these three logos are moved to the left, and a new logo, such as "D.jpg", can be displayed in the second display area. Optionally, the user can also change the number of logos displayed in the second display area by adjusting the size of the second display area.

示例性地,如图2所示,虚拟对象201的第一显示区202包括N个子区域,第一子区域2021关联第一联系人“张三”,第二子区域2022关联第二联系人“李四”,第三子区域2023关联第三联系人“王五”,可以理解地,其他子区域关联不同的联系人,此处不一一举例;虚拟对象201的第二显示区203,显示M个标识,每个标识指示不同的信息,第一标识2031指示第一信息B.mp3文件。Exemplarily, as shown in FIG. 2, thefirst display area 202 of thevirtual object 201 includes N sub-areas, thefirst sub-area 2021 is associated with the first contact "Zhang San", and thesecond sub-area 2022 is associated with the second contact "" Li Si", thethird sub-area 2023 is associated with the third contact "Wang Wu", and it is understood that other sub-areas are associated with different contacts, which are not listed here. Thesecond display area 203 of thevirtual object 201 displays There are M identifiers, each identifier indicates different information, and thefirst identifier 2031 indicates the first information B.mp3 file.

可选地,在将第一信息发送至所述第一子区域关联的第一联系人之后,在所述虚拟对象的第二显示区,仍然显示有第一标识。Optionally, after the first information is sent to the first contact associated with the first sub-area, the first identifier is still displayed in the second display area of the virtual object.

可选地,步骤101中,所述第一输入用于将所述第一标识显示至第一子区域。Optionally, in step 101, the first input is used to display the first identifier to the first sub-area.

可选地,步骤101具体包括步骤1011或步骤1012:Optionally, step 101 specifically includes step 1011 or step 1012:

步骤1011、接收用户对所述第一标识的第一子输入和对所述第一子区域的第二子输入,其中,所述第一子输入用于选中所述第一标识,所述第二子输入用于选中所述第一子区域;所述第一子输入包括第一手势,所述第二子输入包括第二手势。Step 1011: Receive a first sub-input for the first identifier and a second sub-input for the first sub-area from the user, wherein the first sub-input is used to select the first identifier, and the first sub-input is used to select the first identifier. Two sub-inputs are used to select the first sub-region; the first sub-input includes a first gesture, and the second sub-input includes a second gesture.

可选地,所述第一子输入或第二子输入包括但不限于滑动输入、点击输入、拖动输入、长按输入、悬浮触控输入、语音输入等中的至少一种,具体根据实际需要设定,本发明实施例不作限定。第一子输入或第二子输入也可以是第一子操作或第二子操作。在执行所述第一子输入或第二子输入时,可以是单点输入,如采用单根手指进行滑动输入、点击输入等;也可以是多点输入,如同时采用两根手指进行滑动输入、点击输入等。Optionally, the first sub-input or the second sub-input includes but is not limited to at least one of sliding input, click input, drag input, long press input, floating touch input, voice input, etc., depending on the actual situation. It needs to be set, which is not limited in the embodiment of the present invention. The first sub-input or the second sub-input may also be the first sub-operation or the second sub-operation. When the first sub-input or the second sub-input is executed, it can be a single-point input, such as using a single finger for sliding input, tap input, etc.; it can also be a multi-point input, such as using two fingers for sliding input at the same time , tap Enter, etc.

示例性地,所述第一子输入为点击所述第一标识的输入,所述第二子输入为点击所述第一子区域的输入。例如,用户先点击第一标识,再点击第一子区域。Exemplarily, the first sub-input is an input of clicking the first identifier, and the second sub-input is an input of clicking the first sub-area. For example, the user clicks the first logo first, and then clicks the first sub-area.

步骤1012、接收用户将所述第一标识拖动至所述第一子区域的第一输入。Step 1012: Receive a first input from the user to drag the first logo to the first sub-area.

示例性地,用户将手指指向虚拟屏幕上第一标识所在区域,并将所述第一标识拖动至第一子区域。Exemplarily, the user points a finger to the area on the virtual screen where the first mark is located, and drags the first mark to the first sub-area.

可选地,所述用户将手指指向虚拟屏幕上第一标识所在区域,可以包括但不限于用户将手指放置在虚拟屏幕上第一标识所在区域、或者用户的手指指向虚拟屏幕上第一标识所在区域,即用户的手指不在第一标识所在区域,但是用户的手指指向第一标识所在区域,与第一标识所在区域有一定的距离。Optionally, the user points the finger to the area where the first marker is located on the virtual screen, which may include, but is not limited to, the user places the finger on the area where the first marker is located on the virtual screen, or the user's finger points to the location where the first marker is located on the virtual screen. Area, that is, the user's finger is not in the area where the first logo is located, but the user's finger points to the area where the first logo is located, and has a certain distance from the area where the first logo is located.

可选地,所述将所述第一标识拖动至第一子区域,可以包括但不限于用户将所述第一标识拖动至虚拟屏幕上的第一子区域、或者用户将所述第一标识拖动至虚拟屏幕上的第一子区域对应的区域,即第一标识被拖动至第一子区域对应的区域时,第一标识在虚拟对象所在平面内的投影位于第一子区域内。例如将第一标识拖动至第一子区域正前方的区域,正前方指更靠近用户的方向。Optionally, the dragging the first logo to the first sub-area may include, but is not limited to, the user dragging the first logo to the first sub-area on the virtual screen, or the user dragging the first logo to the first sub-area on the virtual screen. A logo is dragged to the area corresponding to the first sub-area on the virtual screen, that is, when the first logo is dragged to the area corresponding to the first sub-area, the projection of the first logo on the plane where the virtual object is located is located in the first sub-area Inside. For example, drag the first logo to the area directly in front of the first sub-area, and the front refers to the direction closer to the user.

可选地,步骤101具体包括:Optionally, step 101 specifically includes:

步骤1013、接收用户对所述第一标识的第三子输入,所述第三子输入用于控制所述第一标识跟随所述用户的手部移动至所述手部所在区域,所述手部所在区域为第一子区域,其中,所述第三子输入包括第三手势。Step 1013: Receive a third sub-input of the first identifier by the user, where the third sub-input is used to control the first identifier to follow the user's hand to move to the area where the hand is located, and the hand The region where the part is located is the first sub-region, wherein the third sub-input includes a third gesture.

可选地,所述第三子输入包括但不限于滑动输入、点击输入、拖动输入、长按输入、悬浮触控输入、语音输入等中的至少一种,具体根据实际需要设定,本发明实施例不作限定。第三子输入也可以是第三子操作。在执行所述第三子输入时,可以是单点输入,如采用单根手指进行滑动输入、点击输入等;也可以是多点输入,如同时采用两根手指进行滑动输入、点击输入等。Optionally, the third sub-input includes but is not limited to at least one of sliding input, click input, drag input, long press input, floating touch input, voice input, etc. The embodiments of the invention are not limited. The third sub-input may also be a third sub-operation. When executing the third sub-input, it can be single-point input, such as sliding input with a single finger, tap input, etc.; it can also be multi-point input, such as using two fingers simultaneously for sliding input, click input, etc.

示例性地,所述第三手势为用户的手部指向所述第一标识所在区域,并做出拿取第一标识的手势,则第一标识跟随用户的手部移动,用户的手部移动至哪里,第一标识移动至哪里,用户的手部移动至第一子区域,第一标识移动至第一子区域。Exemplarily, the third gesture is that the user's hand points to the area where the first sign is located, and makes a gesture of taking the first sign, then the first sign moves with the user's hand, and the user's hand moves. Where to, where the first marker moves, the user's hand moves to the first sub-area, and the first marker moves to the first sub-area.

可选地,所述用户的手部移动至第一子区域,可以包括但不限于用户的手部移动至虚拟屏幕上的第一子区域、或者用户的手部移动至虚拟屏幕上的第一子区域对应的区域,即用户的手部移动至第一子区域对应的区域时,用户的手部在虚拟对象所在平面内的投影位于第一子区域内。例如用户的手部移动至第一子区域正前方的区域,正前方指更靠近用户的方向。Optionally, the movement of the user's hand to the first sub-area may include, but is not limited to, the movement of the user's hand to the first sub-area on the virtual screen, or the movement of the user's hand to the first sub-area on the virtual screen. The area corresponding to the sub-area, that is, when the user's hand moves to the area corresponding to the first sub-area, the projection of the user's hand on the plane where the virtual object is located is located in the first sub-area. For example, the user's hand moves to the area directly in front of the first sub-area, and the front refers to a direction closer to the user.

可选地,所述第一标识移动至第一子区域,可以包括但不限于第一标识移动至虚拟屏幕上的第一子区域、或者第一标识移动至虚拟屏幕上的第一子区域对应的区域,即第一标识被移动至第一子区域对应的区域时,第一标识在虚拟对象所在平面内的投影位于第一子区域内。例如第一标识移动至第一子区域正前方的区域,正前方指更靠近用户的方向。Optionally, moving the first sign to the first sub-area may include, but is not limited to, moving the first sign to the first sub-area on the virtual screen, or moving the first sign to the corresponding first sub-area on the virtual screen. , that is, when the first marker is moved to the area corresponding to the first sub-area, the projection of the first marker on the plane where the virtual object is located is located in the first sub-area. For example, the first marker moves to an area directly in front of the first sub-area, and the front refers to a direction closer to the user.

步骤102中,将第一信息发送至所述第一子区域关联的第一联系人,具体包括:Instep 102, the first information is sent to the first contact associated with the first sub-area, which specifically includes:

步骤1021、在满足第一预设条件的情况下,将所述第一信息发送至所述第一子区域关联的第一联系人;Step 1021: Send the first information to the first contact associated with the first sub-area when the first preset condition is met;

其中,所述满足第一预设条件,包括:所述用户的手部在所述第一子区域停留第一预设时长,或接收到用户的第二输入,其中,所述第二输入包括第四手势。Wherein, satisfying the first preset condition includes: the user's hand stays in the first sub-area for a first preset duration, or receiving a second input from the user, wherein the second input includes Fourth gesture.

可选地,所述第二输入包括但不限于滑动输入、点击输入、拖动输入、长按输入、悬浮触控输入、语音输入等中的至少一种,具体根据实际需要设定,本发明实施例不作限定。第二输入也可以是第二操作。在执行所述第二输入时,可以是单点输入,如采用单根手指进行滑动输入、点击输入等;也可以是多点输入,如同时采用两根手指进行滑动输入、点击输入等。Optionally, the second input includes but is not limited to at least one of sliding input, click input, drag input, long press input, floating touch input, voice input, etc. The embodiment is not limited. The second input may also be a second operation. When executing the second input, it may be single-point input, such as using a single finger for sliding input, click input, etc.; or multi-point input, such as using two fingers simultaneously for sliding input, click input, etc.

示例性地,所述第四手势为用户将第一标识扔向所述第一子区域、或者用户将第一标识放置在第一子区域、或者用户伸出手指等。Exemplarily, the fourth gesture is that the user throws the first marker to the first sub-area, or the user places the first marker in the first sub-area, or the user extends a finger, or the like.

可选地,所述用户将第一标识放置在第一子区域,可以包括但不限于用户将所述第一标识放置在虚拟屏幕上的第一子区域、或者用户将所述第一标识放置在虚拟屏幕上的第一子区域对应的区域,即第一标识被放置在第一子区域对应的区域时,第一标识在虚拟对象所在平面内的投影位于第一子区域内。所述放置是指用户松手放开第一标识。例如将第一标识放置在第一子区域正前方的区域,正前方指更靠近用户的方向。Optionally, the user places the first logo in the first sub-area, which may include, but is not limited to, the user places the first logo on the first sub-area on the virtual screen, or the user places the first logo on the first sub-area. When the area corresponding to the first sub-area on the virtual screen, that is, the first marker is placed in the area corresponding to the first sub-area, the projection of the first marker on the plane where the virtual object is located is located in the first sub-area. The placing refers to the user letting go of the first sign. For example, the first logo is placed in the area directly in front of the first sub-area, and the front refers to the direction closer to the user.

示例性地,用户的手部指向所述第一标识所在区域,并做出拿取第一标识的手势,则第一标识跟随用户的手部移动,用户的手部移动至第一子区域的正前方区域,第一标识移动至第一子区域的正前方区域,用户的手部在第一子区域的正前方区域停留第一预设时长,比如停留3秒,则将所述第一信息发送至所述第一子区域关联的第一联系人。Exemplarily, if the user's hand points to the area where the first sign is located, and makes a gesture of taking the first sign, the first sign moves with the user's hand, and the user's hand moves to the area of the first sub-area. In the front area, the first sign is moved to the area directly in front of the first sub-area, and the user's hand stays in the area directly in front of the first sub-area for a first preset period of time, such as staying for 3 seconds, the first information sent to the first contact associated with the first sub-area.

示例性地,用户的手放置在所述第一标识所在区域,并做出抓取第一标识的手势,则第一标识跟随用户的手部移动,用户的手部移动至第一子区域,第一标识移动至第一子区域,如图3所示,用户将第一标识2031放置在第一子区域2021,所述第一子区域2021高亮显示,用户松手放开第一标识2031,即可将第一信息发送至第一联系人。Exemplarily, the user's hand is placed in the area where the first marker is located, and a gesture of grabbing the first marker is made, then the first marker moves with the user's hand, and the user's hand moves to the first sub-area, The first sign is moved to the first sub-area. As shown in FIG. 3, the user places thefirst sign 2031 in thefirst sub-area 2021, thefirst sub-area 2021 is highlighted, and the user releases thefirst sign 2031. The first information can be sent to the first contact.

在本发明实施例中,用户通过一些简单的手势即可将第一信息发送至第一联系人,通过将第一标识移动至第一子区域并停留预设时间,一步操作即可将第一信息发送至第一联系人,操作简单快捷。In this embodiment of the present invention, the user can send the first information to the first contact through some simple gestures, and by moving the first logo to the first sub-area and staying for a preset time, the first information can be sent to the first contact in one step. The information is sent to the first contact, and the operation is simple and fast.

可选地,所述方法还包括:Optionally, the method further includes:

步骤103、接收用户对所述第一标识的第三输入。Step 103: Receive a third input of the first identifier by the user.

可选地,所述第三输入包括但不限于滑动输入、点击输入、拖动输入、长按输入、悬浮触控输入、语音输入等中的至少一种,具体根据实际需要设定,本发明实施例不作限定。第三输入也可以是第三操作。在执行所述第三输入时,可以是单点输入,如采用单根手指进行滑动输入、点击输入等;也可以是多点输入,如同时采用两根手指进行滑动输入、点击输入等。Optionally, the third input includes but is not limited to at least one of sliding input, click input, drag input, long press input, floating touch input, voice input, etc. The embodiment is not limited. The third input may also be a third operation. When executing the third input, it may be single-point input, such as using a single finger for sliding input, click input, etc.; it may also be multi-point input, such as simultaneously using two fingers for sliding input, click input, etc.

可选地,所述第三输入可以是手势。Optionally, the third input may be a gesture.

步骤104、响应于所述第三输入,显示所述第一信息的信息内容。Step 104: In response to the third input, display the information content of the first information.

示例性地,用户用手指将第一标识从第一子区域拿出,然后松开手指,头戴式设备识别该手势动作后,会将该第一标识指示的第一信息的信息内容在头戴式设备的虚拟屏幕上显示,如图4所示,播放第一信息B.mp3文件的文件内容。Exemplarily, the user takes out the first identifier from the first sub-area with a finger, and then releases the finger. After the head-mounted device recognizes the gesture, the information content of the first information indicated by the first identifier is displayed on the head. Displayed on the virtual screen of the wearable device, as shown in FIG. 4 , the file content of the first information B.mp3 file is played.

可选地,步骤103中,所述第三输入包括:Optionally, in step 103, the third input includes:

将所述第一标识从所述第二显示区移动至第一空间区域的第四子输入,以及触发显示所述第一信息的信息内容的第五子输入;moving the first identifier from the second display area to the fourth sub-input of the first space area, and triggering the fifth sub-input of displaying the information content of the first information;

其中,所述第四子输入包括第五手势,所述第五子输入包括第六手势。Wherein, the fourth sub-input includes a fifth gesture, and the fifth sub-input includes a sixth gesture.

可选地,所述第四子输入或第五子输入包括但不限于滑动输入、点击输入、拖动输入、长按输入、悬浮触控输入、语音输入等中的至少一种,具体根据实际需要设定,本发明实施例不作限定。第四子输入或第五子输入也可以是第四子操作或第五子操作。在执行所述第四子输入或第五子输入时,可以是单点输入,如采用单根手指进行滑动输入、点击输入等;也可以是多点输入,如同时采用两根手指进行滑动输入、点击输入等。Optionally, the fourth sub-input or the fifth sub-input includes but is not limited to at least one of sliding input, click input, drag input, long press input, floating touch input, voice input, etc., depending on the actual situation. It needs to be set, which is not limited in the embodiment of the present invention. The fourth or fifth sub-input may also be the fourth or fifth sub-operation. When executing the fourth sub-input or the fifth sub-input, it can be a single-point input, such as sliding input with a single finger, tap input, etc.; it can also be a multi-point input, such as using two fingers for sliding input at the same time , tap Enter, etc.

示例性地,所述第五手势为用户用手指将第一标识从第一子区域拿出并移动至第一空间区域的手势,所述第六手势为用户将拿着第一标识的手指松开的手势。Exemplarily, the fifth gesture is a gesture in which the user uses a finger to take out the first sign from the first sub-area and move it to the first space area, and the sixth gesture is that the user loosens the finger holding the first sign. open gesture.

可选地,所述第一空间区域所在平面可以是与虚拟对象所在平面相同的平面,也可以是与虚拟对象所在平面不相同的平面,比如第一空间区域所在平面与虚拟对象所在平面平行,且第一空间区域所在平面位于虚拟对象所在平面的正前方,所述正前方指更靠近用户的方向。Optionally, the plane where the first space region is located may be the same plane as the plane where the virtual object is located, or a plane that is different from the plane where the virtual object is located, for example, the plane where the first space region is located is parallel to the plane where the virtual object is located, And the plane where the first space region is located is located directly in front of the plane where the virtual object is located, and the direct front refers to a direction closer to the user.

在本发明实施例中,用户通过一些简单的手势即可打开第一信息的信息内容,操作简单快捷。In the embodiment of the present invention, the user can open the information content of the first information through some simple gestures, and the operation is simple and fast.

可选地,步骤104之后,还包括:Optionally, after step 104, it also includes:

步骤105、接收用户的第四输入,所述第四输入包括第七手势。Step 105: Receive a fourth input from the user, where the fourth input includes a seventh gesture.

可选地,所述第四输入包括但不限于滑动输入、点击输入、拖动输入、长按输入、悬浮触控输入、语音输入等中的至少一种,具体根据实际需要设定,本发明实施例不作限定。第四输入也可以是第四操作。在执行所述第四输入时,可以是单点输入,如采用单根手指进行滑动输入、点击输入等;也可以是多点输入,如同时采用两根手指进行滑动输入、点击输入等。Optionally, the fourth input includes but is not limited to at least one of sliding input, click input, drag input, long press input, floating touch input, voice input, etc. The embodiment is not limited. The fourth input may also be a fourth operation. The fourth input may be single-point input, such as sliding input using a single finger, click input, etc.; or multi-point input, such as using two fingers simultaneously for sliding input, click input, and the like.

步骤106、响应于所述第四输入,取消显示所述第一信息的信息内容。Step 106: In response to the fourth input, cancel the display of the information content of the first information.

示例性地,所述第七手势为用户将手由张开变为握拳状态的手势。Exemplarily, the seventh gesture is a gesture in which the user changes his hand from an open state to a clenched fist state.

可选地,步骤105之后,还包括:Optionally, after step 105, it also includes:

步骤107a、头戴式设备检测用户手部的位置。Step 107a, the head mounted device detects the position of the user's hand.

步骤107b、控制所述第一标识跟随所述用户的手部移动。Step 107b: Control the first sign to move with the user's hand.

示例性地,步骤105中,接收用户的第四输入,用户将手由张开变为握拳状态,响应于所述第四输入,取消显示所述第一信息的信息内容,且第一标识附着在用户的手上,继续跟随用户的手部移动,用户的手部移动至哪里,第一标识移动至哪里。Exemplarily, in step 105, a fourth input from the user is received, the user changes the hand from an open to a fisted state, and in response to the fourth input, the information content of the first information is canceled, and the first logo is attached. On the user's hand, continue to follow the movement of the user's hand, where the user's hand moves, where the first identifier moves.

步骤108、在所述用户的手部移动至所述N个子区域的第二子区域且满足第二预设条件的情况下,将所述第一信息发送至第二联系人;Step 108: Send the first information to a second contact when the user's hand moves to a second sub-area of the N sub-areas and a second preset condition is satisfied;

其中,所述第二子区域与第二联系人关联;所述满足第二预设条件包括:所述用户的手部在所述第二子区域停留第二预设时长,或接收到用户的第五输入,所述第五输入包括第八手势。Wherein, the second sub-area is associated with a second contact; the satisfying the second preset condition includes: the user's hand stays in the second sub-area for a second preset duration, or receiving a user's hand A fifth input, the fifth input including an eighth gesture.

可选地,所述第五输入包括但不限于滑动输入、点击输入、拖动输入、长按输入、悬浮触控输入、语音输入等中的至少一种,具体根据实际需要设定,本发明实施例不作限定。第五输入也可以是第五操作。在执行所述第五输入时,可以是单点输入,如采用单根手指进行滑动输入、点击输入等;也可以是多点输入,如同时采用两根手指进行滑动输入、点击输入等。Optionally, the fifth input includes but is not limited to at least one of sliding input, click input, drag input, long press input, floating touch input, voice input, etc. The embodiment is not limited. The fifth input may also be a fifth operation. When executing the fifth input, it may be single-point input, such as using a single finger for sliding input, click input, etc.; or multi-point input, such as using two fingers simultaneously for sliding input, click input, etc.

可选地,所述用户的手部移动至所述N个子区域的第二子区域,可以包括但不限于用户的手部移动至虚拟屏幕上的第二子区域、或者用户的手部移动至虚拟屏幕上的第二子区域对应的区域,例如用户的手部移动至第二子区域正前方的区域,正前方指更靠近用户的方向。Optionally, moving the user's hand to the second sub-area of the N sub-areas may include, but is not limited to, moving the user's hand to the second sub-area on the virtual screen, or moving the user's hand to the second sub-area on the virtual screen. The area corresponding to the second sub-area on the virtual screen, for example, the user's hand moves to the area directly in front of the second sub-area, and the front refers to the direction closer to the user.

示例性地,用户的手部移动至第二子区域的正前方区域,第一标识移动至第二子区域的正前方区域,用户的手部在第二子区域的正前方区域停留第二预设时长,比如停留3秒、或停留2秒,则将所述第一信息发送至所述第二子区域关联的第二联系人。Exemplarily, the user's hand moves to the area directly in front of the second sub-area, the first sign moves to the area directly in front of the second sub-area, and the user's hand stays in the area directly in front of the second sub-area for the second preset. Set the duration, for example, stay for 3 seconds or stay for 2 seconds, then send the first information to the second contact associated with the second sub-area.

示例性地,用户的手部移动至第二子区域,第一标识跟随用户的手部移动至第二子区域,用户伸出手指,则将所述第一信息发送至所述第二子区域关联的第二联系人。Exemplarily, the user's hand moves to the second sub-area, the first identifier moves to the second sub-area following the user's hand, and the user extends a finger, then the first information is sent to the second sub-area Associated second contact.

可选地,所述虚拟屏幕的第二显示区中还包括第一虚拟控件;Optionally, the second display area of the virtual screen further includes a first virtual control;

步骤101之前,还包括:Before step 101, it also includes:

步骤1002、接收用户对所述第一虚拟控件的第六输入;Step 1002, receiving the sixth input of the user to the first virtual control;

步骤1003、响应于所述第六输入,将所述第一虚拟控件从所述第二显示区移动至第二空间区域,并执行目标操作;Step 1003, in response to the sixth input, move the first virtual control from the second display area to a second space area, and perform a target operation;

步骤1004、在接收到用户的第七输入的情况下,输出所述第一信息;Step 1004, in the case of receiving the seventh input from the user, output the first information;

其中,所述目标操作为生成所述第一信息的操作;所述第六输入包括第九手势,所述第七输入包括第十手势。The target operation is an operation of generating the first information; the sixth input includes a ninth gesture, and the seventh input includes a tenth gesture.

可选地,第一虚拟控件指示录音、录视频、拍照等功能。Optionally, the first virtual control indicates functions such as audio recording, video recording, and photographing.

可选地,所述第六输入或第七输入包括但不限于滑动输入、点击输入、拖动输入、长按输入、悬浮触控输入、语音输入等中的至少一种,具体根据实际需要设定,本发明实施例不作限定。第六输入或第七输入也可以是第六操作或第七操作。在执行所述第六输入或第七输入时,可以是单点输入,如采用单根手指进行滑动输入、点击输入等;也可以是多点输入,如同时采用两根手指进行滑动输入、点击输入等。Optionally, the sixth input or seventh input includes but is not limited to at least one of sliding input, click input, drag input, long press input, floating touch input, voice input, etc. Certainly, the embodiments of the present invention are not limited. The sixth or seventh input may also be the sixth or seventh operation. When executing the sixth input or the seventh input, it can be a single-point input, such as using a single finger for sliding input, click input, etc.; it can also be a multi-point input, such as using two fingers simultaneously for sliding input, click input, etc. input etc.

示例性地,所述第六输入为用户手指指向所述第一虚拟控件,之后用户将手指指向第二空间区域的手势,则响应于所述第六输入,第一虚拟控件跟随用户的手指,从所述第二显示区移动至第二空间区域,并执行目标操作。Exemplarily, the sixth input is a gesture in which the user's finger points to the first virtual control, and then the user points the finger to the second space area, and in response to the sixth input, the first virtual control follows the user's finger, Move from the second display area to the second space area, and perform the target operation.

示例性地,所述第六输入为用户抓取第一虚拟控件,并将第一虚拟控件移动至第二空间区域并松开手指放开第一虚拟控件的手势。Exemplarily, the sixth input is a gesture in which the user grabs the first virtual control, moves the first virtual control to the second space area, and releases a finger to release the first virtual control.

可选地,所述第二空间区域所在平面可以是与虚拟对象所在平面相同的平面,也可以是与虚拟对象所在平面不相同的平面,比如第二空间区域所在平面与虚拟对象所在平面平行,且第二空间区域所在平面位于虚拟对象所在平面的正前方,所述正前方指更靠近用户的方向。Optionally, the plane where the second space region is located may be the same plane as the plane where the virtual object is located, or a plane that is different from the plane where the virtual object is located, for example, the plane where the second space region is located is parallel to the plane where the virtual object is located, And the plane where the second space area is located is located directly in front of the plane where the virtual object is located, and the direct front refers to a direction closer to the user.

可选地,所述目标操作包括但不限于,录音、录视频、拍照等。Optionally, the target operation includes, but is not limited to, audio recording, video recording, photographing, and the like.

示例性地,所述目标操作为录音操作,所述第六输入为用户将第一虚拟控件从所述第二显示区拿出,移动至第二空间区域,并松开手指,则开始录制语音消息;所述第七输入为用户在正在录音的界面上伸出手掌,并由张开的手掌握成拳头状,则停止录音并生成音频文件,可选地,所述音频文件附着在手指上,用户可以用手指继续拖动该音频文件进行后续的操作,比如打开该音频文件、或者发送该音频文件至目标联系人。进一步示例性地,用户将该音频文件拖动至第一子区域,待第一子区域高亮后松开手指,即可将该音频文件发送至第一联系人。Exemplarily, the target operation is a recording operation, and the sixth input is that the user takes the first virtual control out of the second display area, moves it to the second space area, and releases the finger to start recording the voice. message; the seventh input is that the user stretches out his palm on the recording interface, and is grasped into a fist shape by the open hand, then stops recording and generates an audio file, optionally, the audio file is attached to the finger , the user can continue to drag the audio file with a finger to perform subsequent operations, such as opening the audio file, or sending the audio file to the target contact. Further exemplary, the user drags the audio file to the first sub-area, releases the finger after the first sub-area is highlighted, and then the audio file can be sent to the first contact.

可选地,在第一联系人接收到该音频文件之后,第一联系人的头戴式设备的虚拟屏幕中对应所述用户的目标子区域高亮或闪烁,以提示第一联系人,所述用户发送了新消息。Optionally, after the first contact receives the audio file, the target sub-area corresponding to the user on the virtual screen of the head mounted device of the first contact is highlighted or flashed to prompt the first contact, so The user mentioned sent a new message.

在本发明实施例中,用户通过一些简单的手势即可输出第一信息,操作简单快捷。In the embodiment of the present invention, the user can output the first information through some simple gestures, and the operation is simple and quick.

可选地,所述虚拟屏幕的第二显示区中还包括第二虚拟控件;Optionally, the second display area of the virtual screen further includes a second virtual control;

可选地,所述第一虚拟控件和所述第二虚拟控件可以是同一个虚拟控件,也可以是不同的虚拟控件。Optionally, the first virtual control and the second virtual control may be the same virtual control, or may be different virtual controls.

可选地,第二虚拟控件指示与联系人建立通话连接的功能。Optionally, the second virtual control indicates a function of establishing a call connection with the contact.

所述方法还包括:The method also includes:

步骤109、接收用户对所述第二虚拟控件的第八输入,所述第八输入用于将所述第二虚拟控件移动至所述N个子区域的第三子区域,所述第八输入包括第十一手势。Step 109: Receive an eighth input from the user to the second virtual control, where the eighth input is used to move the second virtual control to a third subregion of the N subregions, and the eighth input includes: Eleventh gesture.

可选地,所述第八输入包括但不限于滑动输入、点击输入、拖动输入、长按输入、悬浮触控输入、语音输入等中的至少一种,具体根据实际需要设定,本发明实施例不作限定。第八输入也可以是第八操作。在执行所述第八输入时,可以是单点输入,如采用单根手指进行滑动输入、点击输入等;也可以是多点输入,如同时采用两根手指进行滑动输入、点击输入等。Optionally, the eighth input includes but is not limited to at least one of sliding input, click input, drag input, long press input, floating touch input, voice input, etc., and is specifically set according to actual needs. The embodiment is not limited. The eighth input may also be an eighth operation. The eighth input may be single-point input, such as sliding input with a single finger, click input, etc.; or multi-point input, such as sliding input and click input with two fingers at the same time.

步骤110、响应于所述第八输入,向所述第三子区域关联的第三联系人发送通话请求消息。Step 110: In response to the eighth input, send a call request message to a third contact associated with the third sub-area.

示例性地,用户将第二虚拟控件从第二显示区拿出,并将第二虚拟控件移动至第三子区域,则向第三子区域关联的第三联系人发送通话请求消息。Exemplarily, the user takes out the second virtual control from the second display area and moves the second virtual control to the third sub-area, and sends a call request message to the third contact associated with the third sub-area.

在本发明实施例中,用户通过一些简单的手势即可通过一步操作向第一联系人发送通话请求消息,操作简单快捷。In the embodiment of the present invention, the user can send a call request message to the first contact through one-step operation through some simple gestures, and the operation is simple and fast.

可选地,所述方法还包括:Optionally, the method further includes:

步骤111、在接收到第一联系人发送的第二信息的情况下,在所述第一子区域,显示所述第二信息。Step 111: In the case of receiving the second information sent by the first contact, display the second information in the first sub-area.

可选地,在接收到第一联系人发送的第二信息的情况下,在所述第一子区域,显示指示所述第二信息的目标控件,接收用户的目标输入,比如手指指向所述目标控件,显示所述第二信息的信息内容。Optionally, in the case of receiving the second information sent by the first contact, in the first sub-area, a target control indicating the second information is displayed, and a user's target input is received, such as pointing a finger at the A target control, which displays the information content of the second information.

可选地,步骤111具体包括:Optionally, step 111 specifically includes:

步骤1111、更新所述第一子区域至第一显示状态,并显示所述第二信息;Step 1111, update the first sub-area to the first display state, and display the second information;

其中,所述第一显示状态指示接收到所述第一联系人的未读消息。The first display state indicates that an unread message of the first contact is received.

示例性地,在接收到第一联系人发送的第二信息的情况下,第一子区域高亮或闪烁显示,以提示用户,第一联系人发送了新消息,并且在第一子区域显示指示所述第二信息的目标控件,接收用户的目标输入,比如手指指向所述目标控件,显示所述第二信息的信息内容。Exemplarily, in the case of receiving the second information sent by the first contact, the first sub-area is highlighted or flashed to prompt the user that a new message has been sent by the first contact and is displayed in the first sub-area. The target control indicating the second information receives the user's target input, for example, a finger points to the target control, and the information content of the second information is displayed.

可选地,所述头戴式设备包括摄像头;Optionally, the head-mounted device includes a camera;

步骤101之前,还包括:Before step 101, it also includes:

步骤1005、获取摄像头采集的图像。Step 1005: Acquire an image captured by a camera.

摄像头采集真实环境中的图像,真实环境为用户的视角范围内的真实环境。The camera collects images in the real environment, and the real environment is the real environment within the user's viewing angle range.

步骤1006、在所述图像中包括目标实物的情况下,在虚拟屏幕的第一目标区域,显示虚拟对象,所述第一目标区域为与所述目标实物所在的区域对应的区域。Step 1006 , in the case where the image includes a real object, display a virtual object in a first target area of the virtual screen, where the first target area is an area corresponding to the area where the real object is located.

可选地,在摄像头实时采集的图像中不包括目标实物的情况下,即用户的视线离开了目标实物,则在虚拟屏幕上取消虚拟对象的显示,当用户的视线重新回到目标实物的时候,在虚拟屏幕上显示虚拟对象。Optionally, in the case that the real-time image captured by the camera does not include the target object, that is, the user's sight leaves the target object, the display of the virtual object is canceled on the virtual screen, and when the user's line of sight returns to the target object , to display virtual objects on the virtual screen.

可选地,所述第一目标区域与目标实物所在的区域相同、或者第一目标区域为目标实物所在的区域的部分、或者第一目标区域包括目标实物所在的区域、或者第一目标区域与目标实物所在的区域相邻,比如第一目标区域位于目标实物所在的区域的前方、上方等。Optionally, the first target area is the same as the area where the target object is located, or the first target area is a part of the area where the target object is located, or the first target area includes the area where the target object is located, or the first target area and The area where the target object is located is adjacent, for example, the first target area is located in front of or above the area where the object object is located.

可选地,所述图像中包括目标实物的情况包括:目标实物出现在图像中、或图像中包括目标实物且目标实物周围的环境为目标环境。比如,目标实物为沙发,目标环境是沙发前方0.5米有茶几,茶几前方1米有电视机,沙发左边0.3米有饮水机。Optionally, the situation that the target object is included in the image includes: the target object appears in the image, or the image includes the target object and the environment around the target object is the target environment. For example, the target object is a sofa, and the target environment is that there is a coffee table 0.5 meters in front of the sofa, a TV 1 meter in front of the coffee table, and a water dispenser 0.3 meters to the left of the sofa.

在摄像头采集的真实环境中的图像包括目标实物的情况下,在虚拟屏幕的第一目标区域显示虚拟对象,示例性地,摄像头采集的真实环境中的图像中包括桌子,则在虚拟屏幕的第一目标区域,显示虚拟对象,第一目标区域位于桌子上表面,或者第一目标区域位于桌子上表面的正上方。In the case that the image in the real environment captured by the camera includes a real object, the virtual object is displayed in the first target area of the virtual screen. Exemplarily, the image in the real environment captured by the camera includes a table, then the virtual object is displayed in the first target area of the virtual screen. A target area, displaying virtual objects, the first target area is located on the upper surface of the table, or the first target area is located just above the upper surface of the table.

在本发明实施例中,通过获取摄像头采集的图像,在所述图像中包括目标实物的情况下,在虚拟屏幕的第一目标区域,显示虚拟对象,能够实现,在用户的视角回到目标区域的时候,显示虚拟对象。In the embodiment of the present invention, by acquiring an image captured by a camera, in the case that the image includes a real object, displaying a virtual object in the first target area of the virtual screen can realize that returning to the target area from the user's perspective when the virtual object is displayed.

可选地,所述虚拟屏幕的第二目标区域包括第二标识。Optionally, the second target area of the virtual screen includes a second identifier.

具体地,所述第二标识不属于所述M个标识。Specifically, the second identifier does not belong to the M identifiers.

可选地,第二标识用于指示所述虚拟对象。Optionally, the second identifier is used to indicate the virtual object.

步骤1005之前,还包括:Before step 1005, it also includes:

步骤1006、接收用户对所述第二标识和第三空间区域的第九输入。Step 1006: Receive a ninth input from the user on the second identifier and the third spatial area.

可选地,所述第九输入包括但不限于滑动输入、点击输入、拖动输入、长按输入、悬浮触控输入、语音输入等中的至少一种,具体根据实际需要设定,本发明实施例不作限定。第九输入也可以是第九操作。在执行所述第九输入时,可以是单点输入,如采用单根手指进行滑动输入、点击输入等;也可以是多点输入,如同时采用两根手指进行滑动输入、点击输入等。Optionally, the ninth input includes but is not limited to at least one of sliding input, click input, drag input, long press input, floating touch input, voice input, etc., and is specifically set according to actual needs. The embodiment is not limited. The ninth input may also be a ninth operation. When performing the ninth input, it may be single-point input, such as using a single finger for sliding input, click input, etc.; it may also be multi-point input, such as using two fingers simultaneously for sliding input, click input, etc.

步骤1007、响应于所述第九输入,在虚拟屏幕上对应所述第三空间区域的第三目标区域,显示虚拟对象,所述第三空间区域为目标实物所在的区域。Step 1007: In response to the ninth input, display a virtual object in a third target area corresponding to the third space area on the virtual screen, where the third space area is the area where the target object is located.

可选地,所述第三目标区域与第三空间区域相同、或者第三目标区域为第三空间区域的部分、或者第三目标区域包括第三空间区域、或者第三目标区域与第三空间区域相邻,比如第三目标区域位于第三空间区域的前方、上方等。Optionally, the third target area is the same as the third space area, or the third target area is a part of the third space area, or the third target area includes the third space area, or the third target area and the third space area. The regions are adjacent, for example, the third target region is located in front of or above the third space region, and so on.

示例性地,如图5(a)所示,第二标识501位于虚拟屏幕的第二目标区域502,接收用户对所述第二标识501和第三空间区域503的第九输入,比如将第二标识拖动至第三空间区域,所述目标实物为一面墙,则如图5(b)所示,在第三目标区域显示虚拟对象201,第三目标区域为第三空间区域503的部分,用户可以继续通过手指调整虚拟对象的大小。Exemplarily, as shown in FIG. 5( a ), thesecond identifier 501 is located in thesecond target area 502 of the virtual screen, and a ninth input from the user on thesecond identifier 501 and thethird space area 503 is received, for example, the The second logo is dragged to the third space area, and the target object is a wall, then as shown in FIG. 5(b), thevirtual object 201 is displayed in the third target area, and the third target area is a part of thethird space area 503 , the user can continue to adjust the size of the virtual object with their fingers.

头戴式设备将设置好区域和调整好大小的虚拟对象的信息保存,比如保存虚拟对象的空间坐标、周围的环境信息,虚拟对象在一面墙上,墙的右半边包括一扇门,墙的左侧与另一面包括窗户的墙垂直相连,还可以保存目标实物周围环境的图像信息,当用户的视角回到目标实物所在的区域时,将虚拟对象显示出来,进一步示例性地,当用户的视角落在第三空间区域时,摄像头采集真实环境中的图像,将采集的图像与之前保存的目标实物周围环境的图像比对,在目标实物、周围环境的位置信息以及图像信息都匹配的情况下,在第三目标区域,显示虚拟对象。The head-mounted device saves the information of the set area and the resized virtual object, such as saving the spatial coordinates of the virtual object and the surrounding environment information, the virtual object is on a wall, the right half of the wall includes a door, and the The left side is vertically connected to the other wall including the window, and the image information of the surrounding environment of the target object can also be saved. When the user's perspective returns to the area where the target object is located, the virtual object is displayed. When the viewing angle falls in the third space area, the camera collects images in the real environment, and compares the collected images with the previously saved images of the surrounding environment of the target object. Below, in the third target area, virtual objects are displayed.

可选地,第二标识一直显示在头戴式设备的虚拟屏幕上,即用户可随时看到第二标识,用户可以将第二标识拖动至任意一个或多个空间区域,头戴式设备会记录虚拟对象的空间坐标,用户在多个空间区域均可以看到虚拟对象。Optionally, the second logo is always displayed on the virtual screen of the head-mounted device, that is, the user can see the second logo at any time, and the user can drag the second logo to any one or more space areas, and the head-mounted device The spatial coordinates of virtual objects are recorded, and users can see virtual objects in multiple spatial areas.

在本发明实施例中,通过接收用户对所述第二标识和第三空间区域的第九输入,响应于所述第九输入,在虚拟屏幕上对应所述第三空间区域的第三目标区域,显示虚拟对象,能够实现用户可以通过简单的手势,将虚拟对象放置在多个空间区域中,用户在多个空间区域均可以看到虚拟对象。In this embodiment of the present invention, by receiving a ninth input from the user on the second identifier and the third space area, in response to the ninth input, a third target area corresponding to the third space area on the virtual screen , displaying virtual objects, which can realize that users can place virtual objects in multiple space areas through simple gestures, and users can see virtual objects in multiple space areas.

可选地,步骤102之后,还包括:Optionally, afterstep 102, it also includes:

步骤112、和所述第一联系人建立通话连接,并在虚拟屏幕上的第四空间区域,显示所述第一信息的信息内容。Step 112: Establish a call connection with the first contact, and display the information content of the first information in a fourth space area on the virtual screen.

可选地,所述第四空间区域所在平面可以是与虚拟对象所在平面相同的平面,也可以是与虚拟对象所在平面不相同的平面,比如第四空间区域所在平面与虚拟对象所在平面平行,且第四空间区域所在平面位于虚拟对象所在平面的正前方,所述正前方指更靠近用户的方向。Optionally, the plane where the fourth space region is located may be the same plane as the plane where the virtual object is located, or a plane that is different from the plane where the virtual object is located, for example, the plane where the fourth space region is located is parallel to the plane where the virtual object is located, And the plane where the fourth space area is located is located directly in front of the plane where the virtual object is located, and the direct front refers to a direction closer to the user.

示例性地,用户的手部指向第一标识所在区域,并做出拿取第一标识的手势,第一标识跟随用户的手部移动至第一子区域,用户做出松手放开第一标识的手势,即可将第一信息发送至第一联系人,并和第一联系人建立通话连接,且在虚拟屏幕上的第四空间区域,显示所述第一信息的信息内容。Exemplarily, the user's hand points to the area where the first sign is located, and makes a gesture of taking the first sign, the first sign follows the user's hand and moves to the first sub-area, and the user makes a gesture of letting go of the first sign. gesture, the first information can be sent to the first contact, a call connection is established with the first contact, and the information content of the first information is displayed in the fourth space area on the virtual screen.

可选地,在第一联系人同意接收第一信息后,和第一联系人建立通话连接,且在虚拟屏幕上的第四空间区域,显示所述第一信息的信息内容。Optionally, after the first contact agrees to receive the first information, a call connection is established with the first contact, and the information content of the first information is displayed in a fourth space area on the virtual screen.

可选地,步骤112中,在虚拟屏幕上的第四空间区域,显示所述第一信息的信息内容,具体包括:Optionally, in step 112, the information content of the first information is displayed in the fourth space area on the virtual screen, which specifically includes:

步骤1121、在第四空间区域显示所述第一信息的信息内容,以及显示虚拟标识,所述虚拟标识用于指示所述用户的手部在所述第一信息的信息内容显示界面上的操作位置和手势信息。Step 1121: Display the information content of the first information in the fourth space area, and display a virtual logo, the virtual logo is used to indicate the operation of the user's hand on the information content display interface of the first information Location and gesture information.

可选地,所述头戴式设备为第一头戴式设备,摄像头采集用户手部的图像,获取手部的动作信息,在第一信息显示界面上显示表示用户的手部动作信息的虚拟标识,如图4所示,所述虚拟标识401是用户手部的模型,所述虚拟标识401的显示状态根据用户手部动作的变化或位置的变化实时更新,并将第一信息以及虚拟标识的显示画面同步至第一联系人的第二头戴式设备的虚拟屏幕上,所述第一联系人的第二头戴式设备的虚拟屏幕上显示的同步画面根据第一信息的信息内容或虚拟标识的显示状态的变化实时更新,即第一联系人可以看到用户的手部动作以及第一信息的显示内容,用户可以结合语音和手部动作对第一信息的内容向第一联系人进行讲解和演示。Optionally, the head-mounted device is a first head-mounted device, the camera collects an image of the user's hand, obtains hand motion information, and displays a virtual image representing the user's hand motion information on the first information display interface. As shown in FIG. 4 , thevirtual logo 401 is a model of the user's hand, and the display state of thevirtual logo 401 is updated in real time according to the change of the user's hand movement or the position, and the first information and the virtual logo are updated in real time. The display screen of the first contact is synchronized to the virtual screen of the second head-mounted device of the first contact, and the synchronization screen displayed on the virtual screen of the second head-mounted device of the first contact is based on the information content of the first information or The change of the display state of the virtual logo is updated in real time, that is, the first contact can see the user's hand movements and the displayed content of the first information, and the user can combine the voice and hand movements to the first contact on the content of the first information. Give lectures and demonstrations.

可选地,所述虚拟标识的位置和形态是根据用户手部动作的变化或者位置的变化,实时更新的。Optionally, the position and shape of the virtual logo are updated in real time according to the change of the user's hand movement or the change of the position.

在本发明实施例中,将第一信息发送至第一联系人之后,在虚拟屏幕上显示所述第一信息的信息内容和指示用户手部操作位置和手势信息的虚拟标识,并将第一信息和虚拟标识的显示画面同步至第一联系人的第二头戴式设备的虚拟屏幕上,用户可以结合语音和手部动作对第一信息的内容向第一联系人进行讲解和演示。In this embodiment of the present invention, after the first information is sent to the first contact, the information content of the first information and a virtual identifier indicating the user's hand operation position and gesture information are displayed on the virtual screen, and the first information is displayed on the virtual screen. The display screen of the information and the virtual logo is synchronized to the virtual screen of the second head-mounted device of the first contact, and the user can explain and demonstrate the content of the first information to the first contact by combining voice and hand movements.

在本发明实施例中,头戴式设备通过接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入;响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数,能够实现快速地分享信息,操作简便。In this embodiment of the present invention, the head-mounted device receives a first input from a user to a first sub-region of a virtual object displayed on a virtual screen; and in response to the first input, sends first information to the first A first contact associated with a sub-area; wherein the virtual object includes a first display area, the first display area includes N sub-areas, the N sub-areas include the first sub-area, and the different sub-areas Areas are associated with different contacts, N is a positive integer, which can quickly share information and is easy to operate.

如图6所示,本发明实施例提供一种头戴式设备600,所述头戴式设备600包括:As shown in FIG. 6, an embodiment of the present invention provides a head-mounteddevice 600, where the head-mounteddevice 600 includes:

第一接收模块601,用于接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入;第一发送模块602,用于响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数。Thefirst receiving module 601 is used to receive the first input from the user to the first sub-area of the virtual object displayed on the virtual screen; thefirst sending module 602 is used to send the first information to the user in response to the first input. The first contact associated with the first sub-area; wherein the virtual object includes a first display area, the first display area includes N sub-areas, the N sub-areas include the first sub-area, different The sub-regions of are associated with different contacts, N is a positive integer.

可选地,所述头戴式设备还包括:第一显示模块,用于在所述虚拟对象的第二显示区,显示M个标识,每个所述标识指示不同的信息;其中,所述M个标识包括第一标识,所述第一标识指示所述第一信息,M为正整数。Optionally, the head-mounted device further includes: a first display module configured to display M signs in the second display area of the virtual object, each of the signs indicating different information; wherein the The M identifiers include a first identifier, the first identifier indicates the first information, and M is a positive integer.

可选地,所述第一输入用于将所述第一标识显示至第一子区域。Optionally, the first input is used to display the first identifier to the first sub-area.

可选地,所述第一接收模块,具体用于接收用户对所述第一标识的第一子输入和对所述第一子区域的第二子输入,其中,所述第一子输入用于选中所述第一标识,所述第二子输入用于选中所述第一子区域;所述第一子输入包括第一手势,所述第二子输入包括第二手势;或者,接收用户将所述第一标识拖动至所述第一子区域的第一输入。Optionally, the first receiving module is specifically configured to receive a first sub-input of the first identifier and a second sub-input of the first sub-area from the user, wherein the first sub-input is In selecting the first identifier, the second sub-input is used to select the first sub-area; the first sub-input includes a first gesture, and the second sub-input includes a second gesture; or, receiving The user drags the first identification to the first input of the first sub-area.

可选地,所述第一接收模块,具体用于接收用户对所述第一标识的第三子输入,所述第三子输入用于控制所述第一标识跟随所述用户的手部移动至所述手部所在区域,所述手部所在区域为第一子区域,其中,所述第三子输入包括第三手势;所述第一发送模块,具体用于在满足第一预设条件的情况下,将所述第一信息发送至所述第一子区域关联的第一联系人;其中,所述满足第一预设条件,包括:所述用户的手部在所述第一子区域停留第一预设时长,或接收到用户的第二输入,其中,所述第二输入包括第四手势。Optionally, the first receiving module is specifically configured to receive a third sub-input of the first identifier by the user, where the third sub-input is used to control the first identifier to follow the hand movement of the user to the area where the hand is located, the area where the hand is located is a first sub-area, wherein the third sub-input includes a third gesture; the first sending module is specifically configured to meet the first preset condition In the case of , sending the first information to the first contact associated with the first sub-area; wherein, satisfying the first preset condition includes: the user's hand is in the first sub-area The area stays for a first preset duration, or a second input from the user is received, wherein the second input includes a fourth gesture.

可选地,所述头戴式设备还包括:第二接收模块,用于接收用户对所述第一标识的第三输入;第二显示模块,用于响应于所述第三输入,显示所述第一信息的信息内容。Optionally, the head-mounted device further includes: a second receiving module, configured to receive a third input of the first identifier by the user; a second display module, configured to respond to the third input, display the Describe the information content of the first information.

可选地,所述第三输入包括:将所述第一标识从所述第二显示区移动至第一空间区域的第四子输入,以及触发显示所述第一信息的信息内容的第五子输入;其中,所述第四子输入包括第五手势,所述第五子输入包括第六手势。Optionally, the third input includes: a fourth sub-input for moving the first sign from the second display area to a first space area, and a fifth sub-input for triggering display of the information content of the first information sub-input; wherein the fourth sub-input includes a fifth gesture, and the fifth sub-input includes a sixth gesture.

可选地,所述头戴式设备还包括:第三接收模块,用于接收用户的第四输入,所述第四输入包括第七手势;第三显示模块,用于响应于所述第四输入,取消显示所述第一信息的信息内容。Optionally, the head-mounted device further includes: a third receiving module, configured to receive a fourth input from the user, where the fourth input includes a seventh gesture; and a third display module, configured to respond to the fourth input input to cancel displaying the information content of the first information.

可选地,所述头戴式设备还包括:第一控制模块,用于控制所述第一标识跟随所述用户的手部移动;第二发送模块,用于在所述用户的手部移动至所述N个子区域的第二子区域且满足第二预设条件的情况下,将所述第一信息发送至第二联系人;其中,所述第二子区域与第二联系人关联;所述满足第二预设条件包括:所述用户的手部在所述第二子区域停留第二预设时长,或接收到用户的第五输入,所述第五输入包括第八手势。Optionally, the head-mounted device further includes: a first control module for controlling the first identifier to move with the user's hand; a second sending module for moving on the user's hand to a second sub-area of the N sub-areas and meeting a second preset condition, sending the first information to a second contact; wherein the second sub-area is associated with the second contact; The satisfying the second preset condition includes: the user's hand stays in the second sub-area for a second preset time period, or a fifth input from the user is received, and the fifth input includes an eighth gesture.

可选地,所述虚拟屏幕的第二显示区中还包括第一虚拟控件;所述头戴式设备还包括:第四接收模块,用于接收用户对所述第一虚拟控件的第六输入;第一移动模块,用于响应于所述第六输入,将所述第一虚拟控件从所述第二显示区移动至第二空间区域;第二控制模块,用于执行目标操作;输出模块,用于在接收到用户的第七输入的情况下,输出所述第一信息;其中,所述目标操作为生成所述第一信息的操作;所述第六输入包括第九手势,所述第七输入包括第十手势。Optionally, the second display area of the virtual screen further includes a first virtual control; the head-mounted device further includes: a fourth receiving module configured to receive a sixth input from the user to the first virtual control ; The first moving module is used to move the first virtual control from the second display area to the second space area in response to the sixth input; the second control module is used to perform the target operation; the output module , for outputting the first information when the seventh input from the user is received; wherein, the target operation is an operation for generating the first information; the sixth input includes a ninth gesture, and the The seventh input includes the tenth gesture.

可选地,所述虚拟屏幕的第二显示区中还包括第二虚拟控件;所述头戴式设备还包括:第五接收模块,用于接收用户对所述第二虚拟控件的第八输入,所述第八输入用于将所述第二虚拟控件移动至所述N个子区域的第三子区域,所述第八输入包括第十一手势;第三发送模块,用于响应于所述第八输入,向所述第三子区域关联的第三联系人发送通话请求消息。Optionally, the second display area of the virtual screen further includes a second virtual control; the head-mounted device further includes: a fifth receiving module configured to receive an eighth input from the user to the second virtual control , the eighth input is used to move the second virtual control to the third sub-area of the N sub-areas, the eighth input includes an eleventh gesture; a third sending module is used to respond to the The eighth input is to send a call request message to a third contact associated with the third sub-area.

可选地,所述头戴式设备还包括:第四显示模块,用于在接收到第一联系人发送的第二信息的情况下,在所述第一子区域,显示所述第二信息。Optionally, the head-mounted device further includes: a fourth display module, configured to display the second information in the first sub-area in the case of receiving the second information sent by the first contact .

可选地,所述第四显示模块具体用于:更新所述第一子区域至第一显示状态,并显示所述第二信息;其中,所述第一显示状态指示接收到所述第一联系人的未读消息。Optionally, the fourth display module is specifically configured to: update the first sub-area to a first display state and display the second information; wherein the first display state indicates that the first display state is received Contact's unread messages.

可选地,所述头戴式设备包括摄像头;所述头戴式设备还包括:获取模块,用于获取摄像头采集的图像;第五显示模块,用于在所述图像中包括目标实物的情况下,在虚拟屏幕的第一目标区域,显示虚拟对象,所述第一目标区域为与所述目标实物所在的区域对应的区域。Optionally, the head-mounted device includes a camera; the head-mounted device further includes: an acquisition module for acquiring an image captured by the camera; a fifth display module for including a target object in the image Next, a virtual object is displayed in a first target area of the virtual screen, and the first target area is an area corresponding to the area where the target object is located.

可选地,所述虚拟屏幕的第二目标区域包括第二标识;所述头戴式设备还包括:第六接收模块,用于接收用户对所述第二标识和第三空间区域的第九输入;第六显示模块,用于响应于所述第九输入,在虚拟屏幕上对应所述第三空间区域的第三目标区域,显示虚拟对象,所述第三空间区域为目标实物所在的区域。Optionally, the second target area of the virtual screen includes a second identifier; the head-mounted device further includes: a sixth receiving module, configured to receive a user's ninth identification of the second identifier and the third space area. input; a sixth display module, used for responding to the ninth input, displaying a virtual object in a third target area corresponding to the third space area on the virtual screen, and the third space area is the area where the target object is located .

可选地,所述N个子区域通过分隔标识分隔。Optionally, the N sub-regions are separated by separation identifiers.

本发明实施例提供的头戴式设备能够实现上述方法实施例中头戴式设备实现的各个过程,为避免重复,此处不再赘述。The head-mounted device provided in the embodiments of the present invention can implement each process implemented by the head-mounted device in the foregoing method embodiments, and to avoid repetition, details are not described herein again.

在本发明实施例中,头戴式设备通过接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入;响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数,能够实现快速地分享信息,操作简便。In this embodiment of the present invention, the head-mounted device receives a first input from a user to a first sub-region of a virtual object displayed on a virtual screen; and in response to the first input, sends first information to the first A first contact associated with a sub-area; wherein the virtual object includes a first display area, the first display area includes N sub-areas, the N sub-areas include the first sub-area, and the different sub-areas Areas are associated with different contacts, N is a positive integer, which can quickly share information and is easy to operate.

图7为实现本发明各个实施例的一种头戴式设备的硬件结构示意图,如图7所示,该头戴式设备700包括但不限于:射频单元701、网络模块702、音频输出单元703、输入单元704、传感器705、显示单元706、用户输入单元707、接口单元708、存储器709、处理器710、以及电源711等部件。本领域技术人员可以理解,图7中示出的头戴式设备结构并不构成对头戴式设备的限定,头戴式设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。在本发明实施例中,头戴式设备包括但不限于VR眼镜、AR眼镜、MR眼镜、或VR头盔、AR头盔、MR头盔等。FIG. 7 is a schematic diagram of the hardware structure of a head-mounted device for implementing various embodiments of the present invention. As shown in FIG. 7 , the head-mounteddevice 700 includes but is not limited to: a radio frequency unit 701 , anetwork module 702 , and anaudio output unit 703 , aninput unit 704, asensor 705, adisplay unit 706, auser input unit 707, aninterface unit 708, amemory 709, aprocessor 710, and apower supply 711 and other components. Those skilled in the art can understand that the structure of the head-mounted device shown in FIG. 7 does not constitute a limitation on the head-mounted device, and the head-mounted device may include more or less components than those shown in the figure, or combine some components, or a different arrangement of components. In this embodiment of the present invention, the head-mounted device includes, but is not limited to, VR glasses, AR glasses, MR glasses, or VR helmets, AR helmets, MR helmets, and the like.

其中,用户输入单元707,用于接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入;处理器710,用于响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数。Theuser input unit 707 is configured to receive the first input from the user to the first sub-region of the virtual object displayed on the virtual screen; theprocessor 710 is configured to respond to the first input and send the first information to the the first contact associated with the first sub-area; wherein, the virtual object includes a first display area, the first display area includes N sub-areas, the N sub-areas include the first sub-area, different The sub-areas are associated with different contacts, and N is a positive integer.

本发明实施例提供了一种头戴式设备,头戴式设备可以通过接收用户对虚拟屏幕上显示的虚拟对象的第一子区域的第一输入;响应于所述第一输入,将第一信息发送至所述第一子区域关联的第一联系人;其中,所述虚拟对象包括第一显示区,所述第一显示区包括N个子区域,所述N个子区域包括所述第一子区域,不同的所述子区域关联不同的联系人,N正整数,能够实现快速地分享信息,操作简便。An embodiment of the present invention provides a head-mounted device, and the head-mounted device can receive a first input from a user to a first sub-region of a virtual object displayed on a virtual screen; in response to the first input, the first input The information is sent to the first contact associated with the first sub-area; wherein the virtual object includes a first display area, the first display area includes N sub-areas, and the N sub-areas include the first sub-area Area, different sub-areas are associated with different contacts, N is a positive integer, which can quickly share information and is easy to operate.

应理解的是,本发明实施例中,射频单元701可用于收发信息或通话过程中,信号的接收和发送,具体的,将来自基站的下行数据接收后,给处理器710处理;另外,将上行的数据发送给基站。通常,射频单元701包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外,射频单元701还可以通过无线通信系统与网络和其他设备通信。It should be understood that, in this embodiment of the present invention, the radio frequency unit 701 can be used for receiving and sending signals during sending and receiving of information or during a call. Specifically, after receiving the downlink data from the base station, it is processed by theprocessor 710; The uplink data is sent to the base station. Generally, the radio frequency unit 701 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 701 can also communicate with the network and other devices through a wireless communication system.

头戴式设备通过网络模块702为用户提供了无线的宽带互联网访问,如帮助用户收发电子邮件、浏览网页和访问流式媒体等。The head-mounted device provides the user with wireless broadband Internet access through thenetwork module 702, such as helping the user to send and receive emails, browse web pages, access streaming media, and the like.

音频输出单元703可以将射频单元701或网络模块702接收的或者在存储器709中存储的音频数据转换成音频信号并且输出为声音。而且,音频输出单元703还可以提供与头戴式设备700执行的特定功能相关的音频输出(例如,呼叫信号接收声音、消息接收声音等等)。音频输出单元703包括扬声器、蜂鸣器以及受话器等。Theaudio output unit 703 may convert audio data received by the radio frequency unit 701 or thenetwork module 702 or stored in thememory 709 into audio signals and output as sound. Also, theaudio output unit 703 may also provide audio output related to a specific function performed by the head mounted device 700 (eg, call signal reception sound, message reception sound, etc.). Theaudio output unit 703 includes a speaker, a buzzer, a receiver, and the like.

输入单元704用于接收音频或视频信号。输入单元704可以包括图形处理器(Graphics Processing Unit,GPU)7041和麦克风7042,图形处理器7041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元706上。经图形处理器7041处理后的图像帧可以存储在存储器709(或其它存储介质)中或者经由射频单元701或网络模块702进行发送。麦克风7042可以接收声音,并且能够将这样的声音处理为音频数据。处理后的音频数据可以在电话通话模式的情况下转换为可经由射频单元701发送到移动通信基站的格式输出。Theinput unit 704 is used to receive audio or video signals. Theinput unit 704 may include a graphics processor (Graphics Processing Unit, GPU) 7041 and amicrophone 7042. Thegraphics processor 7041 captures still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed. The processed image frames may be displayed on thedisplay unit 706 . The image frames processed by thegraphics processor 7041 may be stored in the memory 709 (or other storage medium) or transmitted via the radio frequency unit 701 or thenetwork module 702 . Themicrophone 7042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 701 for output in the case of a telephone call mode.

头戴式设备700还包括至少一种传感器705,比如手势传感器、光传感器、运动传感器以及其他传感器。具体地,光传感器包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板7061的亮度,接近传感器可在头戴式设备700移动到耳边时,关闭显示面板7061和/或背光。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别头戴式设备姿态(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;传感器705还可以包括指纹传感器、压力传感器、虹膜传感器、分子传感器、陀螺仪、气压计、湿度计、温度计、红外线传感器等,在此不再赘述。Head mounteddevice 700 also includes at least onesensor 705, such as gesture sensors, light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of thedisplay panel 7061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel when the head-mounteddevice 700 is moved to theear 7061 and/or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the head-mounted device (such as switching between horizontal and vertical screens, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; thesensor 705 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, Thermometers, infrared sensors, etc. will not be repeated here.

显示单元706用于显示由用户输入的信息或提供给用户的信息。显示单元706可包括显示面板7061,可以采用液晶显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板7061。显示单元706可包括全息设备、投影仪(图中未示出),全息设备可以通过使用光干涉在空气中形成三维(3D)图像(全息图)。投影仪可以通过将光投影到屏幕上来显示图像。该屏幕可以位于头戴式设备的内部或外部。Thedisplay unit 706 is used to display information input by the user or information provided to the user. Thedisplay unit 706 may include adisplay panel 7061, and thedisplay panel 7061 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. Thedisplay unit 706 may include a holographic device that can form a three-dimensional (3D) image (hologram) in air by using light interference, a projector (not shown in the figure). A projector can display images by projecting light onto a screen. The screen can be inside or outside the headset.

用户输入单元707可用于接收输入的数字或字符信息,以及产生与头戴式设备的用户设置以及功能控制有关的键信号输入。具体地,用户输入单元707包括触控面板7071以及其他输入设备7072。触控面板7071,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板7071上或在触控面板7071附近的操作)。触控面板7071可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器710,接收处理器710发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板7071。除了触控面板7071,用户输入单元707还可以包括其他输入设备7072。具体地,其他输入设备7072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。Theuser input unit 707 may be used to receive input numerical or character information, and generate key signal input related to user settings and function control of the head mounted device. Specifically, theuser input unit 707 includes atouch panel 7071 andother input devices 7072 . Thetouch panel 7071, also referred to as a touch screen, can collect touch operations by the user on or near it (such as the user's finger, stylus, etc., any suitable object or attachment on or near the touch panel 7071). operate). Thetouch panel 7071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To theprocessor 710, the command sent by theprocessor 710 is received and executed. In addition, thetouch panel 7071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to thetouch panel 7071 , theuser input unit 707 may also includeother input devices 7072 . Specifically,other input devices 7072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.

进一步地,触控面板7071可覆盖在显示面板7061上,当触控面板7071检测到在其上或附近的触摸操作后,传送给处理器710以确定触摸事件的类型,随后处理器710根据触摸事件的类型在显示面板7061上提供相应的视觉输出。虽然在图7中,触控面板7071与显示面板7061是作为两个独立的部件来实现头戴式设备的输入和输出功能,但是在某些实施例中,可以将触控面板7071与显示面板7061集成而实现头戴式设备的输入和输出功能,具体此处不做限定。Further, thetouch panel 7071 can be covered on thedisplay panel 7061. When thetouch panel 7071 detects a touch operation on or near it, it transmits it to theprocessor 710 to determine the type of the touch event, and then theprocessor 710 determines the type of the touch event according to the touch The type of event provides corresponding visual output ondisplay panel 7061. Although in FIG. 7 , thetouch panel 7071 and thedisplay panel 7061 are used as two independent components to realize the input and output functions of the head-mounted device, but in some embodiments, thetouch panel 7071 and the display panel may be combined 7061 is integrated to realize the input and output functions of the head-mounted device, which is not specifically limited here.

接口单元708为外部装置与头戴式设备700连接的接口。例如,外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。接口单元708可以用于接收来自外部装置的输入(例如,数据信息、电力等等)并且将接收到的输入传输到头戴式设备700内的一个或多个元件或者可以用于在头戴式设备700和外部装置之间传输数据。Theinterface unit 708 is an interface for connecting an external device to the head mounteddevice 700 . For example, external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. Theinterface unit 708 may be used to receive input from external devices (eg, data information, power, etc.) and transmit the received input to one or more elements within the head mounteddevice 700 Data is transferred between thedevice 700 and an external device.

存储器709可用于存储软件程序以及各种数据。存储器709可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器709可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。Thememory 709 may be used to store software programs as well as various data. Thememory 709 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of the mobile phone (such as audio data, phone book, etc.), etc. Additionally,memory 709 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

处理器710是头戴式设备的控制中心,利用各种接口和线路连接整个头戴式设备的各个部分,通过运行或执行存储在存储器709内的软件程序和/或模块,以及调用存储在存储器709内的数据,执行头戴式设备的各种功能和处理数据,从而对头戴式设备进行整体监控。处理器710可包括一个或多个处理单元;可选地,处理器710可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器710中,根据本发明的实施例,处理器710可以检测用户的手势并确定与该手势相对应的控制命令。Theprocessor 710 is the control center of the head-mounted device, and uses various interfaces and lines to connect various parts of the entire head-mounted device, by running or executing the software programs and/or modules stored in thememory 709, and calling the stored in the memory. 709, perform various functions of the head-mounted device and process data, so as to perform overall monitoring of the head-mounted device. Theprocessor 710 may include one or more processing units; optionally, theprocessor 710 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem The modulation processor mainly handles wireless communication. It can be understood that the above-mentioned modulation and demodulation processor may not be integrated into theprocessor 710. According to an embodiment of the present invention, theprocessor 710 can detect a user's gesture and determine a control command corresponding to the gesture.

头戴式设备700还可以包括给各个部件供电的电源711(比如电池),可选地,电源711可以通过电源管理系统与处理器710逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。The head mounteddevice 700 may also include a power source 711 (such as a battery) for powering the various components. Power management and other functions.

另外,头戴式设备700包括一些未示出的功能模块,在此不再赘述。In addition, the head-mounteddevice 700 includes some functional modules not shown, which will not be repeated here.

可选地,本发明实施例还提供一种头戴式设备,包括处理器710,存储器709,存储在存储器709上并可在所述处理器710上运行的计算机程序,该计算机程序被处理器710执行时实现上述信息交互方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。Optionally, an embodiment of the present invention further provides a head-mounted device, including aprocessor 710, amemory 709, and a computer program stored in thememory 709 and executable on theprocessor 710, the computer program being executed by the processor When 710 is executed, each process of the above-mentioned information interaction method embodiment is implemented, and the same technical effect can be achieved. In order to avoid repetition, details are not repeated here.

可选的,本发明实施例中,上述实施例中的头戴式设备可以为AR设备。具体的,当上述实施例中的头戴式设备为AR设备时,该AR设备可以包括上述头戴式设备中的全部或部分功能模块。当然,该AR设备还可以包括上述头戴式设备中未包括的功能模块。Optionally, in this embodiment of the present invention, the head-mounted device in the foregoing embodiment may be an AR device. Specifically, when the head-mounted device in the above embodiment is an AR device, the AR device may include all or part of the functional modules in the above-mentioned head-mounted device. Of course, the AR device may also include functional modules not included in the above-mentioned head-mounted device.

可以理解,本发明实施例中,当上述实施例中的头戴式设备为AR设备时,该头戴式设备可以为集成有AR技术的头戴式设备。其中,上述AR技术是指实现现实场景和虚拟场景结合的一种技术。采用AR技术可以复原人类的视觉功能,从而使得人类可以通过AR技术体验现实场景和虚拟场景结合的感觉,进而使得人类更好地体验身临其境的感受。It can be understood that, in this embodiment of the present invention, when the head-mounted device in the foregoing embodiment is an AR device, the head-mounted device may be a head-mounted device integrated with AR technology. The above AR technology refers to a technology that realizes the combination of a real scene and a virtual scene. The use of AR technology can restore human visual function, so that humans can experience the combination of real scenes and virtual scenes through AR technology, so that humans can better experience the immersive feeling.

下面以AR设备为AR眼镜为例,当用户佩戴上AR眼镜后,用户观看到的场景是通过AR技术处理所产生的,即通过AR技术可以使得虚拟场景叠加显示在现实场景中。当用户对AR眼镜显示的内容操作时,用户可以看到AR眼镜将现实场景“剥开”,从而将更加真实的一面展示给用户。例如,用户肉眼观察一个纸箱时只能观察到纸箱外壳,但是当用户佩戴上AR眼镜后,用户便可以通过AR眼镜直接观察到纸箱的内部结构。The following takes the AR device as AR glasses as an example. When the user wears the AR glasses, the scene viewed by the user is processed by the AR technology, that is, the virtual scene can be superimposed and displayed in the real scene through the AR technology. When the user operates on the content displayed by the AR glasses, the user can see that the AR glasses "peel" the real scene, so as to show the user a more realistic side. For example, when a user observes a carton with the naked eye, only the outer shell of the carton can be observed, but when the user wears AR glasses, the user can directly observe the internal structure of the carton through the AR glasses.

上述AR设备中可以包括摄像头,从而AR设备可以在摄像头拍摄的画面的基础上结合虚拟画面进行展示和互动。例如,本发明实施例中,AR设备可以将用户使用AR设备进行娱乐活动时生成的虚拟画面信息,同步至其他AR设备的显示屏上,使AR设备之间能够实现虚拟画面共享。The above AR device may include a camera, so that the AR device can display and interact with virtual images based on the images captured by the cameras. For example, in this embodiment of the present invention, the AR device can synchronize virtual image information generated when the user uses the AR device for entertainment activities to the display screen of other AR devices, so that virtual image sharing can be achieved between AR devices.

本发明实施例还提供一种计算机可读存储介质,计算机可读存储介质上存储有计算机程序,该计算机程序被处理器执行时实现上述信息交互方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。其中,所述的计算机可读存储介质,如只读存储器(Read-Only Memory,简称ROM)、随机存取存储器(Random Access Memory,简称RAM)、磁碟或者光盘等。Embodiments of the present invention further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the foregoing information interaction method embodiments can be implemented, and the same technology can be achieved. The effect, in order to avoid repetition, is not repeated here. The computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk, or an optical disk.

需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台头戴式设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本发明各个实施例所述的方法。From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD), including several instructions to make a head-mounted device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the various embodiments of the present invention.

上面结合附图对本发明的实施例进行了描述,但是本发明并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本发明的启示下,在不脱离本发明宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本发明的保护之内。The embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of the present invention, without departing from the spirit of the present invention and the scope protected by the claims, many forms can be made, which all belong to the protection of the present invention.

Claims (34)

CN202010031835.9A2020-01-132020-01-13Information interaction method, head-mounted device and mediumActiveCN111258420B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202010031835.9ACN111258420B (en)2020-01-132020-01-13Information interaction method, head-mounted device and medium

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202010031835.9ACN111258420B (en)2020-01-132020-01-13Information interaction method, head-mounted device and medium

Publications (2)

Publication NumberPublication Date
CN111258420Atrue CN111258420A (en)2020-06-09
CN111258420B CN111258420B (en)2023-02-21

Family

ID=70952185

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202010031835.9AActiveCN111258420B (en)2020-01-132020-01-13Information interaction method, head-mounted device and medium

Country Status (1)

CountryLink
CN (1)CN111258420B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN112596604A (en)*2020-12-092021-04-02Oppo广东移动通信有限公司Message sending method, message receiving method, device and electronic equipment
CN113238708A (en)*2021-05-172021-08-10杭州灵伴科技有限公司Method and device for displaying touch operation information in head-mounted display equipment
CN113347526A (en)*2021-07-082021-09-03歌尔科技有限公司Sound effect adjusting method and device of earphone and readable storage medium
CN113342433A (en)*2021-05-082021-09-03杭州灵伴科技有限公司Application page display method, head-mounted display device and computer readable medium
WO2022206697A1 (en)*2021-03-312022-10-06维沃移动通信有限公司Image sharing methods and apparatuses, and electronic device

Citations (16)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN102457617A (en)*2010-10-182012-05-16Lg电子株式会社Mobile terminal and method of managing object related information therein
CN102906676A (en)*2010-03-222013-01-30美泰有限公司 Input and output of electronic devices and data
US20130044130A1 (en)*2011-08-172013-02-21Kevin A. GeisnerProviding contextual personal information by a mixed reality device
US20160147400A1 (en)*2014-11-262016-05-26Microsoft Technology Licensing, LlcTab based browser content sharing
CN105635444A (en)*2015-12-222016-06-01深圳市金立通信设备有限公司Contact person information sharing method and terminal
US20170083104A1 (en)*2015-09-172017-03-23Canon Kabushiki KaishaInformation processing apparatus information processing method and storage medium
CN106716306A (en)*2014-09-302017-05-24索尼互动娱乐股份有限公司 Synchronize multiple HMDs to Unity Space and make object movements in Unity Space related
CN108170338A (en)*2018-01-092018-06-15网易(杭州)网络有限公司Information processing method, device, electronic equipment and storage medium
CN108295465A (en)*2018-02-122018-07-20腾讯科技(深圳)有限公司Share the method, apparatus, equipment and storage medium in the visual field in three-dimensional virtual environment
CN108628449A (en)*2018-04-242018-10-09北京小米移动软件有限公司Apparatus control method, device, electronic equipment and computer readable storage medium
CN109274575A (en)*2018-08-082019-01-25阿里巴巴集团控股有限公司 Message sending method and device and electronic device
CN109471742A (en)*2018-11-072019-03-15Oppo广东移动通信有限公司Information processing method and device, electronic equipment and readable storage medium
CN109600303A (en)*2018-12-042019-04-09北京小米移动软件有限公司Content share method, device and storage medium
WO2019071872A1 (en)*2017-10-092019-04-18华为技术有限公司File sharing method and terminal
CN110221761A (en)*2019-04-242019-09-10维沃移动通信有限公司Display methods and terminal device
CN110321044A (en)*2019-04-252019-10-11维沃移动通信有限公司Sharing files method and terminal

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN102906676A (en)*2010-03-222013-01-30美泰有限公司 Input and output of electronic devices and data
CN102457617A (en)*2010-10-182012-05-16Lg电子株式会社Mobile terminal and method of managing object related information therein
US20130044130A1 (en)*2011-08-172013-02-21Kevin A. GeisnerProviding contextual personal information by a mixed reality device
CN106716306A (en)*2014-09-302017-05-24索尼互动娱乐股份有限公司 Synchronize multiple HMDs to Unity Space and make object movements in Unity Space related
US20160147400A1 (en)*2014-11-262016-05-26Microsoft Technology Licensing, LlcTab based browser content sharing
US20170083104A1 (en)*2015-09-172017-03-23Canon Kabushiki KaishaInformation processing apparatus information processing method and storage medium
CN105635444A (en)*2015-12-222016-06-01深圳市金立通信设备有限公司Contact person information sharing method and terminal
WO2019071872A1 (en)*2017-10-092019-04-18华为技术有限公司File sharing method and terminal
CN108170338A (en)*2018-01-092018-06-15网易(杭州)网络有限公司Information processing method, device, electronic equipment and storage medium
CN108295465A (en)*2018-02-122018-07-20腾讯科技(深圳)有限公司Share the method, apparatus, equipment and storage medium in the visual field in three-dimensional virtual environment
CN108628449A (en)*2018-04-242018-10-09北京小米移动软件有限公司Apparatus control method, device, electronic equipment and computer readable storage medium
CN109274575A (en)*2018-08-082019-01-25阿里巴巴集团控股有限公司 Message sending method and device and electronic device
CN109471742A (en)*2018-11-072019-03-15Oppo广东移动通信有限公司Information processing method and device, electronic equipment and readable storage medium
CN109600303A (en)*2018-12-042019-04-09北京小米移动软件有限公司Content share method, device and storage medium
CN110221761A (en)*2019-04-242019-09-10维沃移动通信有限公司Display methods and terminal device
CN110321044A (en)*2019-04-252019-10-11维沃移动通信有限公司Sharing files method and terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
郑铁男主编: "《数字编辑技术实训教程》", 31 July 2017*

Cited By (8)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN112596604A (en)*2020-12-092021-04-02Oppo广东移动通信有限公司Message sending method, message receiving method, device and electronic equipment
WO2022206697A1 (en)*2021-03-312022-10-06维沃移动通信有限公司Image sharing methods and apparatuses, and electronic device
US12073068B2 (en)2021-03-312024-08-27Vivo Mobile Communication Co., Ltd.Image dividing and sharing method
CN113342433A (en)*2021-05-082021-09-03杭州灵伴科技有限公司Application page display method, head-mounted display device and computer readable medium
CN113238708A (en)*2021-05-172021-08-10杭州灵伴科技有限公司Method and device for displaying touch operation information in head-mounted display equipment
CN113238708B (en)*2021-05-172024-02-23杭州灵伴科技有限公司Method and device for displaying touch operation information in head-mounted display equipment
CN113347526A (en)*2021-07-082021-09-03歌尔科技有限公司Sound effect adjusting method and device of earphone and readable storage medium
CN113347526B (en)*2021-07-082022-11-22歌尔科技有限公司Sound effect adjusting method and device of earphone and readable storage medium

Also Published As

Publication numberPublication date
CN111258420B (en)2023-02-21

Similar Documents

PublicationPublication DateTitle
US10356398B2 (en)Method for capturing virtual space and electronic device using the same
CN108499105B (en)Method, device and storage medium for adjusting visual angle in virtual environment
CN111258420B (en)Information interaction method, head-mounted device and medium
US11170580B2 (en)Information processing device, information processing method, and recording medium
US9651782B2 (en)Wearable tracking device
CN111970456B (en)Shooting control method, device, equipment and storage medium
KR20220032059A (en)Touch free interface for augmented reality systems
CN109032445B (en) A screen display control method and terminal device
CN112835445A (en) Interaction method, device and system in virtual reality scene
WO2021136266A1 (en)Virtual image synchronization method and wearable device
US20240104871A1 (en)User interfaces for capturing media and manipulating virtual objects
CN119200825A (en) Method for sharing content and interacting with physical devices in a three-dimensional environment
CN109120800A (en)A kind of application icon method of adjustment and mobile terminal
CN111352505B (en)Operation control method, head-mounted device, and medium
CN112612387B (en)Method, device and equipment for displaying information and storage medium
CN115814405A (en)Video recording method and device in game, electronic equipment and storage medium
CN111240483B (en)Operation control method, head-mounted device, and medium
KR20180113115A (en)Mobile terminal and method for controlling the same
CN110717993A (en)Interaction method, system and medium of split type AR glasses system
CN111064658B (en) Display control method and electronic device
CN111258482B (en)Information sharing method, head-mounted device and medium
CN118012265A (en) Human-computer interaction method, device, equipment and medium
CN111093033A (en) An information processing method and device
CN111178306A (en)Display control method and electronic equipment
WO2024039666A1 (en)Devices, methods, and graphical user interfaces for improving accessibility of interactions with three-dimensional environments

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp