技术领域technical field
本发明涉及计算机技术领域，具体涉及一种虚拟现实VR场景的展示方法、装置、电子设备和计算机可读存储介质。The present invention relates to the field of computer technology, in particular to a display method, device, electronic equipment and computer-readable storage medium of a virtual reality VR scene.
背景技术Background technique
因虚拟现实技术(Virtual Reality，简称VR)给用户带来了良好的视觉体验和听觉体验。现如今，VR技术已经应用在很多的领域中。应用最多的情况，就是在用户的视野中添加指定的虚拟物体，来丰富用户所浏览的场景。但是随着用户的需求的不断增加，简单的添加指定的虚拟物体已经不能满足用户的需求，因此，需要改变传统的VR场景的展示方式，以提高用户的使用体验。Because of virtual reality technology (Virtual Reality, referred to as VR) to bring users a good visual experience and auditory experience. Nowadays, VR technology has been applied in many fields. The most widely used situation is to add specified virtual objects in the user's field of vision to enrich the scenes browsed by the user. However, as user demands continue to increase, simply adding a specified virtual object can no longer meet the user's demand. Therefore, it is necessary to change the display mode of the traditional VR scene in order to improve the user experience.
发明内容Contents of the invention
鉴于上述问题，提出了本发明以便提供一种克服上述问题或者至少部分地解决上述问题的虚拟现实VR场景的展示方法、装置、电子设备和计算机可读存储介质。In view of the above problems, the present invention is proposed to provide a display method, device, electronic device and computer-readable storage medium for virtual reality VR scenes that overcome the above problems or at least partially solve the above problems.
根据本发明的一个方面，提供了一种虚拟现实VR场景的展示方法，其中，该方法包括：According to one aspect of the present invention, a method for displaying a virtual reality VR scene is provided, wherein the method includes:
获取移动终端的摄像头采集的视频画面，在所述视频画面中添加表示入口的指定图像元素后在移动终端的屏幕上播放所述视频；Obtain the video picture collected by the camera of the mobile terminal, add the specified image element representing the entrance to the video picture and play the video on the screen of the mobile terminal;
当检测到进入所述视频中的所述指定图像元素表示的入口的操作指令时，根据预设的VR空间模型在移动终端的屏幕上展示相应的VR空间场景。When an operation instruction to enter the entrance represented by the specified image element in the video is detected, a corresponding VR space scene is displayed on the screen of the mobile terminal according to a preset VR space model.
可选地，在所述视频画面中添加表示入口的指定图像元素之前，该方法还包括：检测所述视频画面中的表示平面的图像元素；Optionally, before adding a designated image element representing an entrance to the video image, the method further includes: detecting an image element representing a plane in the video image;
所述在所述视频画面中添加表示入口的指定图像元素包括：在所述视频画面中的表示平面的图像元素上添加表示入口的指定图像元素。The adding a designated image element representing an entrance in the video picture includes: adding a designated image element representing an entrance to an image element representing a plane in the video picture.
可选地，所述指定图像元素为如下中的任意一种：Optionally, the specified image element is any one of the following:
门；Door;
洞口。hole.
可选地，在所述视频画面中添加表示入口的指定图像元素包括：Optionally, adding a designated image element representing an entry in the video screen includes:
采用VR技术在所述视频画面中添加具有VR视觉效果的表示入口的指定图像元素。A specified image element representing an entrance with a VR visual effect is added to the video picture by adopting VR technology.
可选地，所述检测到进入所述指定图像元素表示的入口的操作指令包括：Optionally, the operation instruction for detecting the entry indicated by the specified image element includes:
检测移动终端的移动信息，当根据移动终端的移动信息确定所述视频的显示效果是用户不断接近所述入口并进入所述入口时，确定检测到所述操作指令。Detecting the movement information of the mobile terminal, when it is determined according to the movement information of the mobile terminal that the display effect of the video is that the user keeps approaching the entrance and entering the entrance, it is determined that the operation instruction is detected.
可选地，在移动终端的屏幕上展示相应的VR空间场景之后，该方法进一步包括：Optionally, after displaying the corresponding VR space scene on the screen of the mobile terminal, the method further includes:
检测移动终端的移动信息；Detect the mobile information of the mobile terminal;
根据移动终端的移动信息进行计算，在移动终端的屏幕上展现所述VR空间场景中的与计算结果对应的场景画面。The calculation is performed according to the movement information of the mobile terminal, and the scene picture corresponding to the calculation result in the VR space scene is displayed on the screen of the mobile terminal.
根据本发明的另一方面，提供了一种虚拟现实VR场景的展示装置，其中，该装置包括：According to another aspect of the present invention, a display device for a virtual reality VR scene is provided, wherein the device includes:
入口添加单元，适于获取移动终端的摄像头采集的视频画面，在所述视频画面中添加表示入口的指定图像元素后在移动终端的屏幕上播放所述视频；The entrance adding unit is adapted to obtain the video picture captured by the camera of the mobile terminal, and play the video on the screen of the mobile terminal after adding a designated image element representing the entrance in the video picture;
VR场景切换单元，适于当检测到进入所述视频中的所述指定图像元素表示的入口的操作指令时，根据预设的VR空间模型在移动终端的屏幕上展示相应的VR空间场景。The VR scene switching unit is adapted to display the corresponding VR space scene on the screen of the mobile terminal according to the preset VR space model when an operation instruction to enter the entrance indicated by the specified image element in the video is detected.
可选地，Optionally,
所述入口添加单元，在所述视频画面中添加表示入口的指定图像元素之前，还适于检测所述视频画面中的表示平面的图像元素，在所述视频画面中的表示平面的图像元素上添加表示入口的指定图像元素。The entry adding unit is further adapted to detect an image element representing a plane in the video picture before adding a designated image element representing an entry in the video picture, and on the image element representing a plane in the video picture Adds the specified image element representing the portal.
可选地，所述指定图像元素为如下中的任意一种：Optionally, the specified image element is any one of the following:
门；Door;
洞口。hole.
可选地，Optionally,
所述入口添加单元，适于采用VR技术在所述视频画面中添加具有VR视觉效果的表示入口的指定图像元素。The entry adding unit is adapted to add a specified image element representing an entry with VR visual effect in the video picture by using VR technology.
可选地，Optionally,
所述VR场景切换单元，适于检测移动终端的移动信息，当根据移动终端的移动信息确定所述视频的显示效果是用户不断接近所述入口并进入所述入口时，确定检测到所述操作指令。The VR scene switching unit is adapted to detect the movement information of the mobile terminal, and when it is determined according to the movement information of the mobile terminal that the display effect of the video is that the user keeps approaching the entrance and entering the entrance, it is determined that the operation is detected instruction.
可选地，Optionally,
所述VR场景切换单元，在移动终端的屏幕上展示相应的VR空间场景之后，进一步适于检测移动终端的移动信息，根据移动终端的移动信息进行计算，在移动终端的屏幕上展现所述VR空间场景中的与计算结果对应的场景画面。The VR scene switching unit is further adapted to detect the movement information of the mobile terminal after displaying the corresponding VR space scene on the screen of the mobile terminal, calculate according to the movement information of the mobile terminal, and present the VR scene on the screen of the mobile terminal. The scene picture corresponding to the calculation result in the space scene.
根据本发明的又一方面，提供了一种电子设备，其中，该电子设备包括：According to yet another aspect of the present invention, an electronic device is provided, wherein the electronic device includes:
处理器；以及processor; and
存储计算机可执行指令的存储器；所述可执行指令在被执行时使所述处理器执行根据前述的方法。A memory storing computer-executable instructions; said executable instructions, when executed, cause said processor to perform the method according to the foregoing.
根据本发明的再一方面，提供了一种计算机可读存储介质，其中，所述计算机可读存储介质存储一个或多个程序，所述一个或多个程序当被处理器执行时，实现前述的方法。According to still another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, the aforementioned Methods.
根据本发明的技术方案，获取移动终端的摄像头采集的视频画面，在视频画面中添加表示入口的指定图像元素后在移动终端的屏幕上播放视频；当检测到进入视频中的指定图像元素表示的入口的操作指令时，根据预设的VR空间模型在移动终端的屏幕上展示相应的VR空间场景。采用本技术方案，不同于传统的VR场景展示方式，用户在移动终端的屏幕中体验进入VR空间场景的过程，同时在屏幕中体验VR空间场景的视觉效果，增加VR场景展示的趣味性，增强用户的使用体验。According to the technical scheme of the present invention, the video picture collected by the camera of the mobile terminal is obtained, and the video is played on the screen of the mobile terminal after adding a specified image element representing an entrance in the video picture; When an operation instruction is given at the entrance, the corresponding VR space scene is displayed on the screen of the mobile terminal according to the preset VR space model. With this technical solution, different from the traditional VR scene display method, the user experiences the process of entering the VR space scene on the screen of the mobile terminal, and at the same time experiences the visual effect of the VR space scene on the screen, which increases the fun of VR scene display and enhances User experience.
上述说明仅是本发明技术方案的概述，为了能够更清楚了解本发明的技术手段，而可依照说明书的内容予以实施，并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂，以下特举本发明的具体实施方式。The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.
附图说明Description of drawings
通过阅读下文优选实施方式的详细描述，各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的，而并不认为是对本发明的限制。而且在整个附图中，用相同的参考符号表示相同的部件。在附图中：Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:
图1示出了根据本发明一个实施例的虚拟现实VR场景的展示方法的流程示意图；FIG. 1 shows a schematic flow diagram of a method for displaying a virtual reality VR scene according to an embodiment of the present invention;
图2示出了根据本发明一个实施例的虚拟现实VR场景的展示装置结构程示意图；FIG. 2 shows a schematic structural diagram of a display device for a virtual reality VR scene according to an embodiment of the present invention;
图3示出了根据本发明一个实施例的电子设备的结构示意图；FIG. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present invention;
图4示出了根据本发明一个实施例的计算机可读存储介质的结构示意图；FIG. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention;
图5(a)示出了根据本发明一个实施例的视频画面中添加指定图像元素的展现效果的示意图；图5(b)示出了根据本发明一个实施例的接近指定图像元素的效果示意图；图5(c)示出了根据本发明一个实施例的进入入口后展示VR空间场景图像的效果示意图；图5(d)示出了根据本发明一个实施例的移动终端移动后展示的VR空间场景图像的效果示意图。Figure 5(a) shows a schematic diagram of the display effect of adding a specified image element in a video screen according to an embodiment of the present invention; Figure 5(b) shows a schematic diagram of the effect of approaching a specified image element according to an embodiment of the present invention ; Figure 5 (c) shows a schematic diagram of the effect of displaying a VR space scene image after entering the entrance according to an embodiment of the present invention; Figure 5 (d) shows a VR display after the mobile terminal moves according to an embodiment of the present invention Schematic diagram of the effect of the space scene image.
具体实施方式Detailed ways
下面将参照附图更详细地描述本公开的示例性实施例。虽然附图中显示了本公开的示例性实施例，然而应当理解，可以以各种形式实现本公开而不应被这里阐述的实施例所限制。相反，提供这些实施例是为了能够更透彻地理解本公开，并且能够将本公开的范围完整的传达给本领域的技术人员。Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.
图1示出了根据本发明一个实施例的虚拟现实VR场景的展示方法的流程示意图。如图1所示，该方法包括：Fig. 1 shows a schematic flowchart of a method for displaying a virtual reality VR scene according to an embodiment of the present invention. As shown in Figure 1, the method includes:
步骤S110，获取移动终端的摄像头采集的视频画面，在视频画面中添加表示入口的指定图像元素后在移动终端的屏幕上播放视频。In step S110, the video image captured by the camera of the mobile terminal is obtained, and a specified image element representing an entrance is added to the video image, and then the video is played on the screen of the mobile terminal.
在本实施例中，移动终端的摄像头会采集对应的真实场景的视频画面。为了进行VR场景的展示，需要获取摄像头采集的视频画面，在视频画面中添加表示入口的指定图像元素后，在移动终端的屏幕中播放的视频画面就是已经添加表示入口的指定图像元素。例如，移动终端拍摄办公室内的办公座位的场景，如果表示入口的指定图像元素是带有窗户的墙，将该带有窗户的墙添加在两个办公座位之间的空地上，则在移动终端的屏幕上播放时，显示的视频图像是两个办公座位，以及两个办公座位之间的带有窗户的墙。In this embodiment, the camera of the mobile terminal collects video images of corresponding real scenes. In order to display the VR scene, it is necessary to obtain the video picture captured by the camera. After adding the specified image element representing the entrance to the video picture, the video picture played on the screen of the mobile terminal is the specified image element representing the entrance added. For example, when a mobile terminal shoots a scene of office seats in an office, if the designated image element representing the entrance is a wall with windows, the wall with windows is added to the open space between two office seats, and the mobile terminal When played on the screen of , the displayed video image is two office seats, and a wall with a window between the two office seats.
步骤S120，当检测到进入视频中的指定图像元素表示的入口的操作指令时，根据预设的VR空间模型在移动终端的屏幕上展示相应的VR空间场景。Step S120, when an operation instruction to enter an entry represented by a specified image element in the video is detected, a corresponding VR space scene is displayed on the screen of the mobile terminal according to a preset VR space model.
当用户想要进入指定图像元素表示的入口时，会触发相应的操作指令，然后移动终端的屏幕上回切换到相应的VR空间场景，则用户感知的效果即是，进入指定图像元素表示的入口后，看到的是另一番景象。在上一个例子中，移动终端的屏幕上有两个办公座位，以及两个办公座位之间的带有窗户的墙。当用户探出墙上的窗户时，移动终端的屏幕上会显示森林的场景，在用户的感知是，窗户外面是森林。When the user wants to enter the entrance represented by the specified image element, the corresponding operation command will be triggered, and then the screen of the mobile terminal will switch back to the corresponding VR space scene, and the effect perceived by the user is to enter the entrance represented by the specified image element After that, what I saw was another scene. In the previous example, there are two office seats on the screen of the mobile terminal, and a wall with a window between the two office seats. When the user leans out of the window on the wall, a forest scene will be displayed on the screen of the mobile terminal, and the user perceives that there is a forest outside the window.
可见，采用本技术方案，不同于传统的VR场景展示方式，用户在移动终端的屏幕中体验进入VR空间场景的过程，同时在屏幕中体验VR空间场景的视觉效果，增加VR场景展示的趣味性，增强用户的使用体验。It can be seen that the adoption of this technical solution is different from the traditional VR scene display method. The user experiences the process of entering the VR space scene on the screen of the mobile terminal, and at the same time experiences the visual effect of the VR space scene on the screen, increasing the interest of the VR scene display. , to enhance the user experience.
在本发明的一个实施例中，在步骤S110中的在视频画面中添加表示入口的指定图像元素之前，该方法还包括：检测视频画面中的表示平面的图像元素。In one embodiment of the present invention, before adding the specified image element representing the entrance in the video frame in step S110, the method further includes: detecting the image element representing the plane in the video frame.
则步骤S110中的在视频画面中添加表示入口的指定图像元素包括：在视频画面中的表示平面的图像元素上添加表示入口的指定图像元素。Then in step S110, adding the specified image element representing the entrance to the video picture includes: adding the specified image element representing the entrance to the image element representing the plane in the video picture.
为了保证视频图像的展示效果，即保证指定图像元素的添加的自然，不突兀。在添加指定图像元素之前，先检测获取到的视频图像中是否包含表示平面的元素，例如，一定面积的墙面或者一定面积的地面。在表示平面的图像元素上添加指定图像元素后，不影响用户对视频图像其他图像元素的浏览，对于用户的感知则是，在平面上多出来一个表示入口的指定图像元素，保证用户对视频的浏览的同时，引起用户的好奇心，引导用户查看相应的VR空间场景，进一步增强用户的使用体验。In order to ensure the display effect of video images, that is to ensure that the addition of specified image elements is natural and not obtrusive. Before adding the specified image element, it is first detected whether the obtained video image contains an element representing a plane, for example, a wall of a certain area or a ground of a certain area. After adding the specified image element to the image element representing the plane, it will not affect the user's browsing of other image elements in the video image. For the user's perception, there is an additional designated image element representing the entrance on the plane to ensure the user's viewing of the video. While browsing, arouse the user's curiosity, guide the user to view the corresponding VR space scene, and further enhance the user experience.
在上个例子中，检测到摄像头获取的视频图像中两个办公座位之间有一定面积的地面，则在两个办公座位之间的地面上添加带有窗户的墙面，而并非是在办公座位处添加。In the previous example, it is detected that there is a certain area of ground between two office seats in the video image captured by the camera, and a wall with windows is added on the ground between the two office seats instead of in the office. Seats are added.
再例如，摄像头采集的视频图像是用户家中的场景，检测到视频图像中包含一定面积的墙面，则可以在该墙面出添加一个门。或者，检测到视频图像中包含一定面积的阳台地面，则可以在该阳台的地面上添加一个山洞的洞口。For another example, the video image collected by the camera is a scene in the user's home, and if a wall of a certain area is detected in the video image, a door may be added to the wall. Alternatively, if it is detected that the video image contains a certain area of balcony ground, an opening of a cave may be added to the balcony ground.
图1所示的方法中的指定图像元素可以是任意表示入口的图像元素，在本发明的一个优选地实施例中，图1所示的方法中的指定图像元素为如下中的任意一种：门；洞口。The designated image element in the method shown in Figure 1 can be any image element representing the entrance, and in a preferred embodiment of the present invention, the designated image element in the method shown in Figure 1 is any of the following: door; opening.
在本发明的一个实施例中，步骤S110中的在视频画面中添加表示入口的指定图像元素包括：采用VR技术在视频画面中添加具有VR视觉效果的表示入口的指定图像元素。In one embodiment of the present invention, adding a designated image element representing an entrance in the video picture in step S110 includes: adding a designated image element representing an entrance with a VR visual effect in the video picture using VR technology.
在本实施例中，为了保证添加的指定图像元素的真实性，采用VR技术，添加具有VR视觉效果的表示入口的指定图像元素。例如，指定图像元素是门，如果仅仅添加一个门的图片，则降低用户的视觉效果，如果采用VR技术，添加具有VR视觉效果的门，即该添加的门是具有一定的大小和形状的，用户可以从不同的角度浏览，而并非是一个图片，保证用户具有良好的视觉效果。In this embodiment, in order to ensure the authenticity of the added designated image elements, VR technology is used to add designated image elements representing entrances with VR visual effects. For example, if you specify that the image element is a door, if you only add a picture of a door, the user's visual effect will be reduced. If you use VR technology, add a door with VR visual effects, that is, the added door has a certain size and shape. Users can browse from different angles, rather than a picture, to ensure that users have a good visual effect.
在本发明的一个实施例中，检测到进入指定图像元素表示的入口的操作指令包括：检测移动终端的移动信息，当根据移动终端的移动信息确定视频的显示效果是用户不断接近入口并进入入口时，确定检测到操作指令。In one embodiment of the present invention, detecting the operation instruction of entering the entrance indicated by the specified image element includes: detecting the movement information of the mobile terminal, when it is determined according to the movement information of the mobile terminal that the display effect of the video is that the user keeps approaching the entrance and enters the entrance , it is determined that an operation instruction is detected.
在本实施例中，根据移动终端的移动传感器检测移动终端的移动信息，当确定用户是不断地走向指定图像元素，并且通过了指定图像元素表示的入口，则说明用户已经进入该入口中，则应该向用户展示进入入口后的VR空间场景，那么此时就确定是检测到进入入口的操作指令。In this embodiment, according to the movement information of the mobile terminal detected by the mobile sensor of the mobile terminal, when it is determined that the user is constantly walking towards the specified image element and passing through the entrance indicated by the specified image element, it means that the user has entered the entrance, then The VR space scene after entering the entrance should be shown to the user, so at this time, it is determined that the operation command to enter the entrance is detected.
例如，在前述的例子中，移动终端的屏幕中展示的是两个办公座位和带有窗户的墙面，当用户拿着移动终端走到墙面处，并将移动终端伸出墙面时，确定检测到进入的操作指令，则移动终端的屏幕的显示就切换到森林的场景。For example, in the foregoing example, two office seats and a wall with windows are displayed on the screen of the mobile terminal. When the user walks to the wall with the mobile terminal and extends the mobile terminal out of the wall, If it is determined that the incoming operation instruction is detected, the display of the screen of the mobile terminal is switched to a forest scene.
在本发明的一个实施例中，在移动终端的屏幕上展示相应的VR空间场景之后，图1所示的方法进一步包括：检测移动终端的移动信息；根据移动终端的移动信息进行计算，在移动终端的屏幕上展现VR空间场景中的与计算结果对应的场景画面。In one embodiment of the present invention, after displaying the corresponding VR space scene on the screen of the mobile terminal, the method shown in FIG. 1 further includes: detecting the movement information of the mobile terminal; A scene picture corresponding to the calculation result in the VR space scene is displayed on the screen of the terminal.
当用户进入入口后，可以从移动终端的屏幕上浏览VR空间中的场景。在本实施例中，为了便于用户可以通过移动移动终端来浏览VR空间场景中不同方向上的场景画面。例如，用户向左移动了移动终端1米，则根据移动终端的移动信息，计算到移动终端左移了1米，将移动终端屏幕当前展现的场景画面左侧1米处的场景画面展现出来。After entering the entrance, the user can browse the scene in the VR space from the screen of the mobile terminal. In this embodiment, for the convenience of the user, the mobile terminal can browse scene pictures in different directions in the VR space scene. For example, if the user moves the mobile terminal 1 meter to the left, then according to the movement information of the mobile terminal, it is calculated that the mobile terminal has moved 1 meter to the left, and the scene picture at the left side of the scene picture currently displayed on the screen of the mobile terminal is displayed 1 meter away.
在本发明的一个实施例中，在移动终端的屏幕上展示相应的VR空间场景之后，图1所示的方法进一步包括：加载指定的音乐。In one embodiment of the present invention, after displaying the corresponding VR space scene on the screen of the mobile terminal, the method shown in FIG. 1 further includes: loading specified music.
在本实施例中，当移动终端的屏幕上展示相应的VR空间场景的同时，播放加载的指定音乐，进一步增强用户的使用体验。In this embodiment, when the corresponding VR space scene is displayed on the screen of the mobile terminal, the loaded specified music is played to further enhance user experience.
在一个具体的例子中，图5(a)示出了根据本发明一个实施例的视频画面中添加指定图像元素的展现效果的示意图；图5(b)示出了根据本发明一个实施例的接近指定图像元素的效果示意图；图5(c)示出了根据本发明一个实施例的进入入口后展示VR空间场景图像的效果示意图；图5(d)示出了根据本发明一个实施例的移动终端移动后展示的VR空间场景图像的效果示意图。如图5(a)-图5(d)所示，移动终端的摄像头采集的是一个办公室过道的视频画面，检测该视频画面中有表示平面的地面，在地面上添加一个表示入口的门510，将添加门510的视频画面展现在移动终端的屏幕上，如图5(a)。用户看到的移动终端屏幕中展现的视频画面中出现门510时，拿着移动终端向门510靠近，用户从屏幕上会看到自己离门510越来越近，如图5(b)，当用户拿着移动终端从门510穿过时(即移动终端从门510穿过时)，表示用户已经进入门510中，在移动终端的屏幕上展示相应的月球表面的场景图像，如图5(c)。在本例中，用户进入门510后，虽然摄像头对着的仍然是办公室内的场景，但是屏幕中展现的是月球表面的场景图像，，如图5(c)。当用户在原地向左转动移动终端，移动终端的屏幕上会展现用户进入门510时的左侧的从月球看到地球的场景图像，如图5(d)。当用户向前移动移动终端，则场景图像中的地球会随之变大，变大的程度是根据移动终端向前移动的距离计算的。In a specific example, Fig. 5(a) shows a schematic diagram of the display effect of adding specified image elements in a video screen according to an embodiment of the present invention; A schematic diagram of the effect of approaching a specified image element; Fig. 5(c) shows a schematic diagram of the effect of displaying a VR space scene image after entering the entrance according to an embodiment of the present invention; Fig. 5(d) shows a schematic diagram of the effect according to an embodiment of the present invention A schematic diagram of the effect of the VR space scene image displayed after the mobile terminal moves. As shown in Figure 5(a)-Figure 5(d), the camera of the mobile terminal collects a video picture of an office aisle, detects that there is a ground representing a plane in the video picture, and adds a door 510 representing an entrance on the ground , and display the video picture of adding the door 510 on the screen of the mobile terminal, as shown in FIG. 5(a). When the door 510 appears in the video picture displayed on the screen of the mobile terminal that the user sees, the user holds the mobile terminal and approaches the door 510, and the user will see from the screen that he is getting closer and closer to the door 510, as shown in Figure 5(b). When the user passes through the door 510 with the mobile terminal (that is, when the mobile terminal passes through the door 510), it means that the user has entered the door 510, and the corresponding scene image of the lunar surface is displayed on the screen of the mobile terminal, as shown in Figure 5(c ). In this example, after the user enters the door 510, although the camera is still facing the scene in the office, the scene image on the surface of the moon is displayed on the screen, as shown in Figure 5(c). When the user turns the mobile terminal to the left on the spot, the screen of the mobile terminal will show the scene image of the earth from the moon on the left side when the user enters the door 510, as shown in FIG. 5(d). When the user moves the mobile terminal forward, the earth in the scene image will become larger accordingly, and the degree of enlargement is calculated according to the distance that the mobile terminal moves forward.
图2示出了根据本发明一个实施例的虚拟现实VR场景的展示装置结构程示意图。如图2所示，该虚拟现实VR场景的展示装置200包括：Fig. 2 shows a schematic structural diagram of a display device for a virtual reality VR scene according to an embodiment of the present invention. As shown in Figure 2, the display device 200 of the virtual reality VR scene includes:
入口添加单元210，适于获取移动终端的摄像头采集的视频画面，在视频画面中添加表示入口的指定图像元素后在移动终端的屏幕上播放视频。The entry adding unit 210 is adapted to acquire a video image captured by the camera of the mobile terminal, add a specified image element representing the entry to the video image, and then play the video on the screen of the mobile terminal.
在本实施例中，移动终端的摄像头会采集对应的真实场景的视频画面。为了进行VR场景的展示，需要获取摄像头采集的视频画面，在视频画面中添加表示入口的指定图像元素后，在移动终端的屏幕中播放的视频画面就是已经添加表示入口的指定图像元素。例如，移动终端拍摄办公室内的办公座位的场景，如果表示入口的指定图像元素是带有窗户的墙，将该带有窗户的墙添加在两个办公座位之间的空地上，则在移动终端的屏幕上播放时，显示的视频图像是两个办公座位，以及两个办公座位之间的带有窗户的墙。In this embodiment, the camera of the mobile terminal collects video images of corresponding real scenes. In order to display the VR scene, it is necessary to obtain the video picture captured by the camera. After adding the specified image element representing the entrance to the video picture, the video picture played on the screen of the mobile terminal is the specified image element representing the entrance added. For example, when a mobile terminal shoots a scene of office seats in an office, if the designated image element representing the entrance is a wall with windows, the wall with windows is added to the open space between two office seats, and the mobile terminal When played on the screen of , the displayed video image is two office seats, and a wall with a window between the two office seats.
VR场景切换单元220，适于当检测到进入视频中的指定图像元素表示的入口的操作指令时，根据预设的VR空间模型在移动终端的屏幕上展示相应的VR空间场景。The VR scene switching unit 220 is adapted to display a corresponding VR space scene on the screen of the mobile terminal according to a preset VR space model when an operation instruction for entering an entry represented by a specified image element in the video is detected.
当用户想要进入指定图像元素表示的入口时，会触发相应的操作指令，然后移动终端的屏幕上回切换到相应的VR空间场景，则用户感知的效果即是，进入指定图像元素表示的入口后，看到的是另一番景象。在上一个例子中，移动终端的屏幕上有两个办公座位，以及两个办公座位之间的带有窗户的墙。当用户探出墙上的窗户时，移动终端的屏幕上会显示森林的场景，在用户的感知是，窗户外面是森林。When the user wants to enter the entrance represented by the specified image element, the corresponding operation command will be triggered, and then the screen of the mobile terminal will switch back to the corresponding VR space scene, and the effect perceived by the user is to enter the entrance represented by the specified image element After that, what I saw was another scene. In the previous example, there are two office seats on the screen of the mobile terminal, and a wall with a window between the two office seats. When the user leans out of the window on the wall, a forest scene will be displayed on the screen of the mobile terminal, and the user perceives that there is a forest outside the window.
可见，采用本技术方案，不同于传统的VR场景展示方式，用户在移动终端的屏幕中体验进入VR空间场景的过程，同时在屏幕中体验VR空间场景的视觉效果，增加VR场景展示的趣味性，增强用户的使用体验。It can be seen that the adoption of this technical solution is different from the traditional VR scene display method. The user experiences the process of entering the VR space scene on the screen of the mobile terminal, and at the same time experiences the visual effect of the VR space scene on the screen, increasing the interest of the VR scene display. , to enhance the user experience.
在本发明的一个实施例中，入口添加单元210，在视频画面中添加表示入口的指定图像元素之前，还适于检测视频画面中的表示平面的图像元素，在视频画面中的表示平面的图像元素上添加表示入口的指定图像元素。In one embodiment of the present invention, the entry adding unit 210 is further adapted to detect the image element representing the plane in the video picture before adding the specified image element representing the entry in the video picture, and the image representing the plane in the video picture Adds the specified image element representing the entry to the element.
为了保证视频图像的展示效果，即保证指定图像元素的添加的自然，不突兀。在添加指定图像元素之前，先检测获取到的视频图像中是否包含表示平面的元素，例如，一定面积的墙面或者一定面积的地面。在表示平面的图像元素上添加指定图像元素后，不影响用户对视频图像其他图像元素的浏览，对于用户的感知则是，在平面上多出来一个表示入口的指定图像元素，保证用户对视频的浏览的同时，引起用户的好奇心，引导用户查看相应的VR空间场景，进一步增强用户的使用体验。In order to ensure the display effect of video images, that is to ensure that the addition of specified image elements is natural and not obtrusive. Before adding the specified image element, it is first detected whether the obtained video image contains an element representing a plane, for example, a wall of a certain area or a ground of a certain area. After adding the specified image element to the image element representing the plane, it will not affect the user's browsing of other image elements in the video image. For the user's perception, there is an additional designated image element representing the entrance on the plane to ensure the user's viewing of the video. While browsing, arouse the user's curiosity, guide the user to view the corresponding VR space scene, and further enhance the user experience.
在上个例子中，检测到摄像头获取的视频图像中两个办公座位之间有一定面积的地面，则在两个办公座位之间的地面上添加带有窗户的墙面，而并非是在办公座位处添加。In the previous example, it is detected that there is a certain area of ground between two office seats in the video image captured by the camera, and a wall with windows is added on the ground between the two office seats instead of in the office. Seats are added.
再例如，摄像头采集的视频图像是用户家中的场景，检测到视频图像中包含一定面积的墙面，则可以在该墙面出添加一个门。或者，检测到视频图像中包含一定面积的阳台地面，则可以在该阳台的地面上添加一个山洞的洞口。For another example, the video image collected by the camera is a scene in the user's home, and if a wall of a certain area is detected in the video image, a door may be added to the wall. Alternatively, if it is detected that the video image contains a certain area of balcony ground, an opening of a cave may be added to the balcony ground.
上述的指定图像元素可以是任意表示入口的图像元素，在本发明的一个优选地实施例中，指定图像元素为如下中的任意一种：门；洞口。The above designated image element may be any image element representing an entrance. In a preferred embodiment of the present invention, the designated image element is any one of the following: a door; an opening.
在本发明的一个实施例中，入口添加单元210，适于采用VR技术在视频画面中添加具有VR视觉效果的表示入口的指定图像元素。In one embodiment of the present invention, the entry adding unit 210 is adapted to add a designated image element representing an entry with a VR visual effect in a video screen by using VR technology.
在本实施例中，为了保证添加的指定图像元素的真实性，采用VR技术，添加具有VR视觉效果的表示入口的指定图像元素。例如，指定图像元素是门，如果仅仅添加一个门的图片，则降低用户的视觉效果，如果采用VR技术，添加具有VR视觉效果的门，即该添加的门是具有一定的大小和形状的，用户可以从不同的角度浏览，而并非是一个图片，保证用户具有良好的视觉效果。In this embodiment, in order to ensure the authenticity of the added designated image elements, VR technology is used to add designated image elements representing entrances with VR visual effects. For example, if you specify that the image element is a door, if you only add a picture of a door, the user's visual effect will be reduced. If you use VR technology, add a door with VR visual effects, that is, the added door has a certain size and shape. Users can browse from different angles, rather than a picture, to ensure that users have a good visual effect.
在本发明的一个实施例中，VR场景切换单元220，适于检测移动终端的移动信息，当根据移动终端的移动信息确定视频的显示效果是用户不断接近入口并进入入口时，确定检测到操作指令。In one embodiment of the present invention, the VR scene switching unit 220 is adapted to detect the movement information of the mobile terminal, and when it is determined according to the movement information of the mobile terminal that the display effect of the video is that the user is constantly approaching the entrance and entering the entrance, it is determined that the operation is detected. instruction.
在本实施例中，根据移动终端的移动传感器检测移动终端的移动信息，当确定用户是不断地走向指定图像元素，并且通过了指定图像元素表示的入口，则说明用户已经进入该入口中，则应该向用户展示进入入口后的VR空间场景，那么此时就确定是检测到进入入口的操作指令。In this embodiment, according to the movement information of the mobile terminal detected by the mobile sensor of the mobile terminal, when it is determined that the user is constantly walking towards the specified image element and passing through the entrance indicated by the specified image element, it means that the user has entered the entrance, then The VR space scene after entering the entrance should be shown to the user, so at this time, it is determined that the operation command to enter the entrance is detected.
例如，在前述的例子中，移动终端的屏幕中展示的是两个办公座位和带有窗户的墙面，当用户拿着移动终端走到墙面处，并将移动终端伸出墙面时，确定检测到进入的操作指令，则移动终端的屏幕的显示就切换到森林的场景。For example, in the foregoing example, two office seats and a wall with windows are displayed on the screen of the mobile terminal. When the user walks to the wall with the mobile terminal and extends the mobile terminal out of the wall, If it is determined that the incoming operation instruction is detected, the display of the screen of the mobile terminal is switched to a forest scene.
在本发明的一个实施例中，VR场景切换单元220，在移动终端的屏幕上展示相应的VR空间场景之后，进一步适于检测移动终端的移动信息，根据移动终端的移动信息进行计算，在移动终端的屏幕上展现VR空间场景中的与计算结果对应的场景画面。In one embodiment of the present invention, after the VR scene switching unit 220 displays the corresponding VR space scene on the screen of the mobile terminal, it is further adapted to detect the movement information of the mobile terminal, and calculate according to the movement information of the mobile terminal. A scene picture corresponding to the calculation result in the VR space scene is displayed on the screen of the terminal.
当用户进入入口后，可以从移动终端的屏幕上浏览VR空间中的场景。在本实施例中，为了便于用户可以通过移动移动终端来浏览VR空间场景中不同方向上的场景画面。例如，用户向左移动了移动终端1米，则根据移动终端的移动信息，计算到移动终端左移了1米，将移动终端屏幕当前展现的场景画面左侧1米处的场景画面展现出来。After entering the entrance, the user can browse the scene in the VR space from the screen of the mobile terminal. In this embodiment, for the convenience of the user, the mobile terminal can browse scene pictures in different directions in the VR space scene. For example, if the user moves the mobile terminal 1 meter to the left, then according to the movement information of the mobile terminal, it is calculated that the mobile terminal has moved 1 meter to the left, and the scene picture at the left side of the scene picture currently displayed on the screen of the mobile terminal is displayed 1 meter away.
在本发明的一个实施例中，VR场景切换单元220，在移动终端的屏幕上展示相应的VR空间场景之后，进一步适于加载指定的音乐。In one embodiment of the present invention, the VR scene switching unit 220 is further adapted to load specified music after displaying the corresponding VR space scene on the screen of the mobile terminal.
在本实施例中，当移动终端的屏幕上展示相应的VR空间场景的同时，播放加载的指定音乐，进一步增强用户的使用体验。In this embodiment, when the corresponding VR space scene is displayed on the screen of the mobile terminal, the loaded specified music is played to further enhance user experience.
在一个具体的例子中，图5(a)示出了根据本发明一个实施例的视频画面中添加指定图像元素的展现效果的示意图；图5(b)示出了根据本发明一个实施例的接近指定图像元素的效果示意图；图5(c)示出了根据本发明一个实施例的进入入口后展示VR空间场景图像的效果示意图；图5(d)示出了根据本发明一个实施例的移动终端移动后展示的VR空间场景图像的效果示意图。如图5(a)-图5(d)所示，移动终端的摄像头采集的是一个办公室过道的视频画面，检测该视频画面中有表示平面的地面，在地面上添加一个表示入口的门510，将添加门510的视频画面展现在移动终端的屏幕上，如图5(a)。用户看到的移动终端屏幕中展现的视频画面中出现门510时，拿着移动终端向门510靠近，用户从屏幕上会看到自己离门510越来越近，如图5(b)，当用户拿着移动终端从门510穿过时(即移动终端从门510穿过时)，表示用户已经进入门510中，在移动终端的屏幕上展示相应的月球表面的场景图像，如图5(c)。在本例中，用户进入门510后，虽然摄像头对着的仍然是办公室内的场景，但是屏幕中展现的是月球表面的场景图像，，如图5(c)。当用户在原地向左转动移动终端，移动终端的屏幕上会展现用户进入门510时的左侧的从月球看到地球的场景图像，如图5(d)。当用户向前移动移动终端，则场景图像中的地球会随之变大，变大的程度是根据移动终端向前移动的距离计算的。In a specific example, Fig. 5(a) shows a schematic diagram of the display effect of adding specified image elements in a video screen according to an embodiment of the present invention; A schematic diagram of the effect of approaching a specified image element; Fig. 5(c) shows a schematic diagram of the effect of displaying a VR space scene image after entering the entrance according to an embodiment of the present invention; Fig. 5(d) shows a schematic diagram of the effect according to an embodiment of the present invention A schematic diagram of the effect of the VR space scene image displayed after the mobile terminal moves. As shown in Figure 5(a)-Figure 5(d), the camera of the mobile terminal collects a video picture of an office aisle, detects that there is a ground representing a plane in the video picture, and adds a door 510 representing an entrance on the ground , and display the video picture of adding the door 510 on the screen of the mobile terminal, as shown in FIG. 5(a). When the door 510 appears in the video picture displayed on the screen of the mobile terminal that the user sees, the user holds the mobile terminal and approaches the door 510, and the user will see from the screen that he is getting closer and closer to the door 510, as shown in Figure 5(b). When the user passes through the door 510 with the mobile terminal (that is, when the mobile terminal passes through the door 510), it means that the user has entered the door 510, and the corresponding scene image of the lunar surface is displayed on the screen of the mobile terminal, as shown in Figure 5(c ). In this example, after the user enters the door 510, although the camera is still facing the scene in the office, the scene image on the surface of the moon is displayed on the screen, as shown in Figure 5(c). When the user turns the mobile terminal to the left on the spot, the screen of the mobile terminal will show the scene image of the earth from the moon on the left side when the user enters the door 510, as shown in FIG. 5(d). When the user moves the mobile terminal forward, the earth in the scene image will become larger accordingly, and the degree of enlargement is calculated according to the distance that the mobile terminal moves forward.
本发明还提供了一种电子设备，其中，该电子设备包括：The present invention also provides an electronic device, wherein the electronic device includes:
处理器；以及processor; and
被安排成存储计算机可执行指令的存储器，可执行指令在被执行时使处理器执行根据图1所示的及其各实施例中的虚拟现实VR场景的展示方法。A memory arranged to store computer-executable instructions that, when executed, cause the processor to execute the method for presenting a virtual reality VR scene according to the embodiment shown in FIG. 1 .
图3示出了根据本发明一个实施例的电子设备的功能结构示意图。如图3所示，该电子设备300包括：Fig. 3 shows a schematic diagram of the functional structure of an electronic device according to an embodiment of the present invention. As shown in Figure 3, the electronic device 300 includes:
处理器310；以及被安排成存储计算机可执行指令(程序代码)的存储器320，在存储器320中，有存储程序代码的存储空间330，用于执行根据本发明的方法步骤的程序代码340存储在存储空间330中，该程序代码在被执行时使处理器310执行根据图1所示的及其各实施例中的虚拟现实VR场景的展示方法。processor 310; and a memory 320 arranged to store computer-executable instructions (program code), in the memory 320 there is a storage space 330 for storing a program code, the program code 340 for carrying out the steps of the method according to the invention is stored in In the storage space 330, when the program code is executed, the processor 310 executes the method for displaying a virtual reality VR scene according to the embodiment shown in FIG. 1 .
图4示出了根据本发明一个实施例的一种计算机可读存储介质的结构示意图。如图4所示，该计算机可读存储介质400存储一个或多个程序(程序代码)410，一个或多个程序(程序代码)410当被处理器执行时，实现图1所示的及其各实施例中的虚拟现实VR场景的展示方法。Fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention. As shown in FIG. 4 , the computer-readable storage medium 400 stores one or more programs (program codes) 410, and when the one or more programs (program codes) 410 are executed by the processor, it realizes the functions shown in FIG. The display method of the virtual reality VR scene in each embodiment.
需要说明的是，图3所示的电子设备和图4所示的计算机可读存储介质的各实施例与图1所示的方法的各实施例对应相同，上文已有详细说明，在此不再赘述。It should be noted that the embodiments of the electronic device shown in FIG. 3 and the computer-readable storage medium shown in FIG. 4 are the same as the embodiments of the method shown in FIG. 1 , which have been described in detail above, and here No longer.
综上所述，根据本发明的技术方案，获取移动终端的摄像头采集的视频画面，在视频画面中添加表示入口的指定图像元素后在移动终端的屏幕上播放视频；当检测到进入视频中的指定图像元素表示的入口的操作指令时，根据预设的VR空间模型在移动终端的屏幕上展示相应的VR空间场景。采用本技术方案，不同于传统的VR场景展示方式，用户在移动终端的屏幕中体验进入VR空间场景的过程，同时在屏幕中体验VR空间场景的视觉效果，增加VR场景展示的趣味性，增强用户的使用体验。In summary, according to the technical solution of the present invention, the video picture collected by the camera of the mobile terminal is obtained, and the video is played on the screen of the mobile terminal after adding a designated image element representing an entrance in the video picture; When specifying the operation instruction of the entrance represented by the image element, the corresponding VR space scene is displayed on the screen of the mobile terminal according to the preset VR space model. With this technical solution, different from the traditional VR scene display method, the user experiences the process of entering the VR space scene on the screen of the mobile terminal, and at the same time experiences the visual effect of the VR space scene on the screen, which increases the fun of VR scene display and enhances User experience.
需要说明的是：It should be noted:
在此提供的算法和显示不与任何特定计算机、虚拟装置或者其它设备固有相关。各种通用装置也可以与基于在此的示教一起使用。根据上面的描述，构造这类装置所要求的结构是显而易见的。此外，本发明也不针对任何特定编程语言。应当明白，可以利用各种编程语言实现在此描述的本发明的内容，并且上面对特定语言所做的描述是为了披露本发明的最佳实施方式。The algorithms and displays presented herein are not inherently related to any particular computer, virtual appliance, or other device. Various general purpose devices can also be used with the teachings based on this. The structure required to construct such an apparatus will be apparent from the foregoing description. Furthermore, the present invention is not specific to any particular programming language. It should be understood that various programming languages can be used to implement the content of the present invention described herein, and the above description of specific languages is for disclosing the best mode of the present invention.
在此处所提供的说明书中，说明了大量具体细节。然而，能够理解，本发明的实施例可以在没有这些具体细节的情况下实践。在一些实例中，并未详细示出公知的方法、结构和技术，以便不模糊对本说明书的理解。In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.
类似地，应当理解，为了精简本公开并帮助理解各个发明方面中的一个或多个，在上面对本发明的示例性实施例的描述中，本发明的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而，并不应将该公开的方法解释成反映如下意图：即所要求保护的本发明要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说，如下面的权利要求书所反映的那样，发明方面在于少于前面公开的单个实施例的所有特征。因此，遵循具体实施方式的权利要求书由此明确地并入该具体实施方式，其中每个权利要求本身都作为本发明的单独实施例。Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, in order to streamline this disclosure and to facilitate an understanding of one or more of the various inventive aspects, various features of the invention are sometimes grouped together in a single embodiment, figure, or its description. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.
本领域那些技术人员可以理解，可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件，以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外，可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述，本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。Those skilled in the art can understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. Modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore may be divided into a plurality of sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method or method so disclosed may be used in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
此外，本领域的技术人员能够理解，尽管在此所述的一些实施例包括其它实施例中所包括的某些特征而不是其它特征，但是不同实施例的特征的组合意味着处于本发明的范围之内并且形成不同的实施例。例如，在下面的权利要求书中，所要求保护的实施例的任意之一都可以以任意的组合方式来使用。Furthermore, those skilled in the art will understand that although some embodiments described herein include some features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of the invention. and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
本发明的各个部件实施例可以以硬件实现，或者以在一个或者多个处理器上运行的软件模块实现，或者以它们的组合实现。本领域的技术人员应当理解，可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本发明实施例的虚拟现实VR场景的展示装置、电子设备和计算机可读存储介质中的一些或者全部部件的一些或者全部功能。本发明还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如，计算机程序和计算机程序产品)。这样的实现本发明的程序可以存储在计算机可读介质上，或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到，或者在载体信号上提供，或者以任何其他形式提供。The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or a digital signal processor (DSP) can be used in practice to realize the display device, electronic equipment and computer-readable storage medium of a virtual reality VR scene according to an embodiment of the present invention. Some or all of the functions of some or all of the components. The present invention can also be implemented as an apparatus or an apparatus program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.
例如，图3示出了根据本发明一个实施例的电子设备的结构示意图。该电子设备300传统上包括处理器310和被安排成存储计算机可执行指令(程序代码)的存储器320。存储器320可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。存储器320具有存储用于执行图1所示的以及各实施例中的任何方法步骤的程序代码340的存储空间330。例如，用于程序代码的存储空间330可以包括分别用于实现上面的方法中的各种步骤的各个程序代码340。这些程序代码可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。这些计算机程序产品包括诸如硬盘，紧致盘(CD)、存储卡或者软盘之类的程序代码载体。这样的计算机程序产品通常为例如图4所述的计算机可读存储介质400。该计算机可读存储介质400可以具有与图3的电子设备中的存储器320类似布置的存储段、存储空间等。程序代码可以例如以适当形式进行压缩。通常，存储单元存储有用于执行根据本发明的方法步骤的程序代码410，即可以由诸如310之类的处理器读取的程序代码，当这些程序代码由电子设备运行时，导致该电子设备执行上面所描述的方法中的各个步骤。For example, FIG. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present invention. The electronic device 300 conventionally comprises a processor 310 and a memory 320 arranged to store computer-executable instructions (program code). Memory 320 may be electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. The memory 320 has a storage space 330 for storing program code 340 for executing any method steps shown in FIG. 1 and in various embodiments. For example, the storage space 330 for program codes may include respective program codes 340 for respectively implementing various steps in the above methods. These program codes can be read from or written into one or more computer program products. These computer program products comprise program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such a computer program product is typically, for example, the computer-readable storage medium 400 as described in FIG. 4 . The computer-readable storage medium 400 may have storage segments, storage spaces, etc. arranged similarly to the memory 320 in the electronic device of FIG. 3 . The program code can eg be compressed in a suitable form. Typically, the memory unit stores program code 410 for performing the steps of the method according to the invention, i.e. program code readable by a processor such as 310, which when executed by the electronic device causes the electronic device to perform steps in the method described above.
应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制，并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中，不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中，这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.
本发明公开了A1、一种虚拟现实VR场景的展示方法，其中，该方法包括：The present invention discloses A1, a method for displaying a virtual reality VR scene, wherein the method includes:
获取移动终端的摄像头采集的视频画面，在所述视频画面中添加表示入口的指定图像元素后在移动终端的屏幕上播放所述视频；Obtain the video picture collected by the camera of the mobile terminal, add the specified image element representing the entrance to the video picture and play the video on the screen of the mobile terminal;
当检测到进入所述视频中的所述指定图像元素表示的入口的操作指令时，根据预设的VR空间模型在移动终端的屏幕上展示相应的VR空间场景。When an operation instruction to enter the entrance represented by the specified image element in the video is detected, a corresponding VR space scene is displayed on the screen of the mobile terminal according to a preset VR space model.
A2、如A1所述的方法，其中，在所述视频画面中添加表示入口的指定图像元素之前，该方法还包括：检测所述视频画面中的表示平面的图像元素；A2. The method as described in A1, wherein, before adding a specified image element representing an entrance in the video image, the method further includes: detecting an image element representing a plane in the video image;
所述在所述视频画面中添加表示入口的指定图像元素包括：在所述视频画面中的表示平面的图像元素上添加表示入口的指定图像元素。The adding a designated image element representing an entrance in the video picture includes: adding a designated image element representing an entrance to an image element representing a plane in the video picture.
A3、如A1所述的方法，其中，所述指定图像元素为如下中的任意一种：A3. The method as described in A1, wherein the specified image element is any one of the following:
门；Door;
洞口。hole.
A4、如A1所述的方法，其中，在所述视频画面中添加表示入口的指定图像元素包括：A4. The method as described in A1, wherein adding a designated image element representing an entrance in the video picture includes:
采用VR技术在所述视频画面中添加具有VR视觉效果的表示入口的指定图像元素。A specified image element representing an entrance with a VR visual effect is added to the video picture by adopting VR technology.
A5、如A4所述的方法，其中，所述检测到进入所述指定图像元素表示的入口的操作指令包括：A5. The method as described in A4, wherein the detection of the operation instruction entering the entry indicated by the specified image element includes:
检测移动终端的移动信息，当根据移动终端的移动信息确定所述视频的显示效果是用户不断接近所述入口并进入所述入口时，确定检测到所述操作指令。Detecting the movement information of the mobile terminal, when it is determined according to the movement information of the mobile terminal that the display effect of the video is that the user keeps approaching the entrance and entering the entrance, it is determined that the operation instruction is detected.
A6、如A1-A5中任一项所述的方法，其中，在移动终端的屏幕上展示相应的VR空间场景之后，该方法进一步包括：A6. The method according to any one of A1-A5, wherein, after displaying the corresponding VR space scene on the screen of the mobile terminal, the method further includes:
检测移动终端的移动信息；Detect the mobile information of the mobile terminal;
根据移动终端的移动信息进行计算，在移动终端的屏幕上展现所述VR空间场景中的与计算结果对应的场景画面。The calculation is performed according to the movement information of the mobile terminal, and the scene picture corresponding to the calculation result in the VR space scene is displayed on the screen of the mobile terminal.
本发明还公开了B7、一种虚拟现实VR场景的展示装置，其中，该装置包括：The present invention also discloses B7, a display device for a virtual reality VR scene, wherein the device includes:
入口添加单元，适于获取移动终端的摄像头采集的视频画面，在所述视频画面中添加表示入口的指定图像元素后在移动终端的屏幕上播放所述视频；The entrance adding unit is adapted to obtain the video picture captured by the camera of the mobile terminal, and play the video on the screen of the mobile terminal after adding a designated image element representing the entrance in the video picture;
VR场景切换单元，适于当检测到进入所述视频中的所述指定图像元素表示的入口的操作指令时，根据预设的VR空间模型在移动终端的屏幕上展示相应的VR空间场景。The VR scene switching unit is adapted to display the corresponding VR space scene on the screen of the mobile terminal according to the preset VR space model when an operation instruction to enter the entrance indicated by the specified image element in the video is detected.
B8、如B7所述的装置，其中，B8. The device as described in B7, wherein,
所述入口添加单元，在所述视频画面中添加表示入口的指定图像元素之前，还适于检测所述视频画面中的表示平面的图像元素，在所述视频画面中的表示平面的图像元素上添加表示入口的指定图像元素。The entry adding unit is further adapted to detect an image element representing a plane in the video picture before adding a designated image element representing an entry in the video picture, and on the image element representing a plane in the video picture Adds the specified image element representing the portal.
B9、如B7所述的装置，其中，所述指定图像元素为如下中的任意一种：B9. The device as described in B7, wherein the specified image element is any one of the following:
门；Door;
洞口。hole.
B10、如B7所述的装置，其中，B10. The device of B7, wherein,
所述入口添加单元，适于采用VR技术在所述视频画面中添加具有VR视觉效果的表示入口的指定图像元素。The entry adding unit is adapted to add a specified image element representing an entry with VR visual effect in the video picture by using VR technology.
B11、如B10所述的装置，其中，B11. The device as described in B10, wherein,
所述VR场景切换单元，适于检测移动终端的移动信息，当根据移动终端的移动信息确定所述视频的显示效果是用户不断接近所述入口并进入所述入口时，确定检测到所述操作指令。The VR scene switching unit is adapted to detect the movement information of the mobile terminal, and when it is determined according to the movement information of the mobile terminal that the display effect of the video is that the user keeps approaching the entrance and enters the entrance, it is determined that the operation is detected instruction.
B12、如B7-B11中任一项所述的装置，其中，B12. The device according to any one of B7-B11, wherein,
所述VR场景切换单元，在移动终端的屏幕上展示相应的VR空间场景之后，进一步适于检测移动终端的移动信息，根据移动终端的移动信息进行计算，在移动终端的屏幕上展现所述VR空间场景中的与计算结果对应的场景画面。The VR scene switching unit is further adapted to detect the movement information of the mobile terminal after displaying the corresponding VR space scene on the screen of the mobile terminal, calculate according to the movement information of the mobile terminal, and present the VR scene on the screen of the mobile terminal. The scene picture corresponding to the calculation result in the space scene.
本发明公开了C13、一种电子设备，其中，该电子设备包括：The present invention discloses C13, an electronic device, wherein the electronic device includes:
处理器；以及processor; and
存储计算机可执行指令的存储器；所述可执行指令在被执行时使所述处理器执行根据A1～A6中任一项所述的方法。A memory storing computer-executable instructions; said executable instructions, when executed, cause said processor to perform the method according to any one of A1-A6.
本发明公开了D14、一种计算机可读存储介质，其中，所述计算机可读存储介质存储一个或多个程序，所述一个或多个程序当被处理器执行时，实现A1～A6中任一项所述的方法。The present invention discloses D14, a computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by the processor, any of A1-A6 is realized. one of the methods described.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711284794.9ACN108089701A (en) | 2017-12-07 | 2017-12-07 | A kind of methods of exhibiting and device of Virtual Reality scene |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711284794.9ACN108089701A (en) | 2017-12-07 | 2017-12-07 | A kind of methods of exhibiting and device of Virtual Reality scene |
| Publication Number | Publication Date |
|---|---|
| CN108089701Atrue CN108089701A (en) | 2018-05-29 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711284794.9APendingCN108089701A (en) | 2017-12-07 | 2017-12-07 | A kind of methods of exhibiting and device of Virtual Reality scene |
| Country | Link |
|---|---|
| CN (1) | CN108089701A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108805989A (en)* | 2018-06-28 | 2018-11-13 | 百度在线网络技术（北京）有限公司 | Method, apparatus, storage medium and the terminal device that scene is passed through |
| CN109767481A (en)* | 2018-12-29 | 2019-05-17 | 北京诺亦腾科技有限公司 | A kind of VR method for changing scenes and device |
| CN111417008A (en)* | 2019-01-08 | 2020-07-14 | 诺基亚技术有限公司 | Method, apparatus and computer program product for virtual reality |
| CN113470191A (en)* | 2021-07-12 | 2021-10-01 | 武汉金运激光股份有限公司 | Interaction method based on block chain and NFC technology and IP derivative |
| CN113676753A (en)* | 2021-10-21 | 2021-11-19 | 北京拾音科技文化有限公司 | Method and device for displaying video in VR scene, electronic equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104718007A (en)* | 2012-10-04 | 2015-06-17 | 迪士尼企业公司 | Interactive objects for immersive environment |
| CN104937519A (en)* | 2013-01-13 | 2015-09-23 | 高通股份有限公司 | Apparatus and method for controlling augmented reality equipment |
| CN106227352A (en)* | 2016-07-28 | 2016-12-14 | 北京国承万通信息科技有限公司 | Virtual reality scenario rendering method and system |
| US9696553B2 (en)* | 2014-02-18 | 2017-07-04 | Merge Labs, Inc. | Soft head mounted display goggles for use with mobile computing devices |
| CN106937531A (en)* | 2014-06-14 | 2017-07-07 | 奇跃公司 | Method and system for generating virtual and augmented reality |
| CN106951316A (en)* | 2017-03-20 | 2017-07-14 | 北京奇虎科技有限公司 | Changing method, device and the virtual reality device of Virtualization Mode and Realistic model |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104718007A (en)* | 2012-10-04 | 2015-06-17 | 迪士尼企业公司 | Interactive objects for immersive environment |
| CN104937519A (en)* | 2013-01-13 | 2015-09-23 | 高通股份有限公司 | Apparatus and method for controlling augmented reality equipment |
| US9696553B2 (en)* | 2014-02-18 | 2017-07-04 | Merge Labs, Inc. | Soft head mounted display goggles for use with mobile computing devices |
| CN106937531A (en)* | 2014-06-14 | 2017-07-07 | 奇跃公司 | Method and system for generating virtual and augmented reality |
| CN106227352A (en)* | 2016-07-28 | 2016-12-14 | 北京国承万通信息科技有限公司 | Virtual reality scenario rendering method and system |
| CN106951316A (en)* | 2017-03-20 | 2017-07-14 | 北京奇虎科技有限公司 | Changing method, device and the virtual reality device of Virtualization Mode and Realistic model |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108805989A (en)* | 2018-06-28 | 2018-11-13 | 百度在线网络技术（北京）有限公司 | Method, apparatus, storage medium and the terminal device that scene is passed through |
| CN109767481A (en)* | 2018-12-29 | 2019-05-17 | 北京诺亦腾科技有限公司 | A kind of VR method for changing scenes and device |
| CN111417008A (en)* | 2019-01-08 | 2020-07-14 | 诺基亚技术有限公司 | Method, apparatus and computer program product for virtual reality |
| US11323683B2 (en) | 2019-01-08 | 2022-05-03 | Nokia Technologies Oy | Method, an apparatus and a computer program product for virtual reality |
| CN111417008B (en)* | 2019-01-08 | 2022-06-03 | 诺基亚技术有限公司 | Method, apparatus and computer readable medium for virtual reality |
| US11943421B2 (en) | 2019-01-08 | 2024-03-26 | Nokia Technologies Oy | Method, an apparatus and a computer program product for virtual reality |
| CN113470191A (en)* | 2021-07-12 | 2021-10-01 | 武汉金运激光股份有限公司 | Interaction method based on block chain and NFC technology and IP derivative |
| CN113676753A (en)* | 2021-10-21 | 2021-11-19 | 北京拾音科技文化有限公司 | Method and device for displaying video in VR scene, electronic equipment and storage medium |
| Publication | Publication Date | Title |
|---|---|---|
| KR102733855B1 (en) | Systems and methods for augmented reality scenes | |
| CN108089701A (en) | A kind of methods of exhibiting and device of Virtual Reality scene | |
| US20160321833A1 (en) | Method and apparatus for generating moving photograph based on moving effect | |
| US9626773B2 (en) | Augmented reality alteration detector | |
| US11836764B2 (en) | Media collection navigation with opt-out interstitial | |
| WO2018072652A1 (en) | Video processing method, video processing device, and storage medium | |
| US20150185825A1 (en) | Assigning a virtual user interface to a physical object | |
| CN109710206A (en) | Method, device, terminal and storage medium for displaying information | |
| US20170163958A1 (en) | Method and device for image rendering processing | |
| US10334222B2 (en) | Focus-based video loop switching | |
| CN108090491B (en) | Video recording method, device and computer readable storage medium | |
| EP3090423A1 (en) | Physical object discovery | |
| CN109154862B (en) | Apparatus, method and computer readable medium for processing virtual reality content | |
| JPWO2018142756A1 (en) | Information processing apparatus and information processing method | |
| WO2018000619A1 (en) | Data display method, device, electronic device and virtual reality device | |
| CN107295393B (en) | method and device for displaying additional media in media playing, computing equipment and computer-readable storage medium | |
| US20140324953A1 (en) | Terminal device and content displaying method thereof, server and controlling method thereof | |
| US11176752B1 (en) | Visualization of a three-dimensional (3D) model in augmented reality (AR) | |
| JP6730461B2 (en) | Information processing system and information processing apparatus | |
| US20170206692A1 (en) | Augmented reality alteration detector | |
| US20180277161A1 (en) | Accessing a Video Segment | |
| CN115527014A (en) | Information display method and electronic equipment | |
| CN108521578A (en) | A method for detecting areas that can be textured in a video and implementing textures in the video | |
| CN111652986B (en) | Stage effect presentation method and device, electronic equipment and storage medium | |
| CN108510433B (en) | Space display method and device and terminal |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20180529 |