技术领域technical field
本发明涉及画面交互处理领域，特别是涉及一种画面交互方法及摄像展示系统。The invention relates to the field of picture interaction processing, in particular to a picture interaction method and a camera display system.
背景技术Background technique
随着社会发展，人们对各种直播形式的兴趣越来越大，其中观看直播教学以及直播购物已经成为部分用户的每日刚需。With the development of society, people are more and more interested in various live broadcast forms, among which watching live teaching and live shopping have become the daily needs of some users.
主播们在进行直播教学或直播购物时，可以通过身边的显示终端对产品进行介绍或者对教学内容进行展示。但是显示终端往往只能展示静态内容或者预先设置好的动态内容，主播对于显示终端中展示内容不能进行交互控制或者需要通过鼠标或光标进行简单的交互控制，因此现有的直播显示终端的展示画面不能进行个性化的交互控制，展示效果单一。When anchors are conducting live teaching or live shopping, they can introduce products or display teaching content through the display terminals around them. However, the display terminal can only display static content or pre-set dynamic content. The anchor cannot interactively control the content displayed in the display terminal or needs to perform simple interactive control through the mouse or cursor. Therefore, the display screen of the existing live broadcast display terminal Personalized interactive control cannot be performed, and the display effect is single.
因此需要开发一种画面交互方法以及摄像展示系统以解决上述技术问题。Therefore, it is necessary to develop a screen interaction method and a camera display system to solve the above technical problems.
发明内容Contents of the invention
本发明实施例提供一种可进行个性化的交互控制且具有多样性的展示效果的画面交互方法以及摄像展示系统，以解决现有的画面交互方法中展示画面不能进行个性化的交互控制且展示效果单一的技术问题。Embodiments of the present invention provide a screen interaction method and camera display system that can perform personalized interactive control and have diverse display effects, so as to solve the problem that the display screen in the existing screen interaction method cannot perform personalized interactive control and display A technical problem with a single effect.
本发明实施例提供一种画面交互方法，用于终端用户与摄像展示系统进行交互，其特征在于，所述摄像展示系统包括显示屏、可见光摄像头、红外光摄像头以及至少一个红外发射指套，所述显示屏的显示内容包括所述可见光摄像头拍摄的终端用户画面、所述红外光摄像头拍摄的终端用户使用所述红外发射指套生成的终端用户指令动作、以及响应所述终端用户指令动作的元素展示画面；所述画面交互方法包括：An embodiment of the present invention provides a screen interaction method for an end user to interact with a camera display system, wherein the camera display system includes a display screen, a visible light camera, an infrared camera, and at least one infrared emitting fingertip. The display content of the display screen includes the terminal user's picture captured by the visible light camera, the terminal user's command action generated by the terminal user using the infrared emitting fingertip captured by the infrared camera, and elements responding to the terminal user's command action display screen; the screen interaction method includes:
基于所述终端用户指令动作，对所述元素展示画面中的展示元素进行控制操作；performing control operations on the display elements in the element display screen based on the instruction action of the terminal user;
将控制操作后的展示元素叠加在所述终端用户画面上，生成最终展示画面；以及superimposing the display elements after the control operation on the terminal user screen to generate a final display screen; and
对所述最终展示画面进行展示操作。A display operation is performed on the final display screen.
在本发明所述的画面交互方法中，如所述展示元素为展示物体，则所述对展示元素进行的控制操作包括平面平移操作、放大缩小操作、旋转操作以及形变操作；In the screen interaction method of the present invention, if the display element is a display object, the control operations performed on the display element include plane translation operations, zoom-in and zoom-out operations, rotation operations, and deformation operations;
如所述展示元素为展示视频，则所述对展示元素进行控制包括平面平移操作、放大缩小操作以及播放暂停操作。If the display element is a display video, the control of the display element includes plane translation operations, zoom-in and zoom-out operations, and playback and pause operations.
在本发明所述的画面交互方法中，所述显示屏的显示内容还包括多个控制操作选择按键的终端用户指令选择画面，所述画面交互方法还包括：In the screen interaction method of the present invention, the display content of the display screen also includes a plurality of terminal user instruction selection screens for controlling operation selection buttons, and the screen interaction method further includes:
基于所述终端用户在所述控制操作选择按键上的终端用户指令动作，确定所述控制操作的类型。The type of the control operation is determined based on the terminal user's instruction action on the control operation selection button by the terminal user.
在本发明所述的画面交互方法中，所述对展示元素进行放大缩小操作包括：In the screen interaction method described in the present invention, the zooming in and out operations on the display elements include:
设定所述展示元素的初始位以及展示位；Setting the initial position and display position of the display element;
设定所述展示元素的初始位预设展示尺寸；Set the initial position and default display size of the display element;
设定所述展示元素的展示位预设展示尺寸；所述展示位预设展示尺寸大于所述初始位预设展示尺寸；Setting the default display size of the display position of the display element; the default display size of the display position is larger than the default display size of the initial position;
基于中间位与所述初始位的距离以及中间位与所述展示位的距离，设定所述中间位的中间位预设展示尺寸，其中所述中间位预设展示尺寸大于所述初始位预设展示尺寸、且小于所述展示位预设展示尺寸。Based on the distance between the middle position and the initial position and the distance between the middle position and the display position, the preset display size of the middle position is set, wherein the preset display size of the middle position is larger than the preset display size of the initial position The display size is set and smaller than the preset display size of the display position.
在本发明所述的画面交互方法中，所述画面交互方法还包括：In the screen interaction method of the present invention, the screen interaction method further includes:
设置一指令动作响应空间，并在所述指令动作响应空间中设置展示元素，以形成响应所述终端用户指令动作的元素展示画面。An instruction action response space is set, and display elements are set in the instruction action response space to form an element display screen responding to the end user's instruction action.
在本发明所述的画面交互方法中，如元素展示画面的同一平面画面位置设置有多个展示元素，当所述终端用户对所述平面画面位置上的展示元素进行控制操作时，选取所述平面画面位置上的展示深度最大的展示元素或展示深度最小的展示元素。In the screen interaction method of the present invention, if multiple display elements are set at the same plane screen position of the element display screen, when the terminal user controls and operates the display elements on the plane screen position, select the The display element with the largest display depth or the display element with the smallest display depth at the position of the plane picture.
在本发明所述的画面交互方法中，如元素展示画面的同一平面画面位置设置有多个展示元素，当所述终端用户对所述平面画面位置上的展示元素进行控制操作时，多个所述展示元素围绕所述平面画面位置展开，以便终端用户对展示元素进行选择。In the screen interaction method of the present invention, if multiple display elements are set in the same plane screen position of the element display screen, when the terminal user controls and operates the display elements on the plane screen position, the multiple display elements The display elements are expanded around the position of the plane picture, so that the terminal user can select the display elements.
在本发明所述的画面交互方法中，所述画面交互方法还包括：In the screen interaction method of the present invention, the screen interaction method further includes:
将所述指令动作响应空间中的多个展示元素设置为展示元素组；Setting multiple display elements in the command action response space as a display element group;
所述基于所述终端用户指令动作，对元素展示画面中的展示元素进行控制操作包括：The controlling operation of the display elements in the element display screen based on the instruction action of the terminal user includes:
所述基于所述终端用户指令动作，对元素展示画面中的展示元素组中的所有展示元素同时进行控制操作。In the action based on the terminal user instruction, the control operation is performed on all the display elements in the display element group in the element display screen at the same time.
在本发明所述的画面交互方法中，所述显示终端系统包括两个红外发射指套；所述对展示元素进行形变操作具体为：In the screen interaction method of the present invention, the display terminal system includes two infrared emitting fingertips; the deformation operation of the display elements is specifically:
基于两个所述红外发射指套生成的终端用户指令动作的距离变化，对所述展示元素进行形变操作。Based on the distance change of the terminal user's command action generated by the two infrared emitting fingertips, the deformation operation is performed on the display element.
本发明实施例还提供一种摄像展示系统，用于与终端用户进行交互，其包括显示屏、可见光摄像头、红外光摄像头、至少一个红外发射指套以及画面处理芯片；An embodiment of the present invention also provides a camera display system for interacting with end users, which includes a display screen, a visible light camera, an infrared light camera, at least one infrared emitting fingertip, and a picture processing chip;
其中所述显示屏的显示内容包括所述可见光摄像头拍摄的终端用户画面、所示红外光摄像头拍摄的终端用户使用所述红外发射指套生成的终端用户指令动作、以及响应所述终端用户指令动作的元素展示画面；Wherein the display content of the display screen includes the end user's picture taken by the visible light camera, the end user's instruction action generated by the end user using the infrared emitting fingertip taken by the shown infrared camera, and the action in response to the end user's instruction element display screen;
所述画面处理芯片包括：The image processing chip includes:
展示元素控制操作模块，用于基于所述终端用户指令动作，对所述元素展示画面中的展示元素进行控制操作；A display element control operation module, configured to control and operate display elements in the element display screen based on the terminal user's command action;
最终展示画面生成模块，用于将控制操作后的展示元素叠加在所述终端用户画面上，生成最终展示画面；以及A final display screen generation module, configured to superimpose the display elements after the control operation on the terminal user screen to generate a final display screen; and
展示模块，用于在所述显示屏上对所述终端展示画面进行展示操作。The display module is configured to display the display screen of the terminal on the display screen.
本发明实施例还提供一种计算机存储介质，其内存储有处理器可执行指令，所述指令由一个或一个以上处理器加载，以执行上述画面交互方法。An embodiment of the present invention also provides a computer storage medium, which stores processor-executable instructions, and the instructions are loaded by one or more processors to execute the above screen interaction method.
相较于现有技术，本发明的画面交互方法及摄像展示系统通过红外摄像头来接收终端用户指令动作，使得终端用户可对元素展示画面中的展示元素进行个性化的交互控制，提升了画面展示效果的多样性；有效解决了现有的画面交互方法中展示画面不能进行个性化的交互控制且展示效果单一的技术问题。Compared with the prior art, the screen interaction method and camera display system of the present invention receive terminal user instruction actions through the infrared camera, so that the terminal user can perform personalized interactive control on the display elements in the element display screen, which improves the screen display The diversity of effects effectively solves the technical problem that in the existing screen interaction method, the display screen cannot be controlled individually and the display effect is single.
附图说明Description of drawings
图1为本发明的摄像展示系统的实施例的结构示意图；Fig. 1 is a schematic structural view of an embodiment of the camera display system of the present invention;
图2为本发明的画面交互方法中显示屏的显示内容的层级结构示意图；FIG. 2 is a schematic diagram of the hierarchical structure of the display content of the display screen in the screen interaction method of the present invention;
图3为本发明的画面交互方法中显示屏的显示内容的平面结构示意图；3 is a schematic plan view of the display content of the display screen in the screen interaction method of the present invention;
图4为本发明的画面交互方法的实施例的流程图；4 is a flowchart of an embodiment of the screen interaction method of the present invention;
图5为本发明的画面交互方法的实施例中对展示元素进行放大缩小操作的示意图；FIG. 5 is a schematic diagram of performing zoom-in and zoom-out operations on display elements in an embodiment of the screen interaction method of the present invention;
图6为本发明的画面交互方法的实施例中对展示元素进行选定操作的示意图之一；Fig. 6 is one of the schematic diagrams of selecting the display elements in the embodiment of the screen interaction method of the present invention;
图7a为本发明的画面交互方法的实施例中对展示元素进行选定操作的示意图之二；Fig. 7a is the second schematic diagram of selecting the display elements in the embodiment of the screen interaction method of the present invention;
图7b为本发明的画面交互方法的实施例中对展示元素进行选定操作的示意图之三；Fig. 7b is the third schematic diagram of selecting display elements in the embodiment of the screen interaction method of the present invention;
图8a-图8d为本发明的画面交互方法的实施例中对展示元素组进行控制操作的示意图；Fig. 8a-Fig. 8d are schematic diagrams of the control operation of the display element group in the embodiment of the screen interaction method of the present invention;
图9为本发明的摄像展示系统的实施例的结构框图；Fig. 9 is a structural block diagram of an embodiment of the camera display system of the present invention;
图10为本发明的画面交互方法所在的电子设备的工作环境结构示意图。FIG. 10 is a schematic diagram of the structure of the working environment of the electronic device where the screen interaction method of the present invention is located.
具体实施方式Detailed ways
请参照图式，其中相同的组件符号代表相同的组件，本发明的原理是以实施在一个适当的运算环境中来举例说明。以下的说明是基于所例示的本发明具体实施例，其不应被视为限制本发明未在此详述的其它具体实施例。Referring to the drawings, wherein like reference numerals represent like components, the principles of the present invention are exemplified when implemented in a suitable computing environment. The following description is based on illustrated specific embodiments of the invention, which should not be construed as limiting other specific embodiments of the invention not described in detail herein.
在以下的说明中，本发明的具体实施例将参考由一部或多部计算机所执行之作业的步骤及符号来说明，除非另有述明。因此，其将可了解到这些步骤及操作，其中有数次提到为由计算机执行，包括了由代表了以一结构化型式中的数据之电子信号的计算机处理单元所操纵。此操纵转换该数据或将其维持在该计算机之内存系统中的位置处，其可重新配置或另外以本领域技术人员所熟知的方式来改变该计算机之运作。该数据所维持的数据结构为该内存之实体位置，其具有由该数据格式所定义的特定特性。但是，本发明原理以上述文字来说明，其并不代表为一种限制，本领域技术人员将可了解到以下所述的多种步骤及操作亦可实施在硬件当中。In the following description, specific embodiments of the present invention are described with reference to steps and symbols for operations performed by one or more computers, unless otherwise stated. Accordingly, it will be understood that the steps and operations, which at times are referred to as being performed by a computer, include manipulation by a computer processing unit of electronic signals representing data in a structured form. This manipulation transforms the data or maintains it at a location in the computer's memory system that can reconfigure or otherwise alter the operation of the computer in a manner well known to those skilled in the art. The data structures maintained by the data are physical locations in the memory that have specific characteristics defined by the data format. However, the principles of the present invention are described in the above words, which are not meant to be a limitation. Those skilled in the art will understand that the various steps and operations described below can also be implemented in hardware.
本发明的画面交互方法可用于终端用户与摄像展示系统进行交互操作，该摄像展示系统可如图1所示，图1为本发明的画面交互方法可用的摄像展示系统的结构示意图。该摄像展示系统10包括显示屏11、可见光摄像头12、红外光摄像头13以及至少一个红外发射指套14。其中可见光摄像头12用于拍摄可见光下的终端用户画面；红外光摄像头13用于拍摄红外光下的终端用户指令动作；终端用户通过使用红外发射指套14来生成终端用户指令动作；显示屏11用于显示对应的显示内容。该显示内容包括可见光摄像头12拍摄的终端用户画面，红外光摄像头13拍摄的终端用户使用红外发射指套14生成的终端用户指令动作以及相应终端用户指令动作的元素展示画面。The screen interaction method of the present invention can be used for terminal users to interact with the camera display system. The camera display system can be shown in Figure 1, which is a schematic structural diagram of the camera display system available for the screen interaction method of the present invention. The camera display system 10 includes a display screen 11 , a visible light camera 12 , an infrared light camera 13 and at least one infrared emitting finger cuff 14 . Wherein the visible light camera 12 is used to photograph the end user's picture under visible light; the infrared camera 13 is used to photograph the terminal user's command action under the infrared light; the terminal user generates the terminal user's command action by using the infrared emitting finger cot 14; to display the corresponding display content. The display content includes the terminal user's picture captured by the visible light camera 12 , the terminal user's command action generated by the terminal user using the infrared emitting fingertip 14 captured by the infrared camera 13 , and the element display screen of the corresponding terminal user's command action.
该显示屏的显示内容可如图2和图3所示，其中图2为本发明的画面交互方法中显示屏的显示内容的层级结构示意图。图3为本发明的画面交互方法中显示屏的显示内容的平面结构示意图。The display content of the display screen can be shown in FIG. 2 and FIG. 3 , wherein FIG. 2 is a schematic diagram of the hierarchical structure of the display content of the display screen in the screen interaction method of the present invention. FIG. 3 is a schematic plan view of the display content of the display screen in the screen interaction method of the present invention.
如图2所示，可见光摄像头12拍摄的终端用户画面以及红外光摄像头13拍摄的终端用户指令动作均位于第一层级21中，终端用户指令动作控制的元素展示画面位于一指令动作响应空间22中，其中指令动作响应空间22可叠加在第一层级21上。通过设置指令动作响应空间22可在不同的终端用户画面位置以及不同的深度位置来设置展示元素231、232以及233，即不仅可以设置不同展示元素在元素展示画面33中的设置位置，还可通过设置深度位置来调整不同展示元素之间的遮挡关系。As shown in FIG. 2 , the end user images captured by the visible light camera 12 and the end user command actions captured by the infrared camera 13 are located in the first level 21, and the element display screens controlled by the terminal user command actions are located in a command action response space 22 , wherein the command action response space 22 can be superimposed on the first level 21 . By setting the instruction action response space 22, the display elements 231, 232, and 233 can be set at different end user screen positions and different depth positions, that is, not only the setting positions of different display elements in the element display screen 33 can be set, but also through Set the depth position to adjust the occlusion relationship between different display elements.
图3为指令动作响应空间22叠加在第一层级21上之后的平面结构展示示意图。该显示内容包括终端用户画面31、红外发射指套生成的终端用户指令动作32以及元素展示画面33。FIG. 3 is a schematic diagram showing the planar structure of the instruction action response space 22 superimposed on the first level 21 . The displayed content includes a terminal user screen 31 , a terminal user instruction action 32 generated by an infrared emitting fingertip, and an element display screen 33 .
其中终端用户指令动作32包括终端用户启动红外发射指套14发射红外光的触发动作以及终端用户中止红外发射指套14发射红外光的中止动作。终端用户可使用终端用户指令动作32来操作指令动作响应空间22中的展示元素231、232以及233，进而改变展示元素231、232以及233在元素展示画面33中的投影位置。The terminal user instruction action 32 includes a trigger action for the end user to start the infrared emitting fingertip 14 to emit infrared light and a stop action for the end user to stop the infrared emitting fingertip 14 from emitting infrared light. The end user can use the end user command action 32 to operate the display elements 231 , 232 and 233 in the command action response space 22 , and then change the projection positions of the display elements 231 , 232 and 233 in the element display screen 33 .
具体的，本发明中的红外发射指套14可为一手持式的红外光发射器，终端用户可通过手指动作执行启动发射红外光的触发动作或中止发射红外光的中止动作。Specifically, the infrared emitting finger cot 14 in the present invention can be a hand-held infrared light emitter, and the end user can perform a trigger action to start emitting infrared light or a stop action to stop emitting infrared light through finger movements.
请参照图4，图4为本发明的画面交互方法的实施例的流程图。本实施例的画面交互方法可在上述的摄像展示系统上执行，用于实现终端用户与摄像展示系统之间的交互操作。该画面交互方法包括：Please refer to FIG. 4 , which is a flow chart of an embodiment of the screen interaction method of the present invention. The screen interaction method of this embodiment can be executed on the above camera display system, and is used to realize the interactive operation between the terminal user and the camera display system. The screen interaction method includes:
步骤S401，基于终端用户指令动作，对元素展示画面中的展示元素进行控制操作；Step S401, based on the terminal user's instruction action, control and operate the display elements in the element display screen;
步骤S402，将控制操作后的展示元素叠加在终端用户画面上，生成最终展示画面；Step S402, superimposing the display elements after the control operation on the terminal user screen to generate a final display screen;
步骤S403，对最终展示画面进行展示操作。Step S403, performing a display operation on the final display screen.
下面详细说明本实施例的画面交互方法的各步骤的具体流程。The specific flow of each step of the screen interaction method of this embodiment will be described in detail below.
在步骤S401中，摄像展示系统会通过红外光摄像头拍摄到终端用户的终端用户指令动作。该终端用户使用该终端用户指令动作对元素展示画面或指令动作响应空间中的展示元素进行控制操作。In step S401, the camera display system captures the terminal user's instruction action of the terminal user through an infrared camera. The end user uses the end user command action to control and operate the element display screen or the display elements in the command action response space.
具体的，该展示元素可为展示物体或展示视频。当展示元素为展示物体时，终端用户指令动作对元素展示画面中的展示元素进行的控制操作包括平面平移操作、放大缩小操作、旋转操作以及形变操作。Specifically, the display element may be a display object or a display video. When the display element is a display object, the control operation performed by the terminal user command action on the display element in the element display screen includes plane translation operation, zoom in and out operation, rotation operation and deformation operation.
这里的平面平移操作是指对展示物体在显示屏的显示平面中进行移动的操作，比如将展示物体在显示平面中的上下左右方向进行移动等。放大缩小操作是指对展示物体在显示平面中的展示尺寸进行放大缩小的操作，比如将展示物体移动到显示平面中心进行放大操作以便于观察展示物体；或者将展示物体移动到显示平面的边缘进行缩小以便于在显示平面的边缘暂时存放展示物体。旋转操作是指对展示物体在显示平面中的显示角度进行调整，比如展示物体是一个地球仪的模型，通过旋转操作可对该地球仪的模型进行旋转使得任何一个终端用户想要展示的国家地理位置面向显示屏。形变操作是指对展示物体在显示平面中进行形变操作，比如展示物体是一个弹力球，通过形变操作可对该弹力球进行拉伸或压缩操作。The plane translation operation here refers to the operation of moving the display object in the display plane of the display screen, for example, moving the display object in up, down, left, and right directions on the display plane. The zoom-in operation refers to the operation of zooming in and out on the display size of the display object on the display plane, such as moving the display object to the center of the display plane for zooming in to facilitate observation of the display object; or moving the display object to the edge of the display plane Zoom out to temporarily store display objects at the edges of the display plane. The rotation operation refers to the adjustment of the display angle of the display object on the display plane. For example, the display object is a model of a globe. Through the rotation operation, the model of the globe can be rotated so that the geographic location of any country that the end user wants to display faces display screen. The deformation operation refers to the deformation operation on the display object in the display plane. For example, the display object is an elastic ball, and the elastic ball can be stretched or compressed through the deformation operation.
进一步的，终端用户还可一只手分别使用一个红外发射指套，这样终端用户可使用双手生成两个终端用户指令动作，这样显示终端系统可基于两个红外发射指套生成的终端用户指令动作的距离变化，对展示元素进行形变操作；例如两个红外发射指套生成的终端用户指令动作的距离变大时，对展示元素进行拉伸操作；如两个红外发射指套生成终端用户指令动作的距离变小时，对展示元素进行压缩操作等。Further, the end user can also use one infrared emitting finger cot for each hand, so that the end user can use both hands to generate two end user command actions, so that the display terminal system can generate end user command actions based on the two infrared emitting finger cots The distance of the display element changes, and the deformation operation is performed on the display element; for example, when the distance of the end user command action generated by two infrared emitting fingertips becomes larger, the display element is stretched; for example, two infrared emitting fingertips generate an end user command action When the distance becomes smaller, compress the display elements, etc.
当展示元素为展示视频时，终端用户指令动作对元素展示画面中的展示元素进行的控制操作包括平面平移操作、放大缩小操作以及播放暂停操作。When the display element is a display video, the control operations performed by the terminal user's command action on the display element in the element display screen include plane translation operations, zoom-in and zoom-out operations, and playback and pause operations.
这里的平面平移操作是指对展示视频在显示屏的显示平面中进行移动的操作，比如将展示视频在显示平面中的上下左右方向进行移动等。放大缩小操作是指对展示视频在显示平面中的展示尺寸进行放大缩小操作。播放暂停操作是指是指对触发展示视频进行播放或触发展示视频停止播放的操作。The plane translation operation here refers to the operation of moving the display video in the display plane of the display screen, for example, moving the display video in up, down, left, and right directions on the display plane. The zoom-in and zoom-out operations refer to zoom-in and zoom-out operations on the display size of the display video on the display plane. The playback and pause operation refers to the operation of playing the triggering display video or stopping the playback of the triggering display video.
为了实现终端用户对元素展示画面中的展示元素进行不同类型的控制操作，显示屏的显示内容还包括用于切换不同类型控制操作的终端用户指令选择画面34，终端用户指令选择画面34包括多个不同的控制操作选择按键，这样摄像展示系统可基于终端用户在控制操作选择按键上的终端用户指令动作，确定控制操作的类型。In order to allow end users to perform different types of control operations on the display elements in the element display screen, the display content of the display screen also includes an end user instruction selection screen 34 for switching between different types of control operations. The end user instruction selection screen 34 includes multiple Different control operation selection buttons, so that the camera display system can determine the type of control operation based on the end user's instruction action on the control operation selection button.
比如终端用户在终端用户指令选择画面34的控制操作选择按键341上执行触发动作，则随后终端用户通过红外发射指套对元素展示画面33中的展示元素的触发动作，可对相应的展示元素进行平面平移操作。如终端用户在终端用户指令选择画面34的控制操作选择按键342上执行触发动作，则随后终端用户通过红外发射指套对元素展示画面的展示元素的触发动作，可对相应的展示元素进行放大缩小操作操作。For example, the terminal user executes the trigger action on the control operation selection button 341 of the terminal user instruction selection screen 34, then the terminal user triggers the display element in the element display screen 33 through the infrared emission fingertip, and can perform corresponding display elements. Plane translation operation. If the end user executes the trigger action on the control operation selection button 342 of the end user instruction selection screen 34, then the end user can then trigger the display element of the element display screen through the infrared emission fingertip to zoom in and out of the corresponding display element Operation operation.
如元素展示画面33中的展示元素无法执行终端用户选择的控制操作选择按键对应的控制操作，如终端用户想对展示物体执行了播放暂停操作，而展示物体是无法执行播放暂停操作的，这时摄像展示系统可提示控制操作错误以便终端用户选择准确的控制操作选择按键。For example, the display element in the element display screen 33 cannot perform the control operation selected by the terminal user to select the control operation corresponding to the button, such as the terminal user wants to perform the playback pause operation on the display object, but the display object cannot perform the playback pause operation. At this time The camera display system can prompt control operation errors so that the end user can select the correct control operation selection button.
进一步的，如终端用户需要对展示元素进行放大缩小操作时，可如图5所示，图5为本发明的画面交互方法的实施例中对展示元素进行放大缩小操作的示意图。摄像展示系统可预先对展示元素（展示视频）的初始位51和展示位52进行设定，为了方便展示元素在初始位51处的暂时存放以及在展示位52处的有效展示，摄像展示系统可设定展示元素在初始位处的初始位预设展示尺寸以及在展示位处的展示位预设展示尺寸；这里展示位预设展示尺寸应大于初始位预设展示尺寸，以便展示元素可在展示位处进行有效展示。这样终端用户可通过对展示元素进行平面平移操作同步实现对展示元素的放大缩小操作，且放大缩小比例可精确控制，避免终端用户多次对展示元素进行平面平移操作以及放大缩小操作，且无法有效的对平面平移位置以及放大缩小比例进行精确控制。Further, if the terminal user needs to perform zoom-in and zoom-out operations on display elements, it can be shown in FIG. 5 , which is a schematic diagram of zoom-in and zoom-out operations on display elements in an embodiment of the screen interaction method of the present invention. The camera display system can pre-set the initial position 51 and the display position 52 of the display element (display video). In order to facilitate the temporary storage of the display element at the initial position 51 and the effective display at the display position 52, the camera display system can Set the default display size of the display element at the initial position and the default display size of the display position at the display position; here, the default display size of the display position should be larger than the default display size of the initial position, so that the display element can be displayed effective display. In this way, the end user can realize the zoom-in and zoom-out operation of the display elements synchronously by performing plane translation operations on the display elements, and the zoom-in ratio can be precisely controlled, preventing the end-user from performing plane translation operations and zoom-in operations on the display elements multiple times, and cannot be effective Precise control of plane translation position and zoom in and out ratio.
为了较好的实现展示元素从初始位到展示位的放大渐变效果，摄像展示系统可基于展示元素的初始位预设展示尺寸以及展示位预设展示尺寸来设定展示元素在任何中间位的中间位预设展示尺寸。具体的，摄像展示系统可基于中间位与初始位的距离以及中间位与展示位的距离，设定中间位的中间位预设展示尺寸，其中中间位预设展示尺寸应大于初始位预设展示尺寸、且小于展示位预设展示尺寸。中间位距离初始位越近，则对应的中间位预设展示尺寸越小，越接近初始位预设展示尺寸；中间位距离展示位越近，则对应的中间位预设展示尺寸越大，越接近展示位预设展示尺寸，从而有效的实现了展示元素从初始位到展示位的放大渐变效果。In order to better realize the magnification and gradient effect of the display element from the initial position to the display position, the camera display system can set the display element in the middle of any intermediate position based on the initial position preset display size of the display element and the preset display size of the display position default display size. Specifically, the camera display system can set the preset display size of the middle position based on the distance between the middle position and the initial position and the distance between the middle position and the display position, wherein the preset display size of the middle position should be larger than the default display size of the initial position Size, and smaller than the default display size of the display. The closer the middle position is to the initial position, the smaller the corresponding default display size of the middle position, and the closer to the default display size of the initial position; the closer the middle position is to the display position, the larger the corresponding default display size of the middle position, the closer The preset display size close to the display position effectively realizes the magnification and gradient effect of the display elements from the initial position to the display position.
进一步的，如在显示屏的显示平面同时设置有多个展示元素，终端用户可能需要基于需求对不同展示元素的遮挡关系进行调整，因此摄像展示系统可设置对元素展示画面的同一平面画面位置上所有展示元素的展示深度，以便实现不同展示元素的遮挡关系。Furthermore, if multiple display elements are set on the display plane of the display screen at the same time, the end user may need to adjust the occlusion relationship of different display elements based on requirements, so the camera display system can be set on the same plane screen position of the element display screen The display depth of all display elements in order to realize the occlusion relationship of different display elements.
具体的，如图2所示，如需要展示元素232需要遮挡展示元素231（如展示元素232与展示元素231位于同一平面画面位置时），摄像展示系统只需要设置展示元素232的深度（展示元素232与第一层级21的距离）大于展示元素231的深度（展示元素231与第一层级21的距离）。Specifically, as shown in FIG. 2, if the display element 232 needs to be blocked and the display element 231 is required (such as when the display element 232 and the display element 231 are located in the same plane picture position), the camera display system only needs to set the depth of the display element 232 (the display element 232 and the first level 21) is greater than the depth of the display element 231 (the distance between the display element 231 and the first level 21).
此外，如显示平面上多个展示元素相互遮挡时，如图6所示，图6为本发明的画面交互方法的实施例中对展示元素进行选定操作的示意图。其中元素展示画面的同一平面画面位置上设置有多个展示元素，比如图6中的展示元素61、展示元素62以及展示元素63，其中展示元素61的展示深度最大，展示元素63的展示深度最小。In addition, if multiple display elements on the display plane block each other, as shown in FIG. 6 , FIG. 6 is a schematic diagram of selecting display elements in an embodiment of the screen interaction method of the present invention. Among them, multiple display elements are set on the same plane screen position of the element display screen, such as display element 61, display element 62, and display element 63 in Figure 6, wherein the display depth of display element 61 is the largest, and the display depth of display element 63 is the smallest. .
摄像展示系统为了满足不同用户对展示元素的选定需求，可设定终端用户对平面画面位置上的展示元素进行控制操作时，选取平面画面位置上展示深度最大的展示元素，即选取展示元素61。这样终端用户可通过控制显示屏的重叠的多个展示元素中最顶部的展示元素，对展示元素进行平移操作，以呈现终端用户将展示元素从上到下依次平移出来的效果。In order to meet the selection requirements of different users for display elements, the camera display system can be set to select the display element with the largest display depth at the position of the plane screen when the end user controls the display elements on the position of the plane screen, that is, select the display element 61 . In this way, the terminal user can perform a translation operation on the display elements by controlling the topmost display element among the multiple overlapping display elements of the display screen, so as to present the effect that the terminal user pans the display elements from top to bottom in sequence.
摄像展示系统也可设定终端用户对平面画面位置上的展示元素进行控制时，选取平面画面位置上展示深度最小的展示元素，即选取展示元素63。这样终端用户可控制显示屏的重叠的多个展示元素中最底部的展示元素，对展示元素进行平移操作，以呈现终端用户对展示元素从下到上依次平移出来的效果。The camera display system can also be configured to select the display element with the smallest display depth at the position of the planar image when the end user controls the display elements at the position of the planar image, that is, select the display element 63 . In this way, the end user can control the bottommost display element among the multiple overlapping display elements of the display screen, and perform a translation operation on the display elements, so as to present the effect that the end user pans the display elements sequentially from bottom to top.
这里终端用户可通过设定不同终端用户指令动作分别来执行对最底部的展示元素进行平移或对最顶部的展示元素进行平移。比如终端用户左右手分别设置有红外发射指套，摄像展示系统可以设定终端用户左手的红外发射指套用于对最底部的展示元素进行平移，终端用户右手的红外发射指套用于对最顶部的展示元素进行平移，这样终端用户可通过两个红外发射指套分别对最底部的展示元素和最顶部的展示元素进行平移操作。Here, the end user can execute the translation of the bottommost display element or the topmost display element respectively by setting different end user instruction actions. For example, the left and right hands of the end user are equipped with infrared emitting finger cots, and the camera display system can set the infrared emitting finger cot of the end user's left hand to translate the display elements at the bottom, and the infrared emitting finger cot of the end user's right hand to display the topmost display elements. The elements are translated, so that the end user can perform translation operations on the bottommost display element and the topmost display element respectively through two infrared emitting fingertips.
当然摄像展示系统还可设定终端用户对平面画面位置上的展示元素进行控制时，可选取平面画面位置上任意展示深度的展示元素。即当终端用户对平面画面位置上的展示元素进行控制操作时，摄像展示系统可设置同一平面画面位置上重叠的多个展示元素围绕该平面画面位置展开，以便终端用户对想要控制操作的展示元素进行选择，具体可如图7a和图7b所示，图7a中的展示元素71、展示元素72以及展示元素73相互重叠，当终端用户对平面画面位置上的展示元素进行控制操作时，即终端用户在该平面画面位置发出终端用户指令动作，则展示元素71、展示元素72以及展示元素73可围绕该平面画面位置依次展开（平面画面位置上的展示元素71、展示元素72以及展示元素73可以保留），终端用户可根据需要选择展示元素71、展示元素72以及展示元素73进行平移以及其他控制操作，未选择的展示元素则继续保留在原平面画面位置，如图7b所示，终端用户对展示元素72进行了平面平移操作。Of course, the camera display system can also set the terminal user to select display elements with any display depth at the position of the plane picture when controlling the display elements on the position of the plane picture. That is, when the end user controls the display elements on the position of the plane picture, the camera display system can set multiple display elements overlapping on the same position of the plane picture to expand around the position of the plane picture, so that the end user can display the desired control operation 7a and 7b, the display element 71, the display element 72 and the display element 73 in Fig. 7a overlap each other. When the end user controls the display element on the position of the plane screen, that is When the end user sends an end user instruction action at the position of the plane picture, the display element 71, the display element 72 and the display element 73 can be unfolded around the position of the plane picture in sequence (the display element 71, the display element 72 and the display element 73 at the position of the plane picture can be reserved), the end user can select display element 71, display element 72 and display element 73 to perform panning and other control operations according to needs, and the unselected display elements will continue to remain in the original plane picture position, as shown in Figure 7b. The display element 72 has performed a plane translation operation.
进一步的，终端用户还可通过终端用户指令动作对指令动作响应空间中的多个展示元素同时进行控制操作。具体请参照图8a至图8d所示，指令动作响应空间82中设置有展示元素821、822以及823，终端用户可将指令动作响应空间中的展示元素821、822以及823设置为展示元素组（如通过终端用户指令动作框选特定平面画面区域中的所有展示元素，并设定为展示元素组），以便终端用户对整个展示元素组进行操作。Furthermore, the terminal user can also simultaneously control and operate multiple display elements in the command-action response space through the terminal-user command action. For details, please refer to FIG. 8a to FIG. 8d. Display elements 821, 822, and 823 are set in the command action response space 82, and end users can set the display elements 821, 822, and 823 in the command action response space as a display element group ( For example, select all display elements in a specific plane screen area through an end user command action, and set it as a display element group), so that the end user can operate on the entire display element group.
在终端用户对展示元素组中的展示元素进行控制操作前，展示元素821、822以及823在指令动作响应空间的位置如图8a所示，展示元素821、822以及823在显示屏的元素展示画面82如图8b所示。Before the terminal user controls the display elements in the display element group, the positions of the display elements 821, 822 and 823 in the command action response space are shown in Figure 8a, and the display elements 821, 822 and 823 are displayed on the element display screen of the display screen. 82 as shown in Figure 8b.
终端用户可选择某个旋转中心点对整个展示元素组进行旋转操作，比如以展示元素822的中心作为旋转中心点对整个展示元素组进行旋转操作（当然终端用户还可根据需要选择指令动作响应空间82中的任意点作为旋转中心点），以展示元素822的中心进行旋转操作后，展示元素821、822以及823在指令动作响应空间82的位置如图8c所示，展示元素821、822以及823在显示屏的元素展示画面82如图8d所示。The end user can select a rotation center point to rotate the entire display element group, for example, use the center of the display element 822 as the rotation center point to rotate the entire display element group (of course, the end user can also select the command action response space as needed 82 as the rotation center point), after the rotation operation is performed with the center of the display element 822, the positions of the display elements 821, 822 and 823 in the command action response space 82 are shown in Figure 8c, and the display elements 821, 822 and 823 The element display screen 82 on the display screen is shown in FIG. 8d.
旋转操作后，终端用户可以选择展示元素组中单独的展示元素再次进行其他的控制操作，比如放大缩小操作或形变操作等。After the rotation operation, the end user can select a single display element in the display element group to perform other control operations again, such as zooming in and out or deformation operation.
在步骤S402中，终端用户通过终端用户指令动作对展示元素进行控制操作后，摄像展示系统可将控制操作后的展示元素直接叠加到终端用户画面上，以生成最终展示画面。这样终端用户可将调整后的展示元素较好的叠加在终端用户画面上。In step S402, after the terminal user controls and operates the display elements through terminal user instruction actions, the camera display system can directly superimpose the controlled display elements on the terminal user's screen to generate a final display screen. In this way, the terminal user can preferably superimpose the adjusted display elements on the screen of the terminal user.
在步骤S403中，摄像展示系统可将步骤S402生成的最终展示画面发送至其他的直播显示终端。这样其他的直播显示终端可较好的显示由终端用户画面以及元素展示画面叠加的个性化的最终展示画面。In step S403, the camera display system may send the final display image generated in step S402 to other live display terminals. In this way, other live display terminals can better display a personalized final display image superimposed by end user images and element display images.
这样即完成了本实施例的画面交互方法的终端用户与摄像展示系统之间的交互操作过程。In this way, the interactive operation process between the terminal user and the camera display system in the screen interaction method of this embodiment is completed.
本实施例的画面交互方法通过红外摄像头来接收终端用户指令动作，使得终端用户可对元素展示画面中的展示元素进行个性化的交互控制，提升了画面展示效果的多样性。The screen interaction method of this embodiment uses an infrared camera to receive terminal user instruction actions, so that the terminal user can perform personalized interactive control on the display elements in the element display screen, improving the diversity of screen display effects.
本发明还提供一种摄像展示系统，该摄像展示系统用于与终端用户进行交互，如图9所示，图9为本发明的摄像展示系统的实施例的结构示意图。该摄像展示系统90包括显示屏91、可见光摄像头92、红外光摄像头93、至少一个红外发射指套94以及画面处理芯片95。The present invention also provides a camera display system for interacting with terminal users, as shown in FIG. 9 , which is a schematic structural diagram of an embodiment of the camera display system of the present invention. The camera display system 90 includes a display screen 91 , a visible light camera 92 , an infrared light camera 93 , at least one infrared emitting fingertip 94 and an image processing chip 95 .
其中显示屏91的显示内容包括可见光摄像头拍摄的终端用户画面、红外光摄像头拍摄的终端用户使用红外发射指套生成的终端用户指令动作、以及响应终端用户指令动作的元素展示画面。The display content of the display screen 91 includes the terminal user's picture captured by the visible light camera, the terminal user's command action generated by the terminal user using the infrared emitting fingertip captured by the infrared camera, and the element display screen responding to the terminal user's command action.
其中画面处理芯片95包括展示元素控制操作模块951、最终展示画面生成模块952以及展示模块953。The image processing chip 95 includes a display element control operation module 951 , a final display image generation module 952 and a display module 953 .
展示元素控制操作模块951用于基于终端用户指令动作，对元素展示画面中的展示元素进行控制操作；最终展示画面生成模块952用于将控制操作后的展示元素叠加在终端用户画面上，生成最终展示画面；展示模块953用于在显示屏上对终端展示画面进行展示操作。The display element control operation module 951 is used to control and operate the display elements in the element display screen based on the terminal user's instruction action; the final display screen generation module 952 is used to superimpose the display elements after the control operation on the terminal user screen to generate the final display element. display screen; the display module 953 is used to display the display screen of the terminal on the display screen.
本发明的摄像展示系统的具体工作原理与上述的画面交互方法的实施例中描述相同或相似，具体请参见上述画面交互方法的实施例中的相关描述。The specific working principle of the camera display system of the present invention is the same as or similar to that described in the above-mentioned embodiment of the screen interaction method. For details, please refer to the relevant description in the above-mentioned embodiment of the screen interaction method.
本发明的画面交互方法以及画面交互装置通过红外摄像头来接收终端用户指令动作，使得终端用户可对元素展示画面中的展示元素进行个性化的交互控制，提升了画面展示效果的多样性；有效解决了现有的画面交互方法中展示画面不能进行个性化的交互控制且展示效果单一的技术问题。The screen interaction method and the screen interaction device of the present invention receive terminal user instruction actions through an infrared camera, so that the terminal user can perform personalized interactive control on the display elements in the element display screen, which improves the diversity of screen display effects; effectively solves the problem of The technical problem that the display screen cannot be personalized interactively controlled and the display effect is single in the existing screen interaction method is solved.
如本申请所使用的术语“组件”、“模块”、“系统”、“接口”、“进程”等等一般地旨在指计算机相关实体：硬件、硬件和软件的组合、软件或执行中的软件。例如，组件可以是但不限于是运行在处理器上的进程、处理器、对象、可执行应用、执行的线程、程序和／或计算机。通过图示，运行在控制器上的应用和该控制器二者都可以是组件。一个或多个组件可以有在于执行的进程和／或线程内，并且组件可以位于一个计算机上和／或分布在两个或更多计算机之间。As used in this application, the terms "component," "module," "system," "interface," "process," and the like are generally intended to refer to a computer-related entity: hardware, a combination of hardware and software, software, or an software. For example, a component may be, but is not limited to being, a process running on a processor, a processor, an object, an executable application, a thread of execution, a program, and/or a computer. By way of illustration, both an application running on a controller and the controller can be components. One or more components can reside within a process and/or thread of execution and a component can be localized on one computer and/or distributed between two or more computers.
图10和随后的讨论提供了对实现本发明所述的画面交互装置所在的电子设备的工作环境的简短、概括的描述。图10的工作环境仅仅是适当的工作环境的一个实例并且不旨在建议关于工作环境的用途或功能的范围的任何限制。FIG. 10 and the subsequent discussion provide a short and general description of the working environment of the electronic device where the screen interaction device of the present invention is implemented. The work environment of FIG. 10 is only one example of a suitable work environment and is not intended to suggest any limitation as to the scope of use or functionality of the work environment.
尽管没有要求，但是在“计算机可读指令”被一个或多个电子设备或电子设备执行的通用背景下描述实施例。计算机可读指令可以经由计算机可读介质来分布（下文讨论）。计算机可读指令可以实现为程序模块，比如执行特定任务或实现特定抽象数据类型的功能、对象、应用编程接口(API)、数据结构等等。典型地，该计算机可读指令的功能可以在各种环境中随意组合或分布。Although not required, the embodiments are described in the general context of "computer readable instructions" being executed by one or more electronic devices or electronic devices. Computer readable instructions may be distributed via computer readable media (discussed below). Computer readable instructions can be implemented as program modules, such as functions, objects, application programming interfaces (APIs), data structures, etc., that perform particular tasks or implement particular abstract data types. Typically, the functions of the computer readable instructions may be combined or distributed at will in various environments.
图10图示了包括本发明的画面交互装置中的一个或多个实施例的电子设备1012的实例。在一种配置中，电子设备1012包括至少一个处理单元1016和存储器1018。根据电子设备的确切配置和类型，存储器1018可以是易失性的(比如RAM)、非易失性的（比如ROM、闪存等）或二者的某种组合。该配置在图10中由虚线1014图示。FIG. 10 illustrates an example of an electronic device 1012 including one or more embodiments of the screen interaction apparatus of the present invention. In one configuration, the electronic device 1012 includes at least one processing unit 1016 and memory 1018 . Depending on the exact configuration and type of electronic device, memory 1018 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.), or some combination of the two. This configuration is illustrated by dashed line 1014 in FIG. 10 .
在其他实施例中，电子设备1012可以包括附加特征和／或功能。例如，设备1012还可以包括附加的存储装置（例如可移除和／或不可移除的），其包括但不限于磁存储装置、光存储装置等等。这种附加存储装置在图10中由存储装置1020图示。在一个实施例中，用于实现本文所提供的一个或多个实施例的计算机可读指令可以在存储装置1020中。存储装置1020还可以存储用于实现操作系统、应用程序等的其他计算机可读指令。计算机可读指令可以载入存储器1018中由例如处理单元1016执行。In other embodiments, electronic device 1012 may include additional features and/or functionality. For example, device 1012 may also include additional storage (eg, removable and/or non-removable) including, but not limited to, magnetic storage, optical storage, and the like. Such additional storage is illustrated in FIG. 10 by storage 1020 . In one embodiment, computer readable instructions to implement one or more embodiments provided herein may be in storage device 1020 . The storage device 1020 may also store other computer-readable instructions for implementing an operating system, application programs, and the like. Computer readable instructions may be loaded into memory 1018 for execution by processing unit 1016, for example.
本文所使用的术语“计算机可读介质”包括计算机存储介质。计算机存储介质包括以用于存储诸如计算机可读指令或其他数据之类的信息的任何方法或技术实现的易失性和非易失性、可移除和不可移除介质。存储器1018和存储装置1020是计算机存储介质的实例。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字通用盘(DVD)或其他光存储装置、盒式磁带、磁带、磁盘存储装置或其他磁存储设备、或可以用于存储期望信息并可以被电子设备1012访问的任何其他介质。任意这样的计算机存储介质可以是电子设备1012的一部分。The term "computer-readable medium" as used herein includes computer storage media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions or other data. Memory 1018 and storage 1020 are examples of computer storage media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical storage device, cassette tape, magnetic tape, magnetic disk storage device or other magnetic storage device, Or any other medium that can be used to store desired information and can be accessed by the electronic device 1012 . Any such computer storage media may be part of electronic device 1012 .
电子设备1012还可以包括允许电子设备1012与其他设备通信的通信连接1026。通信连接1026可以包括但不限于调制解调器、网络接口卡(NIC)、集成网络接口、射频发射器／接收器、红外端口、USB连接或用于将电子设备1012连接到其他电子设备的其他接口。通信连接1026可以包括有线连接或无线连接。通信连接1026可以发射和／或接收通信媒体。The electronic device 1012 may also include a communication connection 1026 that allows the electronic device 1012 to communicate with other devices. Communications connection 1026 may include, but is not limited to, a modem, network interface card (NIC), integrated network interface, radio frequency transmitter/receiver, infrared port, USB connection, or other interface for connecting electronic device 1012 to other electronic devices. The communication link 1026 may comprise a wired connection or a wireless connection. Communication connection 1026 can transmit and/or receive communication media.
术语“计算机可读介质”可以包括通信介质。通信介质典型地包含计算机可读指令或诸如载波或其他传输机构之类的“己调制数据信号”中的其他数据，并且包括任何信息递送介质。术语“己调制数据信号”可以包括这样的信号：该信号特性中的一个或多个按照将信息编码到信号中的方式来设置或改变。The term "computer-readable medium" may include communication media. Communication media typically embodies computer readable instructions or other data in a "modulated data signal" such as a carrier wave or other transport mechanism and includes any information delivery media. The term "modulated data signal" may include a signal that has one or more of its characteristics set or changed in such a manner as to encode information into the signal.
电子设备1012可以包括输入设备1024，比如键盘、鼠标、笔、语音输入设备、触摸输入设备、红外相机、视频输入设备和／或任何其他输入设备。设备1012中也可以包括输出设备1022，比如一个或多个显示器、扬声器、打印机和／或任意其他输出设备。输入设备1024和输出设备1022可以经由有线连接、无线连接或其任意组合连接到电子设备1012。在一个实施例中，来自另一个电子设备的输入设备或输出设备可以被用作电子设备1012的输入设备1024或输出设备1022。The electronic device 1012 may include an input device 1024, such as a keyboard, mouse, pen, voice input device, touch input device, infrared camera, video input device, and/or any other input device. Also included in device 1012 is output device 1022, such as one or more displays, speakers, printer, and/or any other output device. The input device 1024 and the output device 1022 may be connected to the electronic device 1012 via a wired connection, a wireless connection, or any combination thereof. In one embodiment, an input device or output device from another electronic device may be used as input device 1024 or output device 1022 of electronic device 1012 .
电子设备1012的组件可以通过各种互连（比如总线）连接。这样的互连可以包括外围组件互连(PCI)(比如快速PCI)、通用串行总线(USB)、火线(IEEE 1394)、光学总线结构等等。在另一个实施例中，电子设备1012的组件可以通过网络互连。例如，存储器1018可以由位于不同物理位置中的、通过网络互连的多个物理存储器单元构成。The components of electronic device 1012 may be connected by various interconnects, such as buses. Such interconnects may include Peripheral Component Interconnect (PCI) (such as PCI Express), Universal Serial Bus (USB), Firewire (IEEE 1394), optical bus structures, and the like. In another embodiment, the components of the electronic device 1012 may be interconnected by a network. For example, memory 1018 may be comprised of multiple physical memory units located in different physical locations, interconnected by a network.
本领域技术人员将认识到，用于存储计算机可读指令的存储设备可以跨越网络分布。例如，可经由网络1028访问的电子设备1030可以存储用于实现本发明所提供的一个或多个实施例的计算机可读指令。电子设备1012可以访问电子设备1030并且下载计算机可读指令的一部分或所有以供执行。可替代地，电子设备1012可以按需要下载多条计算机可读指令，或者一些指令可以在电子设备1012处执行并且一些指令可以在电子设备1030处执行。Those skilled in the art will realize that storage devices utilized to store computer readable instructions may be distributed across a network. For example, electronic device 1030 accessible via network 1028 may store computer readable instructions for implementing one or more embodiments provided herein. Electronic device 1012 may access electronic device 1030 and download a portion or all of the computer readable instructions for execution. Alternatively, electronic device 1012 may download as many computer readable instructions as desired, or some instructions may be executed at electronic device 1012 and some instructions may be executed at electronic device 1030 .
本文提供了实施例的各种操作。在一个实施例中，所述的一个或多个操作可以构成一个或多个计算机可读介质上存储的计算机可读指令，其在被电子设备执行时将使得计算设备执行所述操作。描述一些或所有操作的顺序不应当被解释为暗示这些操作必需是顺序相关的。本领域技术人员将理解具有本说明书的益处的可替代的排序。而且，应当理解，不是所有操作必需在本文所提供的每个实施例中存在。Various operations of embodiments are provided herein. In one embodiment, one or more operations described may constitute computer-readable instructions stored on one or more computer-readable media, which, when executed by an electronic device, will cause the computing device to perform the operations described. The order in which some or all operations are described should not be construed to imply that these operations are necessarily order-dependent. Alternative orderings will be appreciated by those skilled in the art with the benefit of this description. Also, it should be understood that not all operations need to be present in every embodiment provided herein.
而且，尽管已经相对于一个或多个实现方式示出并描述了本公开，但是本领域技术人员基于对本说明书和附图的阅读和理解将会想到等价变型和修改。本公开包括所有这样的修改和变型，并且仅由所附权利要求的范围限制。特别地关于由上述组件（例如元件、资源等）执行的各种功能，用于描述这样的组件的术语旨在对应于执行所述组件的指定功能（例如其在功能上是等价的）的任意组件（除非另外指示），即使在结构上与执行本文所示的本公开的示范性实现方式中的功能的公开结构不等同。此外，尽管本公开的特定特征已经相对于若干实现方式中的仅一个被公开，但是这种特征可以与如可以对给定或特定应用而言是期望和有利的其他实现方式的一个或多个其他特征组合。而且，就术语“包括”、“具有”、“含有”或其变形被用在具体实施方式或权利要求中而言，这样的术语旨在以与术语“包含”相似的方式包括。Moreover, while the disclosure has been shown and described with respect to one or more implementations, equivalent alterations and modifications will occur to others skilled in the art upon the reading and understanding of this specification and the annexed drawings. The present disclosure includes all such modifications and variations and is limited only by the scope of the appended claims. With particular regard to the various functions performed by the above-described components (eg, elements, resources, etc.), terminology used to describe such components is intended to correspond to an Any component (unless otherwise indicated), even if not structurally equivalent to the disclosed structure that performs the function in the exemplary implementations of the present disclosure shown herein. Furthermore, although a particular feature of the present disclosure has been disclosed with respect to only one of several implementations, such feature may be combined with one or more other implementations as may be desirable and advantageous for a given or particular application. other feature combinations. Moreover, to the extent the terms "comprises", "has", "comprising" or variations thereof are used in the detailed description or the claims, such terms are intended to be encompassed in a manner similar to the term "comprising".
本发明实施例中的各功能单元可以集成在一个处理模块中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。上述提到的存储介质可以是只读存储器，磁盘或光盘等。上述的各装置或系统，可以执行相应方法实施例中的方法。Each functional unit in the embodiment of the present invention may be integrated into one processing module, or each unit may physically exist separately, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are implemented in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like. Each of the above devices or systems may execute the methods in the corresponding method embodiments.
综上所述，虽然本发明已以实施例揭露如上，实施例前的序号仅为描述方便而使用，对本发明各实施例的顺序不造成限制。并且，上述实施例并非用以限制本发明，本领域的普通技术人员，在不脱离本发明的精神和范围内，均可作各种更动与润饰，因此本发明的保护范围以权利要求界定的范围为准。In summary, although the present invention has been disclosed as above with the embodiments, the serial numbers before the embodiments are used for convenience of description only, and do not limit the sequence of the embodiments of the present invention. Moreover, the above-mentioned embodiments are not intended to limit the present invention. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention is defined by the claims range prevails.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310965367.6ACN116661656B (en) | 2023-08-02 | 2023-08-02 | Picture interaction method and shooting display system |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310965367.6ACN116661656B (en) | 2023-08-02 | 2023-08-02 | Picture interaction method and shooting display system |
| Publication Number | Publication Date |
|---|---|
| CN116661656Atrue CN116661656A (en) | 2023-08-29 |
| CN116661656B CN116661656B (en) | 2024-03-12 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310965367.6AActiveCN116661656B (en) | 2023-08-02 | 2023-08-02 | Picture interaction method and shooting display system |
| Country | Link |
|---|---|
| CN (1) | CN116661656B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104020897A (en)* | 2014-05-23 | 2014-09-03 | 神画科技（深圳）有限公司 | Interaction display system |
| CN104199547A (en)* | 2014-08-29 | 2014-12-10 | 福州瑞芯微电子有限公司 | Man-machine interactive type virtual touch device, system and method |
| CN104834394A (en)* | 2014-02-09 | 2015-08-12 | 神画科技（深圳）有限公司 | Interaction display system |
| CN104978077A (en)* | 2014-04-08 | 2015-10-14 | 联想(北京)有限公司 | Interaction method and interaction system |
| US20150346813A1 (en)* | 2014-06-03 | 2015-12-03 | Aaron Michael Vargas | Hands free image viewing on head mounted display |
| CN106446801A (en)* | 2016-09-06 | 2017-02-22 | 清华大学 | Micro-gesture identification method and system based on ultrasonic active detection |
| CN107257439A (en)* | 2017-07-26 | 2017-10-17 | 维沃移动通信有限公司 | A kind of image pickup method and mobile terminal |
| US20180018917A1 (en)* | 2016-07-15 | 2018-01-18 | Samsung Display Co., Ltd. | Organic light emitting display device and head mounted display system having the same |
| CN109716276A (en)* | 2016-06-10 | 2019-05-03 | 赫克斯冈技术中心 | System and method for accessing visually occluded elements in a three-dimensional model |
| CN111766936A (en)* | 2019-04-02 | 2020-10-13 | 广东虚拟现实科技有限公司 | Control method, device, terminal device and storage medium for virtual content |
| CN111880648A (en)* | 2020-06-19 | 2020-11-03 | 华为技术有限公司 | Three-dimensional element control method and terminal |
| CN114422755A (en)* | 2022-01-12 | 2022-04-29 | 中驰智能科技(扬州)有限公司 | Multi-camera shooting picture display method based on vehicle-mounted shooting adjustment |
| CN114428571A (en)* | 2020-10-29 | 2022-05-03 | 深圳Tcl新技术有限公司 | An interaction method, computer device, and computer-readable storage medium |
| CN114830066A (en)* | 2019-12-23 | 2022-07-29 | 苹果公司 | Device, method and graphical user interface for displaying applications in a three-dimensional environment |
| CN114915852A (en)* | 2021-02-09 | 2022-08-16 | 腾讯科技（深圳）有限公司 | Video call interaction method and device, computer equipment and storage medium |
| US20220317776A1 (en)* | 2021-03-22 | 2022-10-06 | Apple Inc. | Methods for manipulating objects in an environment |
| US20230092282A1 (en)* | 2021-09-23 | 2023-03-23 | Apple Inc. | Methods for moving objects in a three-dimensional environment |
| US20230221833A1 (en)* | 2022-01-10 | 2023-07-13 | Apple Inc. | Methods for displaying user interface elements relative to media content |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104834394A (en)* | 2014-02-09 | 2015-08-12 | 神画科技（深圳）有限公司 | Interaction display system |
| CN104978077A (en)* | 2014-04-08 | 2015-10-14 | 联想(北京)有限公司 | Interaction method and interaction system |
| CN104020897A (en)* | 2014-05-23 | 2014-09-03 | 神画科技（深圳）有限公司 | Interaction display system |
| US20150346813A1 (en)* | 2014-06-03 | 2015-12-03 | Aaron Michael Vargas | Hands free image viewing on head mounted display |
| CN104199547A (en)* | 2014-08-29 | 2014-12-10 | 福州瑞芯微电子有限公司 | Man-machine interactive type virtual touch device, system and method |
| CN109716276A (en)* | 2016-06-10 | 2019-05-03 | 赫克斯冈技术中心 | System and method for accessing visually occluded elements in a three-dimensional model |
| US20180018917A1 (en)* | 2016-07-15 | 2018-01-18 | Samsung Display Co., Ltd. | Organic light emitting display device and head mounted display system having the same |
| CN106446801A (en)* | 2016-09-06 | 2017-02-22 | 清华大学 | Micro-gesture identification method and system based on ultrasonic active detection |
| CN107257439A (en)* | 2017-07-26 | 2017-10-17 | 维沃移动通信有限公司 | A kind of image pickup method and mobile terminal |
| CN111766936A (en)* | 2019-04-02 | 2020-10-13 | 广东虚拟现实科技有限公司 | Control method, device, terminal device and storage medium for virtual content |
| CN114830066A (en)* | 2019-12-23 | 2022-07-29 | 苹果公司 | Device, method and graphical user interface for displaying applications in a three-dimensional environment |
| CN115167676A (en)* | 2019-12-23 | 2022-10-11 | 苹果公司 | Apparatus and method for displaying applications in a three-dimensional environment |
| CN111880648A (en)* | 2020-06-19 | 2020-11-03 | 华为技术有限公司 | Three-dimensional element control method and terminal |
| CN114428571A (en)* | 2020-10-29 | 2022-05-03 | 深圳Tcl新技术有限公司 | An interaction method, computer device, and computer-readable storage medium |
| CN114915852A (en)* | 2021-02-09 | 2022-08-16 | 腾讯科技（深圳）有限公司 | Video call interaction method and device, computer equipment and storage medium |
| US20220317776A1 (en)* | 2021-03-22 | 2022-10-06 | Apple Inc. | Methods for manipulating objects in an environment |
| US20230092282A1 (en)* | 2021-09-23 | 2023-03-23 | Apple Inc. | Methods for moving objects in a three-dimensional environment |
| US20230221833A1 (en)* | 2022-01-10 | 2023-07-13 | Apple Inc. | Methods for displaying user interface elements relative to media content |
| CN114422755A (en)* | 2022-01-12 | 2022-04-29 | 中驰智能科技(扬州)有限公司 | Multi-camera shooting picture display method based on vehicle-mounted shooting adjustment |
| Publication number | Publication date |
|---|---|
| CN116661656B (en) | 2024-03-12 |
| Publication | Publication Date | Title |
|---|---|---|
| US11481096B2 (en) | Gesture mapping for image filter input parameters | |
| CN109766053B (en) | User interface display method, device, terminal and storage medium | |
| JP5628300B2 (en) | Method, apparatus and computer program product for generating graphic objects with desirable physical features for use in animation | |
| JP6185675B2 (en) | Generate screenshot | |
| WO2020038168A1 (en) | Content sharing method and device, terminal, and storage medium | |
| KR20180015532A (en) | Display control method, storage medium and electronic device | |
| CN111866423A (en) | Screen recording method and corresponding device for electronic terminal | |
| CN114779987B (en) | Method, device, terminal and storage medium for displaying content | |
| US20230185513A1 (en) | Method for operating mirrored content under mirror mode and computer readable storage medium | |
| WO2021243788A1 (en) | Screenshot method and apparatus | |
| WO2018010440A1 (en) | Projection picture adjusting method and apparatus, and projection terminal | |
| JP7187307B2 (en) | Electronic device and its control method | |
| WO2021042622A1 (en) | Mind map presentation method and apparatus, storage medium, and electronic device | |
| CN111010528A (en) | Video call method, mobile terminal and computer readable storage medium | |
| WO2024222356A1 (en) | Special-effect generation method and apparatus, and computer device and storage medium | |
| CN107395901A (en) | Camera activation method, device and terminal | |
| CN116661656A (en) | Screen interaction method and camera display system | |
| CN109416638B (en) | Customizable compact overlay window | |
| CN114115691B (en) | Electronic equipment and interaction method and medium thereof | |
| CN112740161A (en) | Terminal, method for controlling terminal, and recording medium in which program for implementing the method is recorded | |
| CN113076031B (en) | Display equipment, touch positioning method and device | |
| JP2020046983A (en) | Program, information processing apparatus, and method | |
| JP7289208B2 (en) | Program, Information Processing Apparatus, and Method | |
| CN115113795B (en) | Virtual keyboard calibration method, device, electronic equipment and medium | |
| CN115120963B (en) | Virtual object adjusting method and device, electronic equipment and storage medium |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | Address after:1001, rujun building, 105 Zhongxing Road, Ma'antang community, Bantian street, Longgang District, Shenzhen, Guangdong 518000 Patentee after:Anying Zhixuan (Shenzhen) Technology Co., Ltd. Country or region after:China Address before:Guangdong Province Shenzhen City Longgang District Bantian Street Ma'antang Community Zhongxing Road 105 Rujun Building 1001 Patentee before:Anke Youxuan (Shenzhen) Technology Co.,Ltd. Country or region before:China | |
| CP03 | Change of name, title or address |