本申请要求于2021年06月16日提交国家知识产权局、申请号为202110676709.3、发明名称为“一种基于故事线模式的用户视频创作方法及电子设备”的中国专利申请的优先权，以及于2021年11月29日提交国家知识产权局、申请号为202111436311.9、发明名称为“一种隔空手势的引导使用方法及电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application requires the priority of the Chinese patent application submitted to the State Intellectual Property Office on June 16, 2021, with the application number 202110676709.3 and the invention title "A user video creation method and electronic device based on story line mode", and in The priority of the Chinese patent application submitted to the State Intellectual Property Office on November 29, 2021, with the application number 202111436311.9 and the invention title "A method for guiding the use of air gestures and electronic equipment", the entire content of which is incorporated herein by reference. Applying.
技术领域Technical field
本申请涉及终端技术领域，尤其涉及一种隔空手势的引导使用方法及电子设备。The present application relates to the field of terminal technology, and in particular, to a method for guiding the use of air gestures and an electronic device.
背景技术Background technique
随着互联网技术的发展，应用程序的功能也越来越丰富。当应用程序出现新增功能时，可在应用程序的界面上弹出新手引导，通过新手引导向用户展示新增功能的使用方法，从而让用户更快了解、掌握新增功能的用法。With the development of Internet technology, the functions of applications are becoming more and more abundant. When a new function appears in the application, a novice guide can pop up on the application interface, and the user can be shown how to use the new function through the novice guide, so that the user can quickly understand and master the use of the new function.
但是，即使用户查看了新手引导，也常常会忘记使用新功能。However, even after users review the onboarding, they often forget to use new features.
发明内容Contents of the invention
本申请实施例提供一种隔空手势的引导使用方法及电子设备，可在识别到用户存在使用隔空手势的需求时显示隔空手势的标识，以提醒用户使用隔空手势。Embodiments of the present application provide a method for guiding the use of air gestures and an electronic device, which can display a logo of the air gesture when it is recognized that the user needs to use the air gesture to remind the user to use the air gesture.
为达到上述目的，本申请的实施例采用如下技术方案：In order to achieve the above objectives, the embodiments of the present application adopt the following technical solutions:
第一方面，本申请实施例提供一种隔空手势的引导使用方法，方法应用于包括显示屏、第一摄像头和第二摄像头的电子设备，第一摄像头和第二摄像头位于显示屏的不同侧，第一摄像头与显示屏位于电子设备的同一侧，方法包括：电子设备显示拍摄预览界面，拍摄预览界面包括第一图像、第二图像中的至少一个，第一图像为第一摄像头实时采集的图像，第二图像为第二摄像头实时采集的图像。若第一时间与当前时间的时间差大于第一预设时间，响应于检测到电子设备正在录制视频，电子设备连接自拍杆，电子设备在拍摄预览界面显示第一弹窗，第一弹窗包括手势标识，手势标识用于提醒用户使用隔空手势切换拍摄模式，第一时间为电子设备上一次响应于第一摄像头检测到隔空手势而切换拍摄模式的时间。In a first aspect, embodiments of the present application provide a method for guiding the use of air gestures. The method is applied to an electronic device including a display screen, a first camera and a second camera. The first camera and the second camera are located on different sides of the display screen. , the first camera and the display screen are located on the same side of the electronic device. The method includes: the electronic device displays a shooting preview interface, the shooting preview interface includes at least one of a first image and a second image, and the first image is collected in real time by the first camera. image, the second image is an image collected in real time by the second camera. If the time difference between the first time and the current time is greater than the first preset time, in response to detecting that the electronic device is recording a video, the electronic device connects to the selfie stick, and the electronic device displays a first pop-up window on the shooting preview interface, and the first pop-up window includes a gesture. The gesture logo is used to remind the user to use the air gesture to switch the shooting mode. The first time is the time when the electronic device last switched the shooting mode in response to the first camera detecting the air gesture.
本申请实施例提供的隔空手势的引导使用方法，可在电子设备处于前置拍摄模式、后置拍摄模式、前后拍摄模式、画中画拍摄模式时检测用户上一次使用隔空手势的时间(即第一时间)与当前时间的时间差是否大于第一预设时间，并在第一时间与当前时间的时间差大于第一预设时间时，检测到电子设备正在录制视频且连接自拍杆时认为用户存在使用隔空手势的需求，因而显示第一弹窗，通过在引导弹窗上显示手势标识来提醒用户使用隔空手势切换拍摄模式。这种方法可有效提醒用户使用新功能(例如，隔空手势)，提升用户在拍摄过程中的效率。The guided use method of the air gesture provided by the embodiment of the present application can detect the time when the user last used the air gesture when the electronic device is in the front shooting mode, the rear shooting mode, the front and back shooting mode, and the picture-in-picture shooting mode ( That is, whether the time difference between the first time) and the current time is greater than the first preset time, and when the time difference between the first time and the current time is greater than the first preset time, it is detected that the electronic device is recording video and the selfie stick is connected. There is a need to use air gestures, so a first pop-up window is displayed to remind the user to use air gestures to switch shooting modes by displaying a gesture logo on the guide pop-up window. This method can effectively remind users to use new functions (such as air gestures) and improve user efficiency during the shooting process.
在一种可能的实现方式中，响应于检测到电子设备正在录制视频，电子设备连接自拍杆，电子设备在拍摄预览界面显示第一弹窗，包括：响应于接收到用户的第一操作，电子设备开始录制视频；响应于检测到连接自拍杆，电子设备在拍摄预览界面显示第一弹窗。In a possible implementation, in response to detecting that the electronic device is recording a video, the electronic device connects to the selfie stick, and the electronic device displays a first pop-up window on the shooting preview interface, including: in response to receiving the first operation of the user, the electronic device The device starts recording video; in response to detecting that the selfie stick is connected, the electronic device displays a first pop-up window on the shooting preview interface.
也就是说，在第一时间与当前时间的时间差大于第一预设时间的情况下，电子设备可以先开始录制视频，再在连接自拍杆时显示第一弹窗。That is to say, when the time difference between the first time and the current time is greater than the first preset time, the electronic device can first start recording the video, and then display the first pop-up window when the selfie stick is connected.
在一种可能的实现方式中，响应于检测到电子设备正在录制视频，电子设备连接自拍杆，电子设备在拍摄预览界面显示第一弹窗，包括：电子设备连接自拍杆；响应于接收到用户的第一操作，电子设备开始录制视频，电子设备在拍摄预览界面显示第一弹窗。In one possible implementation, in response to detecting that the electronic device is recording a video, the electronic device connects to the selfie stick, and the electronic device displays a first pop-up window on the shooting preview interface, including: the electronic device connects to the selfie stick; in response to receiving the user In the first operation, the electronic device starts recording video, and the electronic device displays the first pop-up window in the shooting preview interface.
也就是说，在第一时间与当前时间的时间差大于第一预设时间的情况下，电子设备可以先连接自拍杆，用户可通过自拍杆、隔空手势、拍摄预览上面的控件控制电子设备开始录制视频，此时电子设备也可以在拍摄预览界面显示第一弹窗。That is to say, when the time difference between the first time and the current time is greater than the first preset time, the electronic device can be connected to the selfie stick first, and the user can control the electronic device to start through the controls on the selfie stick, air gesture, and shooting preview. When recording a video, the electronic device can also display the first pop-up window in the shooting preview interface.
在一种可能的实现方式中，拍摄预览界面包括第一控件，方法还包括：响应于用户对第一控件的操作，电子设备在拍摄预览界面显示第二弹窗；电子设备在第二弹窗中按照预设顺序循环播放多个引导视频，多个引导视频中的每个引导视频用于展示一个隔空手势的使用方法。In a possible implementation, the shooting preview interface includes a first control, and the method further includes: in response to the user's operation on the first control, the electronic device displays a second pop-up window on the shooting preview interface; the electronic device displays a second pop-up window in the second pop-up window. Multiple guidance videos are played in a loop in a preset order, and each of the multiple guidance videos is used to demonstrate how to use an air gesture.
可见，电子设备不仅可以在录像过程中引导用户使用隔空手势，电子设备也可以通过第二弹窗来展示隔空手势的使用方法，从多个方面引导用户使用隔空手势。It can be seen that the electronic device can not only guide the user to use the air gesture during the recording process, but the electronic device can also display the method of using the air gesture through the second pop-up window, guiding the user to use the air gesture from multiple aspects.
在一种可能的实现方式中，方法还包括：响应于用户左滑第二弹窗的操作，电子设备在第二弹窗显示与正在播放的第一视频相邻的上一个引导视频，并停止循环播放；或，响应于用户右滑第二弹窗的操作，电子设备在第二弹窗显示与第一视频相邻的下一个引导视频，并停止循环播放。In a possible implementation, the method further includes: in response to the user's operation of sliding the second pop-up window left, the electronic device displays the previous guide video adjacent to the first video being played in the second pop-up window, and stops Loop playback; or, in response to the user's operation of right-swiping the second pop-up window, the electronic device displays the next guidance video adjacent to the first video in the second pop-up window, and stops loop playback.
也就是说，电子设备既可以在第二弹窗上自动循环播放多个引导视频，用户也可手动选择自己想看的引导视频。其中，在用户手动选择引导视频(即左滑或者右滑第二弹窗)后，电子设备便不再循环播放引导视频，而是显示用户选择的引导视频。In other words, the electronic device can automatically play multiple guidance videos in a loop on the second pop-up window, or the user can manually select the guidance video he wants to watch. Among them, after the user manually selects the guidance video (ie, swipes left or right on the second pop-up window), the electronic device no longer plays the guidance video in a loop, but displays the guidance video selected by the user.
在一种可能的实现方式中，第二弹窗包括第一显示区以及第二显示区，第一显示区用于循环播放多个引导视频，第二显示区用于循环显示多个引导视频对应的多个提示信息，多个引导视频与多个提示信息一一对应，每个提示信息用于解释对应的引导视频所展示的隔空手势的功能及使用方法，第一显示区正在显示的引导视频与第二显示区正在显示的提示信息对应。In a possible implementation, the second pop-up window includes a first display area and a second display area. The first display area is used to loop multiple guide videos, and the second display area is used to loop multiple guide videos corresponding to each other. Multiple prompt information, multiple guidance videos and multiple prompt information correspond one to one. Each prompt information is used to explain the function and use method of the air gesture displayed in the corresponding guidance video. The guidance being displayed in the first display area The video corresponds to the prompt information being displayed in the second display area.
也即，第二弹窗上不仅可以显示引导视频，还可显示与引导视频对应的提示信息(可包括文字和图标)，更利于用户理解隔空手势的使用方法。That is to say, not only the guidance video can be displayed on the second pop-up window, but also prompt information (which can include text and icons) corresponding to the guidance video can be displayed, which is more conducive to the user's understanding of how to use the air gesture.
在一种可能的实现方式中，第二弹窗包括确认选项，方法还包括：响应于用户对确认选项的操作，电子设备关闭第二弹窗。也即，该第二弹窗可以由用户手动关闭，若用户未点击确认选项，电子设备可以一直显示第二弹窗。In a possible implementation, the second pop-up window includes a confirmation option, and the method further includes: in response to the user's operation on the confirmation option, the electronic device closes the second pop-up window. That is, the second pop-up window can be closed manually by the user. If the user does not click the confirmation option, the electronic device can always display the second pop-up window.
在一种可能的实现方式中，方法还包括：若电子设备检测到用户未点击过第一控件，且未响应于第一摄像头检测到隔空手势而切换拍摄模式，电子设备在拍摄预览界面上显示第二弹窗。In a possible implementation, the method further includes: if the electronic device detects that the user has not clicked on the first control and does not switch the shooting mode in response to the first camera detecting the air gesture, the electronic device displays the shooting preview interface on the shooting preview interface. Display the second pop-up window.
可以看出，第一电子设备可以通过检测用户是否点击过第一控件来确认用户是否学习过隔空手势的用法，通过检测是否响应于第一摄像头检测到隔空手势而切换拍摄模式来确认用户是否使用过隔空手势。在检测到用户未点击过第一控件，且未响应于第一摄像头检测到隔空手势而切换拍摄模式时，认为用户未学习过隔空手势的用法以及未使用过隔空手势，这种情况下电子设备可以自动弹出第二弹窗，引导用户学习使用隔空手势。进一步的，电子设备可以在第二次进入多镜录像模式进行上述检测，并在满足上述条件时自动弹出第二弹窗。It can be seen that the first electronic device can confirm whether the user has learned the usage of the air gesture by detecting whether the user has clicked the first control, and confirms the user by detecting whether the shooting mode is switched in response to the first camera detecting the air gesture. Have you ever used air gestures? When it is detected that the user has not clicked on the first control and has not switched the shooting mode in response to the first camera detecting the air gesture, it is considered that the user has not learned how to use the air gesture and has not used the air gesture. In this case, A second pop-up window can automatically pop up when the electronic device is removed, guiding the user to learn to use air gestures. Further, the electronic device can perform the above detection when entering the multi-lens recording mode for the second time, and automatically pop up the second pop-up window when the above conditions are met.
在一种可能的实现方式中，拍摄预览界面还包括引导提示，引导提示设置于第一控件的预设区域，引导提示用于指示用户点击第一控件查看引导视频。可以理解地，电子设备可以通过显示引导提示来提醒用户学习使用隔空手势。进一步的，电子设备可以在第一次进入多镜录像模式时，显示该引导提示。In a possible implementation, the shooting preview interface also includes a guidance prompt, which is set in a preset area of the first control, and the guidance prompt is used to instruct the user to click the first control to view the guidance video. Understandably, the electronic device can remind the user to learn to use air gestures by displaying guidance prompts. Further, the electronic device can display the guidance prompt when entering the multi-lens recording mode for the first time.
在一种可能的实现方式中，拍摄预览界面还包括第二控件，方法还包括：响应于检测到用户对第二控件的操作，电子设备在拍摄预览界面显示第三弹窗，第三弹窗包括多种拍摄模式的预览界面；若电子设备正在录制视频，第一时间与当前时间的时间差大于第一预设时间，电子设备在拍摄预览界面显示第一弹窗，第一弹窗与第三弹窗不重叠。In a possible implementation, the shooting preview interface further includes a second control, and the method further includes: in response to detecting the user's operation on the second control, the electronic device displays a third pop-up window on the shooting preview interface, and the third pop-up window It includes a preview interface for multiple shooting modes; if the electronic device is recording a video and the time difference between the first time and the current time is greater than the first preset time, the electronic device displays the first pop-up window on the shooting preview interface, and the first pop-up window and the third time are displayed on the shooting preview interface. Pop-ups do not overlap.
在一种可能的实现方式中，手势标识包括：第一手势标识、第二手势标识及第三手势标识，第一手势标识指示向两侧移动的手势，第二手势标识指示翻转手掌的手势，第三手势标识指示握拳的手势。In a possible implementation, the gesture identifier includes: a first gesture identifier, a second gesture identifier, and a third gesture identifier. The first gesture identifier indicates a gesture of moving to both sides, and the second gesture identifier indicates a gesture of turning the palm. Gesture, the third gesture logo indicates the gesture of making a fist.
第二方面，本申请实施例提供了一种隔空手势的引导使用方法，方法应用于包括显示屏、第一摄像头和第二摄像头的电子设备，第一摄像头和第二摄像头位于显示屏的不同侧，第一摄像头与显示屏位于电子设备的同一侧，方法包括：电子设备显示拍摄预览界面，拍摄预览界面包括第一图像、第二图像中的至少一个，第一图像为第一摄像头实时采集的图像，第二图像为第二摄像头实时采集的图像；响应于接收到用户的第一操作，电子设备开始录制视频；若第一时间与当前时间的时间差大于第一预设时间，响应于在开始录制视频后的第二预设时间内，检测到第一摄像头所拍摄的用户与显示屏的距离大于或等于预设距离，电子设备在拍摄预览界面显示第一弹窗，第一弹窗包括手势标识，第一时间为电子设备上一次响应于第一摄像头检测到隔空手势而切换拍摄模式的时间。In the second aspect, embodiments of the present application provide a method for guiding the use of air gestures. The method is applied to an electronic device including a display screen, a first camera and a second camera. The first camera and the second camera are located on different sides of the display screen. side, the first camera and the display screen are located on the same side of the electronic device, and the method includes: the electronic device displays a shooting preview interface, the shooting preview interface includes at least one of a first image and a second image, and the first image is collected in real time by the first camera image, the second image is an image collected in real time by the second camera; in response to receiving the first operation of the user, the electronic device starts recording the video; if the time difference between the first time and the current time is greater than the first preset time, in response to Within the second preset time after starting to record the video, it is detected that the distance between the user captured by the first camera and the display screen is greater than or equal to the preset distance, and the electronic device displays a first pop-up window on the shooting preview interface, and the first pop-up window includes The first time of the gesture identifier is the time when the electronic device last switched the shooting mode in response to the first camera detecting the air gesture.
也就是说，在第一时间与当前时间的时间差大于第一预设时间的情况下，若电子设备在开始录制视频后的第二预设时间内，检测到第一摄像头所拍摄的用户与显示屏的距离大于或等于预设距离，则认为用户可能手持电子设备进行拍摄，因而显示第一弹窗，通过在引导弹窗上显示手势标识来提醒用户使用隔空手势切换拍摄模式。这种方法可有效提醒用户使用新功能(例如，隔空手势)，提升用户在拍摄过程中的效率。That is to say, when the time difference between the first time and the current time is greater than the first preset time, if the electronic device detects the user and the display image captured by the first camera within the second preset time after starting to record the video, If the distance between the screens is greater than or equal to the preset distance, it is considered that the user may be holding the electronic device for shooting, so the first pop-up window is displayed, and the gesture logo is displayed on the guidance pop-up window to remind the user to use the air gesture to switch the shooting mode. This method can effectively remind users to use new functions (such as air gestures) and improve user efficiency during the shooting process.
在一种可能的实现方式中，拍摄预览界面包括第一控件，方法还包括：响应于用户对第一控件的操作，电子设备在拍摄预览界面显示第二弹窗；电子设备在第二弹窗中按照预设顺序循环播放多个引导视频，多个引导视频中的每个引导视频用于展示一个隔空手势的使用方法。In a possible implementation, the shooting preview interface includes a first control, and the method further includes: in response to the user's operation on the first control, the electronic device displays a second pop-up window on the shooting preview interface; the electronic device displays a second pop-up window in the second pop-up window. Multiple guidance videos are played in a loop in a preset order, and each of the multiple guidance videos is used to demonstrate how to use an air gesture.
可见，电子设备不仅可以在录像过程中引导用户使用隔空手势，电子设备也可以通过第二弹窗来展示隔空手势的使用方法，从多个方面引导用户使用隔空手势。It can be seen that the electronic device can not only guide the user to use the air gesture during the recording process, but the electronic device can also display the method of using the air gesture through the second pop-up window, guiding the user to use the air gesture from multiple aspects.
在一种可能的实现方式中，方法还包括：响应于用户左滑第二弹窗的操作，电子设备在第二弹窗显示与正在播放的第一视频相邻的上一个引导视频，并停止循环播放；或，响应于用户右滑第二弹窗的操作，电子设备在第二弹窗显示与第一视频相邻的下一个引导视频，并停止循环播放。In a possible implementation, the method further includes: in response to the user's operation of sliding the second pop-up window left, the electronic device displays the previous guide video adjacent to the first video being played in the second pop-up window, and stops Loop playback; or, in response to the user's operation of right-swiping the second pop-up window, the electronic device displays the next guidance video adjacent to the first video in the second pop-up window, and stops loop playback.
也就是说，电子设备既可以在第二弹窗上自动循环播放多个引导视频，用户也可手动选择自己想看的引导视频。其中，在用户手动选择引导视频(即左滑或者右滑第二弹窗)后，电子设备便不再循环播放引导视频，而是显示用户选择的引导视频。In other words, the electronic device can automatically play multiple guidance videos in a loop on the second pop-up window, or the user can manually select the guidance video he wants to watch. Among them, after the user manually selects the guidance video (ie, swipes left or right on the second pop-up window), the electronic device no longer plays the guidance video in a loop, but displays the guidance video selected by the user.
在一种可能的实现方式中，第二弹窗包括第一显示区以及第二显示区，第一显示区用于循环播放多个引导视频，第二显示区用于循环显示多个引导视频对应的多个提示信息，多个引导视频与多个提示信息一一对应，每个提示信息用于解释对应的引导视频所展示的隔空手势的功能及使用方法，第一显示区正在显示的引导视频与第二显示区正在显示的提示信息对应。In a possible implementation, the second pop-up window includes a first display area and a second display area. The first display area is used to loop multiple guide videos, and the second display area is used to loop multiple guide videos corresponding to each other. Multiple prompt information, multiple guidance videos and multiple prompt information correspond one to one. Each prompt information is used to explain the function and use method of the air gesture displayed in the corresponding guidance video. The guidance being displayed in the first display area The video corresponds to the prompt information being displayed in the second display area.
也即，第二弹窗上不仅可以显示引导视频，还可显示与引导视频对应的提示信息(可包括文字和图标)，更利于用户理解隔空手势的使用方法。That is to say, not only the guidance video can be displayed on the second pop-up window, but also prompt information (which can include text and icons) corresponding to the guidance video can be displayed, which is more conducive to the user's understanding of how to use the air gesture.
在一种可能的实现方式中，第二弹窗包括确认选项，方法还包括：响应于用户对确认选项的操作，电子设备关闭第二弹窗。也即，该第二弹窗可以由用户手动关闭，若用户未点击确认选项，电子设备可以一直显示第二弹窗。In a possible implementation, the second pop-up window includes a confirmation option, and the method further includes: in response to the user's operation on the confirmation option, the electronic device closes the second pop-up window. That is, the second pop-up window can be closed manually by the user. If the user does not click the confirmation option, the electronic device can always display the second pop-up window.
在一种可能的实现方式中，方法还包括：若电子设备检测到用户未点击过第一控件，且未响应于第一摄像头检测到隔空手势而切换拍摄模式，电子设备在拍摄预览界面上显示第二弹窗。In a possible implementation, the method further includes: if the electronic device detects that the user has not clicked on the first control and does not switch the shooting mode in response to the first camera detecting the air gesture, the electronic device displays the shooting preview interface on the shooting preview interface. Display the second pop-up window.
可以看出，第一电子设备可以通过检测用户是否点击过第一控件来确认用户是否学习过隔空手势的用法，通过检测是否响应于第一摄像头检测到隔空手势而切换拍摄模式来确认用户是否使用过隔空手势。在检测到用户未点击过第一控件，且未响应于第一摄像头检测到隔空手势而切换拍摄模式时，认为用户未学习过隔空手势的用法以及未使用过隔空手势，这种情况下电子设备可以自动弹出第二弹窗，引导用户学习使用隔空手势。进一步的，电子设备可以在第二次进入多镜录像模式进行上述检测，并在满足上述条件时自动弹出第二弹窗。It can be seen that the first electronic device can confirm whether the user has learned the usage of the air gesture by detecting whether the user has clicked the first control, and confirms the user by detecting whether the shooting mode is switched in response to the first camera detecting the air gesture. Have you ever used air gestures? When it is detected that the user has not clicked on the first control and has not switched the shooting mode in response to the first camera detecting the air gesture, it is considered that the user has not learned how to use the air gesture and has not used the air gesture. In this case, A second pop-up window can automatically pop up when the electronic device is removed, guiding the user to learn to use air gestures. Further, the electronic device can perform the above detection when entering the multi-lens recording mode for the second time, and automatically pop up the second pop-up window when the above conditions are met.
在一种可能的实现方式中，拍摄预览界面还包括引导提示，引导提示设置于第一控件的预设区域，引导提示用于指示用户点击第一控件查看引导视频。可以理解地，电子设备可以通过显示引导提示来提醒用户学习使用隔空手势。进一步的，电子设备可以在第一次进入多镜录像模式时，显示该引导提示。In a possible implementation, the shooting preview interface also includes a guidance prompt, which is set in a preset area of the first control, and the guidance prompt is used to instruct the user to click the first control to view the guidance video. Understandably, the electronic device can remind the user to learn to use air gestures by displaying guidance prompts. Further, the electronic device can display the guidance prompt when entering the multi-lens recording mode for the first time.
在一种可能的实现方式中，拍摄预览界面还包括第二控件，方法还包括：响应于检测到用户对第二控件的操作，电子设备在拍摄预览界面显示第三弹窗，第三弹窗包括多种拍摄模式的预览界面；若电子设备正在录制视频，第一时间与当前时间的时间差大于第一预设时间，电子设备在拍摄预览界面显示第一弹窗，第一弹窗与第三弹窗不重叠。In a possible implementation, the shooting preview interface further includes a second control, and the method further includes: in response to detecting the user's operation on the second control, the electronic device displays a third pop-up window on the shooting preview interface, and the third pop-up window It includes a preview interface for multiple shooting modes; if the electronic device is recording a video and the time difference between the first time and the current time is greater than the first preset time, the electronic device displays the first pop-up window on the shooting preview interface, and the first pop-up window and the third time are displayed on the shooting preview interface. Pop-ups do not overlap.
在一种可能的实现方式中，手势标识包括：第一手势标识、第二手势标识及第三手势标识，第一手势标识指示向两侧移动的手势，第二手势标识指示翻转手掌的手势，第三手势标识指示握拳的手势。In a possible implementation, the gesture identifier includes: a first gesture identifier, a second gesture identifier, and a third gesture identifier. The first gesture identifier indicates a gesture of moving to both sides, and the second gesture identifier indicates a gesture of turning the palm. Gesture, the third gesture logo indicates the gesture of making a fist.
第三方面，本申请实施例提供了一种隔空手势的引导使用方法，方法应用于包括显示屏、第一摄像头和第二摄像头的电子设备，第一摄像头和第二摄像头位于显示屏的不同侧，第一摄像头与显示屏位于电子设备的同一侧，方法包括：电子设备显示拍摄预览界面，拍摄预览界面包括第一图像、第二图像中的至少一个，第一图像为第一摄像头实时采集的图像，第二图像为第二摄像头实时采集的图像；响应于接收到用户的第一操作，电子设备开始录制视频；若第一时间与当前时间的时间差大于第一预设时间，响应于在开始录制视频后的第二预设时间内，检测到第一图像占比缩小，电子设备在拍摄预览界面显示第一弹窗，第一弹窗包括手势标识，第一时间为电子设备上一次响应于第一摄像头检测到隔空手势而切换拍摄模式的时间，第一图像占比为第一图像中人脸区域的面积占比。In a third aspect, embodiments of the present application provide a method for guiding the use of air gestures. The method is applied to an electronic device including a display screen, a first camera and a second camera. The first camera and the second camera are located on different sides of the display screen. side, the first camera and the display screen are located on the same side of the electronic device, and the method includes: the electronic device displays a shooting preview interface, the shooting preview interface includes at least one of a first image and a second image, and the first image is collected in real time by the first camera image, the second image is an image collected in real time by the second camera; in response to receiving the first operation of the user, the electronic device starts recording the video; if the time difference between the first time and the current time is greater than the first preset time, in response to Within the second preset time after starting to record the video, it is detected that the proportion of the first image has shrunk, and the electronic device displays a first pop-up window on the shooting preview interface. The first pop-up window includes a gesture logo, and the first time is the last time the electronic device responded. When the first camera detects the air gesture and switches the shooting mode, the first image proportion is the area proportion of the face area in the first image.
也就是说，在第一时间与当前时间的时间差大于第一预设时间的情况下，若电子设备在开始录制视频后的第二预设时间内，检测到第一图像中人脸区域的面积占比缩小，则认为用户可能手持电子设备进行拍摄，因而显示第一弹窗，通过在引导弹窗上显示手势标识来提醒用户使用隔空手势切换拍摄模式。这种方法可有效提醒用户使用新功能(例如，隔空手势)，提升用户在拍摄过程中的效率。That is to say, when the time difference between the first time and the current time is greater than the first preset time, if the electronic device detects the area of the face area in the first image within the second preset time after starting to record the video, If the proportion is reduced, it is considered that the user may hold the electronic device to shoot, so the first pop-up window is displayed, and the gesture logo is displayed on the guidance pop-up window to remind the user to use the air gesture to switch the shooting mode. This method can effectively remind users to use new functions (such as air gestures) and improve user efficiency during the shooting process.
第四方面，本申请实施例提供了一种电子设备，包括显示屏、第一摄像头、第二摄像头及处理器，处理器和存储器耦合，存储器存储有程序指令，当存储器存储的程序指令被处理器执行时使得电子设备实现第一方面、第二方面或第三方面及其任一种可能的设计方式所述的方法。In the fourth aspect, embodiments of the present application provide an electronic device, including a display screen, a first camera, a second camera, and a processor. The processor is coupled to a memory, and the memory stores program instructions. When the program instructions stored in the memory are processed When the processor is executed, the electronic device realizes the method described in the first aspect, the second aspect or the third aspect and any possible design manner thereof.
第五方面，一种计算机可读存储介质，包括计算机指令；当计算机指令在电子设备上运行时，使得电子设备执行第一方面、第二方面或第三方面及其任一种可能的设计方式所述的方法。A fifth aspect, a computer-readable storage medium, including computer instructions; when the computer instructions are run on an electronic device, the electronic device causes the electronic device to execute the first aspect, the second aspect or the third aspect and any possible design method thereof. the method described.
第六方面，本申请提供一种芯片系统，该芯片系统包括一个或多个接口电路和一个或多个处理器。该接口电路和处理器通过线路互联。In a sixth aspect, the present application provides a chip system, which includes one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected through lines.
上述芯片系统可以应用于包括通信模块和存储器的电子设备。该接口电路用于从电子设备的存储器接收信号，并向处理器发送接收到的信号，该信号包括存储器中存储的计算机指令。当处理器执行该计算机指令时，电子设备可以执行如第一方面、第二方面或第三方面及其任一种可能的设计方式所述的方法。The above chip system can be applied to electronic devices including communication modules and memories. The interface circuit is configured to receive signals from the memory of the electronic device and send the received signals to the processor, the signals including computer instructions stored in the memory. When the processor executes the computer instructions, the electronic device may perform the method described in the first aspect, the second aspect, or the third aspect and any possible design manner thereof.
第七方面，本申请提供一种计算机程序产品，当所述计算机程序产品在计算机上运行时，使得所述计算机执行如第一方面、第二方面或第三方面及其任一种可能的设计方式所述的方法。In a seventh aspect, the present application provides a computer program product. When the computer program product is run on a computer, it causes the computer to execute the first aspect, the second aspect or the third aspect and any possible design thereof. method as described.
附图说明Description of the drawings
图1A为本申请实施例提供的一种电子设备的硬件结构示意图；Figure 1A is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application;
图1B为本申请实施例提供的一种电子设备的软件架构图；Figure 1B is a software architecture diagram of an electronic device provided by an embodiment of the present application;
图2A-图2B为本申请实施例提供的一组界面示意图；Figures 2A-2B are a set of interface schematic diagrams provided by embodiments of the present application;
图3A-图3B为本申请实施例提供的一组界面示意图；Figures 3A-3B are a set of interface schematic diagrams provided by embodiments of the present application;
图4为本申请实施例提供的一组界面示意图；Figure 4 is a set of interface schematic diagrams provided by the embodiment of the present application;
图5A-图5C为本申请实施例提供的一组界面示意图；Figures 5A-5C are a set of interface schematic diagrams provided by embodiments of the present application;
图6A-图6F为本申请实施例提供的一组界面示意图；Figures 6A-6F are a set of interface schematic diagrams provided by embodiments of the present application;
图7A-图7D为本申请实施例提供的一组界面示意图；Figures 7A-7D are a set of interface schematic diagrams provided by embodiments of the present application;
图8A-图8C为本申请实施例提供的一组界面示意图；Figures 8A-8C are a set of interface schematic diagrams provided by embodiments of the present application;
图9A-图9C为本申请实施例提供的一组界面示意图；Figures 9A-9C are a set of interface schematic diagrams provided by embodiments of the present application;
图10为本申请实施例提供的一组界面示意图；Figure 10 is a set of interface schematic diagrams provided by the embodiment of the present application;
图11A-图11B为本申请实施例提供的一组界面示意图；Figures 11A-11B are a set of interface schematic diagrams provided by embodiments of the present application;
图12为本申请实施例提供的一组界面示意图；Figure 12 is a set of interface schematic diagrams provided by the embodiment of the present application;
图13A-图13B为本申请实施例提供的一组界面示意图；Figures 13A-13B are a set of interface schematic diagrams provided by embodiments of the present application;
图14为本申请实施例提供的芯片系统的结构示意图。Figure 14 is a schematic structural diagram of a chip system provided by an embodiment of the present application.
具体实施方式Detailed ways
以下，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本实施例的描述中，除非另有说明，“多个”的含义是两个或两个以上。Hereinafter, the terms “first” and “second” are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features. Therefore, features defined as "first" and "second" may explicitly or implicitly include one or more of these features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.
为了下述各实施例的描述清楚简洁及便于本领域技术人员容易理解，首先给出相关概念或技术的简要介绍。In order to make the description of the following embodiments clear, concise and easy for those skilled in the art to understand, a brief introduction to related concepts or technologies is first given.
拍摄预览界面，指电子设备拍摄前或者拍摄时所显示的界面，可用于显示摄像头实时采集的图像。此外，拍摄预览界面还可显示多个控件，多个控件可包括用于开启/关闭闪光灯的闪光灯控件，用于开启/关闭美颜功能的美颜控件，可用于拍摄的快门控件等。The shooting preview interface refers to the interface displayed by the electronic device before or during shooting. It can be used to display the images collected by the camera in real time. In addition, the shooting preview interface can also display multiple controls. The multiple controls can include flash controls for turning on/off the flash, beauty controls for turning on/off the beauty function, shutter controls for shooting, etc.
单镜拍摄，指电子设备仅通过一个摄像头进行拍摄的模式。电子设备在单镜拍摄模式下，在拍摄预览界面中仅显示一个摄像头拍摄的图像。其中，单镜拍摄可包括前置拍摄模式、后置拍摄模式等。Single-lens shooting refers to a mode in which an electronic device shoots through only one camera. In the single-lens shooting mode, the electronic device only displays the image captured by one camera in the shooting preview interface. Among them, single-lens shooting may include front shooting mode, rear shooting mode, etc.
具体的，前置拍摄，指电子设备通过前置摄像头进行拍摄的模式。电子设备处于前置拍摄模式时，可在拍摄预览界面显示该前置摄像头实时采集的图像。Specifically, front-facing shooting refers to the mode in which electronic devices shoot through the front-facing camera. When the electronic device is in the front-facing shooting mode, the images captured by the front-facing camera in real time can be displayed on the shooting preview interface.
后置拍摄模式，指电子设备通过后置摄像头进行拍摄的模式。电子设备处于后置拍摄模式时，可在拍摄预览界面显示该后置摄像头实时采集的图像。Rear shooting mode refers to the mode in which electronic devices shoot through the rear camera. When the electronic device is in the rear shooting mode, the images captured by the rear camera in real time can be displayed on the shooting preview interface.
多镜拍摄，指电子设备可通过多个摄像头进行拍摄的模式。电子设备在多镜拍摄模式下，显示屏在拍摄预览界面中同时显示多个摄像头分别拍摄的图像，不同摄像头拍摄的图像可以拼接显示，或者以画中画的方式显示。其中，根据电子设备所用摄像头的类型，及不同摄像头拍摄的图像的显示方式，多镜拍摄可包括前后拍摄模式、后后拍摄模式、画中画拍摄模式等。在本申请实施例中，多镜拍摄也可称为多镜录像。Multi-lens shooting refers to a mode in which an electronic device can shoot through multiple cameras. When the electronic device is in multi-lens shooting mode, the display screen displays images taken by multiple cameras separately in the shooting preview interface at the same time. Images taken by different cameras can be spliced and displayed, or displayed in a picture-in-picture manner. Among them, according to the type of camera used in the electronic device and the display mode of the images captured by different cameras, multi-lens shooting may include front-to-back shooting mode, back-to-back shooting mode, picture-in-picture shooting mode, etc. In the embodiment of the present application, multi-lens shooting may also be called multi-lens video recording.
前后拍摄模式，指电子设备可通过前置摄像头和后置摄像头同时进行拍摄的模式。电子设备处于前后拍摄模式时，可在拍摄预览界面中同时显示前置摄像头和后置摄像头所拍摄的图像(例如，第一图像、第二图像)，第一图像与第二图像拼接显示。其中，当电子设备竖置时，第一图像与第二图像可上下拼接；当电子设备横置时，第一图像与第二图像可左右拼接。默认情况下，第一图像的显示面积与第二图像的显示面积一致。Front and back shooting mode refers to a mode in which an electronic device can shoot simultaneously through the front camera and the rear camera. When the electronic device is in the front and rear shooting mode, the images captured by the front camera and the rear camera can be displayed simultaneously in the shooting preview interface (for example, the first image, the second image), and the first image and the second image are spliced and displayed. Wherein, when the electronic device is placed vertically, the first image and the second image can be spliced up and down; when the electronic device is placed horizontally, the first image and the second image can be spliced left and right. By default, the display area of the first image is consistent with the display area of the second image.
后后拍摄模式，指电子设备可通过两个后置摄像头(如果存在多个后置摄像头)同时进行拍摄的模式。电子设备处于后后拍摄模式时，电子设备可在拍摄预览界面中同时显示两个后置摄像头所拍摄的图像(例如，第一图像、第二图像)，第一图像与第二图像拼接显示。其中，当电子设备竖置时，第一图像与第二图像可上下拼接；当电子设备横置时，第一图像与第二图像可左右拼接。Back-to-back shooting mode refers to a mode in which the electronic device can shoot simultaneously through two rear cameras (if there are multiple rear cameras). When the electronic device is in the rear-facing shooting mode, the electronic device can simultaneously display images (for example, a first image, a second image) captured by two rear cameras in the shooting preview interface, and the first image and the second image are spliced and displayed. Wherein, when the electronic device is placed vertically, the first image and the second image can be spliced up and down; when the electronic device is placed horizontally, the first image and the second image can be spliced left and right.
画中画拍摄模式，指电子设备可通过两个摄像头同时进行拍摄的模式。电子设备处于画中画拍摄模式时，可在拍摄预览界面中同时显示两个摄像头所拍摄的图像(例如，第一图像、第二图像)。其中，第二图像显示于拍摄预览界面的整个区域，第一图像叠放于第二图像上，且第一图像的显示面积小于第二图像的显示面积。默认情况下，第一图像可位于第二图像的左下方。上述两个摄像头可自由组合，例如可以为两个前置摄像头、两个后置摄像头或者一个前置摄像头和一个后置摄像头。Picture-in-picture shooting mode refers to a mode in which electronic devices can shoot through two cameras at the same time. When the electronic device is in the picture-in-picture shooting mode, the images captured by the two cameras (for example, the first image and the second image) can be displayed simultaneously in the shooting preview interface. The second image is displayed in the entire area of the shooting preview interface, the first image is stacked on the second image, and the display area of the first image is smaller than the display area of the second image. By default, the first image can be positioned to the lower left of the second image. The above two cameras can be freely combined, for example, they can be two front cameras, two rear cameras, or one front camera and one rear camera.
需要说明的是，上述“单镜拍摄”、“多镜拍摄”、“前置拍摄模式”、“后置拍摄模式”、“前后拍摄模式”、“画中画拍摄模式”、“后后拍摄模式”只是本申请实施例所使用的一些名称，其代表的含义在本申请实施例中已经记载，其名称并不能对本实施例构成任何限制。It should be noted that the above-mentioned "single-lens shooting", "multi-lens shooting", "front-facing shooting mode", "rear-facing shooting mode", "front-to-back shooting mode", "picture-in-picture shooting mode", "back-to-back shooting" "Mode" are just some names used in the embodiments of this application, and their representative meanings have been recorded in the embodiments of this application. Their names do not constitute any limitation on this embodiment.
本申请提供了一种隔空手势的引导使用方法，应用于包括显示屏第一摄像头和第二摄像头的电子设备，第一摄像头和第二摄像头位于显示屏的不同侧，第一摄像头与显示屏位于电子设备的同一侧。该电子设备可显示拍摄预览界面，该预览界面包括第一图像、第二图像中的至少一个，所述第一图像为所述第一摄像头实时采集的图像，所述第二图像为所述第二摄像头实时采集的图像。若第一时间与当前时间的时间差大于第一预设时间时，电子设备检测到用户存在使用隔空手势的需求，电子设备弹出隔空手势的引导弹窗(可以称为第一弹窗)，该引导弹窗包括手势标识，用于展示隔空手势的使用方法。其中，电子设备处于多镜录像模式下的录制状态，第一时间为电子设备上一次响应于第一摄像头检测到隔空手势而切换拍摄模式的时间(也可以理解为用户上一次使用隔空手势的时间)。通过本申请提供的方法，可及时提醒用户使用隔空手势来切换电子设备的拍摄模式，能有效提升人机交互效率及用户体验。This application provides a method for guiding the use of air gestures, which is applied to an electronic device including a first camera and a second camera of a display screen. The first camera and the second camera are located on different sides of the display screen. The first camera and the display screen Located on the same side as the electronics. The electronic device can display a shooting preview interface. The preview interface includes at least one of a first image and a second image. The first image is an image collected by the first camera in real time. The second image is the second image. Images collected by two cameras in real time. If the time difference between the first time and the current time is greater than the first preset time, the electronic device detects the user's need to use the air gesture, and the electronic device pops up a guidance pop-up window for the air gesture (which can be called the first pop-up window). The guidance pop-up window includes gesture logos to demonstrate how to use air gestures. Among them, when the electronic device is in the recording state in the multi-lens recording mode, the first time is the time when the electronic device last switched the shooting mode in response to the first camera detecting the air gesture (it can also be understood as the last time the user used the air gesture). time). Through the method provided by this application, users can be reminded in time to use air gestures to switch the shooting mode of electronic devices, which can effectively improve human-computer interaction efficiency and user experience.
其中，该电子设备可以为包括一个显示屏的电子设备或者折叠屏设备。在电子设备为单屏手机时，该第一摄像头和第二摄像头可分别为电子设备的前置摄像头和后置摄像头。在电子设备为折叠屏手机时，该显示屏可包括第一屏和第二屏，第一屏与第二屏转动连接，该第一摄像头、第二摄像头可分别位于第一屏的两侧，第一摄像头与第一屏位于该电子设备的同一侧。或者，第一摄像头位于第一屏，第二摄像头位于第二屏，且与第一屏、第二屏、第一摄像头和第二摄像头位于该电子设备的同一侧。在本申请实施例中，以电子设备为包括一个显示屏的电子设备为例进行说明。The electronic device may be an electronic device including a display screen or a folding screen device. When the electronic device is a single-screen mobile phone, the first camera and the second camera may be the front camera and the rear camera of the electronic device respectively. When the electronic device is a folding screen mobile phone, the display screen may include a first screen and a second screen. The first screen and the second screen are rotatably connected. The first camera and the second camera may be respectively located on both sides of the first screen. The first camera and the first screen are located on the same side of the electronic device. Alternatively, the first camera is located on the first screen, the second camera is located on the second screen, and the first screen, the second screen, the first camera and the second camera are located on the same side of the electronic device. In the embodiment of the present application, the electronic device is an electronic device including a display screen as an example for description.
用户存在使用隔空手势的需求的场景存在多种，后文将结合附图详细描述。此外，上述的隔空手势只是本申请实施例所使用的名称，其还可以被称为悬空手势、悬浮手势等，具体是指不接触电子设备而输入的手势，其代表的含义在本申请实施例中已经记载，其名称并不能对本实施例构成任何限制。There are many scenarios in which users need to use air gestures, which will be described in detail later with reference to the accompanying drawings. In addition, the above-mentioned air gestures are just names used in the embodiments of this application. They can also be called air gestures, floating gestures, etc. Specifically, they refer to gestures input without touching the electronic device. The meanings they represent are implemented in this application. It has been recorded in the example, and its name does not constitute any limitation on this embodiment.
为了更加清楚、详细地介绍本申请实施例提供的拍摄方法，下面先介绍本申请实施例提供实施该方法所涉及的电子设备。In order to introduce the photographing method provided by the embodiment of the present application more clearly and in detail, the electronic equipment involved in implementing the method provided by the embodiment of the present application will be introduced below.
电子设备可以是手机、平板电脑、桌面型计算机、膝上型计算机、手持计算机、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本，以及蜂窝电话、个人数字助理(personal digital assistant，PDA)、增强现实(augmentedreality，AR)设备、虚拟现实(virtual reality，VR)设备、人工智能(artificialintelligence,AI)设备、可穿戴式设备、车载设备、智能家居设备和/或智慧城市设备，本申请实施例对该电子设备的具体类型不作特殊限制。The electronic device may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, as well as a cellular phone, a personal digital assistant (personal digital assistant) assistant (PDA), augmented reality (AR) device, virtual reality (VR) device, artificial intelligence (AI) device, wearable device, vehicle-mounted device, smart home device and/or smart city device , the embodiment of the present application does not place special restrictions on the specific type of the electronic device.
参阅图1A，图1A示出了本申请实施例所提供的电子设备的硬件结构示意图。Referring to FIG. 1A , FIG. 1A shows a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application.
如图1A所示，该电子设备200可以处理器210，外部存储器接口220，内部存储器221，通用串行总线(universal serial bus，USB)接口230，充电管理模块240，电源管理模块241，电池242，天线1，天线2，移动通信模块250，无线通信模块260，音频模块270，扬声器270A，受话器270B，麦克风270C，耳机接口270D，传感器模块280，按键290，马达291，指示器292，多个摄像头293，显示屏294，以及用户标识模块(subscriber identificationmodule，SIM)卡接口295等。As shown in FIG. 1A , the electronic device 200 may include a processor 210 , an external memory interface 220 , an internal memory 221 , a universal serial bus (USB) interface 230 , a charging management module 240 , a power management module 241 , and a battery 242 , antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, audio module 270, speaker 270A, receiver 270B, microphone 270C, headphone interface 270D, sensor module 280, button 290, motor 291, indicator 292, multiple Camera 293, display screen 294, and subscriber identification module (subscriber identification module, SIM) card interface 295, etc.
其中，上述传感器模块280可以包括压力传感器，陀螺仪传感器，气压传感器，磁传感器，加速度传感器，距离传感器，接近光传感器，指纹传感器，温度传感器，触摸传感器，环境光传感器和骨传导传感器等传感器。The sensor module 280 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and other sensors.
可以理解的是，本实施例示意的结构并不构成对电子设备200的具体限定。在另一些实施例中，电子设备200可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。It can be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 200 . In other embodiments, the electronic device 200 may include more or fewer components than illustrated, or some components may be combined, or some components may be separated, or may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.
处理器210可以包括一个或多个处理单元，例如：处理器210可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processingunit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。The processor 210 may include one or more processing units. For example, the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), an image signal processor ( image signal processor (ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU), etc. . Among them, different processing units can be independent devices or integrated in one or more processors.
控制器可以是电子设备200的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。The controller may be the nerve center and command center of the electronic device 200 . The controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.
处理器210中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器210中的存储器为高速缓冲存储器。该存储器可以保存处理器210刚用过或循环使用的指令或数据。如果处理器210需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器210的等待时间，因而提高了系统的效率。The processor 210 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 210 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 210 . If the processor 210 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 210 is reduced, thus improving the efficiency of the system.
在一些实施例中，处理器210可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuitsound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purposeinput/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口等。可以理解的是，本实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对电子设备200的结构限定。在另一些实施例中，电子设备200也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。In some embodiments, processor 210 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuitsound, I2S) interface, a pulse code modulation (PCM) interface, and a universal asynchronous receiver (universal asynchronous receiver) /transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and/or Universal serial bus (USB) interface, etc. It can be understood that the interface connection relationships between the modules illustrated in this embodiment are only schematic illustrations and do not constitute a structural limitation of the electronic device 200 . In other embodiments, the electronic device 200 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
在本申请实施例中，处理器210可以接收到摄像头293拍摄的用户输入的隔空手势例如为“手掌”所对应的多个连续的图像，然后处理器210可以对该多个连续的图像进行对比分析，确定该多个连续的图像对应的隔空手势为“手掌”，并确定该隔空手势对应的操作例如是开始录制，之后处理器210可以控制相机应用程序执行对应的操作。该对应的操作例如可以包括：去调动多个摄像头同时拍摄图像，然后通过GPU将多个摄像头分别拍摄到的图像，通过拼接或画中画(局部叠加)等方式合成，并调用显示屏294将合成后的图像显示于电子设备的拍摄预览界面中。In this embodiment of the present application, the processor 210 may receive multiple consecutive images corresponding to the air gesture input by the user, such as "palm", captured by the camera 293, and then the processor 210 may perform processing on the multiple consecutive images. Through comparative analysis, it is determined that the air gesture corresponding to the multiple consecutive images is "palm", and it is determined that the operation corresponding to the air gesture is, for example, starting recording, and then the processor 210 can control the camera application to perform the corresponding operation. The corresponding operation may include, for example: mobilizing multiple cameras to capture images simultaneously, and then using the GPU to synthesize the images captured by the multiple cameras through splicing or picture-in-picture (local superposition), and calling the display screen 294 to combine the images. The combined image is displayed in the shooting preview interface of the electronic device.
外部存储器接口220可以用于连接外部存储卡，例如Micro SD卡，实现扩展电子设备200的存储能力。外部存储卡通过外部存储器接口220与处理器210通信，实现数据存储功能。例如将音乐，视频等文件保存在外部存储卡中。The external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200 . The external memory card communicates with the processor 210 through the external memory interface 220 to implement the data storage function. Such as saving music, videos, etc. files in external memory card.
内部存储器221可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器210通过运行存储在内部存储器221的指令，从而执行电子设备200的各种功能应用以及数据处理。例如，在本申请实施例中，处理器210可以通过执行存储在内部存储器221中的指令，内部存储器221可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储电子设备200使用过程中所创建的数据(比如音频数据，电话本等)等。此外，内部存储器221可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。Internal memory 221 may be used to store computer executable program code, which includes instructions. The processor 210 executes instructions stored in the internal memory 221 to execute various functional applications and data processing of the electronic device 200 . For example, in this embodiment of the present application, the processor 210 can execute instructions stored in the internal memory 221, and the internal memory 221 can include a program storage area and a data storage area. Among them, the stored program area can store an operating system, at least one application program required for a function (such as a sound playback function, an image playback function, etc.). The storage data area may store data created during use of the electronic device 200 (such as audio data, phone book, etc.). In addition, the internal memory 221 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
在本申请实施例中，内部存储器221可以存储有电子设备在不同拍摄模式下拍摄的图片文件或录制的视频文件等。In this embodiment of the present application, the internal memory 221 may store picture files or video files recorded by the electronic device in different shooting modes.
充电管理模块240用于从充电器接收充电输入。其中，充电器可以是无线充电器，也可以是有线充电器。充电管理模块240为电池242充电的同时，还可以通过电源管理模块241为终端设备供电。The charge management module 240 is used to receive charging input from the charger. Among them, the charger can be a wireless charger or a wired charger. While charging the battery 242, the charging management module 240 can also provide power to the terminal device through the power management module 241.
电源管理模块241用于连接电池242，充电管理模块240与处理器210。电源管理模块241接收电池242和/或充电管理模块240的输入，为处理器210，内部存储器221，外部存储器，显示屏294，摄像头293，和无线通信模块260等供电。在一些实施例中，电源管理模块241和充电管理模块240也可以设置于同一个器件中。The power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and/or the charging management module 240 and supplies power to the processor 210, internal memory 221, external memory, display screen 294, camera 293, wireless communication module 260, etc. In some embodiments, the power management module 241 and the charging management module 240 can also be provided in the same device.
电子设备200的无线通信功能可以通过天线1，天线2，移动通信模块250，无线通信模块260，调制解调处理器以及基带处理器等实现。在一些实施例中，电子设备200的天线1和移动通信模块250耦合，天线2和无线通信模块260耦合，使得电子设备200可以通过无线通信技术与网络以及其他设备通信。The wireless communication function of the electronic device 200 can be implemented through the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modem processor and the baseband processor. In some embodiments, the antenna 1 of the electronic device 200 is coupled to the mobile communication module 250, and the antenna 2 is coupled to the wireless communication module 260, so that the electronic device 200 can communicate with the network and other devices through wireless communication technology.
天线1和天线2用于发射和接收电磁波信号。电子设备200中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 200 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.
移动通信模块250可以提供应用在电子设备200上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块250可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块250可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。The mobile communication module 250 can provide wireless communication solutions including 2G/3G/4G/5G applied to the electronic device 200 . The mobile communication module 250 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 250 can receive electromagnetic waves from the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation.
移动通信模块250还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。在一些实施例中，移动通信模块250的至少部分功能模块可以被设置于处理器210中。在一些实施例中，移动通信模块250的至少部分功能模块可以与处理器210的至少部分模块被设置在同一个器件中。The mobile communication module 250 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 250 may be disposed in the processor 210 . In some embodiments, at least part of the functional modules of the mobile communication module 250 and at least part of the modules of the processor 210 may be provided in the same device.
无线通信模块260可以提供应用在电子设备200上的包括WLAN(如(wirelessfidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigationsatellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(nearfield communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。The wireless communication module 260 can provide WLAN (such as (wireless fidelity, Wi-Fi) network), Bluetooth (bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation) applied on the electronic device 200 , FM), near field communication technology (nearfield communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
无线通信模块260可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块260经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器210。无线通信模块260还可以从处理器210接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。The wireless communication module 260 may be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 210 . The wireless communication module 260 can also receive the signal to be sent from the processor 210, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
电子设备200通过GPU，显示屏294，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏294和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器210可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。The electronic device 200 implements display functions through a GPU, a display screen 294, an application processor, and the like. The GPU is an image processing microprocessor and is connected to the display screen 294 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.
显示屏294用于显示图像，视频等。该显示屏294包括显示面板。The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel.
电子设备200可以通过ISP，摄像头293，视频编解码器，GPU，显示屏294以及应用处理器等实现拍摄功能。ISP用于处理摄像头293反馈的数据。摄像头293用于捕获静态图像或视频。在一些实施例中，电子设备200可以包括N个摄像头293，N为大于2的正整数。The electronic device 200 can implement the shooting function through an ISP, a camera 293, a video codec, a GPU, a display screen 294, and an application processor. The ISP is used to process the data fed back by the camera 293. Camera 293 is used to capture still images or video. In some embodiments, the electronic device 200 may include N cameras 293, where N is a positive integer greater than 2.
电子设备200可以通过音频模块270，扬声器270A，受话器270B，麦克风270C，耳机接口270D，以及应用处理器等实现音频功能。例如音乐播放，录音等。The electronic device 200 can implement audio functions through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone interface 270D, and the application processor. Such as music playback, recording, etc.
按键290包括开机键，音量键等。按键290可以是机械按键。也可以是触摸式按键。马达291可以产生振动提示。马达291可以用于来电振动提示，也可以用于触摸振动反馈。指示器292可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。The buttons 290 include a power button, a volume button, etc. Key 290 may be a mechanical key. It can also be a touch button. The motor 291 can generate vibration prompts. The motor 291 can be used for vibration prompts for incoming calls and can also be used for touch vibration feedback. The indicator 292 may be an indicator light, which may be used to indicate charging status, power changes, or may be used to indicate messages, missed calls, notifications, etc.
多个摄像头293用于拍摄图像。在本申请实施例中，摄像头293的数量可以为M个，M≥2，M为正整数。电子设备在多镜拍摄中开启的摄像头的数量可以为N，2≤N≤M，N为正整数。Multiple cameras 293 are used to capture images. In this embodiment of the present application, the number of cameras 293 may be M, M≥2, and M is a positive integer. The number of cameras turned on by the electronic device during multi-lens shooting can be N, 2≤N≤M, and N is a positive integer.
在本申请实施例中，摄像头293的类型可以根据硬件配置以及物理位置进行区分。例如，摄像头293所包含的多个摄像头可以分别置于电子设备的正反两面，设置在电子设备的显示屏294那一面的摄像头可以称为前置摄像头，设置在电子设备的后盖那一面的摄像头可以称为后置摄像头；又例如，摄像头293所包含的多个摄像头的焦距、视角不同，焦距短、视角越大的摄像头可以称为广角摄像头，焦距长、视角小的摄像头可以称为普通摄像头。不同摄像头拍摄到的图像的内容的不同之处在于：前置摄像头用于拍摄电子设备正面面对的景物，而后置摄像头用于拍摄电子设备背面面对的景物；广角摄像头在较短的拍摄距离范围内，能拍摄到较大面积的景物，在相同的拍摄距离处所拍摄的景物，比使用普通镜头所拍摄的景物在画面中的影像小。其中，焦距的长短、视角的大小为相对概念，并无具体的参数限定，因此广角摄像头和普通摄像头也是一个相对概念，具体可以根据焦距、视角等物理参数进行区分。In this embodiment of the present application, the types of cameras 293 can be distinguished according to hardware configuration and physical location. For example, the multiple cameras included in the camera 293 can be placed on the front and back sides of the electronic device respectively. The camera set on the display screen 294 side of the electronic device can be called a front camera, and the camera set on the back cover side of the electronic device can be called a front camera. The camera can be called a rear camera; for another example, the multiple cameras included in the camera 293 have different focal lengths and viewing angles. The camera with a short focal length and a larger viewing angle can be called a wide-angle camera, and the camera with a long focal length and a small viewing angle can be called a normal camera. Camera. The difference in the content of images captured by different cameras is that the front camera is used to capture the scenery facing the front of the electronic device, while the rear camera is used to capture the scenery facing the back of the electronic device; the wide-angle camera is used at a shorter shooting distance Within the range, a larger area of scenery can be photographed. The scenery photographed at the same shooting distance has a smaller image in the frame than the scenery photographed with an ordinary lens. Among them, the length of the focal length and the size of the angle of view are relative concepts, and there are no specific parameter limits. Therefore, wide-angle cameras and ordinary cameras are also relative concepts, and can be distinguished based on physical parameters such as focal length and angle of view.
特别的，在本申请实施例中，摄像头293中至少包含一个具有(time of flight，TOF)3D感测模块或结构光(structured light)3D感测模块的摄像头，该摄像头获取拍摄图像中的物体的3D数据，以便处理器210可以根据物体的3D数据，识别用户的隔空手势对应的操作指令。Particularly, in this embodiment of the present application, the camera 293 includes at least one camera with a time of flight (TOF) 3D sensing module or a structured light (structured light) 3D sensing module, which acquires objects in the captured image. 3D data, so that the processor 210 can identify the operation instructions corresponding to the user's air gesture according to the 3D data of the object.
该用于获取物体3D数据的摄像头可以是独立的一个低功耗摄像头，也可以是其他普通的前置摄像头或后置摄像头，该普通的前置摄像头或后置摄像头支持低功耗模式，当低功耗摄像头工作时，或者普通前置摄像头或后置摄像头工作在低功耗模式时，摄像头的帧率比普通摄像头在非低功耗模式下工作的帧率低且输出的图像为黑白格式。通常普通的摄像头1秒可以输出30帧图像、60帧图像、90帧图像、240帧图像，但是该低功耗摄像头，或者普通前置摄像头或后置摄像头运行低功耗模式时，摄像头1秒可以输出例如2.5帧图像，而当摄像头拍摄到表示同一个隔空手势的第一张图像时，上述摄像头可以切换为1秒输出10帧图像，以通过连续的多张图像识别准确识别该隔空手势对应的操作指令，此外，该低功耗摄像头的拍摄的图像的像素低于普通摄像头拍摄的图像的像素。同时相比普通摄像头在给低功耗模式下工作降低了功耗。The camera used to obtain 3D data of an object can be an independent low-power camera, or other ordinary front-facing camera or rear-facing camera. The ordinary front-facing camera or rear-facing camera supports low-power consumption mode. When the low-power camera is working, or when the ordinary front camera or rear camera is working in the low-power mode, the frame rate of the camera is lower than the frame rate of the ordinary camera working in the non-low-power mode and the output image is in black and white format. . Usually, an ordinary camera can output 30 frames of images, 60 frames of images, 90 frames of images, and 240 frames of images in 1 second. However, when the low-power camera, or the ordinary front camera or rear camera runs in low-power mode, the camera can output 1 second. It can output, for example, 2.5 frames of images, and when the camera captures the first image representing the same space gesture, the above-mentioned camera can switch to output 10 frames of images in 1 second to accurately identify the space through continuous multiple image recognition. The operation instructions corresponding to the gestures. In addition, the pixels of the images captured by the low-power camera are lower than the pixels of the images captured by the ordinary cameras. At the same time, compared with ordinary cameras, working in low-power mode reduces power consumption.
显示屏294用于显示图像，视频等。在一些实施例中，电子设备可以包括1个或N个显示屏294，N为大于1的正整数。在本申请实施例中，显示屏294可用于显示来自任意一个或多个摄像头293拍摄的图像，例如在拍摄预览界面中显示来自一个摄像头拍摄的多帧图像，或者在已保存的视频文件中显示来自一个摄像头293的多帧图像，或者在已保存的图片文件中显示来自一个摄像头293的一张照片。The display screen 294 is used to display images, videos, etc. In some embodiments, the electronic device may include 1 or N display screens 294, where N is a positive integer greater than 1. In this embodiment of the present application, the display screen 294 can be used to display images captured by any one or more cameras 293 , such as displaying multiple frames of images captured by one camera in the shooting preview interface, or displaying them in a saved video file. Multiple frames of images from one camera 293, or one photo from one camera 293 displayed in a saved picture file.
SIM卡接口295用于连接SIM卡。SIM卡可以通过插入SIM卡接口295，或从SIM卡接口295拔出，实现和电子设备200的接触和分离。电子设备200可以支持1个或N个SIM卡接口，N为大于1的正整数。SIM卡接口295可以支持Nano SIM卡，Micro SIM卡，SIM卡等。The SIM card interface 295 is used to connect a SIM card. The SIM card can be connected to or separated from the electronic device 200 by inserting it into the SIM card interface 295 or pulling it out from the SIM card interface 295 . The electronic device 200 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. SIM card interface 295 can support Nano SIM card, Micro SIM card, SIM card, etc.
图1B是本发明实施例提供的电子设备的软件结构框图。FIG. 1B is a software structure block diagram of an electronic device provided by an embodiment of the present invention.
分层架构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将Android系统分为四层，从上至下分别为应用程序层，应用程序框架层，安卓运行时(Android runtime)和系统库，以及内核层。The layered architecture divides the software into several layers, and each layer has clear roles and division of labor. The layers communicate through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime (Android runtime) and system libraries, and kernel layer.
应用程序层可以包括一系列应用程序包。The application layer can include a series of application packages.
如图1B所示，应用程序包可以包括相机，图库，日历，通话，地图，导航，WLAN，蓝牙，音乐，视频，短信息等应用程序。As shown in Figure 1B, the application package can include camera, gallery, calendar, calling, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.
应用程序框架层为应用程序层的应用程序提供应用编程接口(applicationprogramming interface，API)和编程框架。应用程序框架层包括一些预先定义的函数。The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.
如图1B所示，应用程序框架层可以包括窗口管理器，内容提供器，视图系统，电话管理器，资源管理器，通知管理器等。As shown in Figure 1B, the application framework layer can include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。A window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc.
内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。Content providers are used to store and retrieve data and make this data accessible to applications. Said data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如，包括短信通知图标的显示界面，可以包括显示文字的视图以及显示图片的视图。The view system includes visual controls, such as controls that display text, controls that display pictures, etc. A view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
电话管理器用于提供电子设备的通信功能。例如通话状态的管理(包括接通，挂断等)。Telephone managers are used to provide communication functions of electronic devices. For example, call status management (including connected, hung up, etc.).
资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。The resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, etc.
通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知管理器被用于告知下载完成，消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息，发出提示音，电子设备振动，指示灯闪烁等。The notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a beep sounds, the electronic device vibrates, the indicator light flashes, etc.
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。Android Runtime includes core libraries and virtual machines. The Android runtime is responsible for the scheduling and management of the Android system.
核心库包含两部分：一部分是java语言需要调用的功能函数，另一部分是安卓的核心库。The core library contains two parts: one is the functional functions that need to be called by the Java language, and the other is the core library of Android.
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理，堆栈管理，线程管理，安全和异常的管理，以及垃圾回收等功能。The application layer and application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and application framework layer into binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions.
系统库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(Media Libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (Media Libraries), 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.
表面管理器用于对显示子系统进行管理，并且为多个应用程序提供了2D和3D图层的融合。The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
媒体库支持多种常用的音频，视频格式回放和录制，以及静态图像文件等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
三维图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing.
2D图形引擎是2D绘图的绘图引擎。2D Graphics Engine is a drawing engine for 2D drawing.
内核层是硬件和软件之间的层。内核层至少包含显示驱动，摄像头驱动，音频驱动，传感器驱动。The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
下面结合捕获拍照场景，示例性说明电子设备在拍摄过程中软件以及硬件的工作流程。The following is an example of the workflow of the software and hardware of the electronic device during the shooting process by combining the capture of the photographing scene.
当触摸传感器接收到触摸操作，相应的硬件中断被发给内核层。内核层将触摸操作加工成原始输入事件(包括触摸坐标，触摸操作的时间戳等信息)。原始输入事件被存储在内核层。应用程序框架层从内核层获取原始输入事件，识别该输入事件所对应的控件。以该触摸操作是触摸单击操作，该单击操作所对应的控件为相机应用图标的控件为例，相机应用调用应用框架层的接口，启动相机应用，进而通过调用内核层启动摄像头驱动，通过摄像头293捕获静态图像或视频。在本申请实施例中，上述触摸传感器接收到触摸操作可以由摄像头293拍摄到用户输入的隔空手势的操作来代替。具体的，当摄像头293拍摄到隔空手势的操作，相应的硬件中断被发给内核层。内核层将隔空手势操作加工成原始输入事件(包括隔空手势的图像，隔空手势操作的时间戳等信息)。原始输入事件被存储在内核层。应用程序框架层从内核层获取原始输入事件，识别该输入事件所对应的操作。以该隔空手势操作是切换拍摄模式的操作为例，相机应用调用应用框架层的接口，进而通过调用内核层启动其他摄像头驱动，从而切换为其他摄像头293来捕获静态图像或视频。When the touch sensor receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes touch operations into raw input events (including touch coordinates, timestamps of touch operations, and other information). Raw input events are stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation and the control corresponding to the click operation as a camera application icon control as an example, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer. Camera 293 captures still images or video. In this embodiment of the present application, the touch operation received by the touch sensor may be replaced by the camera 293 capturing the air gesture input by the user. Specifically, when the camera 293 captures the air gesture operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the air gesture operation into original input events (including the image of the air gesture, the timestamp of the air gesture operation, and other information). Raw input events are stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies the operation corresponding to the input event. Taking the air gesture operation as an example of switching the shooting mode, the camera application calls the interface of the application framework layer, and then starts other camera drivers by calling the kernel layer, thereby switching to other cameras 293 to capture still images or videos.
接下来，将结合附图说明本申请提供的隔空手势的引导使用方法的具体内容。Next, the specific content of the guided use method of air gesture provided by this application will be explained with reference to the accompanying drawings.
电子设备可在第一次进入多镜录像时弹出隔空手势的引导弹窗，向用户展示隔空手势的使用方法。电子设备也可在检测到用户上一次使用隔空手势的时间与当前时间的时间差大于第一预设时间且检测到用户存在使用隔空手势的需求时，弹出隔空手势的引导弹窗，向用户展示隔空手势的使用方法。以下内容将分别结合附图描述在上述两种场景下电子设备弹出引导弹窗的过程。The electronic device can pop up a guidance pop-up window for air gestures when entering multi-lens recording for the first time to show users how to use air gestures. The electronic device can also pop up a guidance pop-up window for the air gesture when it detects that the time difference between the last time the user used the air gesture and the current time is greater than the first preset time and detects that the user has a need to use the air gesture. User shows how to use air gesture. The following content will be combined with the accompanying drawings to describe the process of the electronic device popping up the guidance pop-up window in the above two scenarios.
参阅图2A-图2B，示出了电子设备第一次进入多镜录像的过程。Referring to FIGS. 2A and 2B , the process of the electronic device entering multi-lens recording for the first time is shown.
如图2A所示，手机可显示主界面301。主界面301可包括相机应用的图标302。手机可接收用户点击该图标302的操作，响应于该操作，如图2B所示，手机可开启相机应用并显示相机应用的拍摄预览界面303。可以理解的是，相机应用是智能手机、平板电脑等电子设备上的一款图像拍摄的应用，其可以是系统应用也可以是第三方应用，本申请对该应用的名称不做限制。也即是说，用户可以点击相机应用的图标302来打开相机应用的拍摄预览界面303。不限于此，用户还可以在其他应用中调用相机应用以打开拍摄预览界面303，例如用户在社交类应用中点击拍摄控件来打开拍摄预览界面303。该社交类应用，可支持用户向他人分享所拍摄的图片或视频等。As shown in Figure 2A, the mobile phone can display the main interface 301. The main interface 301 may include an icon 302 of the camera application. The mobile phone can receive the user's operation of clicking the icon 302, and in response to the operation, as shown in FIG. 2B, the mobile phone can open the camera application and display the shooting preview interface 303 of the camera application. It can be understood that the camera application is an image capturing application on electronic devices such as smartphones and tablets. It can be a system application or a third-party application. This application does not limit the name of the application. That is to say, the user can click the icon 302 of the camera application to open the shooting preview interface 303 of the camera application. Not limited to this, the user can also call the camera application in other applications to open the shooting preview interface 303. For example, the user clicks on the shooting control in a social application to open the shooting preview interface 303. This social application allows users to share captured pictures or videos with others.
需要说明的是，拍摄预览界面303可以是相机应用的默认拍摄模式的用户界面，例如可以是相机应用处于前置拍摄模式时提供的用户界面。可以理解的是，该默认拍摄模式也可以为其他，例如后置拍摄模式、前后拍摄模式等。又或者，相机应用可以具备记忆功能，该拍摄预览界面303可以为相机应用上一次退出时，相机应用所处的拍摄模式的用户界面。It should be noted that the shooting preview interface 303 may be the user interface of the default shooting mode of the camera application, for example, it may be the user interface provided when the camera application is in the front shooting mode. It is understandable that the default shooting mode can also be other, such as rear shooting mode, front and rear shooting mode, etc. Alternatively, the camera application may have a memory function, and the shooting preview interface 303 may be the user interface of the shooting mode in which the camera application was exited last time.
图2B以拍摄预览界面303为相机应用处于前置拍摄模式时对应的拍摄预览界面为例进行说明。如图2B所示，拍摄预览界面303可包括预览图像304拍摄模式选项305、闪光灯控件、快门控件等。其中，预览图像304为多个摄像头293中的前置摄像头拍摄的图像。需要说明的是，电子设备可实时刷新拍摄预览界面303所显示的图像(即预览图像304)，以便于用户预览摄像头293当前拍摄到的图像。拍摄模式选项305用于提供多种拍摄模式供用户选择。多种拍摄模式可包括：拍照305a、录像305b、多镜录像305c、实时虚化、全景等。电子设备可接收用户左滑/右滑该拍摄模式选项305的操作，响应于该操作，电子设备可开启用户选择的拍摄模式。需要说明的是，不限于图2B所示，拍摄模式选项305中可以显示比图2B所示更多或者更少的选项。FIG. 2B takes the shooting preview interface 303 as an example to illustrate the corresponding shooting preview interface when the camera application is in the front-facing shooting mode. As shown in Figure 2B, the shooting preview interface 303 may include a preview image 304, shooting mode options 305, flash controls, shutter controls, etc. The preview image 304 is an image captured by a front camera among the plurality of cameras 293 . It should be noted that the electronic device can refresh the image displayed on the shooting preview interface 303 (ie, the preview image 304) in real time, so that the user can preview the image currently captured by the camera 293. The shooting mode option 305 is used to provide multiple shooting modes for the user to choose. Various shooting modes can include: photo 305a, video 305b, multi-lens video 305c, real-time blur, panorama, etc. The electronic device can receive the user's operation of sliding left/right on the shooting mode option 305, and in response to the operation, the electronic device can turn on the shooting mode selected by the user. It should be noted that the shooting mode options 305 may display more or fewer options than those shown in FIG. 2B without being limited to those shown in FIG. 2B .
其中，拍照305a所对应的拍摄模式即常用的单镜拍摄，可包括前置拍摄模式、后置拍摄模式等。也即，当拍照305a被选中时，电子设备可通过前置摄像头或后置摄像头进行拍照。其中关于前置拍摄模式、后置拍摄模式的具体介绍请参照前文，在此暂不赘述。Among them, the shooting mode corresponding to the photo taking 305a is the commonly used single-lens shooting, which may include a front shooting mode, a rear shooting mode, etc. That is, when taking pictures 305a is selected, the electronic device can take pictures through the front camera or the rear camera. Please refer to the previous article for specific introduction to the front shooting mode and rear shooting mode, and will not go into details here.
多镜录像305c所对应的拍摄模式可包括多镜拍摄及单镜拍摄。也即，当多镜录像305c被选中时，电子设备既可以通过一个摄像头进行单镜拍摄，也可以通过多个摄像头进行多镜拍摄。其中，关于多镜拍摄下的具体介绍可以参考前文的具体描述，在此暂不赘述。The shooting modes corresponding to the multi-lens video recording 305c may include multi-lens photography and single-lens photography. That is, when the multi-lens video recording 305c is selected, the electronic device can either perform single-lens photography through one camera or multi-lens photography through multiple cameras. Among them, for the specific introduction of multi-lens shooting, you can refer to the previous specific description, and will not be repeated here.
如图2B所示，拍照305a处于被选中状态。也即，电子设备当前处于拍照模式。若用户希望开启多镜录像模式，则可左滑拍摄模式选项305，并选择多镜录像305c。当检测到用户左滑拍摄模式选项305并选中多镜录像305c的操作时，电子设备可开启多镜录像模式并显示如图3A所示的拍摄预览界面401。As shown in Figure 2B, taking pictures 305a is in a selected state. That is, the electronic device is currently in the photo-taking mode. If the user wants to turn on the multi-lens recording mode, he can slide the shooting mode option 305 left and select the multi-lens recording 305c. When it is detected that the user slides the shooting mode option 305 left and selects the multi-lens recording 305c operation, the electronic device can turn on the multi-lens recording mode and display the shooting preview interface 401 as shown in Figure 3A.
如图3A所示，进入多镜录像模式后，电子设备可显示拍摄预览界面401。该拍摄预览界面401包括图像401a(也可称为第二图像)、图像401b(也可称为第一图像)、隔空换镜控件402、教学引导控件403、提示信息404、设置控件405及拍摄模式切换控件406。图像401a为后置摄像头实时采集的图像，图像401b为前置摄像头实时采集的图像，且由于电子设备竖置，该图像401a与图像401b上下拼接。具体的，第一图像位于拍摄预览界面的第一区域，第二图像位于拍摄预览界面的第二区域，第一区域与第二区域不重叠。示例性的，第一区域可以为图3A中图像401b所在区域，第二区域可以为图3A中图像401a所在区域。As shown in Figure 3A, after entering the multi-lens recording mode, the electronic device can display a shooting preview interface 401. The shooting preview interface 401 includes an image 401a (also called a second image), an image 401b (also called a first image), a remote lens change control 402, a teaching guidance control 403, prompt information 404, a setting control 405 and Shooting mode switching control 406. Image 401a is an image collected in real time by the rear camera, and image 401b is an image collected in real time by the front camera. Since the electronic device is placed vertically, image 401a and image 401b are spliced up and down. Specifically, the first image is located in the first area of the shooting preview interface, the second image is located in the second area of the shooting preview interface, and the first area and the second area do not overlap. For example, the first area may be the area where the image 401b in FIG. 3A is located, and the second area may be the area where the image 401a in FIG. 3A is located.
需要说明的是，在本申请中，电子设备第一次进入多镜录像模式时，默认开启前置摄像头和后置摄像头，图像的显示方式默认为拼接方式。但在其他实施方式中，默认开启的摄像头也可以为两个后置摄像头、一个前置摄像头或者一个后置摄像头等。此外，图像的显示方式不仅限于拼接方式，还可以为画中画方式等，在此不做具体限制。又或者，相机应用可具备记忆功能，在电子设备进入多镜录像模式后，电子设备可开启相机应用上一次从多镜录像模式退出时正在工作的摄像头，并以上一次的显示方式进行显示。It should be noted that in this application, when the electronic device enters the multi-lens recording mode for the first time, the front camera and the rear camera are turned on by default, and the image display mode is the splicing mode by default. However, in other implementations, the cameras enabled by default may also be two rear cameras, one front camera, one rear camera, etc. In addition, the display method of the image is not limited to the splicing method, but can also be a picture-in-picture method, etc., and there are no specific restrictions here. Or, the camera application can have a memory function. After the electronic device enters the multi-lens recording mode, the electronic device can turn on the camera that was working when the camera application last exited from the multi-lens recording mode, and display it in the previous display mode.
其中，隔空换镜控件402可供用户快速开启/关闭隔空换镜功能。隔空换镜功能开启后，用户可通过隔空手势控制电子设备。需要说明的是，电子设备进入多镜录像模式后，可默认开启隔空换镜功能。因此，该隔空换镜控件402处于开启状态(又可以称为第一状态)，用于指示隔空换镜功能已开启。当然，隔空换镜功能也可关闭。例如，响应于检测到用户作用于该隔空换镜控件402的触摸操作，电子设备可关闭隔空换镜功能。此时，隔空换镜控件402处于关闭状态(又可称为第二状态)，用于指示隔空换镜功能已关闭。Among them, the air-to-air mirror-changing control 402 allows the user to quickly turn on/off the air-to-air mirror-changing function. After the air-to-air mirror-changing function is turned on, users can control electronic devices through air-to-air gestures. It should be noted that after the electronic device enters the multi-mirror recording mode, the mirror-changing function can be enabled by default. Therefore, the air-to-air mirror-changing control 402 is in an on state (also called the first state), which is used to indicate that the air-to-air mirror-changing function is turned on. Of course, the remote mirror changing function can also be turned off. For example, in response to detecting a user's touch operation on the air-to-air mirror-changing control 402, the electronic device may turn off the air-to-air mirror-changing function. At this time, the air-to-air mirror-changing control 402 is in a closed state (also called the second state), which is used to indicate that the air-to-air mirror-changing function has been turned off.
教学引导控件403(也可称为第一控件)可用于引导用户学习隔空换镜的隔空手势，例如开启录制的隔空手势、切换双镜和单镜的手势、开启/关闭画中画的手势、前后镜头互换的手势、结束录制的手势等。需要说明的是，该教学引导控件403与隔空换镜功能关联：当隔空换镜功能被开启(或者说隔空换镜控件402处于开启状态)时，拍摄预览界面401可显示该教学引导控件403；当隔空换镜功能被关闭(或者说隔空换镜控件402处于关闭状态)时，拍摄预览界面401可隐藏(可以理解为不显示)该教学引导控件403。需要说明的是，当电子设备开启录制后，也可隐藏该教学引导控件403。The teaching guidance control 403 (also called the first control) can be used to guide the user to learn air gestures for changing mirrors in the air, such as turning on recorded air gestures, switching between dual mirrors and single mirrors, turning on/off picture-in-picture gestures, gestures for switching front and rear cameras, gestures for ending recording, etc. It should be noted that the teaching guidance control 403 is associated with the air-to-air mirror-changing function: when the air-to-air mirror-changing function is turned on (or the air-to-air mirror-changing control 402 is turned on), the shooting preview interface 401 can display the teaching guide. Control 403; when the air-to-air lens changing function is turned off (or the air-to-air lens changing control 402 is in a closed state), the shooting preview interface 401 can hide (can be understood as not displaying) the teaching guidance control 403. It should be noted that when the electronic device starts recording, the teaching guidance control 403 can also be hidden.
该提示信息404(也可称为引导提示)设置于教学引导控件403的预设位置(例如设置于教学引导控件403的左边，并指向教学引导控件403)，用于提醒用户点击教学引导控件403，以查看隔空换镜手势的教学。例如，该提示信息404可以为“点击可查看“隔空换镜”手势”。The prompt information 404 (also called a guidance prompt) is set at a preset position of the teaching guidance control 403 (for example, it is set to the left of the teaching guidance control 403 and points to the teaching guidance control 403), and is used to remind the user to click on the teaching guidance control 403. , to view the tutorial on the mirror-changing gesture in the air. For example, the prompt information 404 may be "Click to view the "air mirror changing" gesture".
设置控件405可用于调整拍摄照片的参数(如分辨率、图片比例等)以及开启或关闭一些用于拍照的方式(如隔空换镜、定时拍摄、微笑抓拍、声控拍照等)等。具体的，电子设备可接收用户点击设置控件405的操作，响应于该操作，电子设备可显示如图3B所示的设置界面405a。设置界面405a可包括隔空换镜405b、照片比例、声控拍照等选项。该隔空换镜405b可开启或关闭隔空换镜功能。需要说明的是，该设置界面405a中的隔空换镜405b的开关状态与拍摄预览界面401中的隔空换镜控件402的开关状态是联动的，且隔空换镜405b的开关状态与隔空换镜控件402的开关状态保持一致。也即，若隔空换镜405b由开启状态/关闭状态切换为关闭状态/开启状态，隔空换镜控件402也由开启状态/关闭状态切换为关闭状态/开启状态，反之亦然。The setting control 405 can be used to adjust the parameters of taking photos (such as resolution, picture ratio, etc.) and enable or close some methods for taking photos (such as changing lenses in the air, timed shooting, smile capture, voice-activated photo taking, etc.). Specifically, the electronic device may receive the user's operation of clicking the setting control 405, and in response to the operation, the electronic device may display the setting interface 405a as shown in FIG. 3B. The setting interface 405a may include options such as remote lens changing 405b, photo ratio, voice-activated photo taking, etc. The air-to-air mirror changing function 405b can turn on or off the air-to-air mirror changing function. It should be noted that the on/off state of the air-to-air lens change 405b in the setting interface 405a is linked to the on/off state of the air-to-air lens change control 402 in the shooting preview interface 401, and the on/off state of the air-to-air lens change 405b is linked to the on/off state of the air-to-air lens change 405b. The switch status of the air-changing mirror control 402 remains consistent. That is, if the air-to-air mirror change 405b switches from the on/off state to the off/on state, the air-to-air mirror change control 402 also switches from the on/off state to the off/on state, and vice versa.
拍摄模式切换控件406可用于提供多种拍摄模式给用户进行选择，如前后拍摄模式、后后拍摄模式、画中画拍摄模式、前置拍摄模式、后置拍摄模式等。The shooting mode switching control 406 can be used to provide multiple shooting modes for the user to choose, such as front-to-back shooting mode, back-to-back shooting mode, picture-in-picture shooting mode, front-facing shooting mode, rear-facing shooting mode, etc.
需要说明的是，从电子设备再次进度多镜录像的过程可与图2A-图2B所示的过程一致。区别在于，电子设备已经进入过多镜录像后，其拍摄预览界面上不再显示提示信息404。It should be noted that the process of re-starting multi-lens video recording from the electronic device can be consistent with the process shown in FIGS. 2A and 2B . The difference is that after the electronic device has entered multi-lens recording, the prompt message 404 will no longer be displayed on the shooting preview interface.
若用户希望查看隔空手势的教学引导，则可点击该教学引导控件403。如图4所示，电子设备可接收用户点击教学引导控件403的操作，响应于该操作，电子设备可显示如图5A所示的引导弹窗407(也可称为第二弹窗)。引导弹窗407可用于展示隔空手势的使用方式及相关辅助解释。具体的，引导弹窗407可包括动画显示区407a(也可以称为第一显示区)、文字提示区407b(也可称为第二显示区)及确认选项407c。其中，动画显示区407a用于展示多个引导视频，以展示隔空手势的使用方法及效果。在一种设计中，动效显示407a可以动画的方式进行展示，动画比较生动、易懂，有助于用户快速理解、学习隔空手势。文字提示区407b所显示的内容与动效显示区407a所显示的内容匹配，可用于辅助解释动画显示区407a正在显示的隔空手势的功能，以及隔空手势的使用方法。If the user wants to view the teaching guidance of the air gesture, he can click the teaching guidance control 403. As shown in Figure 4, the electronic device can receive the user's operation of clicking the teaching guidance control 403. In response to the operation, the electronic device can display the guidance pop-up window 407 (also called the second pop-up window) as shown in Figure 5A. The guidance pop-up window 407 can be used to show how to use the air gesture and related auxiliary explanations. Specifically, the guidance pop-up window 407 may include an animation display area 407a (which may also be called a first display area), a text prompt area 407b (which may also be called a second display area), and a confirmation option 407c. Among them, the animation display area 407a is used to display multiple guidance videos to demonstrate the use method and effect of the air gesture. In one design, the dynamic effect display 407a can be displayed in the form of animation. The animation is relatively vivid and easy to understand, which helps users quickly understand and learn air gestures. The content displayed in the text prompt area 407b matches the content displayed in the animation display area 407a, and can be used to assist in explaining the function of the air gesture being displayed in the animation display area 407a, and how to use the air gesture.
如图5A-图5C所示，动画显示区407a可显示隔空开启录制的引导动画。As shown in FIGS. 5A to 5C , the animation display area 407a can display a boot animation for air-to-air recording.
具体的，如图5A所示，在动画显示区407a中，电子设备处于前后拍摄模式。电子设备可在拍摄预览界面408上显示后置摄像头拍摄的图像409a和前置摄像头拍摄的图像409b。电子设备还可在识别到“举手”的手势后显示隔空换镜图标410。如图5B所示，电子设备持续检测到保持该“举手”的手势时，可逐渐填充隔空换镜图标410的时间进度条，并在第一预设时间(例如2秒)后显示如图5C所示的拍摄预览界面408。与如图5A所示的拍摄预览界面408相比，图5C所示的拍摄预览界面408为电子设备开启录制状态后的拍摄预览界面。Specifically, as shown in Figure 5A, in the animation display area 407a, the electronic device is in the front and back shooting mode. The electronic device may display the image 409a captured by the rear camera and the image 409b captured by the front camera on the shooting preview interface 408. The electronic device may also display the mirror-changing icon 410 after recognizing the "raise hand" gesture. As shown in FIG. 5B , when the electronic device continues to detect the "raise hand" gesture, the time progress bar of the air-to-air mirror-changing icon 410 can be gradually filled in, and after the first preset time (for example, 2 seconds), the following is displayed: The shooting preview interface 408 shown in Figure 5C. Compared with the shooting preview interface 408 shown in FIG. 5A , the shooting preview interface 408 shown in FIG. 5C is a shooting preview interface after the electronic device turns on the recording state.
与之对应的，文字提示区407b可显示“隔空开启录制，举手出现隔空换镜图标410(图中显示具体图标)后，等待2秒”，用于辅助用户理解如何使用隔空手势开启录制。Correspondingly, the text prompt area 407b can display "Start recording through the air, raise your hand and wait for 2 seconds after the air-to-air lens change icon 410 appears (the specific icon is shown in the figure)" to assist the user in understanding how to use the air-to-air gesture. Start recording.
如图6A-图6F所示，动画显示区407a还可显示隔空切换双镜和单镜的引导动画。As shown in Figures 6A to 6F, the animation display area 407a can also display a guidance animation for switching between dual mirrors and single mirrors over the air.
其中，图6A-图6C显示了电子设备从双镜切换为单镜的引导动画。Among them, Figures 6A to 6C show the guidance animation of the electronic device switching from dual mirrors to single mirrors.
如图6A所示，在动画显示区407a中，电子设备处于前后拍摄模式。电子设备可在拍摄预览界面408上显示后置摄像头拍摄的图像409a和前置摄像头拍摄的图像409b。其中，图像409a位于拍摄预览界面408的左边，图像409b位于拍摄预览界面408的右边。仍然如图6A所示，电子设备可在识别到“举手”的手势后显示隔空换镜图标410。如图6B所示，电子设备检测到“手掌从右向左滑动”的手势后，可从前后拍摄模式切换为前置拍摄模式，显示如图6C所示的拍摄预览界面408，该拍摄预览界面408包括图像409b。在切换过程中，图像409a可根据从右向左的手势相应的从右向左移动并逐渐缩小其显示面积最终从拍摄预览界面408中消失，而图像409b相应的从右向左移动并逐渐增加显示面积最终填充于整个拍摄预览界面408。As shown in Figure 6A, in the animation display area 407a, the electronic device is in the front and rear shooting mode. The electronic device may display the image 409a captured by the rear camera and the image 409b captured by the front camera on the shooting preview interface 408. Among them, image 409a is located on the left side of the shooting preview interface 408, and image 409b is located on the right side of the shooting preview interface 408. Still as shown in FIG. 6A , the electronic device may display the air-to-air mirror-changing icon 410 after recognizing the "raise hand" gesture. As shown in Figure 6B, after the electronic device detects the gesture of "sliding the palm from right to left", it can switch from the front and rear shooting mode to the front shooting mode, and display the shooting preview interface 408 as shown in Figure 6C. The shooting preview interface 408 includes image 409b. During the switching process, the image 409a can move from right to left and gradually reduce its display area according to the right-to-left gesture, and finally disappear from the shooting preview interface 408, while the image 409b can move from right to left and gradually increase The display area is finally filled in the entire shooting preview interface 408.
图6D-图6F显示了电子设备从单镜切换为双镜的引导动画。Figures 6D-6F show a boot animation of the electronic device switching from a single mirror to a dual mirror.
如图6D所示，电子设备在处于前置拍摄模式时，可在拍摄预览界面408中显示前置摄像头拍摄的图像409b。此外，电子设备还可在识别“举手”的手势后显示隔空换镜图标410。如图6E所示，电子设备可在检测到“手掌从左向右滑动”的手势后，将拍摄模式从前置拍摄模式切换为前后拍摄模式，并显示如图6F所示的拍摄预览界面408。在图6F中，电子设备同时显示后置摄像头拍摄的图像409a和前置摄像头拍摄的图像409b。其中，图像409a和图像408b的显示形式为左右拼接的形式，并且，图像409a可根据手掌从左向右滑动的手势相应的逐渐增加显示面积最终显示在拍摄预览界面408的左侧，图像408b相应的从左向右移动并逐渐减小其显示面积最终显示在拍摄预览界面408的右侧。As shown in Figure 6D, when the electronic device is in the front-facing shooting mode, the image 409b captured by the front-facing camera can be displayed in the shooting preview interface 408. In addition, the electronic device can also display the mirror-changing icon 410 after recognizing the "raise hand" gesture. As shown in Figure 6E, after detecting the gesture of "sliding the palm from left to right", the electronic device can switch the shooting mode from the front shooting mode to the front and back shooting mode, and display the shooting preview interface 408 as shown in Figure 6F. . In FIG. 6F, the electronic device simultaneously displays the image 409a captured by the rear camera and the image 409b captured by the front camera. Among them, the display form of image 409a and image 408b is in the form of left and right splicing, and the image 409a can gradually increase the display area according to the gesture of sliding the palm from left to right, and is finally displayed on the left side of the shooting preview interface 408, and the image 408b accordingly. moves from left to right and gradually reduces its display area and is finally displayed on the right side of the shooting preview interface 408 .
与之对应的，在图6A-图6F中，该文字提示区407b可显示“隔空切换双镜和单镜，举手出现隔空换镜图标410后，横屏时，左滑推走左屏，右滑推走右屏。(竖屏时，左滑推走上屏，右滑推走下屏)”，用于辅助用户理解如何使用隔空手势在单镜和双镜间切换。Correspondingly, in Figures 6A to 6F, the text prompt area 407b can display "Switch between dual mirrors and single mirrors in the air. After raising your hand to change the mirror icon 410 in the air, when the screen is horizontal, slide left to push away the left mirror. screen, swipe right to push away the right screen. (When the screen is in portrait orientation, swipe left to push up the screen, and swipe right to push away the bottom screen)" is used to help users understand how to use air gestures to switch between single mirror and dual mirror.
如图7A-图7C所示，动画显示区407a还可显示隔空开启/关闭画中画的引导动画。As shown in FIGS. 7A to 7C , the animation display area 407a can also display a guidance animation for turning on/off picture-in-picture over the air.
如图7A所示，电子设备处于后置拍摄模式，并在拍摄预览界面408中显示后置摄像头拍摄的图像409a。仍然如图7A所示，电子设备可在识别到“举手”的手势后显示隔空换镜图标410。如图7B所示，电子设备可在识别到“举手并握拳”的手势后，开启画中画模式并显示如图7C所示的拍摄预览界面408。图7C所示的拍摄预览界面408同时显示图像409a和图像409b。其中，图像409a仍显示于拍摄预览界面408的整个显示区域，图像409b叠加于该图像409a上。As shown in FIG. 7A , the electronic device is in the rear shooting mode, and the image 409 a captured by the rear camera is displayed in the shooting preview interface 408 . As still shown in FIG. 7A , the electronic device may display a mirror-changing icon 410 after recognizing the "raise hand" gesture. As shown in FIG. 7B , the electronic device can turn on the picture-in-picture mode and display the shooting preview interface 408 as shown in FIG. 7C after recognizing the gesture of "raising hands and making a fist". The shooting preview interface 408 shown in FIG. 7C displays image 409a and image 409b simultaneously. Among them, the image 409a is still displayed in the entire display area of the shooting preview interface 408, and the image 409b is superimposed on the image 409a.
此外，动画显示区407a还可显示图7A-图7C的逆过程。也即，电子设备可在图7C所示的拍摄预览界面408中检测到“举手”的手势之后，显示如图7B所示的拍摄预览界面408。然后在图7B所示的拍摄预览界面408中检测到“举手并握拳”的手势后，显示如图7A所示的拍摄预览界面408。换句话说，用户可通过该“举手并握拳”的手势开启或关闭画中画。In addition, the animation display area 407a can also display the reverse process of FIG. 7A-FIG. 7C. That is, the electronic device may display the shooting preview interface 408 shown in FIG. 7B after detecting the "raise hand" gesture in the shooting preview interface 408 shown in FIG. 7C . Then, after detecting the "raise hand and make a fist" gesture in the shooting preview interface 408 shown in FIG. 7B , the shooting preview interface 408 shown in FIG. 7A is displayed. In other words, users can turn on or off picture-in-picture through this "raise your hand and make a fist" gesture.
与之对应的，在图7A-图7C中，该文字提示区域407b可显示“隔空开启/关闭画中画，举手出现隔空手势图标408后，握拳”，用于辅助用户理解如何使用隔空手势开启/关闭画中画。Correspondingly, in Figures 7A to 7C, the text prompt area 407b can display "Turn on/off picture-in-picture through air, raise your hand and make a fist after the air gesture icon 408 appears" to assist the user in understanding how to use it. Air gesture turns on/off picture-in-picture.
在一种可能的设计中，电子设备在显示图7A所示的拍摄预览界面408前，还可显示如图7D所示的拍摄预览界面408，该拍摄预览界面408为电子设备为识别到“举手”的手势前所显示的界面。该拍摄预览界面408可显示提示信息411，该提示信息411用于提示用户，处于后置拍摄模式时电子设备可使用前置摄像头识别隔空手势，避免用户感觉隐私被侵犯。在本申请实施例中，该提示信息411可以为图标。但在其他实施例中，该提示信息411可以为文字或者文字与图标结合的形式。需要说明的是，图7D所示场景，也可以单独作为一个引导动画显示于动画显示区407a中，而不是与隔空切换双镜与单镜的动画结合在一起。In a possible design, before displaying the shooting preview interface 408 shown in FIG. 7A , the electronic device can also display the shooting preview interface 408 shown in FIG. 7D . The shooting preview interface 408 is used by the electronic device to recognize the "lift" The interface displayed in front of the hand" gesture. The shooting preview interface 408 can display prompt information 411. The prompt information 411 is used to prompt the user that when in the rear shooting mode, the electronic device can use the front camera to recognize the air gesture to prevent the user from feeling that his privacy has been violated. In this embodiment of the present application, the prompt information 411 may be an icon. However, in other embodiments, the prompt information 411 may be in the form of text or a combination of text and icons. It should be noted that the scene shown in FIG. 7D can also be displayed in the animation display area 407a as a guidance animation alone, instead of being combined with the animation of switching between dual mirrors and single mirrors in the air.
如图8A-图8C所示，动画显示区407a还可显示隔空切换前后镜头的引导动画。As shown in FIGS. 8A to 8C , the animation display area 407a can also display the guidance animation of the before and after air switching lenses.
如图8A所示，电子设备处于后置拍摄模式，并在拍摄预览界面408中显示后置摄像头拍摄的图像409a。电子设备可在识别到“举手”的手势后显示隔空换镜图标410。如图8B所示，电子设备可在识别到“从手心翻转到手背”的手势后，将拍摄模式从后置拍摄模式切换为前置拍摄模式，并显示如图7C所示的拍摄预览界面408。该拍摄预览界面408中显示有前置摄像头拍摄的图像409b。As shown in FIG. 8A , the electronic device is in the rear shooting mode, and the image 409 a captured by the rear camera is displayed in the shooting preview interface 408 . The electronic device may display the remote mirror changing icon 410 after recognizing the "raise hand" gesture. As shown in Figure 8B, the electronic device can switch the shooting mode from the rear shooting mode to the front shooting mode after recognizing the gesture of "turning from the palm to the back of the hand", and display the shooting preview interface 408 as shown in Figure 7C. . The image 409b captured by the front camera is displayed in the shooting preview interface 408.
与之对应的，在图8A-图8C中，该文字提示区域407b可显示“隔空切换前后镜头，举手出现隔空手势图标408后，从手心翻转到手背”，用于辅助用户理解如何使用隔空手势切换前后镜头。Correspondingly, in Figures 8A to 8C, the text prompt area 407b can display "switch the front and rear lenses in the air, raise your hand to appear the air gesture icon 408, flip from the palm to the back of the hand" to assist the user in understanding how to Use air gestures to switch between front and rear cameras.
在本申请实施例中，电子设备显示在电子设备显示如图8A所示的拍摄预览界面408前，电子设备也可显示如图7D所示的拍摄预览界面408，其具体内容参照前文，在此暂不赘述。In the embodiment of the present application, before the electronic device displays the shooting preview interface 408 as shown in Figure 8A, the electronic device can also display the shooting preview interface 408 as shown in Figure 7D. Please refer to the previous article for its specific content. No further details for now.
如图9A-图9C所示，动画显示区407a还可显示隔空结束录制的引导动画。As shown in Figures 9A to 9C, the animation display area 407a can also display a guidance animation for ending recording in the air.
如图9A所示，电子设备处于前后拍摄模式，并在拍摄预览界面408中显示后置摄像头拍摄的图像409a和前置摄像头拍摄的图像409b，且图像409a与图像409b左右拼接。电子设备可在识别到举手的手势后显示隔空换镜图标410。如图9B所示，在如图9A所示的场景下，电子设备可在识别到“OK”的手势后，显示如图9C所示的拍摄预览界面408。与如图9A所示的拍摄预览界面408相比，图9C所示的拍摄预览界面408为电子设备结束录制状态后的拍摄预览界面。As shown in FIG. 9A , the electronic device is in the front-to-back shooting mode, and the image 409a captured by the rear camera and the image 409b captured by the front camera are displayed in the shooting preview interface 408, and the image 409a and the image 409b are spliced left and right. The electronic device may display the air-to-air mirror-changing icon 410 after recognizing the hand-raising gesture. As shown in FIG. 9B , in the scene shown in FIG. 9A , after recognizing the "OK" gesture, the electronic device may display the shooting preview interface 408 as shown in FIG. 9C . Compared with the shooting preview interface 408 shown in FIG. 9A , the shooting preview interface 408 shown in FIG. 9C is a shooting preview interface after the electronic device ends the recording state.
与之对应的，在图9A-图9C中，该文字提示区域407b可显示“隔空结束录制，举手出现隔空手势图标408后，将拇指和食指连成圆圈，其他手指自然弯曲”，用于辅助用户理解如何使用隔空手势结束录制。Correspondingly, in Figures 9A to 9C, the text prompt area 407b can display "To end recording in the air, raise your hand after the air gesture icon 408 appears, connect your thumb and index finger to form a circle, and bend the other fingers naturally." Used to assist users in understanding how to use air gestures to end recording.
在引导弹窗407中，动画显示区407a可自动轮播并循环播放隔空开启录制、隔空切换双镜和单镜、隔空开启/关闭画中画、隔空切换前后镜头、隔空结束录制的引导动画。需要说明的是，其播放顺序并不一定按照隔空开启录制、隔空切换双镜和单镜、隔空开启/关闭画中画、隔空切换前后镜头、隔空结束录制的顺序进行播放，而是可以存在其他播放顺序，在此不做具体限制。In the guidance pop-up window 407, the animation display area 407a can automatically rotate and loop to start recording over the air, switch between dual mirrors and single mirrors over the air, turn on/off picture-in-picture over the air, switch front and rear lenses over the air, and end over the air. Recorded boot animation. It should be noted that the playback sequence does not necessarily follow the order of starting recording over the air, switching between dual-lens and single-lens over the air, turning on/off picture-in-picture over the air, switching between front and rear lenses over the air, and ending recording over the air. Instead, there may be other playback sequences, which are not specifically limited here.
需要说明的是，上述的隔空手势仅为示例，该隔空手势还可以为其他，例如“胜利”手势、“左右挥手”的手势等等。It should be noted that the above-mentioned air gesture is only an example, and the air gesture can also be other gestures, such as a "victory" gesture, a "left and right wave" gesture, and so on.
在本申请实施例中，电子设备还可接收用户滑动引导弹窗407的操作，响应于该操作，电子设备可切换动画显示区407a正在播放的引导动画，以及文字显示区407b所显示的提示信息。示例性的，若电子设备按照隔空开启录制、隔空切换双镜和单镜、隔空开启/关闭画中画、隔空切换前后镜头、隔空结束录制的顺序依次播放对应的引导动画。则如图10所示，电子设备可在引导弹窗407显示隔空切换前后镜头的引导动画及相关文字解释。电子设备可接收用户左滑该引导弹窗407的操作，响应于该操作，如图9A所示，电子设备将引导弹窗407中显示的引导动画切换为隔空结束录制的引导动画。In the embodiment of the present application, the electronic device can also receive the user's operation of sliding the guidance pop-up window 407. In response to the operation, the electronic device can switch the guidance animation being played in the animation display area 407a and the prompt information displayed in the text display area 407b. . For example, if the electronic device sequentially plays the corresponding guide animation in the order of starting recording over the air, switching between dual mirrors and single mirror over the air, turning on/off picture-in-picture over the air, switching front and rear lenses over the air, and ending recording over the air. As shown in Figure 10, the electronic device can display the guidance animation and related text explanations of the before and after air switching in the guidance pop-up window 407. The electronic device can receive the user's operation of swiping left on the guidance pop-up window 407. In response to the operation, as shown in FIG. 9A, the electronic device switches the guidance animation displayed in the guidance pop-up window 407 to the guidance animation that ends recording in the air.
需要说明的是，电子设备接收到用户手动切换动画的操作后，电子设备不再自动轮播多个引导动画。也即，一旦用户手动切换过动画，电子设备便只能在再一次接收到用户切换动画的操作后，才能再次切换引导弹窗407所播放的引导动画。It should be noted that after the electronic device receives the user's manual operation of switching animations, the electronic device no longer automatically rotates multiple guide animations. That is, once the user manually switches the animation, the electronic device can only switch the guidance animation played by the guidance pop-up window 407 again after receiving the user's operation to switch the animation again.
确认选项407c用于供用户提前结束教学引导。例如，该确认选项407c可以为“知道了”。示例性的，如图11A所示，电子设备可接收用户点击该确认选项407c的操作，响应于该操作，电子设备关闭引导弹窗407，并显示如图11B所示的拍摄预览界面401。该拍摄预览界面401与图4所示的拍摄预览界面401类似，区别在于：该拍摄预览界面401不再显示该提示信息404。需要说明的是，用户可在电子设备播放任意一个引导动画时，点击该确认选项407c使电子设备关闭引导弹窗407。Confirmation option 407c is used for the user to end the teaching guidance early. For example, the confirmation option 407c may be "got it". For example, as shown in Figure 11A, the electronic device can receive the user's operation of clicking the confirmation option 407c. In response to the operation, the electronic device closes the guidance pop-up window 407 and displays the shooting preview interface 401 as shown in Figure 11B. The shooting preview interface 401 is similar to the shooting preview interface 401 shown in FIG. 4 , except that the shooting preview interface 401 no longer displays the prompt information 404 . It should be noted that when the electronic device plays any guidance animation, the user can click the confirmation option 407c to cause the electronic device to close the guidance pop-up window 407.
可见，电子设备未接收到切换动画的指令或是结束引导的指令前，电子设备可自动轮播多个引导动画。而在电子设备接收到切换动画的指令后，电子设备便不再自动轮播多个引导动画。电子设备接收到结束引导的指令后，可结束教学引导。It can be seen that before the electronic device receives an instruction to switch animations or an instruction to end guidance, the electronic device can automatically rotate multiple guidance animations. After the electronic device receives the instruction to switch animations, the electronic device no longer automatically rotates multiple guide animations. After receiving the instruction to end the guidance, the electronic device can end the teaching guidance.
在本申请实施例中，若电子设备未检测到用户点击过该教学引导控件403，用户也未使用过隔空手势，电子设备可在第二次进入多镜录像模式时主动显示引导弹窗407，主动引导用户学习隔空手势。其中，关于该引导弹窗407的描述参照前文中的相关内容，在此暂不赘述。在一种可选的实施例中，电子设备可以检测是否曾响应于第一摄像头检测到隔空手势而切换拍摄模式。若电子设备曾响应于第一摄像头检测到隔空手势而切换拍摄模式，则可以认为用户使用过隔空手势。若电子设备未响应于第一摄像头检测到隔空手势而切换拍摄模式，则可以认为用户未使用过隔空手势。In the embodiment of the present application, if the electronic device does not detect that the user has clicked on the teaching guidance control 403 and the user has not used the air gesture, the electronic device can actively display the guidance pop-up window 407 when entering the multi-lens recording mode for the second time. , actively guide users to learn air gestures. For the description of the guidance pop-up window 407, please refer to the relevant content mentioned above, and will not be described again here. In an optional embodiment, the electronic device may detect whether the shooting mode has been switched in response to the first camera detecting the air gesture. If the electronic device has switched the shooting mode in response to the first camera detecting the air gesture, it can be considered that the user has used the air gesture. If the electronic device does not switch the shooting mode in response to the first camera detecting the air gesture, it can be considered that the user has not used the air gesture.
也即，电子设备可在第一次进入多镜录像模式时，提醒用户查看关于隔空手势的教学引导。若电子设备第一次进入多镜录像模式时用户未查看该教学引导(可以理解为电子设备未检测到用户点击过教学引导控件403)可在第二次进入多镜录像模式时自动播放关于隔空手势的教学引导。通过多次引导用户观看关于隔空手势的教学引导，可提升用户查看教学引导的概率，尽可能使用户快速学会隔空手势，提升人机交互效率。That is to say, the electronic device can remind the user to view the teaching guidance on air gestures when entering the multi-lens recording mode for the first time. If the user does not view the teaching guide when the electronic device enters the multi-lens recording mode for the first time (it can be understood that the electronic device does not detect that the user has clicked on the teaching guidance control 403), it can automatically play the video about the interval when the electronic device enters the multi-lens recording mode for the second time. Teaching guidance for empty gestures. By guiding users to watch the teaching guidance on air gestures multiple times, the probability of users viewing the teaching guidance can be increased, allowing users to learn air gestures as quickly as possible, and improving the efficiency of human-computer interaction.
在电子设备第一次进入多镜录像时显示引导弹窗407，其主要目的在于引导用户学习如何使用隔空手势。但用户学习以后，可能并不会真的经常使用隔空手势。因此，电子设备还可在适当的时机引导用户使用隔空手势。When the electronic device enters multi-lens recording for the first time, a guidance pop-up window 407 is displayed. Its main purpose is to guide the user to learn how to use air gestures. But after users learn it, they may not really use air gestures often. Therefore, electronic devices can also guide users to use air gestures at the appropriate time.
具体的，电子设备可在检测到用户上一次使用隔空手势的时间(也可以理解为电子设备上一次响应于第一摄像头检测到隔空手势而切换拍摄模式的时间，或者第一时间)与当前时间的时间差大于第一预设时间且检测到用户存在使用隔空手势的需求时，弹出隔空手势的引导弹窗，向用户展示隔空手势的使用方法。其中，电子设备处于多镜录像下的录制状态。Specifically, the electronic device can detect the last time the user used the air gesture (which can also be understood as the last time the electronic device switched the shooting mode in response to the first camera detecting the air gesture, or the first time). When the time difference between the current time and the present time is greater than the first preset time and it is detected that the user needs to use the air gesture, a guidance pop-up window for the air gesture pops up to show the user how to use the air gesture. Among them, the electronic device is in a recording state under multi-lens recording.
若用户上一次使用隔空手势的时间与当前时间的时间差大于第一预设时间，则可以认为用户曾经会使用隔空手势，但可能由于忘记使用隔空手势或者遗忘隔空手势，导致用户长时间未再次使用隔空手势。在这种情况下去提醒用户使用隔空手势，可避免频繁提醒用户使用隔空手势导致影响用户体验。需要说明的是，该隔空手势可以为隔空开启录制的手势、隔空切换双镜和单镜的手势、隔空开启/关闭画中画的手势、隔空切换前后镜头的手势、隔空结束录制的手势中的任意一种手势。If the time difference between the last time the user used the Air gesture and the current time is greater than the first preset time, it can be considered that the user has used the Air gesture before, but may have forgotten to use the Air gesture or forgotten the Air gesture, causing the user to Time has passed since Air Gesture was used again. In this case, reminding the user to use air gestures can avoid frequently reminding users to use air gestures, which may affect the user experience. It should be noted that this air gesture can be a gesture to open recording in the air, a gesture to switch between dual mirrors and a single mirror in the air, a gesture to turn on/off picture-in-picture in the air, a gesture to switch the front and rear lenses in the air, and Any of the gestures to end recording.
在一种可选的设计中，若电子设备在开启录制后的第二预设时间内，检测到前置画面内的用户与显示屏的距离大于或等于预设距离，可认为电子设备检测到用户存在使用隔空手势的需求。In an optional design, if the electronic device detects that the distance between the user in the front screen and the display screen is greater than or equal to the preset distance within the second preset time after starting recording, the electronic device can be considered to have detected There is a need for users to use air gestures.
其中，前置画面内的用户可以理解为前置摄像头所拍摄的用户。前置画面内的用户与显示屏的距离大于或等于预设距离可以理解为，电子设备的拍摄预览界面正在显示前置摄像头所拍摄的图像，且用户与显示屏的距离大于或等于预设距离。该预设距离可以指用户在不缩小自身与显示屏的距离的情况下，无法触摸显示屏的距离。示例性的，该预设距离可以为用户使用自拍杆持电子设备录制时，用户与显示屏的距离，例如为60厘米。Among them, the user in the front screen can be understood as the user captured by the front camera. If the distance between the user and the display screen in the front screen is greater than or equal to the preset distance, it can be understood that the shooting preview interface of the electronic device is displaying the image captured by the front camera, and the distance between the user and the display screen is greater than or equal to the preset distance. . The preset distance may refer to the distance at which the user cannot touch the display screen without reducing the distance between himself and the display screen. For example, the preset distance may be the distance between the user and the display screen when the user uses a selfie stick to hold the electronic device to record, for example, 60 cm.
可以理解地，在上述场景下若用户通过触摸显示屏上的拍摄模式切换控件406来切换拍摄模式，很容易影响前置摄像头的取景，从而影响视频的质量。因此，在这种情况下可以认为用户存在使用隔空手势的需求，可以引导用户使用隔空手势。It can be understood that in the above scenario, if the user switches the shooting mode by touching the shooting mode switching control 406 on the display screen, it will easily affect the framing of the front camera, thus affecting the quality of the video. Therefore, in this case, it can be considered that the user has a need to use air gestures, and the user can be guided to use air gestures.
示例性的，电子设备可在开启录制视频后的第二预设时间内，检测到前置画面内的用户与显示屏的距离大于或等于预设距离时，显示如图12所示的拍摄预览界面401。该拍摄预览界面401与图11B所示的拍摄预览界面401类似，区别在于：该拍摄预览界面401中的图像401a与图像401b为左右拼接，这是因为电子设备被横置。此外，该拍摄预览界面401还包括引导弹窗412(也可以称为第一弹窗)。该引导弹窗412用于展示隔空手势以引导用户使用隔空手势。例如，该引导弹窗412可显示用于隔空切换双镜和单镜的手势、用于隔空切换前后镜头的手势、用于隔空开启/关闭画中画的手势。For example, when the electronic device detects that the distance between the user and the display screen in the front screen is greater than or equal to the preset distance within the second preset time after starting the video recording, the electronic device can display the shooting preview as shown in Figure 12 Interface 401. The shooting preview interface 401 is similar to the shooting preview interface 401 shown in FIG. 11B. The difference is that the image 401a and the image 401b in the shooting preview interface 401 are spliced left and right because the electronic device is placed horizontally. In addition, the shooting preview interface 401 also includes a guidance pop-up window 412 (which may also be called a first pop-up window). The guidance pop-up window 412 is used to display the air gesture to guide the user to use the air gesture. For example, the guidance pop-up window 412 can display gestures for air switching between dual mirrors and single mirrors, gestures for air switching between front and rear lenses, and gestures for turning on/off picture-in-picture over the air.
在一种可选的设计中，若电子设备在开启录制后的第二预设时间内，检测到第一图像占比缩小，其中第一图像占比为第一图像中人脸区域的面积占比，认为检测到用户存在使用隔空手势的需求，电子设备可显示如图12所示的引导弹窗412。In an optional design, if the electronic device detects that the proportion of the first image is reduced within the second preset time after starting the recording, the first image proportion is the area of the face area in the first image. For example, it is considered that the user's need to use air gestures is detected, and the electronic device may display a guidance pop-up window 412 as shown in Figure 12 .
在一种可选的设计中，在电子设备连接自拍杆时，可认为电子设备检测到用户存在使用隔空手势的需求。In an optional design, when the electronic device is connected to the selfie stick, it may be considered that the electronic device detects the user's need to use the air gesture.
其中，电子设备可通过耳机孔、蓝牙、WIFI等方式与自拍杆连接。示例性的，电子设备开启蓝牙功能后，可接收自拍杆发送的配对请求。该配对请求可携带有自拍杆的设备名称、媒体存取控制(media access control，mac)地址以及设备类型标识。该设备类型标识指示配对请求的发送端的设备类型为自拍杆。如此，电子设备与自拍杆配对并连接后，可根据该设备类型标识确认自身连接自拍杆。Among them, electronic devices can be connected to the selfie stick through headphone jacks, Bluetooth, WIFI, etc. For example, after turning on the Bluetooth function, the electronic device can receive the pairing request sent by the selfie stick. The pairing request may carry the device name of the selfie stick, a media access control (MAC) address, and a device type identifier. The device type identifier indicates that the device type of the sender of the pairing request is a selfie stick. In this way, after the electronic device is paired and connected to the selfie stick, it can confirm that it is connected to the selfie stick according to the device type identification.
当电子设备连接自拍杆时，可以认为用户存在远距离拍摄的需求，在这种情况下，若用户通过触摸显示屏上的拍摄模式切换控件406来切换拍摄模式，也会影响前置摄像头的取景，从而影响视频的质量。因此，在这种情况下可以认为用户存在使用隔空手势的需求，可以引导用户使用隔空手势。When the electronic device is connected to the selfie stick, it can be considered that the user has a need for long-distance shooting. In this case, if the user switches the shooting mode by touching the shooting mode switching control 406 on the display screen, it will also affect the framing of the front camera. , thus affecting the quality of the video. Therefore, in this case, it can be considered that the user has a need to use air gestures, and the user can be guided to use air gestures.
需要说明的是，在电子设备连接自拍杆时，也可显示如图12所示的拍摄预览界面401及引导弹窗412。其中，关于该拍摄预览界面401的具体描述参见前文，在此暂不赘述。It should be noted that when the electronic device is connected to the selfie stick, the shooting preview interface 401 and the guidance pop-up window 412 as shown in Figure 12 may also be displayed. The specific description of the shooting preview interface 401 can be found in the foregoing, and will not be described again here.
还需说明的是，前述内容说明当电子设备处于录制状态时，若检测到连接自拍杆，电子设备可显示如图12所示的引导弹窗412。实际上，电子设备连接自拍杆时，响应于接收到用户的第一操作，电子设备开始录制视频，电子设备在拍摄预览界面401上显示引导弹窗412。也即，电子设备可以先连接自拍杆，然后在开始录制视频后显示第一弹窗。换句话说，只要在用户上一次使用隔空手势的时间(也可以称为第一时间)与当前时间的时间差大于第一预设时间的情况下，满足电子设备正在录制视频且连接自拍杆这两个条件，电子设备即可显示引导弹窗412。It should also be noted that the foregoing content illustrates that when the electronic device is in the recording state, if it is detected that the selfie stick is connected, the electronic device may display a guidance pop-up window 412 as shown in Figure 12 . In fact, when the electronic device is connected to the selfie stick, in response to receiving the user's first operation, the electronic device starts recording video, and the electronic device displays a guidance pop-up window 412 on the shooting preview interface 401 . That is, the electronic device can first connect the selfie stick, and then display the first pop-up window after starting to record the video. In other words, as long as the time difference between the last time the user used the air gesture (which can also be called the first time) and the current time is greater than the first preset time, the electronic device is recording a video and the selfie stick is connected. Under two conditions, the electronic device can display the guidance pop-up window 412.
在一种可选的设计中，在电子设备检测到用户在显示屏上切换拍摄模式时，可认为电子设备检测到用户存在使用隔空手势的需求。In an optional design, when the electronic device detects that the user switches the shooting mode on the display screen, it may be considered that the electronic device detects the user's need to use the air gesture.
具体的，如图13A所示，电子设备可接收用户点击拍摄模式切换控件406(也可称为第二控件)的操作，响应于该操作，电子设备可显示如图13B所示的拍摄预览界面401。如图13B所示，该拍摄预览界面401可包括引导弹窗412及拍摄模式选择区413(也可以称为第三弹窗)。其中关于引导弹窗412的内容参见前文，在此暂不赘述。该拍摄模式选择区413可展示多种拍摄模式的预览界面，例如前置拍摄模式的预览界面413a、后置拍摄模式的预览界面413b、画中画拍摄模式的预览界面413c、后后拍摄模式的预览界面413d及前后拍摄模式的预览界面413e。Specifically, as shown in Figure 13A, the electronic device can receive the operation of the user clicking on the shooting mode switching control 406 (which can also be called the second control). In response to the operation, the electronic device can display the shooting preview interface as shown in Figure 13B. 401. As shown in FIG. 13B , the shooting preview interface 401 may include a guidance pop-up window 412 and a shooting mode selection area 413 (which may also be called a third pop-up window). Regarding the content of the guidance pop-up window 412, please refer to the previous article and will not be described in detail here. The shooting mode selection area 413 can display preview interfaces for multiple shooting modes, such as a preview interface 413a for front-facing shooting mode, a preview interface 413b for rear-facing shooting mode, a preview interface 413c for picture-in-picture shooting mode, and a preview interface 413c for rear-facing shooting mode. The preview interface 413d and the preview interface 413e of the front and back shooting mode.
总之，在电子设备处于多镜录像的录制状态时，若检测到用户上一次使用隔空手势的时间与当前时间的时间差大于第一预设时间，且在开启录制后的第二预设时间内检测到前置画面内的用户与显示屏的距离大于或等于预设距离，电子设备可显示如图12所示的引导弹窗412。在电子设备处于多镜录像的录制状态时，若检测到用户上一次使用隔空手势的时间与当前时间的时间差大于第一预设时间且连接自拍杆，电子设备可显示如图12所示的引导弹窗412。在电子设备处于多镜录像的录制状态时，若检测到用户上一次使用隔空手势的时间与当前时间的时间差大于第一预设时间且检测到用户在显示屏上切换拍摄模式，电子设备可显示如图13B所示的引导弹窗412。In short, when the electronic device is in the recording state of multi-lens recording, if it is detected that the time difference between the last time the user used the air gesture and the current time is greater than the first preset time, and within the second preset time after starting the recording If it is detected that the distance between the user in the front screen and the display screen is greater than or equal to the preset distance, the electronic device may display a guidance pop-up window 412 as shown in Figure 12 . When the electronic device is in the recording state of multi-lens video, if it is detected that the time difference between the last time the user used the air gesture and the current time is greater than the first preset time and the selfie stick is connected, the electronic device may display as shown in Figure 12 Boot popup 412. When the electronic device is in the recording state of multi-lens video, if it is detected that the time difference between the last time the user used the air gesture and the current time is greater than the first preset time and it is detected that the user switches the shooting mode on the display screen, the electronic device can The guidance pop-up window 412 shown in Figure 13B is displayed.
需要说明的是，前述内容仅以电子设备处于前后拍摄模式时为例说明隔空手势的引导使用方法。实际上，电子设备也可以处于多镜录像下的任意一种拍摄模式，例如画中画拍摄模式、前置拍摄模式、后置拍摄模式、后后拍摄模式等，在此不做具体限制。It should be noted that the foregoing content only takes the electronic device in the front-to-back shooting mode as an example to illustrate the guided use method of the air gesture. In fact, the electronic device can also be in any shooting mode under multi-lens recording, such as picture-in-picture shooting mode, front-facing shooting mode, rear-facing shooting mode, rear-facing shooting mode, etc. There are no specific restrictions here.
可见，本申请提供的隔空手势的引导使用方法，可在电子设备第一次进入多镜录像时提醒用户学习隔空手势。特别地，电子设备也可在检测到用户上一次使用隔空手势的时间与当前时间的时间差大于第一预设时间且检测到用户存在使用隔空手势的需求时，弹出隔空手势的引导弹窗，向用户展示隔空手势的使用方法，增大用户使用隔空手势的可能性，有利于提高人机交互效率。It can be seen that the guided use method of air gesture provided by this application can remind the user to learn the air gesture when the electronic device enters multi-mirror recording for the first time. In particular, the electronic device can also pop up a guidance popup for the air gesture when it detects that the time difference between the last time the user used the air gesture and the current time is greater than the first preset time and detects that the user has a need to use the air gesture. The window shows users how to use air gestures, increases the possibility of users using air gestures, and helps improve the efficiency of human-computer interaction.
本申请还提供一种芯片系统1400，如图14所示，该芯片系统包括至少一个处理器1401和至少一个接口电路1402。处理器1401和接口电路1402可通过线路互联。例如，接口电路1402可用于从其它装置(例如，电子设备的存储器)接收信号。又例如，接口电路1402可用于向其它装置(例如处理器1401)发送信号。This application also provides a chip system 1400. As shown in Figure 14, the chip system includes at least one processor 1401 and at least one interface circuit 1402. The processor 1401 and the interface circuit 1402 may be interconnected by wires. For example, interface circuitry 1402 may be used to receive signals from other devices (eg, memory of an electronic device). As another example, interface circuit 1402 may be used to send signals to other devices (eg, processor 1401).
例如，接口电路1402可读取电子设备中存储器中存储的指令，并将该指令发送给处理器1401。当所述指令被处理器1401执行时，可使得电子设备执行上述各实施例中的各个步骤。For example, the interface circuit 1402 may read instructions stored in a memory in the electronic device and send the instructions to the processor 1401 . When the instructions are executed by the processor 1401, the electronic device can be caused to perform various steps in the above embodiments.
通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。Through the above description of the embodiments, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be allocated as needed. It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. For the specific working processes of the systems, devices and units described above, reference can be made to the corresponding processes in the foregoing method embodiments, which will not be described again here.
在本申请实施例各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。Each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application are essentially or contribute to the existing technology, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage device. The medium includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned storage media include: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk and other media that can store program codes.
以上所述，仅为本申请实施例的具体实施方式，但本申请实施例的保护范围并不局限于此，任何在本申请实施例揭露的技术范围内的变化或替换，都应涵盖在本申请实施例的保护范围之内。因此，本申请实施例的保护范围应以所述权利要求的保护范围为准。The above are only specific implementation modes of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the embodiments of the present application shall be covered by this application. within the protection scope of the application embodiment. Therefore, the protection scope of the embodiments of the present application should be subject to the protection scope of the claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110676709 | 2021-06-16 | ||
| CN2021106767093 | 2021-06-16 | ||
| CN202111436311 | 2021-11-29 | ||
| CN2021114363119 | 2021-11-29 |
| Publication Number | Publication Date |
|---|---|
| CN115484394A CN115484394A (en) | 2022-12-16 |
| CN115484394Btrue CN115484394B (en) | 2023-11-14 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111679527.8AActiveCN115484394B (en) | 2021-06-16 | 2021-12-31 | Guide use method of air separation gesture and electronic equipment |
| Country | Link |
|---|---|
| CN (1) | CN115484394B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118276670A (en)* | 2022-12-30 | 2024-07-02 | 荣耀终端有限公司 | Space-apart gesture processing method, electronic equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3012732A1 (en)* | 2014-10-24 | 2016-04-27 | LG Electronics Inc. | Mobile terminal and controlling method thereof |
| CN106055098A (en)* | 2016-05-24 | 2016-10-26 | 北京小米移动软件有限公司 | Air gesture operation method and apparatus |
| CN106250021A (en)* | 2016-07-29 | 2016-12-21 | 维沃移动通信有限公司 | A kind of control method taken pictures and mobile terminal |
| CN107613207A (en)* | 2017-09-29 | 2018-01-19 | 努比亚技术有限公司 | A kind of camera control method, equipment and computer-readable recording medium |
| CN110045819A (en)* | 2019-03-01 | 2019-07-23 | 华为技术有限公司 | A kind of gesture processing method and equipment |
| US10551995B1 (en)* | 2013-09-26 | 2020-02-04 | Twitter, Inc. | Overlay user interface |
| CN111787223A (en)* | 2020-06-30 | 2020-10-16 | 维沃移动通信有限公司 | Video shooting method, device and electronic device |
| CN112394811A (en)* | 2019-08-19 | 2021-02-23 | 华为技术有限公司 | Interaction method for air-separating gesture and electronic equipment |
| CN112929558A (en)* | 2019-12-06 | 2021-06-08 | 荣耀终端有限公司 | Image processing method and electronic device |
| CN112954218A (en)* | 2019-03-18 | 2021-06-11 | 荣耀终端有限公司 | Multi-channel video recording method and equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8830302B2 (en)* | 2011-08-24 | 2014-09-09 | Lg Electronics Inc. | Gesture-based user interface method and apparatus |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10551995B1 (en)* | 2013-09-26 | 2020-02-04 | Twitter, Inc. | Overlay user interface |
| EP3012732A1 (en)* | 2014-10-24 | 2016-04-27 | LG Electronics Inc. | Mobile terminal and controlling method thereof |
| CN106055098A (en)* | 2016-05-24 | 2016-10-26 | 北京小米移动软件有限公司 | Air gesture operation method and apparatus |
| CN106250021A (en)* | 2016-07-29 | 2016-12-21 | 维沃移动通信有限公司 | A kind of control method taken pictures and mobile terminal |
| CN107613207A (en)* | 2017-09-29 | 2018-01-19 | 努比亚技术有限公司 | A kind of camera control method, equipment and computer-readable recording medium |
| CN110045819A (en)* | 2019-03-01 | 2019-07-23 | 华为技术有限公司 | A kind of gesture processing method and equipment |
| CN112954218A (en)* | 2019-03-18 | 2021-06-11 | 荣耀终端有限公司 | Multi-channel video recording method and equipment |
| CN112394811A (en)* | 2019-08-19 | 2021-02-23 | 华为技术有限公司 | Interaction method for air-separating gesture and electronic equipment |
| CN112929558A (en)* | 2019-12-06 | 2021-06-08 | 荣耀终端有限公司 | Image processing method and electronic device |
| CN111787223A (en)* | 2020-06-30 | 2020-10-16 | 维沃移动通信有限公司 | Video shooting method, device and electronic device |
| Title |
|---|
| 鼠标手势的工效学研究进展;刘子慧;陈硕;;人类工效学(第01期);全文* |
| Publication number | Publication date |
|---|---|
| CN115484394A (en) | 2022-12-16 |
| Publication | Publication Date | Title |
|---|---|---|
| JP7450035B2 (en) | Video shooting methods and electronic equipment | |
| CN115484380B (en) | Shooting method, graphical user interface and electronic equipment | |
| CN110781688B (en) | Methods and electronic devices for machine translation | |
| CN107087101B (en) | Apparatus and method for providing dynamic panorama function | |
| EP3226537B1 (en) | Mobile terminal and method for controlling the same | |
| CN112887583B (en) | A shooting method and electronic device | |
| CN112714901A (en) | Display control method of system navigation bar, graphical user interface and electronic equipment | |
| CN112637477A (en) | Image processing method and electronic equipment | |
| CN112068907A (en) | Interface display method and electronic equipment | |
| CN115484391B (en) | Shooting method and electronic equipment | |
| CN115484387B (en) | Prompting method and electronic equipment | |
| EP4207744B1 (en) | Video photographing method and electronic device | |
| CN115484394B (en) | Guide use method of air separation gesture and electronic equipment | |
| CN115442509B (en) | Photography methods, user interfaces and electronic equipment | |
| CN115484390B (en) | Video shooting method and electronic equipment | |
| WO2024139934A1 (en) | Multi-window presentation method for application programs, and electronic device | |
| CN115034948B (en) | An image processing method and electronic device | |
| CN115484393B (en) | Abnormality prompting method and electronic equipment | |
| CN115484399A (en) | Video processing method and electronic equipment | |
| CN115484392B (en) | Video shooting method and electronic equipment | |
| US12445715B2 (en) | Video shooting method and electronic device | |
| CN115811656A (en) | Video shooting method and electronic equipment | |
| WO2023078133A1 (en) | Video playback method and device |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | Address after:Unit 3401, unit a, building 6, Shenye Zhongcheng, No. 8089, Hongli West Road, Donghai community, Xiangmihu street, Futian District, Shenzhen, Guangdong 518040 Patentee after:Honor Terminal Co.,Ltd. Country or region after:China Address before:3401, unit a, building 6, Shenye Zhongcheng, No. 8089, Hongli West Road, Donghai community, Xiangmihu street, Futian District, Shenzhen, Guangdong Patentee before:Honor Device Co.,Ltd. Country or region before:China | |
| CP03 | Change of name, title or address |