CN103475849A - Method and device for adjusting shooting angle of camera during video call - Google Patents
Method and device for adjusting shooting angle of camera during video callDownload PDFInfo
- Publication number
- CN103475849A CN103475849ACN2013104327728ACN201310432772ACN103475849ACN 103475849 ACN103475849 ACN 103475849ACN 2013104327728 ACN2013104327728 ACN 2013104327728ACN 201310432772 ACN201310432772 ACN 201310432772ACN 103475849 ACN103475849 ACN 103475849A
- Authority
- CN
- China
- Prior art keywords
- user image
- face
- set area
- shooting angle
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Studio Devices (AREA)
- Image Analysis (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本发明涉及通信技术领域，尤其涉及在视频通话时对摄像头拍摄角度进行调节的方法及装置。The invention relates to the field of communication technologies, in particular to a method and a device for adjusting a camera shooting angle during a video call.
背景技术Background technique
随着网络带宽的快速提升以及硬件设备的发展和普及，视频通话逐渐渗入至人们的学习、工作和生活等各个领域。视频通话，又称视频电话，指在终端之间基于互联网（例如3G）端实时传送人的语音和图像的一种即时通信方式，其中终端可以是智能手机、笔记本电脑、平板电脑、个人数字助理等电子设备。With the rapid improvement of network bandwidth and the development and popularization of hardware devices, video calls have gradually penetrated into various fields such as people's study, work and life. Video call, also known as video phone, refers to an instant communication method that transmits human voice and images in real time based on the Internet (such as 3G) between terminals, where the terminals can be smartphones, laptops, tablets, personal digital assistants and other electronic equipment.
具备视频通话功能的终端通常包括语音通话装置、摄像装置、图像接收显示装置。其中，终端的语音通话装置用于发送通话本端或接收通话对端的语音信息，摄像装置用于获取通话本端的图像并发送至通话对端，图像接收显示装置用于接收通话对端的图像，并在通话本端屏幕的视频图像显示窗口显示该图像。A terminal with a video call function usually includes a voice call device, a camera device, and an image receiving and display device. Among them, the voice communication device of the terminal is used to send the voice information of the calling end or receive the voice information of the calling end; The image is displayed in the video image display window on the screen of the local end of the call.
在对现有技术的研究和实践过程中，发明人发现现有技术至少存在以下问题：通话本端用户在与通话对端用户进行视频通话时，由于通话对端用户移动或通话对端摆放位置的不同，有时会导致通话对端用户的头像并不能够始终显示在通话本端的可视通话显示屏幕的固定位置（例如正中央位置），此时需与通话对端用户通过语音通话来进行调整，且在调整的过程中会打断用户之间原有的通话，浪费较多网络宽带资源，且用户体验不佳。During the research and practice of the existing technology, the inventor found that the prior art has at least the following problems: when the user at the call end makes a video call with the user at the end of the call, due to the movement of the user at the end of the call or the placement of the end of the call Depending on the location, sometimes the avatar of the peer user cannot always be displayed at a fixed position (such as the center) of the video call display screen on the local end of the call. During the adjustment process, the original calls between users will be interrupted, a lot of network broadband resources will be wasted, and the user experience will be poor.
发明内容Contents of the invention
有鉴于此，本发明实施例提供在视频通话时对摄像头拍摄角度进行调节的方法及装置，来解决以上背景技术部分提到的技术问题。In view of this, the embodiments of the present invention provide a method and an apparatus for adjusting a camera shooting angle during a video call, so as to solve the technical problems mentioned in the background technology section above.
一方面，本发明实施例提供一种在视频通话时对摄像头拍摄角度进行调节的方法，所述方法包括：On the one hand, an embodiment of the present invention provides a method for adjusting a camera shooting angle during a video call, the method comprising:
在检测到终端处于视频通话的状态下，获取终端摄像头实时采集的用户图像；When it is detected that the terminal is in a video call state, obtain the user image captured by the terminal camera in real time;
对所述用户图像进行人脸检测，判断所述用户图像中的人脸是否位于所述用户图像的设定区域之内；Performing face detection on the user image, and judging whether the face in the user image is within the set area of the user image;
当所述用户图像中的人脸未位于所述用户图像的设定区域之内时，根据所述人脸的位置和所述设定区域，对所述终端摄像头的拍摄角度进行调整，以使得所述用户图像的人脸能够位于所述设定区域之内。When the face in the user image is not located within the set area of the user image, adjust the shooting angle of the terminal camera according to the position of the face and the set area, so that The human face of the user image can be located within the set area.
一方面，本发明实施例还提出了一种在视频通话时对摄像头拍摄角度进行调节的装置，所述装置包括：On the one hand, the embodiment of the present invention also proposes a device for adjusting the shooting angle of the camera during a video call, the device comprising:
用户图像获取单元，用于在检测到终端处于视频通话的状态下，获取终端摄像头实时采集的用户图像；A user image acquisition unit, configured to acquire a user image captured by the terminal camera in real time when the terminal is detected to be in a video call state;
人脸检测单元，用于对所述用户图像进行人脸检测，判断所述用户图像中的人脸是否位于所述用户图像的设定区域之内；A face detection unit, configured to perform face detection on the user image, and determine whether the face in the user image is within a set area of the user image;
拍摄角度调整单元，用于当所述用户图像中的人脸未位于所述用户图像的设定区域之内时，根据所述人脸的位置和所述设定区域，对所述终端摄像头的拍摄角度进行调整，以使得所述用户图像的人脸能够位于所述设定区域之内。A shooting angle adjustment unit, configured to adjust the position of the terminal camera according to the position of the face and the set area when the face in the user image is not within the set area of the user image The shooting angle is adjusted so that the face of the user image can be located within the set area.
本发明实施例提出的在视频通话时对摄像头拍摄角度进行调节的方法及装置具有如下特点：通过对终端摄像头实时采集的用户图像进行人脸检测，在判断用户图像的人脸未位于该用户图像的设定区域之内时，对终端摄像头的拍摄角度进行调整，以使得用户图像的人脸能够位于设定区域之内，无需通话双方通过语音通话进行人为的调整，节省了网络宽带资源，提升了视频通话时的用户体验。The method and device for adjusting the shooting angle of the camera during a video call proposed by the embodiments of the present invention have the following characteristics: by performing face detection on the user image collected by the terminal camera in real time, it is judged that the face of the user image is not located in the user image When within the set area, the shooting angle of the terminal camera is adjusted so that the face of the user image can be located within the set area, and there is no need for both parties to make artificial adjustments through voice calls, which saves network broadband resources and improves User experience during video calls.
附图说明Description of drawings
图1是本发明第一实施例提供的一种在视频通话时对摄像头拍摄角度进行调节的方法的流程示意图；FIG. 1 is a schematic flowchart of a method for adjusting a camera shooting angle during a video call according to the first embodiment of the present invention;
图2（a）是本发明第一实施例提供的一种未对本端摄像头的拍摄角度进行调整前本端用户图像在对端显示屏幕的显示图；Fig. 2(a) is a display diagram of the local user image on the peer display screen before the shooting angle of the local camera is adjusted according to the first embodiment of the present invention;
图2（b）是本发明第一实施例提供的一种对终端摄像头的拍摄角度进行调整后本端用户图像在对端显示屏幕的显示图；Fig. 2(b) is a display diagram of the image of the user at the end on the display screen at the opposite end after the shooting angle of the camera of the terminal is adjusted according to the first embodiment of the present invention;
图3是本发明第二实施例提供的一种在视频通话时对摄像头拍摄角度进行调节的装置的结构示意图；Fig. 3 is a schematic structural diagram of a device for adjusting the shooting angle of a camera during a video call according to the second embodiment of the present invention;
图4为可用于实施本发明方案的终端的结构示意图。Fig. 4 is a schematic structural diagram of a terminal that can be used to implement the solution of the present invention.
具体实施方式Detailed ways
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是，此处所描述的具体实施例仅仅用于解释本发明，而非对本发明的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本发明相关的部分而非全部内容。The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, only parts related to the present invention are shown in the drawings but not all content.
图1示出了本发明的第一实施例。Fig. 1 shows a first embodiment of the invention.
图1是本发明第一实施例提供的一种在视频通话时对摄像头拍摄角度进行调节的方法的流程示意图。本实施例主要以具有视频通话功能的终端来举例说明，该终端可以包括但不限于智能手机、笔记本电脑、平板电脑、个人数字助理和膝上型便携计算机等等。参见图1，所述方法包括：Fig. 1 is a schematic flowchart of a method for adjusting a camera shooting angle during a video call according to the first embodiment of the present invention. This embodiment is mainly illustrated by using a terminal with a video call function as an example, and the terminal may include, but not limited to, a smart phone, a notebook computer, a tablet computer, a personal digital assistant, a laptop computer, and the like. Referring to Figure 1, the method includes:
步骤S101、在检测到终端处于视频通话的状态下，获取终端摄像头实时采集的用户图像。Step S101 , when it is detected that the terminal is in a video call state, acquire user images captured by the terminal camera in real time.
在本实施例中，终端实时检测对视频通话的触发事件，如果判断接收到视频通话触发信号时，则向终端摄像头发送控制信号，通知终端摄像头实时采集用户图像，而后获取终端摄像头所采集到的用户图像。其中，终端摄像头具有水平竖直方向的调整功能。In this embodiment, the terminal detects a trigger event for a video call in real time, and if it determines that a trigger signal for a video call is received, it sends a control signal to the terminal camera to notify the terminal camera to collect user images in real time, and then obtains the captured image by the terminal camera. user image. Wherein, the terminal camera has a horizontal and vertical adjustment function.
在本实施例的一个优选实施方式中，当终端为具有触摸屏和视频通话功能的电子设备时，对视频通话的触发事件包括但不限于：用户直接用手或者通过触控笔对终端屏幕上所呈现的视频通话图标进行的触发。当终端所采用的显示屏是电阻式触摸屏时，通常为采用触控笔进行的触发；当终端所采用的显示屏是电容式触摸屏时，通常为由用户直接触摸而进行的触发。In a preferred implementation of this embodiment, when the terminal is an electronic device with a touch screen and video call functions, the triggering event for the video call includes but is not limited to: the user directly uses the hand or touch pen to touch the Fired by the rendered video call icon. When the display screen adopted by the terminal is a resistive touch screen, it is generally triggered by a stylus; when the display screen adopted by the terminal is a capacitive touch screen, it is generally triggered by a user's direct touch.
步骤S102、对用户图像进行人脸检测，判断用户图像中的人脸是否位于用户图像的设定区域之内。Step S102 , performing face detection on the user image, and judging whether the face in the user image is within a set area of the user image.
在获取到用户图像后，终端首先对该图像进行人脸检测，提取该图像中的人脸区域特征。所述提取过程包括但不限于：对获取到的用户图像进行光线补偿、肤色区域提取、形态学处理等操作，提取用户图像的人脸待选区域；利用人脸模板特征对人脸待选区域的几何特征或灰度特征进行进一步验证，提取人脸区域，进而生成该人脸区域特征，其中所述人脸区域特征包括人脸区域的中心坐标。After acquiring the image of the user, the terminal first performs face detection on the image, and extracts features of the face area in the image. The extraction process includes but is not limited to: performing operations such as light compensation, skin color area extraction, and morphological processing on the acquired user image to extract the candidate face area of the user image; The geometric features or gray features of the face are further verified, and the face area is extracted to generate the face area feature, wherein the face area feature includes the center coordinates of the face area.
然后，终端根据所生成的人脸区域特征，判断用户图像中的人脸是否位于用户图像的设定区域之内。具体的判断过程包括：判断人脸区域的中心坐标是否位于用户图像的设定区域之内，如果是，则判断用户图像中的人脸位于用户图像的设定区域之内，否则判断用户图像中的人脸未位于用户图像的设定区域之内。其中，用户图像的设定区域可以是位于用户图像正中央的矩形区域，其矩形区域的中心为用户图像的中心，长度和宽度可由终端预先设置。当然，该设定区域还可以是终端预设的其它形式的区域，例如用户图像的设定区域为位于用户图像正中央的圆形区域，其圆形区域的中心为用户图像的中心，半径可由终端预先设置。Then, the terminal judges whether the face in the user image is located within the set area of the user image according to the generated face area features. The specific judging process includes: judging whether the center coordinates of the face area are within the set area of the user image, if yes, then judging that the face in the user image is within the set area of the user image, otherwise judging whether the face in the user image is within the set area of the user image The face of is not within the set area of the user image. Wherein, the setting area of the user image may be a rectangular area located in the center of the user image, the center of the rectangular area is the center of the user image, and the length and width may be preset by the terminal. Of course, the setting area can also be an area in other forms preset by the terminal. For example, the setting area of the user image is a circular area located in the center of the user image, the center of the circular area is the center of the user image, and the radius can be determined by Terminal presets.
本领域的普通技术人员应理解，当所生成的人脸区域特征包括人脸的宽度、长度和角度等其他特征时，还可采用其他方法来判断用户图像中的人脸是否位于用户图像的设定区域之内，例如，根据用户图像中人脸的宽度、长度和中心坐标这三个人脸区域特征，判断人脸区域与用户图像的设定区域相重合的区域所包含的像素点个数是否大于等于设定的阈值，如果是，则判断用户图像中的人脸位于用户图像的设定区域之内，否则判断用户图像中的人脸未位于用户图像的设定区域之内。Those of ordinary skill in the art should understand that when the generated facial region features include other features such as the width, length and angle of the human face, other methods can also be used to determine whether the human face in the user image is located in the setting of the user image. Within the area, for example, according to the three face area characteristics of the width, length and center coordinates of the face in the user image, it is judged whether the number of pixels contained in the area where the face area overlaps with the set area of the user image is greater than is equal to the set threshold, if yes, it is determined that the face in the user image is within the set area of the user image, otherwise it is determined that the face in the user image is not within the set area of the user image.
步骤S103、当用户图像中的人脸未位于用户图像的设定区域之内时，根据所述人脸的位置和所述设定区域，对终端摄像头的拍摄角度进行调整，以使得用户图像的人脸能够位于所述设定区域之内。Step S103, when the face in the user image is not within the set area of the user image, adjust the shooting angle of the terminal camera according to the position of the face and the set area, so that the user image A human face can be located within the set area.
在本实施例中，在判断用户图像中的人脸未位于用户图像的设定区域之内的情况下，终端根据人脸的位置和所述设定区域，对终端摄像头的拍摄角度进行调整。In this embodiment, when it is determined that the face in the user image is not within the set area of the user image, the terminal adjusts the shooting angle of the terminal camera according to the position of the face and the set area.
在本实施例的一个优选的实施方式中，具体的调整过程为：计算用户图像中人脸的中心坐标相对于用户图像设定区域的中心坐标的水平偏移量和垂直偏移量；将终端摄像头的拍摄角度在水平方向上移动水平偏移量的距离，在竖直方向上移动竖直偏移量的距离。例如，终端计算用户图像中人脸的中心坐标相对于用户图像的设定区域的中心坐标在水平方向上的偏移量为向左偏移了80个像素的距离，在竖直方向上的偏移量为向下偏移了60个像素的距离，进而将终端摄像头的拍摄角度在水平方向上向左移动80个像素的距离，在竖直方向上向下移动60个像素的距离。In a preferred implementation of this embodiment, the specific adjustment process is: calculating the horizontal offset and vertical offset of the center coordinates of the face in the user image relative to the center coordinates of the user image setting area; The shooting angle of the camera moves the distance of the horizontal offset in the horizontal direction, and moves the distance of the vertical offset in the vertical direction. For example, the terminal calculates that the horizontal offset of the center coordinates of the face in the user image relative to the center coordinates of the set area of the user image is a distance of 80 pixels to the left, and the offset in the vertical direction is 80 pixels. The amount of displacement is a downward displacement of 60 pixels, and then the shooting angle of the terminal camera is moved to the left by 80 pixels in the horizontal direction, and 60 pixels in the vertical direction.
图2（a）是本发明第一实施例提供的一种未对本端摄像头的拍摄角度进行调整前本端用户图像在对端显示屏幕的显示图，图2（b）是本发明第一实施例提供的一种对终端摄像头的拍摄角度进行调整后本端用户图像在对端显示屏幕的显示图。参见图2（a）和图2（b），当本端用户图像在对端显示屏幕全屏显示时，用户图像的设定区域201位于对端显示屏幕20的正中央位置，用户图像的人脸202在未对本端摄像头的拍摄角度进行调整前位于对端显示屏幕20的左下角，而在对本端摄像头的拍摄角度进行调整后会位于对端显示屏幕20的正中央位置。Fig. 2(a) is a display diagram of the local user image on the peer display screen before the shooting angle of the local camera is not adjusted according to the first embodiment of the present invention. Fig. 2(b) is the first embodiment of the present invention The example provides a display diagram of the image of the local user on the remote display screen after the shooting angle of the terminal camera is adjusted. Referring to Figure 2(a) and Figure 2(b), when the local user image is displayed in full screen on the peer display screen, the
为了加快处理速度，减轻系统负担，在本实施例的另一个优选的实施方式中，步骤S103还可进一步包括如下步骤：In order to speed up the processing speed and reduce the system load, in another preferred implementation manner of this embodiment, step S103 may further include the following steps:
当用户图像中的人脸未位于用户图像的设定区域之内时，进一步判断连续前N帧用户图像中的人脸是否均未位于用户图像的设定区域之内；When the face in the user image is not within the set area of the user image, it is further judged whether the faces in the user images in the previous N frames are not located within the set area of the user image;
如果是，则计算连续前N帧的用户图像和本帧用户图像中人脸的平均位置；If so, calculate the average position of the face in the user image of the previous N frames and the user image of this frame;
根据所述平均位置和所述设定区域，对终端摄像头的拍摄角度进行调整，以使得用户图像的人脸能够位于设定区域之内；Adjust the shooting angle of the terminal camera according to the average position and the set area, so that the face of the user image can be located within the set area;
其中，N为大于等于1的正整数，人脸的平均位置包括人脸的平均中心点坐标、平均宽度和平均长度等。Wherein, N is a positive integer greater than or equal to 1, and the average position of a human face includes the average center point coordinates, average width, and average length of the human face.
在本实施例的一个优选的实施方式中，当用户图像中的人脸位于用户图像的设定区域之内时，返回步骤S101继续执行在检测到终端处于视频通话的状态下，获取终端摄像头实时采集的用户图像。In a preferred implementation of this embodiment, when the face in the user image is within the set area of the user image, return to step S101 and continue to execute when it is detected that the terminal is in a video call state, obtain the real-time Captured user image.
本实施例通过对终端摄像头实时采集的用户图像进行人脸检测，在判断用户图像的人脸未位于该用户图像的设定区域之内时，对终端摄像头的拍摄角度进行调整，以使得用户图像的人脸能够位于设定区域之内，无需通话双方通过语音通话进行人为的调整，节省了网络宽带资源，提升了视频通话时的用户体验。In this embodiment, face detection is performed on the user image collected by the terminal camera in real time, and when it is judged that the face of the user image is not within the set area of the user image, the shooting angle of the terminal camera is adjusted so that the user image The face can be located within the set area, without the need for both parties to make artificial adjustments through voice calls, which saves network broadband resources and improves the user experience during video calls.
图3示出了本发明的第二实施例。Figure 3 shows a second embodiment of the invention.
图3是本发明第二实施例提供的一种在视频通话时对摄像头拍摄角度进行调节的装置的结构示意图。参见图3，所述装置包括：Fig. 3 is a schematic structural diagram of a device for adjusting a camera shooting angle during a video call according to a second embodiment of the present invention. Referring to Fig. 3, described device comprises:
用户图像获取单元301，用于在检测到终端处于视频通话的状态下，获取终端摄像头实时采集的用户图像；A user
人脸检测单元302，用于对用户图像进行人脸检测，判断用户图像中的人脸是否位于用户图像的设定区域之内；A
拍摄角度调整单元303，用于当用户图像中的人脸未位于用户图像的设定区域之内时，根据人脸的位置和所述设定区域，对终端摄像头的拍摄角度进行调整，以使得用户图像的人脸能够位于所述设定区域之内。The shooting
在本实施例中，用户图像获取单元301实时检测对视频通话的触发事件，如果判断接收到视频通话触发信号时，则向终端摄像头发送控制信号，通知终端摄像头实时采集用户图像，而后获取终端摄像头所采集到的用户图像。其中，终端摄像头具有水平竖直方向的调整功能。In this embodiment, the user
在本实施例的一个优选实施方式中，当终端为具有触摸屏和视频通话功能的电子设备时，对视频通话的触发事件包括但不限于：用户直接用手或者通过触控笔对终端屏幕上所呈现的视频通话图标进行的触发。当终端所采用的显示屏是电阻式触摸屏时，通常为采用触控笔进行的触发；当终端所采用的显示屏是电容式触摸屏时，通常为由用户直接触摸而进行的触发。In a preferred implementation of this embodiment, when the terminal is an electronic device with a touch screen and video call functions, the triggering event for the video call includes but is not limited to: the user directly uses the hand or touch pen to touch the Fired by the rendered video call icon. When the display screen adopted by the terminal is a resistive touch screen, it is generally triggered by a stylus; when the display screen adopted by the terminal is a capacitive touch screen, it is generally triggered by a user's direct touch.
在用户图像获取单元301获取到用户图像后，人脸检测单元302中的人脸区域提取子单元3021首先对该图像进行人脸检测，提取该图像中的人脸区域特征。所述提取过程包括但不限于：对获取到的用户图像进行光线补偿、肤色区域提取、形态学处理等操作，提取用户图像的人脸待选区域；利用人脸模板特征对人脸待选区域的几何特征或灰度特征进行进一步验证，提取人脸区域，进而生成该人脸区域特征，其中所述人脸区域特征包括人脸区域的中心坐标。After the user
然后，人脸检测单元302中的人脸位置判断子单元303根据所生成的人脸区域特征，判断用户图像中的人脸是否位于用户图像的设定区域之内。具体的判断过程包括：判断人脸区域的中心坐标是否位于用户图像的设定区域之内，如果是，则判断用户图像中的人脸位于用户图像的设定区域之内，否则判断用户图像中的人脸未位于用户图像的设定区域之内。其中，用户图像的设定区域可以是位于用户图像正中央的矩形区域，其矩形区域的中心为用户图像的中心，长度和宽度可由终端预先设置。当然，该设定区域还可以是终端预设的其它形式的区域，例如用户图像的设定区域为位于用户图像正中央的圆形区域，其圆形区域的中心为用户图像的中心，半径可由终端预先设置。Then, the face
本领域的普通技术人员应理解，当所生成的人脸区域特征包括人脸的宽度、长度和角度等其他特征时，人脸位置判断子单元303还可采用其他方法来判断用户图像中的人脸是否位于用户图像的设定区域之内，例如，根据用户图像中人脸的宽度、长度和中心坐标这三个人脸区域特征，判断人脸区域与用户图像的设定区域相重合的区域所包含的像素点个数是否大于等于设定的阈值，如果是，则判断用户图像中的人脸位于用户图像的设定区域之内，否则判断用户图像中的人脸未位于用户图像的设定区域之内。Those of ordinary skill in the art should understand that when the generated face region features include other features such as the width, length, and angle of the face, the face
在本实施例中，在人脸检测单元302判断用户图像中的人脸未位于用户图像的设定区域之内的情况下，拍摄角度调整单元303根据人脸的位置和所述设定区域，对终端摄像头的拍摄角度进行调整。In this embodiment, when the
在本实施例的一个优选的实施方式中，拍摄角度调整单元303包括：偏移量计算子单元，用于计算用户图像中人脸的中心坐标相对于用户图像设定区域的中心坐标的水平偏移量和垂直偏移量；拍摄角度调整子单元，用于将终端摄像头的拍摄角度在水平方向上移动水平偏移量的距离，在竖直方向上移动竖直偏移量的距离。例如，偏移量计算子单元计算用户图像中人脸的中心坐标相对于用户图像的设定区域的中心坐标在水平方向上的偏移量为向左偏移了80个像素的距离，在竖直方向上的偏移量为向下偏移了60个像素的距离时，拍摄角度调整子单元会将终端摄像头的拍摄角度在水平方向上向左移动80个像素的距离，在竖直方向上向下移动60个像素的距离。In a preferred implementation of this embodiment, the shooting
为了加快处理速度，减轻系统负担，在本实施例的另一个优选的实施方式中，拍摄角度调整单元303包括：In order to speed up the processing speed and reduce the system load, in another preferred implementation of this embodiment, the shooting
连续帧判断子单元，用于当人脸检测单元302判断用户图像中的人脸未位于用户图像的设定区域之内时，进一步判断连续前N帧用户图像的人脸是否均未位于用户图像的设定区域之内，如果是向人脸平均位置计算子单元发送控制信号；The continuous frame judging subunit is used to further judge whether the faces of the user images in the previous N consecutive frames are not located in the user image when the
人脸平均位置计算子单元，用于接收所述控制信号，计算连续前N帧的用户图像和本帧用户图像中人脸的平均位置；The average face position calculation subunit is used to receive the control signal and calculate the average position of the face in the user image of the previous N frames and the user image of this frame;
所述拍摄角度调整子单元，用于根据所述平均位置和所述设定区域，对终端摄像头的拍摄角度进行调整，以使得用户图像的人脸能够位于所述设定区域之内；The shooting angle adjustment subunit is configured to adjust the shooting angle of the terminal camera according to the average position and the set area, so that the face of the user image can be located within the set area;
其中，N为大于等于1的正整数，人脸的平均位置包括人脸的平均中心点坐标、平均宽度和平均长度等。Wherein, N is a positive integer greater than or equal to 1, and the average position of a human face includes the average center point coordinates, average width, and average length of the human face.
在本实施例的一个优选的实施方式中，当人脸检测单元302判断用户图像中的人脸位于用户图像的设定区域之内时，用户图像获取单元301在检测到终端处于视频通话的状态下，继续获取终端摄像头实时采集的用户图像。In a preferred implementation of this embodiment, when the
本实施例通过对终端摄像头实时采集的用户图像进行人脸检测，在判断用户图像的人脸未位于该用户图像的设定区域之内时，对终端摄像头的拍摄角度进行调整，以使得用户图像的人脸能够位于设定区域之内，无需通话双方通过语音通话进行人为的调整，节省了网络宽带资源，提升了视频通话时的用户体验。In this embodiment, face detection is performed on the user image collected by the terminal camera in real time, and when it is judged that the face of the user image is not within the set area of the user image, the shooting angle of the terminal camera is adjusted so that the user image The face can be located within the set area, without the need for both parties to make artificial adjustments through voice calls, which saves network broadband resources and improves the user experience during video calls.
图4为可用于实施本发明方案的终端的结构示意图。参见图4，终端40可以包括图像采集装置401、存储器402、处理器403、输入单元404、显示单元405、通信装置406等部件。Fig. 4 is a schematic structural diagram of a terminal that can be used to implement the solution of the present invention. Referring to FIG. 4 , the terminal 40 may include an image acquisition device 401 , a memory 402 , a processor 403 , an input unit 404 , a display unit 405 , a communication device 406 and other components.
图像采集装置401可用于捕捉当前终端用户的头像信息，优选的可为摄像头。The image acquisition device 401 can be used to capture the avatar information of the current terminal user, preferably a camera.
存储器402可用于存储实现本发明实施例提出的在视频通话时对摄像头拍摄角度进行调节的方法的软件程序以及模块，处理器403通过运行存储在存储器402的软件程序以及获取图像采集装置401和输入单元404的数据，从而执行各种功能应用以及数据处理。The memory 402 can be used to store software programs and modules for implementing the method for adjusting the shooting angle of the camera during a video call proposed by the embodiment of the present invention. The processor 403 runs the software program stored in the memory 402 and obtains the image acquisition device 401 and input The data of the unit 404, thereby performing various functional applications and data processing.
输入单元404可用于接收输入的数字或音符信息，以及产生与用户设置或功能控制有关的触控板、键盘、鼠标、操作杆信号输入。The input unit 404 can be used to receive input numbers or note information, and generate touch pad, keyboard, mouse, and joystick signal inputs related to user settings or function control.
显示单元405可用于显示处理器403提供的由用户输入的信息或提供给用户的信息以及终端40的各种图形用户接口，这些图形用户接口可以由图形、文本、图标、视频和其任意组合来构成，在一个优选方式中，显示单元405为触摸屏显示器。The display unit 405 can be used to display the information input by the user or information provided to the user provided by the processor 403 and various graphical user interfaces of the terminal 40. These graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. In a preferred manner, the display unit 405 is a touch screen display.
通信装置406可用于通过无线/有线通信技术发送和接收数据，优选的，通信装置406为无线通信装置，该装置可基于CDMA（Code Division MultipleAccess，码分多址）、WCDMA（Wideband Code Division Multiple Access，宽带码分多址）、GPRS（General Packet Radio Service，通用分组无线服务）等现有的无线通信技术进行数据的发送和接收。Communication device 406 can be used for sending and receiving data by wireless/wired communication technology, preferably, communication device 406 is wireless communication device, and this device can be based on CDMA (Code Division Multiple Access, code division multiple access), WCDMA (Wideband Code Division Multiple Access , Broadband Code Division Multiple Access), GPRS (General Packet Radio Service, General Packet Radio Service) and other existing wireless communication technologies to send and receive data.
本领域技术人员可以理解，图4中示出的终端结构并不构成对终端的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。Those skilled in the art can understand that the terminal structure shown in FIG. 4 does not constitute a limitation on the terminal, and may include more or less components than those shown in the figure, or combine some components, or arrange different components.
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成，也可以通过程序来指令相关的硬件完成，该程序可以存储于计算机可读存储介质中，存储介质可以包括存储器、磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps for realizing the above-mentioned embodiments can be completed by hardware, and can also be completed by instructing related hardware through a program. The program can be stored in a computer-readable storage medium, and the storage medium can include a memory. , disk or CD, etc.
注意，上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解，本发明不限于这里所述的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此，虽然通过以上实施例对本发明进行了较为详细的说明，但是本发明不仅仅限于以上实施例，在不脱离本发明构思的情况下，还可以包括更多其他等效实施例，而本发明的范围由所附的权利要求范围决定。Note that the above are only preferred embodiments of the present invention and applied technical principles. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present invention, and the present invention The scope is determined by the scope of the appended claims.
Claims (12)
Translated fromChinesePriority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310432772.8ACN103475849B (en) | 2013-09-22 | 2013-09-22 | Method photographic head shooting angle being adjusted when video calling and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310432772.8ACN103475849B (en) | 2013-09-22 | 2013-09-22 | Method photographic head shooting angle being adjusted when video calling and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103475849Atrue CN103475849A (en) | 2013-12-25 |
| CN103475849B CN103475849B (en) | 2016-06-08 |
Family
ID=49800528
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310432772.8AActiveCN103475849B (en) | 2013-09-22 | 2013-09-22 | Method photographic head shooting angle being adjusted when video calling and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103475849B (en) |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104038697A (en)* | 2014-06-11 | 2014-09-10 | 深圳市欧珀通信软件有限公司 | Mobile terminal multi-person photographing method and mobile terminal |
| CN104104867A (en)* | 2014-04-28 | 2014-10-15 | 三星电子（中国）研发中心 | Method for controlling image photographing device for photographing and device thereof |
| CN104182038A (en)* | 2014-07-14 | 2014-12-03 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN104517337A (en)* | 2014-12-29 | 2015-04-15 | 深圳市捷顺科技实业股份有限公司 | Method and device for reading card at vehicle entrance and exit |
| CN104820605A (en)* | 2015-05-28 | 2015-08-05 | 广东欧珀移动通信有限公司 | Angle setting method and device for rotary camera |
| CN105787884A (en)* | 2014-12-18 | 2016-07-20 | 联想(北京)有限公司 | Image processing method and electronic device |
| CN105791676A (en)* | 2016-02-26 | 2016-07-20 | 广东欧珀移动通信有限公司 | Terminal, imaging device, interactive system, control method and control device thereof |
| CN105898136A (en)* | 2015-11-17 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Camera angle adjustment method, system and television |
| WO2017088378A1 (en)* | 2015-11-27 | 2017-06-01 | 小米科技有限责任公司 | Adjustment method and device for shooting angles of camera |
| CN106851094A (en)* | 2016-12-30 | 2017-06-13 | 纳恩博（北京）科技有限公司 | A kind of information processing method and device |
| WO2017124792A1 (en)* | 2016-01-21 | 2017-07-27 | 惠州Tcl移动通信有限公司 | Method and system for dynamically capturing photograph of face, and mobile terminal |
| CN107145870A (en)* | 2017-05-10 | 2017-09-08 | 成都优孚达信息技术有限公司 | The identifying system of face in a kind of video |
| CN108366220A (en)* | 2018-04-23 | 2018-08-03 | 维沃移动通信有限公司 | A kind of video calling processing method and mobile terminal |
| CN108734472A (en)* | 2018-05-17 | 2018-11-02 | Oppo广东移动通信有限公司 | Payment method, payment device, electronic device and storage medium |
| WO2020029402A1 (en)* | 2018-08-08 | 2020-02-13 | 深圳码隆科技有限公司 | Suitcase volume measurement method and device, and suitcase volume measurement server, and computer readable medium |
| CN111147749A (en)* | 2019-12-31 | 2020-05-12 | 宇龙计算机通信科技(深圳)有限公司 | Photographing method, photographing device, terminal and storage medium |
| CN112672062A (en)* | 2020-08-21 | 2021-04-16 | 海信视像科技股份有限公司 | Display device and portrait positioning method |
| CN112995564A (en)* | 2019-12-17 | 2021-06-18 | 佛山市云米电器科技有限公司 | Call method based on display device, display device and storage medium |
| CN112995566A (en)* | 2019-12-17 | 2021-06-18 | 佛山市云米电器科技有限公司 | Sound source positioning method based on display equipment, display equipment and storage medium |
| CN112995565A (en)* | 2019-12-17 | 2021-06-18 | 佛山市云米电器科技有限公司 | Camera adjusting method of display device, display device and storage medium |
| CN114500909A (en)* | 2021-12-31 | 2022-05-13 | 深圳壹秘科技有限公司 | Remote call method, device, equipment and computer readable storage medium |
| US20230351611A1 (en)* | 2022-04-29 | 2023-11-02 | Nanning Fulian Fugui Precision Industrial Co., Ltd. | Method and device for identifying face of one person among many and tracking same as the target |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1756306A (en)* | 2004-10-01 | 2006-04-05 | 罗技欧洲公司 | System, method and network camera for optical module of mobile network camera |
| CN101072332A (en)* | 2007-06-04 | 2007-11-14 | 深圳市融合视讯科技有限公司 | Automatic mobile target tracking and shooting method |
| CN102214291A (en)* | 2010-04-12 | 2011-10-12 | 云南清眸科技有限公司 | Method for quickly and accurately detecting and tracking human face based on video sequence |
- 2013
- 2013-09-22CNCN201310432772.8Apatent/CN103475849B/enactiveActive
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1756306A (en)* | 2004-10-01 | 2006-04-05 | 罗技欧洲公司 | System, method and network camera for optical module of mobile network camera |
| CN101072332A (en)* | 2007-06-04 | 2007-11-14 | 深圳市融合视讯科技有限公司 | Automatic mobile target tracking and shooting method |
| CN102214291A (en)* | 2010-04-12 | 2011-10-12 | 云南清眸科技有限公司 | Method for quickly and accurately detecting and tracking human face based on video sequence |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104104867B (en)* | 2014-04-28 | 2017-12-29 | 三星电子（中国）研发中心 | The method and apparatus that control camera device is shot |
| CN104104867A (en)* | 2014-04-28 | 2014-10-15 | 三星电子（中国）研发中心 | Method for controlling image photographing device for photographing and device thereof |
| CN104038697A (en)* | 2014-06-11 | 2014-09-10 | 深圳市欧珀通信软件有限公司 | Mobile terminal multi-person photographing method and mobile terminal |
| CN104038697B (en)* | 2014-06-11 | 2018-05-04 | 广东欧珀移动通信有限公司 | A kind of mobile terminal realizes the method and mobile terminal that more people take pictures |
| CN104182038A (en)* | 2014-07-14 | 2014-12-03 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN104182038B (en)* | 2014-07-14 | 2018-08-31 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN105787884A (en)* | 2014-12-18 | 2016-07-20 | 联想(北京)有限公司 | Image processing method and electronic device |
| CN104517337A (en)* | 2014-12-29 | 2015-04-15 | 深圳市捷顺科技实业股份有限公司 | Method and device for reading card at vehicle entrance and exit |
| CN104820605A (en)* | 2015-05-28 | 2015-08-05 | 广东欧珀移动通信有限公司 | Angle setting method and device for rotary camera |
| CN104820605B (en)* | 2015-05-28 | 2018-01-16 | 广东欧珀移动通信有限公司 | The angle method to set up and device of rotating camera |
| WO2017084316A1 (en)* | 2015-11-17 | 2017-05-26 | 乐视控股（北京）有限公司 | Camera perspective adjustment method, system, and television |
| CN105898136A (en)* | 2015-11-17 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Camera angle adjustment method, system and television |
| RU2695104C2 (en)* | 2015-11-27 | 2019-07-19 | Сяоми Инк. | Method and camera angle adjustment device |
| US10375296B2 (en) | 2015-11-27 | 2019-08-06 | Xiaomi Inc. | Methods apparatuses, and storage mediums for adjusting camera shooting angle |
| WO2017088378A1 (en)* | 2015-11-27 | 2017-06-01 | 小米科技有限责任公司 | Adjustment method and device for shooting angles of camera |
| WO2017124792A1 (en)* | 2016-01-21 | 2017-07-27 | 惠州Tcl移动通信有限公司 | Method and system for dynamically capturing photograph of face, and mobile terminal |
| CN105791676A (en)* | 2016-02-26 | 2016-07-20 | 广东欧珀移动通信有限公司 | Terminal, imaging device, interactive system, control method and control device thereof |
| WO2018121385A1 (en)* | 2016-12-30 | 2018-07-05 | 纳恩博（北京）科技有限公司 | Information processing method and apparatus, and computer storage medium |
| CN106851094A (en)* | 2016-12-30 | 2017-06-13 | 纳恩博（北京）科技有限公司 | A kind of information processing method and device |
| CN107145870A (en)* | 2017-05-10 | 2017-09-08 | 成都优孚达信息技术有限公司 | The identifying system of face in a kind of video |
| CN107145870B (en)* | 2017-05-10 | 2020-01-21 | 成都优孚达信息技术有限公司 | Recognition system for human face in video |
| CN108366220A (en)* | 2018-04-23 | 2018-08-03 | 维沃移动通信有限公司 | A kind of video calling processing method and mobile terminal |
| WO2019206077A1 (en)* | 2018-04-23 | 2019-10-31 | 维沃移动通信有限公司 | Video call processing method and mobile terminal |
| CN108734472A (en)* | 2018-05-17 | 2018-11-02 | Oppo广东移动通信有限公司 | Payment method, payment device, electronic device and storage medium |
| WO2020029402A1 (en)* | 2018-08-08 | 2020-02-13 | 深圳码隆科技有限公司 | Suitcase volume measurement method and device, and suitcase volume measurement server, and computer readable medium |
| CN112995565B (en)* | 2019-12-17 | 2024-03-08 | 佛山市云米电器科技有限公司 | Camera adjustment method of display device, display device and storage medium |
| CN112995564A (en)* | 2019-12-17 | 2021-06-18 | 佛山市云米电器科技有限公司 | Call method based on display device, display device and storage medium |
| CN112995566A (en)* | 2019-12-17 | 2021-06-18 | 佛山市云米电器科技有限公司 | Sound source positioning method based on display equipment, display equipment and storage medium |
| CN112995565A (en)* | 2019-12-17 | 2021-06-18 | 佛山市云米电器科技有限公司 | Camera adjusting method of display device, display device and storage medium |
| CN112995566B (en)* | 2019-12-17 | 2024-04-05 | 佛山市云米电器科技有限公司 | Sound source positioning method based on display device, display device and storage medium |
| CN111147749A (en)* | 2019-12-31 | 2020-05-12 | 宇龙计算机通信科技(深圳)有限公司 | Photographing method, photographing device, terminal and storage medium |
| CN112672062A (en)* | 2020-08-21 | 2021-04-16 | 海信视像科技股份有限公司 | Display device and portrait positioning method |
| CN114500909A (en)* | 2021-12-31 | 2022-05-13 | 深圳壹秘科技有限公司 | Remote call method, device, equipment and computer readable storage medium |
| US20230351611A1 (en)* | 2022-04-29 | 2023-11-02 | Nanning Fulian Fugui Precision Industrial Co., Ltd. | Method and device for identifying face of one person among many and tracking same as the target |
| US12380574B2 (en)* | 2022-04-29 | 2025-08-05 | Nanning Fulian Fugui Precision Industrial Co., Ltd. | Method and device for identifying face of one person among many and tracking same as the target |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103475849B (en) | 2016-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103475849B (en) | Method photographic head shooting angle being adjusted when video calling and device | |
| CN107835464B (en) | Video call window picture processing method, terminal and computer readable storage medium | |
| US20200094138A1 (en) | Game Picture Display Method and Apparatus, Storage Medium and Electronic Device | |
| CN104360816B (en) | Screenshotss method and system | |
| KR101951135B1 (en) | Method for scaling video image, and mobile terminal | |
| CN107145293A (en) | A kind of screenshot method, mobile terminal and storage medium | |
| EP3035656A1 (en) | Method and apparatus for controlling an electronic device | |
| EP4131931A1 (en) | Image capturing method and electronic device | |
| US9473808B2 (en) | Information processing apparatus, program, information processing method, and information processing system | |
| CN107231470B (en) | Image processing method, mobile terminal and computer readable storage medium | |
| CN107885448B (en) | Control method for application touch operation, mobile terminal and readable storage medium | |
| JP2016507810A (en) | Using distance between objects in touchless gesture interface | |
| JP2014044727A (en) | Portable terminal and moving image call service operation method therefor | |
| WO2020078319A1 (en) | Gesture-based manipulation method and terminal device | |
| EP3541066A1 (en) | Electronic whiteboard, image display method, and carrier means | |
| JP2015507391A (en) | Method and gesture detector for recognizing gestures | |
| CN104347049A (en) | A method and device for adjusting screen refresh rate | |
| CN107148776B (en) | Method, apparatus, system, and computer-readable storage medium for acquiring video data | |
| CN109413333B (en) | Display control method and terminal | |
| CN106254784A (en) | A kind of method and device of Video processing | |
| CN102298500A (en) | Self-adaptive screen zooming adjusting method | |
| CN107509040A (en) | A kind of photographic method and mobile terminal | |
| WO2012088702A1 (en) | Method and apparatus for providing a mechanism for gesture recognition | |
| CN105930142A (en) | Screen capture processing method, device and intelligent terminal | |
| CN104378576B (en) | Information processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder | Address after:Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before:Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee before:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |