Movatterモバイル変換


[0]ホーム

URL:


CN112911154B - Snapshot method, server and computer storage medium - Google Patents

Snapshot method, server and computer storage medium
Download PDF

Info

Publication number
CN112911154B
CN112911154BCN202110146060.4ACN202110146060ACN112911154BCN 112911154 BCN112911154 BCN 112911154BCN 202110146060 ACN202110146060 ACN 202110146060ACN 112911154 BCN112911154 BCN 112911154B
Authority
CN
China
Prior art keywords
audio
video data
home
electronic device
captured object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110146060.4A
Other languages
Chinese (zh)
Other versions
CN112911154A (en
Inventor
曹冰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp LtdfiledCriticalGuangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202110146060.4ApriorityCriticalpatent/CN112911154B/en
Publication of CN112911154ApublicationCriticalpatent/CN112911154A/en
Application grantedgrantedCritical
Publication of CN112911154BpublicationCriticalpatent/CN112911154B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Classifications

Landscapes

Abstract

The embodiment of the application discloses a snapshot method, which is applied to a server, wherein the server is in communication connection with at least two electronic devices arranged in a family, and the snapshot method comprises the following steps: when the snapshot object is determined to be in the monitoring area of the camera in the electronic equipment, the current scene where the snapshot object is located is determined according to the operation information of the electronic equipment, and when the current scene is determined to be the preset scene, the camera is controlled to snapshot the snapshot object, so that the audio and video data of the snapshot object are obtained and stored. The embodiment of the application also provides a server and a computer storage medium.

Description

Translated fromChinese
一种抓拍方法、服务器及计算机存储介质Snapshot method, server and computer storage medium

技术领域technical field

本申请涉及智慧家庭平台中音视频的抓拍技术,尤其涉及一种抓拍方法、服务器及计算机存储介质。The present application relates to a technology for capturing audio and video in a smart home platform, and in particular, to a capturing method, a server and a computer storage medium.

背景技术Background technique

通常地,现有的摄像头的抓拍技术通过摄像头对周围环境进行监控,目标检测,跟踪和捕捉等手段来对目标对象进行音视频的抓拍,或者借助一些传感器来触发启动摄像头捕捉音视频,然而,该抓拍方法通常得到的音视频要么并非用户需要捕捉的音视频,要么未抓拍到用户需要捕捉的音视频,导致得到的音视频的冗余或者缺失;由此可以看出,现有的摄像头的抓拍方法存在抓拍效率低下的技术问题。Generally, the existing camera capture technology uses the camera to monitor the surrounding environment, target detection, tracking and capture to capture the audio and video of the target object, or use some sensors to trigger the camera to capture audio and video. However, The audio and video usually obtained by the capture method are either not the audio and video that the user needs to capture, or the audio and video that the user needs to capture is not captured, resulting in redundancy or lack of the obtained audio and video; The capture method has the technical problem of low capture efficiency.

发明内容SUMMARY OF THE INVENTION

本申请实施例提供一种抓拍方法、服务器及计算机存储介质,能够提高音视频的抓拍效率。Embodiments of the present application provide a capture method, a server, and a computer storage medium, which can improve the capture efficiency of audio and video.

本申请的技术方案是这样实现的:The technical solution of the present application is realized as follows:

本申请实施例提供了一种抓拍方法,所述方法应用于服务器中,所述服务器与设置于家庭中的至少两个电子设备具有通信连接,所述方法包括:An embodiment of the present application provides a capture method, the method is applied to a server, the server has a communication connection with at least two electronic devices set in a home, and the method includes:

当确定抓拍对象处于所述电子设备中摄像头的监控区域时,根据所述电子设备的运行信息,确定所述抓拍对象所处的当前场景;When it is determined that the captured object is in the monitoring area of the camera in the electronic device, the current scene where the captured object is located is determined according to the operation information of the electronic device;

当确定所述当前场景为预设场景时,控制所述摄像头对所述抓拍对象进行抓拍,得到所述抓拍对象的音视频数据并进行存储。When it is determined that the current scene is a preset scene, the camera is controlled to capture the captured object, and audio and video data of the captured object is obtained and stored.

本申请实施例提供了一种服务器,所述服务器与设置于家庭中的至少两个电子设备具有通信连接,包括:An embodiment of the present application provides a server, where the server has a communication connection with at least two electronic devices set in a home, including:

确定模块,用于当确定抓拍对象处于所述电子设备中摄像头的监控区域时,根据所述电子设备的运行信息,确定所述抓拍对象所处的当前场景;a determining module, configured to determine the current scene where the captured object is located according to the operation information of the electronic device when it is determined that the captured object is in the monitoring area of the camera in the electronic device;

抓拍模块,用于当确定所述当前场景为预设场景时,控制所述摄像头对所述抓拍对象进行抓拍,得到所述抓拍对象的音视频数据并进行存储。A capture module, configured to control the camera to capture the capture object when it is determined that the current scene is a preset scene, obtain and store audio and video data of the capture object.

本申请实施例还提供了一种服务器,所述服务器包括:处理器以及存储有所述处理器可执行指令的存储介质,所述存储介质通过通信总线依赖所述处理器执行操作,当所述指令被所述处理器执行时,执行上述一个或多个实施例所述抓拍方法。An embodiment of the present application further provides a server, where the server includes: a processor and a storage medium storing executable instructions of the processor, and the storage medium relies on the processor to perform operations through a communication bus. When the instruction is executed by the processor, the capturing method described in one or more of the foregoing embodiments is executed.

本申请实施例提供了一种计算机存储介质,存储有可执行指令,当所述可执行指令被一个或多个处理器执行的时候,所述处理器执行上述一个或多个实施例所述抓拍方法。Embodiments of the present application provide a computer storage medium storing executable instructions. When the executable instructions are executed by one or more processors, the processors execute the snapshots described in one or more of the foregoing embodiments. method.

本申请实施例提供了一种抓拍方法、服务器及计算机存储介质,该方法应用于服务器中,该服务器与设置于家庭中的至少两个电子设备具有通信连接,该方法包括:当确定抓拍对象处于电子设备中摄像头的监控区域时,根据电子设备的运行信息,确定抓拍对象所处的当前场景,当确定当前场景为预设场景时,控制摄像头对抓拍对象进行抓拍,得到抓拍对象的音视频数据并进行存储;也就是说,在本申请实施例中,服务器在确定抓拍对象处于电子设备中摄像头的监控区域时,服务器不直接控制摄像头开启抓拍,而是进一步根据电子设备的运行信息来确定抓拍对象所处的当前场景,并且只有当前场景为预设场景时,服务器才控制摄像头对抓拍对象进行抓拍,从而得到抓拍对象的音视频数据,这里,通过家庭中的电子设备的运行信息来确定当前场景,使得服务器可以结合当前场景来确定是否开启摄像头来实现抓拍,那么,在进行抓拍时,能够结合家庭中的情景,按照用户的需求进行抓拍,更加智能化的控制摄像头实现抓拍,从而避免了在不合适的场景下进行抓拍,进而提高了音视频的抓拍效率。Embodiments of the present application provide a capture method, a server, and a computer storage medium. The method is applied to a server, and the server has a communication connection with at least two electronic devices installed in a home. The method includes: when it is determined that the capture object is in When the monitoring area of the camera in the electronic device is used, the current scene where the captured object is located is determined according to the operation information of the electronic device. When it is determined that the current scene is the preset scene, the camera is controlled to capture the captured object to obtain the audio and video data of the captured object. That is to say, in the embodiment of the present application, when the server determines that the capture object is in the monitoring area of the camera in the electronic device, the server does not directly control the camera to start capture, but further determines the capture according to the operation information of the electronic device. The current scene where the object is located, and only when the current scene is the preset scene, the server controls the camera to capture the captured object, so as to obtain the audio and video data of the captured object. scene, so that the server can determine whether to turn on the camera to realize the snapshot based on the current scene, then, when capturing, it can combine the scene in the family, capture according to the user's needs, and more intelligently control the camera to realize the snapshot, thus avoiding the need for Capture in inappropriate scenes, thereby improving the capture efficiency of audio and video.

附图说明Description of drawings

图1为本申请实施例提供的一种可选的抓拍方法的流程示意图;1 is a schematic flowchart of an optional capture method provided by an embodiment of the present application;

图2为本申请实施例提供的一种可选的智慧家庭系统的实例的结构示意图;FIG. 2 is a schematic structural diagram of an example of an optional smart home system provided by an embodiment of the present application;

图3为申请实施例提供的一种可选的抓拍方法的实例的流程示意图;3 is a schematic flowchart of an example of an optional snapshot method provided by the application embodiment;

图4为本申请实施例提供的一种服务器的结构示意图一;FIG. 4 is a schematic structural diagram 1 of a server according to an embodiment of the present application;

图5为本申请实施例提供的一种服务器的结构示意图二。FIG. 5 is a second schematic structural diagram of a server according to an embodiment of the present application.

具体实施方式Detailed ways

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application.

实施例一Example 1

本申请实施例提供了一种抓拍方法,该方法应用于服务器中,该服务器与设置于家庭中的至少两个电子设备具有通信连接,图1为本申请实施例提供的一种可选的抓拍方法的流程示意图,参考图1所示,上述抓拍方法可以包括:An embodiment of the present application provides a snapshot method, which is applied to a server, and the server has a communication connection with at least two electronic devices installed in a home. FIG. 1 is an optional snapshot provided by an embodiment of the application. For a schematic flowchart of the method, as shown in FIG. 1 , the above-mentioned capture method may include:

S101:当确定抓拍对象处于电子设备中摄像头的监控区域时,根据电子设备的运行信息,确定抓拍对象所处的当前场景;S101: when it is determined that the captured object is in the monitoring area of the camera in the electronic device, according to the operation information of the electronic device, determine the current scene where the captured object is located;

目前,现有的抓拍方法得到的音视频要么并非用户需要捕捉的音视频,要么未抓拍到用户需要捕捉的音视频,导致得到音视频的冗余或者缺失,抓拍效率低下的技术问题。At present, the audio and video obtained by the existing capture methods are either not the audio and video that the user needs to capture, or the audio and video that the user needs to capture is not captured, resulting in the redundancy or lack of the obtained audio and video, and the technical problem of low capture efficiency.

为了提高抓拍效率,服务器在确定抓拍对象处于电子设备中摄像头的监控区域,例如,抓拍对象为家庭中的小孩,将摄像头布置在客厅中,监控区域为客厅,那么,服务器在确定小孩处于客厅区域时,获取电子设备的运行信息,并根据电子设备的运行信息确定抓拍对象所处的当前场景。In order to improve the capture efficiency, the server determines that the capture object is in the monitoring area of the camera in the electronic device. For example, if the capture object is a child in the family, the camera is arranged in the living room, and the monitoring area is the living room. Then, the server determines that the child is in the living room area. At the time, the operation information of the electronic device is obtained, and the current scene where the captured object is located is determined according to the operation information of the electronic device.

为了确定出抓拍对象是否处于电子设备中摄像头的监控区域,可以采用多种方法实现,在一种可选的实施例中,确定抓拍对象处于电子设备中摄像头的监控区域,可以包括:In order to determine whether the captured object is in the monitoring area of the camera in the electronic device, a variety of methods can be used to achieve. In an optional embodiment, determining that the captured object is in the monitoring area of the camera in the electronic device may include:

根据电子设备的可穿戴设备的信号强度,确定可穿戴设备的位置;其中,抓拍对象佩戴有可穿戴设备;Determine the position of the wearable device according to the signal strength of the wearable device of the electronic device; wherein, the capture object wears the wearable device;

当可穿戴设备的位置处于监控区域的范围之内时,确定抓拍对象处于电子设备中摄像头的监控区域。When the position of the wearable device is within the range of the monitoring area, it is determined that the captured object is in the monitoring area of the camera in the electronic device.

由于服务器与电子设备具有通信连接,那么服务器可以获取到电子设备的信号强度,例如,接收信号的强度指示(RSSI,Received Signal Strength Indication),服务器可以根据RSSI获取到可穿戴设备距离电子设备中至少三个网络设备的距离,然后根据两点之间的距离公式,确定出可穿戴设备的位置;由于可穿戴设备佩戴于抓拍对象身上,那么,服务器就可以获取到抓拍对象的位置。Since the server has a communication connection with the electronic device, the server can obtain the signal strength of the electronic device, for example, Received Signal Strength Indication (RSSI, Received Signal Strength Indication). The distance between the three network devices, and then the position of the wearable device is determined according to the distance formula between the two points; since the wearable device is worn on the captured object, the server can obtain the captured object's position.

然后,服务器可以判断可穿戴设备的位置是否处于监控区域的范围之内,经过判断,服务器确定可穿戴设备的位置处于监控区域的范围之内时,确定抓拍对象处于电子设备中摄像头的监控区域。Then, the server can determine whether the position of the wearable device is within the range of the monitoring area, and after the judgment, when the server determines that the position of the wearable device is within the range of the monitoring area, it determines that the captured object is within the monitoring area of the camera in the electronic device.

举例来说,为了实现对小孩的抓拍,这里,可穿戴设备为手环手表,将手环手表佩戴在小孩的身上,当服务器确定手环手表处于监控区域时,这里,服务器可以通过无线保真(WIFI,Wireless Fidelity)或者蓝牙的信号强度来推算出手环手表的位置,只有当手环手表处于监控区域时,才确定抓拍对象处于监控区域。For example, in order to capture the child, here, the wearable device is a wrist watch, and the wrist watch is worn on the child's body. When the server determines that the wrist watch is in the monitoring area, here, the server can use wireless fidelity (WIFI, Wireless Fidelity) or Bluetooth signal strength to calculate the position of the wristband watch. Only when the wristband watch is in the monitoring area can the captured object be determined to be in the monitoring area.

另外,为了确定出抓拍对象是否处于电子设备中摄像头的监控区域,在一种可选的实施例中,确定抓拍对象处于电子设备中摄像头的监控区域,可以包括:In addition, in order to determine whether the captured object is in the monitoring area of the camera in the electronic device, in an optional embodiment, determining that the captured object is in the monitoring area of the camera in the electronic device may include:

当通过电子设备中感知设备检测到对象时,开启摄像头;When an object is detected by the sensing device in the electronic device, turn on the camera;

当摄像头拍摄到的画面中包含抓拍对象时,确定抓拍对象处于电子设备中摄像头的监控区域。When the image captured by the camera includes the captured object, it is determined that the captured object is in the monitoring area of the camera in the electronic device.

这里,在监控区域中设置有感知设备,通过感知设备来检测是否有对象,当感知设备检测到有对象时,先开启摄像头,通过摄像头来拍摄,再判断拍摄到的画面中是否包含抓拍对象,如果包含,说明此时抓拍对象处于电子设备中摄像头的监控区域内,如果不包含,说明此时抓拍对象不处于电子设备中摄像头的监控区域内。Here, a sensing device is set in the monitoring area, and the sensing device is used to detect whether there is an object. When the sensing device detects an object, the camera is turned on first, and the camera is used to shoot, and then it is judged whether the captured image contains a captured object. If it is included, it means that the captured object is in the monitoring area of the camera in the electronic device at this time. If it is not included, it means that the captured object is not in the monitoring area of the camera in the electronic device at this time.

举例来说,在监控区域布置有人体感应器,当人体感应器检测到有目标对象时,开启摄像头捕捉画面,当画面中的目标对象包含抓拍对象时,确定抓拍对象处于监控区域。For example, a human body sensor is arranged in the monitoring area. When the human body sensor detects a target object, the camera is turned on to capture the screen. When the target object in the screen includes the captured object, it is determined that the captured object is in the monitoring area.

为了确定出抓拍对象所处的当前场景,在一种可选的实施例中,根据电子设备的运行信息,确定抓拍对象所处的当前场景,可以包括:In order to determine the current scene where the captured object is located, in an optional embodiment, according to the operation information of the electronic device, determining the current scene where the captured object is located may include:

从电子设备中门禁设备中获取家庭出入信息;Obtain home access information from access control devices in electronic devices;

当家庭出入信息指示家中无人时,确定当前场景为离家模式;When the home entry and exit information indicates that there is no one at home, determine that the current scene is the leaving home mode;

当家庭出入信息指示家中有人时,确定当前场景为在家模式。When the home entry and exit information indicates that there is someone in the home, it is determined that the current scene is the home mode.

具体来说,电子设备中包含家庭中所设置的所有电子设备,例如,智能家电,传感器和网络设备等,这里,为了确定出当前场景,服务器先从电子设备中门禁设备获取家庭出入信息,在实际应用中,门禁设备可以为设置在入户门上的可视化门铃,通过可视化门铃可以获取每一个进出入户门的人的信息,即为家庭出入信息。Specifically, the electronic devices include all electronic devices set in the home, such as smart home appliances, sensors and network devices, etc. Here, in order to determine the current scene, the server first obtains home access information from the access control device In practical applications, the access control device can be a visual doorbell set on the entrance door, and the information of each person entering and exiting the door can be obtained through the visual doorbell, that is, family access information.

当家庭出入信息中的每个人中既有进入信息,也有外出信息,说明家中无人,所以,服务器确定当前场景为离家模式,当家庭出入信息中存在有只有进入信息,没有外出信息的人,说明此时家中有人,所以,服务器确定当前场景为在家模式。When each person in the home entry and exit information has both entry information and outgoing information, it means that there is no one at home. Therefore, the server determines that the current scene is the leaving home mode. When there is a person who only has entry information and no outgoing information in the home entry and exit information , indicating that there is someone at home at this time, so the server determines that the current scene is the home mode.

由于在家模式还可以分为多种模式,在一种可选的实施例中,当家庭出入信息指示家中有人时,确定当前场景为在家模式,可以包括:Since the at-home mode can be further divided into multiple modes, in an optional embodiment, when the home entry and exit information indicates that there are people at home, determining that the current scene is the at-home mode may include:

当家庭出入信息指示家中有人时,且家庭出入信息中指示家庭中有非家庭成员的进入信息,从电子设备的安防设备获取安防设备的运行信息;When the family access information indicates that there is someone in the home, and the family access information indicates that there are non-family members in the family, obtain the operation information of the security device from the security device of the electronic device;

当安防设备的运行信息中未包含报警信息,且门禁设备的运行信息中未包含报警信息时,确定当前场景为在家模式的会客模式;When the operation information of the security equipment does not contain alarm information, and the operation information of the access control equipment does not contain alarm information, it is determined that the current scene is the guest mode of the home mode;

当家庭出入信息指示家中有人时,且家庭出入信息中指示家庭中均为家庭成员的进入信息,确定当前场景为在家模式的非会客模式。When the family entry and exit information indicates that there are people in the home, and the family entry and exit information indicates that all the family members are entry information, it is determined that the current scene is a non-guest meeting mode of the home mode.

具体来说,当家中有人,且家庭出人信息中指示家庭中存在非家庭人员的进入信息,服务器会从家里的安防设备中获取运行信息,例如,门窗检测设备为安防设备,服务器从门窗检测设备中获取门窗检测设备的运行信息,以此来判断进入的非家庭成员是否为客人,对于非法闯入的人,安防设备或者门禁设备会发出报警信息,那么,当安防设备的运行信息中未包含报警信息,且门禁设备的运行信息中也未包含报警信息时,说明此时进入家中的非家庭成员为合法进入,所以,服务器确定当前场景为在家模式的会客模式。Specifically, when there are people in the home, and the home exit information indicates that there is entry information of non-family personnel in the home, the server will obtain the operation information from the security equipment in the home. For example, the door and window detection device is a security device, and the server detects from the door and window The operation information of the door and window detection equipment is obtained from the equipment to determine whether the non-family members who enter are guests. For those who break in illegally, the security equipment or access control equipment will issue an alarm information. When the alarm information is included, and the operation information of the access control device does not include the alarm information, it means that the non-family members who enter the home at this time are legally entering, so the server determines that the current scene is the guest mode of the home mode.

当家庭出入信息指示家中有人,且均为家庭成员时,服务器确定当前场景为在家模式的非会客模式。When the home entry and exit information indicates that there are people in the home, and all of them are family members, the server determines that the current scene is a non-guest meeting mode of the home mode.

也就是说,这里,服务器可以通过安防系统和门禁系统确定出此时是会客模式和非会客模式。That is to say, here, the server can determine, through the security system and the access control system, whether it is a guest mode or a non-guest mode at this time.

进一步地,针对非会客模式,还可以进行分类,在一种可选的实施例中,当家庭出入信息指示家中有人时,确定当前场景为在家模式,可以包括:Further, for the non-meeting guest mode, classification can also be performed. In an optional embodiment, when the home entry and exit information indicates that there are people in the home, determining that the current scene is the home mode may include:

当家庭出入信息指示家中有人时,且获取到的电子设备中音量检测仪的分贝值小于等于指定阈值时,确定当前场景为在家模式的睡眠模式;When the home entry and exit information indicates that there is someone at home, and the acquired decibel value of the volume detector in the electronic device is less than or equal to the specified threshold, determine that the current scene is the sleep mode of the home mode;

当家庭出入信息指示家中有人时,且获取到的电子设备中至少一个烹饪设备正在运行时,确定当前场景为在家模式的餐饮模式;When the home entry and exit information indicates that there is someone at home and at least one cooking device in the obtained electronic devices is running, determine that the current scene is the dining mode in the home mode;

当家庭出入信息指示家中有人时,且获取到的电子设备中至少一个娱乐类设备正在运行时,确定当前场景为在家模式的娱乐模式。When the home entry and exit information indicates that there is someone at home and at least one entertainment device in the obtained electronic device is running, it is determined that the current scene is the entertainment mode of the home mode.

具体来说,当家庭出入信息中指示家中有人时,并且电子设备中的音量检测仪检测到的分贝值小于等于指定阈值时,说明此时家中的分贝值较低,服务器确定当前场景为在家模式的睡眠模式;其中,指定阈值为预先设定好的值。Specifically, when the home entry and exit information indicates that there are people at home, and the decibel value detected by the volume detector in the electronic device is less than or equal to the specified threshold, it means that the decibel value in the home is low at this time, and the server determines that the current scene is the home mode. sleep mode; wherein, the specified threshold is a preset value.

当家庭出入信息中指示家中有人时,并且电子设备中至少存在一个烹饪设备正在运行,例如,电饭锅正在运行,说明此时家中正在做饭,所以服务器确定当前场景为在家模式的餐饮模式。When the home access information indicates that there is someone at home, and at least one cooking device is running in the electronic device, for example, the rice cooker is running, it means that the home is cooking at this time, so the server determines that the current scene is the home mode dining mode.

当家庭出入信息中指示家中有人时,并且电子设备中至少存在一个娱乐类设备正在运行,例如,智能电视正在运行,或者,虚拟现实(VR,Virtual Reality)/增强现实(AR,Augmented Reality)眼镜正在运行等等,所以服务器确定当前场景为在家模式的娱乐模式。When the home entry and exit information indicates that there are people in the home, and at least one entertainment device is running in the electronic device, for example, a smart TV is running, or virtual reality (VR, Virtual Reality) / Augmented reality (AR, Augmented Reality) glasses is running, etc., so the server determines that the current scene is the entertainment mode of the home mode.

这里,需要说明的是,服务器在确定当前场景时还可以依据历史记录,确定每天每个时段的场景模式,在确定当前场景时还可以结合历史记录进行判断,从而准确地判断出抓拍对象所处的当前场景,有利于准确地控制摄像头对抓拍对象进行抓拍。Here, it should be noted that when determining the current scene, the server can also determine the scene mode of each period of the day according to the historical records, and can also make judgments based on the historical records when determining the current scene, so as to accurately determine the location of the captured object. The current scene is conducive to accurately controlling the camera to capture the captured object.

在实际应用中,智慧家庭平台连接着家里所有的电子设备,能够获取所有电子设备当前状态以及各个电子设备最新的通知信息,智慧家庭平台首先会按照生活习惯(例如,时间作息以及活动)将其划分为相互独立的模式,比如,离家模式(具体为:家里没人,安防会启动)/在家模式(具体为:家里有人,在家模式又细分为:睡眠模式/娱乐模式/餐饮模式),家里有没有人可以通过在门口的视频监控识别出来。In practical applications, the smart home platform is connected to all electronic devices in the home, and can obtain the current status of all electronic devices and the latest notification information of each electronic device. Divided into independent modes, for example, leaving home mode (specifically: no one at home, security will be activated) / home mode (specifically: someone at home, home mode is subdivided into: sleep mode/entertainment mode/dining mode) , whether anyone at home can be identified by video surveillance at the door.

当智慧家庭平台识别出在家模式(具体为:有家人在家)的时候,如果又识别出有陌生人在家时,并且并没有非法闯入(具体为:非法闯入可以通过门窗检测设备)以及挟持(门口摄像头监测)等等安全报警时,就可以判定陌生人为客人,那么此时智慧家庭就处于会客场景。When the smart home platform recognizes the home mode (specifically: there are family members at home), if it recognizes that there are strangers at home, and there is no illegal intrusion (specifically: illegal intrusion can be detected through doors and windows) and hostage (Camera monitoring at the door) and other security alarms, it can be determined that a stranger is a guest, then the smart home is in a guest scene at this time.

S102:当确定当前场景为预设场景时,控制摄像头对抓拍对象进行抓拍,得到抓拍对象的音视频数据。S102: When it is determined that the current scene is the preset scene, control the camera to capture the captured object to obtain audio and video data of the captured object.

通过S101可以确定出抓拍对象所处的当前场景,通过判断只有当当前场景为预设场景时,服务器控制摄像头对抓拍对象进行抓拍,得到抓拍对象的音视频数据。Through S101, the current scene where the captured object is located can be determined, and the server controls the camera to capture the captured object only when the current scene is a preset scene, and obtains audio and video data of the captured object.

然而,为了避免在不合适的场景下进行抓拍,在一种可选的实施例中,S102可以包括:However, in order to avoid capturing in inappropriate scenes, in an optional embodiment, S102 may include:

当确定当前场景为在家模式的非会客模式,控制摄像头对抓拍对象进行抓拍,得到抓拍对象的音视频数据并进行存储。When it is determined that the current scene is in the non-meeting mode of the home mode, the camera is controlled to capture the captured object, and the audio and video data of the captured object is obtained and stored.

也就是说,若确定出当前场景为在家模式的非会客模式,说明此时家中均为家庭成员,所以,服务器控制摄像头对抓拍对象进行抓拍,得到抓拍对象的音视频数据,对于在家模式的会客模式,或者离家模式,服务器禁止打开摄像头进行抓拍,这样,避免了会客模式下对客人所造成的不适,在离家模式下抓拍到冗余的音视频数据。That is to say, if it is determined that the current scene is in the non-guest mode of the home mode, it means that all the family members are at home at this time. Therefore, the server controls the camera to capture the captured object, and obtains the audio and video data of the captured object. In guest mode or leave home mode, the server prohibits opening the camera to capture, thus avoiding the discomfort caused to guests in guest mode, and capturing redundant audio and video data in home leave mode.

为了防止抓拍得到的冗余的或者无效的音视频数据所占据的资源,在一种可选的实施例中,上述方法还可以包括:In order to prevent resources occupied by redundant or invalid audio and video data obtained by capturing, in an optional embodiment, the above method may further include:

从抓拍对象的音视频数据中确定出无效的音视频数据;Determine invalid audio and video data from the audio and video data of the captured object;

从抓拍对象的音视频数据中删除掉无效的音视频数据。Delete invalid audio and video data from the audio and video data of the captured object.

具体来说,服务器先从抓拍对象的音视频数据中确定出无效的音视频数据,然后在从抓拍对象的音视频中删除掉无效的音视频数据。Specifically, the server first determines invalid audio and video data from the audio and video data of the capture object, and then deletes the invalid audio and video data from the audio and video data of the capture object.

进一步地,为了实现从抓拍对象的音视频数据中确定出无效的音视频数据,在一种可选的实施例中,从抓拍对象的音视频数据中确定出无效的音视频数据,可以包括:Further, in order to determine invalid audio and video data from the audio and video data of the captured object, in an optional embodiment, determine invalid audio and video data from the audio and video data of the captured object, which may include:

确定抓拍对象的音视频数据中每个音视频数据中每帧图像对比度;Determine the contrast of each frame of image in each audio and video data in the audio and video data of the captured object;

确定对比度小于等于第二预设阈值的图像帧数在对应的音视频数据的图像总帧数的占比,当图像帧数在对应的音视频数据的图像总帧数的占比小于第三预设阈值时,将对应的音视频数据,确定为无效的音视频数据。Determine the ratio of the number of image frames with a contrast less than or equal to the second preset threshold in the total number of image frames of the corresponding audio and video data, when the ratio of the number of image frames in the total number of frames of the corresponding audio and video data is less than the third preset When the threshold is set, the corresponding audio and video data is determined as invalid audio and video data.

具体来说,音视频的有效性主要通过音视频的质量评估来完成,音频的有效性判断方法可以从音频和视频两个方面来判断。Specifically, the validity of audio and video is mainly completed through the quality assessment of audio and video, and the method of judging the validity of audio can be judged from two aspects of audio and video.

首先,对于音频来说,服务器可以确定出音频的信噪比,并且确定出能够识别出来的语音内容,但是,需要说明的是,整个音频在音视频质量最终的影响较小,占比可以设置在10%左右,也就意味着,即使音频不好或者缺失也不会对整个质量产生太大的影响。First of all, for audio, the server can determine the signal-to-noise ratio of the audio and determine the voice content that can be recognized. However, it should be noted that the final impact of the entire audio on the audio and video quality is small, and the proportion can be set At around 10%, it means that even bad or missing audio doesn't affect the overall quality much.

针对视频的有效性判断方法来说,视频的模糊度,具体需要对音视频中每一帧图像进行模糊度分析,具体的分析方法主要利用对比度来实现,比如把一张图像片分割成M*N块,然后对每一块计算出对比度,最后求出M*N块的平均值,确定为每帧图像的对比度,然后,根据经验设定模糊度阈值(相当于上述第二预设阈值),比如70,再统计出整个音视频中模糊帧的占比,如果超过了50%,就可以确定出该音视频为模糊的,也就是无效的音视频。For the method of judging the validity of the video, the ambiguity of the video needs to be analyzed for the ambiguity of each frame image in the audio and video. The specific analysis method is mainly realized by contrast, such as dividing an image into M* N blocks, then the contrast is calculated for each block, and finally the average value of M*N blocks is obtained, which is determined as the contrast of each frame of image, and then the blurriness threshold is set according to experience (equivalent to the above-mentioned second preset threshold), For example, 70, and then count the proportion of fuzzy frames in the entire audio and video. If it exceeds 50%, it can be determined that the audio and video are fuzzy, that is, invalid audio and video.

另外,为了实现从抓拍对象的音视频数据中确定出无效的音视频数据,在一种可选的实施例中,从抓拍对象的音视频数据中确定出无效的音视频数据,包括:In addition, in order to determine invalid audio and video data from the audio and video data of the captured object, in an optional embodiment, determine the invalid audio and video data from the audio and video data of the captured object, including:

对抓拍对象的音视频数据中每个音视频数据中每帧图像进行人脸识别;Perform face recognition on each frame of image in each audio and video data in the audio and video data of the captured object;

确定识别出人脸区域的图像帧数在对应的音视频数据的图像总帧数的占比,当识别出人脸区域的图像帧数在对应的音视频数据的图像总帧数的占比小于等于第四预设阈值时,将对应的音视频数据,确定为无效的音视频数据。Determine the ratio of the number of image frames of the identified face area to the total number of image frames of the corresponding audio and video data. When the proportion of the number of image frames of the identified face area to the total number of frames of the corresponding audio and video data is less than When it is equal to the fourth preset threshold, the corresponding audio and video data is determined as invalid audio and video data.

举例来说,对音视频数据中每帧图像的内容的识别,具体需要对音视频中每帧图像进行人脸识别,统计整个音视频中能够识别出人脸图片的图像帧数的占比,比如小于20%,可以判断音视频为无效的音视频数据。For example, to identify the content of each frame of image in audio and video data, it is necessary to perform face recognition on each frame of image in audio and video data, and count the proportion of image frames in which face pictures can be recognized in the entire audio and video data. For example, if it is less than 20%, it can be determined that the audio and video data are invalid audio and video data.

下面举实例来对上述一个或多个实施例中所述的抓拍方法进行说明。The following examples are used to describe the capturing method described in one or more of the above embodiments.

图2为本申请实施例提供的一种可选的智慧家庭系统的实例的结构示意图,如图2所示,智慧家庭系统可以包括智慧家庭平台21,云台相机22,手机/平板23,感知设备24和感知设备25;其中,智慧家庭平台21可以获取到用户对手机/平板23的浏览信息或者筛选信息,还可以通过感知设备24和/或感知设备25的获取信息,智慧家庭平台21触发实现对目标的监测+触发+条件判断,智能筛选+分析+提醒,以实现启动或者停止云台相机22,对抓拍对象进行目标追踪与反馈。FIG. 2 is a schematic structural diagram of an example of an optional smart home system provided by an embodiment of the present application. As shown in FIG. 2, the smart home system may include a smart home platform 21, apan-tilt camera 22, a mobile phone/tablet 23, a sensor The device 24 and the sensing device 25; wherein, the smart home platform 21 can obtain the user's browsing information or screening information on the mobile phone/tablet 23, and can also obtain information from the sensing device 24 and/or the sensing device 25. The smart home platform 21 triggers Realize the monitoring of the target + trigger + condition judgment, intelligent screening + analysis + reminder, so as to start or stop thePTZ camera 22, and perform target tracking and feedback on the captured object.

在本实例中,作为一名家长,很多时候希望能够抓拍到小孩子某一瞬间的行为动作或者说的话,现在能够做的方式就是购买一个监控摄像头,然后长时间的对某个区域进行抓拍,这样就会存在两个问题,如果在客厅放置一个摄像头并且对着某个区域进行拍摄的话,当客人过来看到时就会很不自在;另外就是每天捕获的视频量非常大,还需要再花费大量的时间进行人工筛选。为了避免上述现象的发生,图3为本申请实施例提供的一种可选的抓拍方法的实例的流程示意图,如图3所示,基于上述智慧家庭系统中,上述抓拍方法可以包括:In this example, as a parent, I often want to be able to capture the behavior or words of a child at a certain moment. The way I can do now is to buy a surveillance camera, and then capture a certain area for a long time. In this way, there will be two problems. If you place a camera in the living room and shoot at a certain area, it will be very uncomfortable when guests come to see it; the other is that the amount of video captured every day is very large, and it will cost more A lot of time for manual screening. In order to avoid the occurrence of the above phenomenon, FIG. 3 is a schematic flowchart of an example of an optional snapshot method provided by an embodiment of the present application. As shown in FIG. 3 , based on the above-mentioned smart home system, the above-mentioned snapshot method may include:

S301:智慧家庭平台21判断是否满足触发条件?若不满足,执行S302,若满足,执行S304;S301: The smart home platform 21 determines whether the trigger condition is met? If not satisfied, execute S302, if satisfied, execute S304;

另外,需要说明的是,默认云台相机22处于待机状态,旋转至拍摄角度为0的位置,用户根据需要设定智慧家庭平台21对小孩触发事件,触发条件比如:手环手表进入某个区域内时/人体感应特征表明为小孩进入时/红外监测目标进入时等。In addition, it should be noted that thedefault pan-tilt camera 22 is in the standby state and rotated to the position where the shooting angle is 0. The user can set the smart home platform 21 to trigger events for children according to their needs. The inner time/human body sensing feature indicates that it is when a child enters/infrared monitoring target enters, etc.

S302:智慧家庭平台21判断云台相机22是否正在抓拍?若正在抓拍,执行S303,若未正在抓拍,终止。S302: The smart home platform 21 judges whether thegimbal camera 22 is taking pictures? If the capture is in progress, execute S303, and if the capture is not in progress, terminate.

S303:智慧家庭平台21控制云台相机22停止抓拍。S303: The smart home platform 21 controls thePTZ camera 22 to stop capturing.

S304:智慧家庭平台21判断当前场景是否为预设场景,若是,执行S305,若不是,执行S302;S304: The smart home platform 21 judges whether the current scene is a preset scene, and if so, executes S305, and if not, executes S302;

具体来说,用户选定场景需求,比如:会客模式时/夜晚模式时/度假模式时等以外的场景方可进行抓拍。Specifically, the user selects the scene requirements, such as: the scene other than the meeting mode/night mode/vacation mode, etc., can be captured.

S305:智慧家庭平台21获取与之连接的电子设备的运行信息,对当前场景进行识别,在音视频数据超过某个值时提醒用户,并对音视频内容进行分析,删除掉无效的音视频数据。S305: The smart home platform 21 obtains the operation information of the electronic device connected to it, identifies the current scene, reminds the user when the audio and video data exceeds a certain value, analyzes the audio and video content, and deletes invalid audio and video data .

S306:智慧家庭平台21控制云台相机22对抓对象的视频进行抓拍;S306: The smart home platform 21 controls thePTZ camera 22 to capture the video of the captured object;

S307:智慧家庭平台21进行视频存储。S307: The smart home platform 21 performs video storage.

具体来说,智慧家庭平台21提供场景识别能力,判定当前场景的模式,一旦监测事件触发后,会再判定一次当前场景是否满足条件,都满足条件时,开启云台相机22,调整角度开启抓拍与存储。智慧家庭平台21会持续监测停止的触发事件以及场景条件,比如,场景切换为会客模式/目标离开等,均会停止抓拍,并将云台摄像头旋转拍摄角度为0位置。Specifically, the smart home platform 21 provides a scene recognition capability to determine the mode of the current scene. Once the monitoring event is triggered, it will determine again whether the current scene meets the conditions. When all the conditions are met, thePTZ camera 22 is turned on, and the angle is adjusted to start the snapshot. with storage. The smart home platform 21 will continue to monitor the stopped trigger events and scene conditions. For example, when the scene is switched to the guest mode or the target leaves, etc., it will stop capturing and rotate the pan-tilt camera to the 0 position.

智慧家庭平台21会对存储视频内容进行有效性分析,如果目标在拍摄的音视频中占有比例不足时,或者遮挡比较严重时,可以判定为无效的音视频可以自动删除;当音视频存储大小/数量/时长达到一定的阈值时,可以提醒用户进行筛选,并且将需要筛选的链接同步给用户进行浏览与操作。The smart home platform 21 will analyze the validity of the stored video content. If the target occupies an insufficient proportion of the captured audio and video, or if the occlusion is serious, the audio and video that can be judged to be invalid can be automatically deleted; when the audio and video storage size / When the number/duration reaches a certain threshold, the user can be reminded to filter, and the links that need to be filtered are synchronized to the user for browsing and operation.

另外,当新存储的音视频文件满足一定条件时会触发事件,提醒用户进行数据刷选,最后保存的数据才是用户希望保留的,用户可以随时进行浏览与分享。In addition, when the newly stored audio and video files meet certain conditions, an event will be triggered to remind the user to refresh the data. The last saved data is what the user wishes to keep, and the user can browse and share it at any time.

利用上述智慧家庭系统之后,首先,云台相机22默认会转到角落的位置,这样避免来客人时感觉到被监视的尴尬,另外因为结合了智能家庭中情景模式识别以及智能设备的感知能力,只有小孩出现的场景时才会进行抓拍。然后智慧家庭会对抓拍的视频进行有效性判别,如果不符合条件的话会自动删除,这样尽可能提供精准有效的内容给用户进行最后的筛选,提升用户使用体验。After utilizing the above-mentioned smart home system, firstly, thePTZ camera 22 will turn to the corner position by default, so as to avoid the embarrassment of being monitored when visiting guests. Only the scene where the child appears will be captured. Then the smart home will judge the validity of the captured video, and if it does not meet the conditions, it will be automatically deleted, so as to provide accurate and effective content as much as possible for users to perform final screening and improve the user experience.

本实例中充分利用云台相机22本身的特点对目标对象进行抓取的同时,融合智慧家庭平台中智能设备的感知能力,理解用户意图,更精准的抓取用户想要抓取的内容,并且会对抓取内容有效性进行智能化分析,在存储到一定量时智能提醒用户对抓取音视频进行过滤保存,给用户提供更好的音视频捕捉与存储服务。In this example, while making full use of the characteristics of thePTZ camera 22 to capture the target object, it integrates the perception capabilities of the smart devices in the smart home platform to understand the user's intention, and more accurately capture the content that the user wants to capture, and It will intelligently analyze the effectiveness of the captured content, and intelligently remind users to filter and save the captured audio and video when a certain amount is stored, so as to provide users with better audio and video capture and storage services.

本实例中,结合了云台相机本身特性与智慧家庭对用户意图的充分理解,使得抓拍的音视频更加精准有效,帮助用户记录家庭中美好瞬间,本实例中充分利用了智慧家庭对用户意图的理解,在尽可能保证用户隐私的前提下,对用户关心的内容进行抓拍,并且在抓拍完成之后对其内容进行识别,如果音视频无效,会自动将其删除,减少对无效数据的冗余存储,最后提供智能化交互,将音视频的筛选交给用户,保证音视频存储的满意度。In this example, the characteristics of the PTZ camera itself and the smart home's full understanding of the user's intention are combined to make the captured audio and video more accurate and effective, helping the user to record the beautiful moments in the family. This example makes full use of the smart home's understanding of the user's intention. It is understood that under the premise of ensuring user privacy as much as possible, capture the content that the user cares about, and identify the content after the capture is completed. If the audio and video are invalid, they will be automatically deleted to reduce redundant storage of invalid data. , and finally provide intelligent interaction, hand over the screening of audio and video to users, and ensure the satisfaction of audio and video storage.

本申请实施例提供了一种抓拍方法,该方法应用于服务器中,该服务器与设置于家庭中的至少两个电子设备具有通信连接,该方法包括:当确定抓拍对象处于电子设备中摄像头的监控区域时,根据电子设备的运行信息,确定抓拍对象所处的当前场景,当确定当前场景为预设场景时,控制摄像头对抓拍对象进行抓拍,得到抓拍对象的音视频数据并进行存储;也就是说,在本申请实施例中,服务器在确定抓拍对象处于电子设备中摄像头的监控区域时,服务器不直接控制摄像头开启抓拍,而是进一步根据电子设备的运行信息来确定抓拍对象所处的当前场景,并且只有当前场景为预设场景时,服务器才控制摄像头对抓拍对象进行抓拍,从而得到抓拍对象的音视频数据,这里,通过家庭中的电子设备的运行信息来确定当前场景,使得服务器可以结合当前场景来确定是否开启摄像头来实现抓拍,那么,在进行抓拍时,能够结合家庭中的情景,按照用户的需求进行抓拍,更加智能化的控制摄像头实现抓拍,从而避免了在不合适的场景下进行抓拍,进而提高了音视频的抓拍效率。An embodiment of the present application provides a capture method, the method is applied in a server, the server has a communication connection with at least two electronic devices set in a home, the method includes: when it is determined that the capture object is in the electronic device in the camera monitoring In the region, according to the operation information of the electronic equipment, determine the current scene where the captured object is located, and when the current scene is determined to be the preset scene, control the camera to capture the captured object, obtain the audio and video data of the captured object and store it; that is, Said, in the embodiment of the present application, when the server determines that the captured object is in the monitoring area of the camera in the electronic device, the server does not directly control the camera to start capturing, but further determines the current scene where the captured object is located according to the operation information of the electronic device , and only when the current scene is the preset scene, the server controls the camera to capture the captured object, so as to obtain the audio and video data of the captured object. To determine whether to turn on the camera to capture the current scene, then, when capturing, it can combine the scene in the family, capture according to the user's needs, and control the camera more intelligently to capture, thus avoiding inappropriate scenes. Snapshots are performed, thereby improving the capture efficiency of audio and video.

实施例二Embodiment 2

图4为本申请实施例提供的一种服务器的结构示意图一,如图4所示,本申请实施例提供了一种服务器,服务器与设置于家庭中的至少两个电子设备具有通信连接,包括:确定模块41和抓拍模块42;其中,FIG. 4 is a schematic structural diagram 1 of a server provided by an embodiment of the present application. As shown in FIG. 4 , an embodiment of the present application provides a server. The server has a communication connection with at least two electronic devices installed in a home, including :determination module 41 andcapture module 42; wherein,

确定模块41,用于当确定抓拍对象处于电子设备中摄像头的监控区域时,根据电子设备的运行信息,确定抓拍对象所处的当前场景;Thedetermination module 41 is configured to determine the current scene where the captured object is located according to the operation information of the electronic device when it is determined that the captured object is in the monitoring area of the camera in the electronic device;

抓拍模块42,用于当确定当前场景为预设场景时,控制摄像头对抓拍对象进行抓拍,得到抓拍对象的音视频数据并进行存储。The capturingmodule 42 is configured to control the camera to capture the captured object when it is determined that the current scene is the preset scene, obtain and store audio and video data of the captured object.

可选的,确定模块41确定抓拍对象处于电子设备中摄像头的监控区域中,包括:Optionally, the determiningmodule 41 determines that the captured object is in the monitoring area of the camera in the electronic device, including:

根据电子设备的可穿戴设备的信号强度,确定可穿戴设备的位置;其中,抓拍对象佩戴有可穿戴设备;Determine the position of the wearable device according to the signal strength of the wearable device of the electronic device; wherein, the capture object wears the wearable device;

当可穿戴设备的位置处于监控区域的范围之内时,确定抓拍对象处于电子设备中摄像头的监控区域。When the position of the wearable device is within the range of the monitoring area, it is determined that the captured object is in the monitoring area of the camera in the electronic device.

可选的,确定模块41确定抓拍对象处于电子设备中摄像头的监控区域中,包括:Optionally, the determiningmodule 41 determines that the captured object is in the monitoring area of the camera in the electronic device, including:

当通过电子设备中感知设备检测到对象时,开启摄像头;When an object is detected by the sensing device in the electronic device, turn on the camera;

当摄像头拍摄到的画面中包含抓拍对象时,确定抓拍对象处于电子设备中摄像头的监控区域。When the image captured by the camera includes the captured object, it is determined that the captured object is in the monitoring area of the camera in the electronic device.

可选的,确定模块41根据电子设备的运行信息,确定抓拍对象所处的当前场景中,包括:Optionally, thedetermination module 41 determines the current scene where the captured object is located according to the operation information of the electronic device, including:

从电子设备中门禁设备中获取家庭出入信息;Obtain home access information from access control devices in electronic devices;

当家庭出入信息指示家中无人时,确定当前场景为离家模式;When the home entry and exit information indicates that there is no one at home, determine that the current scene is the leaving home mode;

当家庭出入信息指示家中有人时,确定当前场景为在家模式。When the home entry and exit information indicates that there is someone in the home, it is determined that the current scene is the home mode.

可选的,当家庭出入信息指示家中有人时,确定模块41确定当前场景为在家模式中,包括:Optionally, when the home entry and exit information indicates that there is someone at home, the determiningmodule 41 determines that the current scene is in the home mode, including:

当家庭出入信息指示家中有人时,且家庭出入信息中指示家庭中有非家庭成员的进入信息,从电子设备的安防设备获取安防设备的运行信息;When the family access information indicates that there is someone in the home, and the family access information indicates that there are non-family members in the family, obtain the operation information of the security device from the security device of the electronic device;

当安防设备的运行信息中未包含报警信息,且门禁设备的运行信息中未包含报警信息时,确定当前场景为在家模式的会客模式;When the operation information of the security equipment does not contain alarm information, and the operation information of the access control equipment does not contain alarm information, it is determined that the current scene is the guest mode of the home mode;

当家庭出入信息指示家中有人时,且家庭出入信息中指示家庭中均为家庭成员的进入信息,确定当前场景为在家模式的非会客模式。When the family entry and exit information indicates that there are people in the home, and the family entry and exit information indicates that all the family members are entry information, it is determined that the current scene is a non-guest meeting mode of the home mode.

可选的,当确定当前场景为预设场景时,抓拍模块42控制摄像头对抓拍对象进行抓拍,得到抓拍对象的音视频数据中,包括:Optionally, when it is determined that the current scene is a preset scene, thecapture module 42 controls the camera to capture the captured object, and obtains the audio and video data of the captured object, including:

当确定当前场景为在家模式的非会客模式,控制摄像头对抓拍对象进行抓拍,得到抓拍对象的音视频数据。When it is determined that the current scene is in the non-meeting mode of the home mode, the camera is controlled to capture the captured object, and audio and video data of the captured object is obtained.

可选的,该服务器还用于:Optionally, the server is also used to:

从抓拍对象的音视频数据中确定出无效的音视频数据;Determine invalid audio and video data from the audio and video data of the captured object;

从抓拍对象的音视频数据中删除掉无效的音视频数据。Delete invalid audio and video data from the audio and video data of the captured object.

可选的,该服务器从抓拍对象的音视频数据中确定出无效的音视频数据中,包括:Optionally, the server determines the invalid audio and video data from the audio and video data of the captured object, including:

确定抓拍对象的音视频数据中每个音视频数据中每帧图像对比度;Determine the contrast of each frame of image in each audio and video data in the audio and video data of the captured object;

确定对比度小于等于第一预设阈值的图像帧数在对应的音视频数据的图像总帧数的占比,当图像帧数在对应的音视频数据的图像总帧数的占比小于第二预设阈值时,将对应的音视频数据,确定为无效的音视频数据。Determine the ratio of the number of image frames with a contrast less than or equal to the first preset threshold to the total number of image frames of the corresponding audio and video data. When the threshold is set, the corresponding audio and video data is determined as invalid audio and video data.

可选的,该服务器从抓拍对象的音视频数据中确定出无效的音视频数据中,包括:Optionally, the server determines the invalid audio and video data from the audio and video data of the captured object, including:

对抓拍对象的音视频数据中每个音视频数据中每帧图像进行人脸识别;Perform face recognition on each frame of image in each audio and video data in the audio and video data of the captured object;

确定识别出人脸区域的图像帧数在对应的音视频数据的图像总帧数的占比,当识别出人脸区域的图像帧数在对应的音视频数据的图像总帧数的占比小于等于第三预设阈值时,将对应的音视频数据,确定为无效的音视频数据。Determine the ratio of the number of image frames of the identified face area to the total number of image frames of the corresponding audio and video data. When the proportion of the number of image frames of the identified face area to the total number of frames of the corresponding audio and video data is less than When it is equal to the third preset threshold, the corresponding audio and video data is determined as invalid audio and video data.

在实际应用中,上述确定模块41和抓拍模块42可由位于服务器上的处理器实现,具体为中央处理器(CPU,Central Processing Unit)、微处理器(MPU,MicroprocessorUnit)、数字信号处理器(DSP,Digital Signal Processing)或现场可编程门阵列(FPGA,Field Programmable Gate Array)等实现。In practical applications, theabove determination module 41 andcapture module 42 may be implemented by a processor located on a server, specifically a central processing unit (CPU, Central Processing Unit), a microprocessor (MPU, Microprocessor Unit), a digital signal processor (DSP) , Digital Signal Processing) or Field Programmable Gate Array (FPGA, Field Programmable Gate Array).

图5为本申请实施例提供的一种服务器的结构示意图二,如图5所示,本申请实施例提供了一种服务器500,包括:FIG. 5 is a second schematic structural diagram of a server provided by an embodiment of the present application. As shown in FIG. 5 , an embodiment of the present application provides a server 500, including:

处理器51以及存储有所述处理器51可执行指令的存储介质52,所述存储介质52通过通信总线53依赖所述处理器51执行操作,当所述指令被所述处理器51执行时,执行上述实施例一所述的抓拍方法。Theprocessor 51 and thestorage medium 52 storing the executable instructions of theprocessor 51. Thestorage medium 52 relies on theprocessor 51 to perform operations through thecommunication bus 53. When the instructions are executed by theprocessor 51, The capturing method described in the first embodiment above is executed.

需要说明的是,实际应用时,终端中的各个组件通过通信总线53耦合在一起。可理解,通信总线53用于实现这些组件之间的连接通信。通信总线53除包括数据总线之外,还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见,在图5中将各种总线都标为通信总线53。It should be noted that, in practical application, various components in the terminal are coupled together through thecommunication bus 53 . It can be understood that thecommunication bus 53 is used to realize the connection communication between these components. In addition to the data bus, thecommunication bus 53 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the various buses are labeled ascommunication bus 53 in FIG. 5 .

本申请实施例提供了一种计算机存储介质,存储有可执行指令,当所述可执行指令被一个或多个处理器执行的时候,所述处理器执行实施例一所述的抓拍方法。An embodiment of the present application provides a computer storage medium storing executable instructions. When the executable instructions are executed by one or more processors, the processors execute the capturing method described in the first embodiment.

其中,计算机可读存储介质可以是磁性随机存取存储器(ferromagnetic randomaccess memory,FRAM)、只读存储器(Read Only Memory,ROM)、可编程只读存储器(Programmable Read-Only Memory,PROM)、可擦除可编程只读存储器(ErasableProgrammable Read-Only Memory,EPROM)、电可擦除可编程只读存储器(ElectricallyErasable Programmable Read-Only Memory,EEPROM)、快闪存储器(Flash Memory)、磁表面存储器、光盘、或只读光盘(Compact Disc Read-Only Memory,CD-ROM)等存储器。Wherein, the computer-readable storage medium may be a magnetic random access memory (ferromagnetic random access memory, FRAM), a read only memory (Read Only Memory, ROM), a programmable read only memory (Programmable Read-Only Memory, PROM), an erasable memory In addition to programmable read-only memory (ErasableProgrammable Read-Only Memory, EPROM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), flash memory (Flash Memory), magnetic surface memory, optical disks, Or memory such as Compact Disc Read-Only Memory (CD-ROM).

本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用硬件实施例、软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。As will be appreciated by those skilled in the art, the embodiments of the present application may be provided as a method, a system, or a computer program product. Accordingly, the application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied therein, including but not limited to disk storage, optical storage, and the like.

本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

以上所述,仅为本申请的较佳实施例而已,并非用于限定本申请的保护范围。The above descriptions are only preferred embodiments of the present application, and are not intended to limit the protection scope of the present application.

Claims (10)

Translated fromChinese
1.一种抓拍方法,其特征在于,所述方法应用于服务器中,所述服务器与设置于家庭中的至少两个电子设备具有通信连接,所述方法包括:1. A capture method, characterized in that the method is applied in a server, and the server has a communication connection with at least two electronic devices installed in a family, the method comprising:当确定抓拍对象处于所述电子设备中摄像头的监控区域时,根据所述电子设备的运行信息,确定所述抓拍对象所处的当前场景;When it is determined that the captured object is in the monitoring area of the camera in the electronic device, the current scene where the captured object is located is determined according to the operation information of the electronic device;当确定所述当前场景为预设场景时,控制所述摄像头对所述抓拍对象进行抓拍,得到所述抓拍对象的音视频数据并进行存储;When it is determined that the current scene is a preset scene, controlling the camera to capture the captured object, obtaining and storing audio and video data of the captured object;其中,所述预设场景包括:在家模式的非会客模式,所述根据所述电子设备的运行信息,确定所述抓拍对象所处的当前场景,包括:Wherein, the preset scene includes: a non-meeting guest mode in a home mode, and determining the current scene where the captured object is located according to the operation information of the electronic device, including:从所述电子设备中门禁设备中获取家庭出入信息;Obtain home access information from the access control device in the electronic device;当所述家庭出入信息指示家中有人时,且所述家庭出入信息中指示家庭中均为家庭成员的进入信息,确定所述当前场景为在家模式的非会客模式;When the family entry and exit information indicates that there are people in the home, and the family entry and exit information indicates that all the family members are entry information in the family, it is determined that the current scene is a non-meeting guest mode of the home mode;所述方法还包括:The method also includes:从所述抓拍对象的音视频数据中确定出无效的音视频数据;Determine invalid audio and video data from the audio and video data of the captured object;从所述抓拍对象的音视频数据中删除掉所述无效的音视频数据。The invalid audio and video data is deleted from the audio and video data of the captured object.2.根据权利要求1所述的方法,其特征在于,所述确定抓拍对象处于所述电子设备中摄像头的监控区域,包括:2. The method according to claim 1, wherein the determining that the captured object is in the monitoring area of the camera in the electronic device comprises:根据所述电子设备的可穿戴设备的信号强度,确定所述可穿戴设备的位置;其中,所述抓拍对象佩戴有所述可穿戴设备;Determine the position of the wearable device according to the signal strength of the wearable device of the electronic device; wherein the wearable device is worn by the capture object;当所述可穿戴设备的位置处于所述监控区域的范围之内时,确定所述抓拍对象处于所述电子设备中摄像头的监控区域。When the position of the wearable device is within the range of the monitoring area, it is determined that the captured object is in the monitoring area of the camera in the electronic device.3.根据权利要求1所述的方法,其特征在于,所述确定抓拍对象处于所述电子设备中摄像头的监控区域,包括:3. The method according to claim 1, wherein the determining that the captured object is in the monitoring area of the camera in the electronic device comprises:当通过所述电子设备中感知设备检测到对象时,开启所述摄像头;Turn on the camera when an object is detected by the sensing device in the electronic device;当所述摄像头拍摄到的画面中包含所述抓拍对象时,确定所述抓拍对象处于所述电子设备中摄像头的监控区域。When the picture captured by the camera includes the snapshot object, it is determined that the snapshot object is in the monitoring area of the camera in the electronic device.4.根据权利要求1至3任一项所述的方法,其特征在于,所述根据所述电子设备的运行信息,确定所述抓拍对象所处的当前场景,包括:4. The method according to any one of claims 1 to 3, wherein the determining, according to the operation information of the electronic device, the current scene where the captured object is located, comprising:从所述电子设备中门禁设备中获取家庭出入信息;Obtain home access information from the access control device in the electronic device;当所述家庭出入信息指示家中无人时,确定所述当前场景为离家模式;When the home entry and exit information indicates that there is no one in the home, determining that the current scene is the leaving home mode;当所述家庭出入信息指示家中有人时,确定所述当前场景为在家模式。When the home entry and exit information indicates that there is someone at home, it is determined that the current scene is a home mode.5.根据权利要求4所述的方法,其特征在于,所述当所述家庭出入信息指示家中有人时,确定所述当前场景为在家模式,包括:5. The method according to claim 4, wherein, when the home access information indicates that there is someone at home, determining that the current scene is an at-home mode, comprising:当所述家庭出入信息指示家中有人时,且所述家庭出入信息中指示家庭中有非家庭成员的进入信息,从所述电子设备的安防设备获取所述安防设备的运行信息;When the home access information indicates that there is someone in the home, and the home access information indicates that there are non-family members in the home, obtain the operation information of the security device from the security device of the electronic device;当所述安防设备的运行信息中未包含报警信息,且所述门禁设备的运行信息中未包含报警信息时,确定所述当前场景为在家模式的会客模式。When the operation information of the security device does not include alarm information, and the operation information of the access control device does not include alarm information, it is determined that the current scene is the guest mode of the home mode.6.根据权利要求1所述的方法,其特征在于,所述从所述抓拍对象的音视频数据中确定出无效的音视频数据,包括:6. method according to claim 1, is characterized in that, described from the audio and video data of described snapping object, determine invalid audio and video data, comprising:确定所述抓拍对象的音视频数据中每个音视频数据中每帧图像对比度;Determine the contrast of each frame of image in each audio and video data in the audio and video data of the captured object;确定对比度小于等于第一预设阈值的图像帧数在对应的音视频数据的图像总帧数的占比,当所述图像帧数在对应的音视频数据的图像总帧数的占比小于第二预设阈值时,将对应的音视频数据,确定为所述无效的音视频数据。Determine the ratio of the number of image frames with a contrast less than or equal to the first preset threshold in the total number of image frames of the corresponding audio and video data, when the ratio of the number of image frames in the total number of image frames of the corresponding audio and video data is less than the first When there are two preset thresholds, the corresponding audio and video data is determined as the invalid audio and video data.7.根据权利要求1所述的方法,其特征在于,所述从所述抓拍对象的音视频数据中确定出无效的音视频数据,包括:7. method according to claim 1, is characterized in that, described from the audio and video data of described capturing object, determine invalid audio and video data, comprising:对所述抓拍对象的音视频数据中每个音视频数据中每帧图像进行人脸识别;Face recognition is performed on each frame of image in each audio and video data in the audio and video data of the captured object;确定识别出人脸区域的图像帧数在对应的音视频数据的图像总帧数的占比,当识别出人脸区域的图像帧数在对应的音视频数据的图像总帧数的占比小于等于第三预设阈值时,将对应的音视频数据,确定为所述无效的音视频数据。Determine the ratio of the number of image frames of the identified face area to the total number of image frames of the corresponding audio and video data. When the proportion of the number of image frames of the identified face area to the total number of frames of the corresponding audio and video data is less than When it is equal to the third preset threshold, the corresponding audio and video data is determined as the invalid audio and video data.8.一种服务器,其特征在于,所述服务器与设置于家庭中的至少两个电子设备具有通信连接,包括:8. A server, characterized in that the server has a communication connection with at least two electronic devices arranged in a family, comprising:确定模块,用于当确定抓拍对象处于所述电子设备中摄像头的监控区域时,根据所述电子设备的运行信息,确定所述抓拍对象所处的当前场景;a determining module, configured to determine the current scene where the captured object is located according to the operation information of the electronic device when it is determined that the captured object is in the monitoring area of the camera in the electronic device;抓拍模块,用于当确定所述当前场景为预设场景时,控制所述摄像头对所述抓拍对象进行抓拍,得到所述抓拍对象的音视频数据并进行存储;其中,所述预设场景包括:在家模式的非会客模式;A capture module, configured to control the camera to capture the captured object when it is determined that the current scene is a preset scene, obtain and store audio and video data of the captured object; wherein the preset scene includes : Non-meeting guest mode of at-home mode;确定模块,还用于根据所述电子设备的运行信息,确定所述抓拍对象所处的当前场景,包括;从所述电子设备中门禁设备中获取家庭出入信息;当所述家庭出入信息指示家中有人时,且所述家庭出入信息中指示家庭中均为家庭成员的进入信息,确定所述当前场景为在家模式的非会客模式;The determining module is further configured to determine the current scene where the captured object is located according to the operation information of the electronic device, including: obtaining home access information from an access control device in the electronic device; when the home access information indicates the home When there is someone, and the family entry and exit information indicates that the family is the entry information of family members, it is determined that the current scene is a non-meeting guest mode of the home mode;抓拍模块,还用于从所述抓拍对象的音视频数据中确定出无效的音视频数据;从所述抓拍对象的音视频数据中删除掉所述无效的音视频数据。The snapshot module is further configured to determine invalid audio and video data from the audio and video data of the snapshot object; delete the invalid audio and video data from the audio and video data of the snapshot object.9.一种服务器,其特征在于,所述服务器包括:处理器以及存储有所述处理器可执行指令的存储介质,所述存储介质通过通信总线依赖所述处理器执行操作,当所述指令被所述处理器执行时,执行上述的权利要求1至7任一项所述的抓拍方法。9. A server, characterized in that the server comprises: a processor and a storage medium storing instructions executable by the processor, the storage medium relying on the processor to perform operations through a communication bus, when the instructions When executed by the processor, the capturing method according to any one of the above claims 1 to 7 is executed.10.一种计算机存储介质,其特征在于,存储有可执行指令,当所述可执行指令被一个或多个处理器执行的时候,所述处理器执行所述的权利要求1至7任一项所述的抓拍方法。10. A computer storage medium, wherein executable instructions are stored, and when the executable instructions are executed by one or more processors, the processors execute any one of the claims 1 to 7 The capture method described in the item.
CN202110146060.4A2021-02-022021-02-02Snapshot method, server and computer storage mediumActiveCN112911154B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202110146060.4ACN112911154B (en)2021-02-022021-02-02Snapshot method, server and computer storage medium

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202110146060.4ACN112911154B (en)2021-02-022021-02-02Snapshot method, server and computer storage medium

Publications (2)

Publication NumberPublication Date
CN112911154A CN112911154A (en)2021-06-04
CN112911154Btrue CN112911154B (en)2022-10-18

Family

ID=76122576

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202110146060.4AActiveCN112911154B (en)2021-02-022021-02-02Snapshot method, server and computer storage medium

Country Status (1)

CountryLink
CN (1)CN112911154B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN115879140A (en)*2021-09-262023-03-31华为技术有限公司Equipment control method, center equipment and device
CN114040105A (en)*2021-11-172022-02-11北京市商汤科技开发有限公司Video quick snapshot method, system, face recognition module and storage medium
CN115412843A (en)*2022-08-232022-11-29北京金和网络股份有限公司Site comprehensive management method and device based on Bluetooth technology

Citations (7)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN104811595A (en)*2015-04-082015-07-29合肥君正科技有限公司Network monitor camera and working method thereof
CN106288212A (en)*2016-08-222017-01-04珠海格力电器股份有限公司Household safety protection method and device and air conditioner
CN106331586A (en)*2015-06-162017-01-11杭州萤石网络有限公司Smart household video monitoring method and system
CN106610591A (en)*2015-10-202017-05-03刘国梁Wireless smart home security system
CN110430393A (en)*2019-07-132019-11-08恒大智慧科技有限公司A kind of monitoring method and system
CN111240217A (en)*2020-01-082020-06-05深圳绿米联创科技有限公司State detection method and device, electronic equipment and storage medium
CN111552189A (en)*2020-04-202020-08-18星络智能科技有限公司Method for starting scene mode, intelligent home controller and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN104811595A (en)*2015-04-082015-07-29合肥君正科技有限公司Network monitor camera and working method thereof
CN106331586A (en)*2015-06-162017-01-11杭州萤石网络有限公司Smart household video monitoring method and system
CN106610591A (en)*2015-10-202017-05-03刘国梁Wireless smart home security system
CN106288212A (en)*2016-08-222017-01-04珠海格力电器股份有限公司Household safety protection method and device and air conditioner
CN110430393A (en)*2019-07-132019-11-08恒大智慧科技有限公司A kind of monitoring method and system
CN111240217A (en)*2020-01-082020-06-05深圳绿米联创科技有限公司State detection method and device, electronic equipment and storage medium
CN111552189A (en)*2020-04-202020-08-18星络智能科技有限公司Method for starting scene mode, intelligent home controller and storage medium

Also Published As

Publication numberPublication date
CN112911154A (en)2021-06-04

Similar Documents

PublicationPublication DateTitle
CN112911154B (en)Snapshot method, server and computer storage medium
US10665072B1 (en)Sensor to characterize the behavior of a visitor or a notable event
WO2020125406A1 (en)Safety guardianship method, apparatus, terminal and computer readable storage medium
US9953187B2 (en)System and method of contextual adjustment of video fidelity to protect privacy
US8743200B2 (en)Activity monitor
WO2016150045A1 (en)Housebreaking alarm method and device
US20070252693A1 (en)System and method for surveilling a scene
EP4080467B1 (en)Electric monitoring system using video notification
US10891492B2 (en)Method and a system for providing privacy enabled surveillance in a building
WO2017161880A1 (en)Regional monitoring and alarming system and alarming method
CN110120113A (en)Data processing method and device, access control equipment and access control system
CN110933478A (en)Security protection system
Prathaban et al.A vision-based home security system using OpenCV on Raspberry Pi 3
CN111212274A (en)Intelligent building security system
KR102078265B1 (en)Aapparatus of processing image and method of providing image thereof
CN115174872A (en)Monitoring method and device
JP2020522828A (en) Computer vision based surveillance system and method
CN104243896A (en)Smart television monitoring anti-theft method and system
US20090153660A1 (en)Surveillance system and method including active alert function
CN105444815B (en)A kind of switching method, device, electronic equipment and application system
TWI433058B (en)Security surveillance system and method thereof, computer readable storage media and computer program product
WO2024227076A1 (en)An ai enhanced unified security system
US20230005346A1 (en)Smart Home System and Method Having Plural User Interface Modes
TWM464777U (en)Monitoring device
JP5733802B2 (en) Security structure and building structure that can be used with security device and has doorway locking device

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp