技术领域technical field
本发明涉及视频监控领域，特别是一种感兴趣区域的视频传输方法及装置。The invention relates to the field of video surveillance, in particular to a video transmission method and device for an area of interest.
背景技术Background technique
在视频监控领域，前端网络摄像机在高清晰度低延时与低带宽要求之间，一直寻找一个平衡。希望清晰度越高越好，延时越低越好，同时也要求带宽越低越好。In the field of video surveillance, front-end network cameras have been looking for a balance between high-definition low-latency and low-bandwidth requirements. It is hoped that the higher the definition, the better, the lower the delay, the better, and the lower the bandwidth, the better.
在解决高清晰度低延时和低带宽之间，目前业界常用的方案是通过ROI技术，即在画面上画一块区域出来，在总体带宽码流保持不变的前提下，对黑框内的ROI区域进行高清晰度的编码，重点保证其清晰度，对非黑框区域的部分进行低清晰度的编码。从而达到总体码流带宽不变。To solve the problem of high-definition, low-latency and low-bandwidth, the current common solution in the industry is to draw an area on the screen through ROI technology. High-definition encoding is performed on the ROI area, focusing on ensuring its clarity, and low-definition encoding is performed on the part of the non-black frame area. In this way, the overall stream bandwidth remains unchanged.
而现有技术的技术方案ROI区域的选择不够灵活，因为不同时间段，人眼对前端网络摄像机的视图画面的关注部位是不一样的，可能这个时间段对画面的左下角重点关注，左下角是ROI区域，下一个时间段对画面的左上角重点关注，左上角是ROI区域。每一次变化，都需要在前端网络摄像机上由管理员手工动态的画框标注，非常费时费力，实时性也不好。However, the selection of the ROI area in the technical solution of the prior art is not flexible enough, because in different time periods, human eyes pay different attention to the view screen of the front-end network camera. Is the ROI area, focus on the upper left corner of the screen in the next time period, and the upper left corner is the ROI area. Every change needs to be manually and dynamically marked by the administrator on the front-end network camera, which is very time-consuming and laborious, and the real-time performance is not good.
另外，在一些例如交通管控这样的应用场景下，对局部图像的延时非常敏感，希望能实时抓拍到到车辆的违法全过程，为后续的处罚提供证据链支持。目前的ROI在清晰度方面有一定的改善，但是在延时方面依旧是无法满足需求，并对带宽要求较高。In addition, in some application scenarios such as traffic control, it is very sensitive to the delay of local images. It is hoped that the whole process of illegal vehicles can be captured in real time, so as to provide evidence chain support for subsequent punishment. The current ROI has improved in terms of clarity, but it still cannot meet the demand in terms of delay, and has high requirements for bandwidth.
发明内容Contents of the invention
本发明提供了一种感兴趣区域的视频传输方法及装置，目的在于缓解局部图像延迟的问题。The present invention provides a video transmission method and device for a region of interest, aiming at alleviating the problem of partial image delay.
本发明第一方面公开了一种感兴趣区域的视频传输方法，应用于视频监控系统，所述视频监控系统至少包括前端设备和后端设备，后端设备包括用于显示画面的显示装置，所述感兴趣区域的视频传输方法包括：The first aspect of the present invention discloses a video transmission method for an area of interest, which is applied to a video surveillance system. The video surveillance system includes at least front-end equipment and back-end equipment, and the back-end equipment includes a display device for displaying pictures. The methods of video transmission for the region of interest described above include:
根据设定规则确定感兴趣区域所包括的范围；Determine the range included in the region of interest according to the set rules;
前端设备根据感兴趣区域，发送与感兴趣区域所包括的范围对应的视频数据至后端设备，所述视频数据是未经编码的视频数据；The front-end device sends video data corresponding to the range included in the region of interest to the back-end device according to the region of interest, and the video data is unencoded video data;
后端设备接收未经编码的视频数据，并不经解码由显示装置显示。The back-end equipment receives unencoded video data and displays it on the display device without decoding it.
作为优选技术方案，所述前端设备根据感兴趣区域，发送与感兴趣区域所包括的范围对应的视频数据至后端设备，所述视频数据是未经编码的视频数据，包括，前端设备采用IP数据包发送所述未经编码的视频数据，IP数据包的协议字段使用预设的自定义字段；As a preferred technical solution, the front-end device sends video data corresponding to the range included in the region of interest to the back-end device according to the region of interest, the video data is unencoded video data, including, the front-end device adopts IP The data packet sends the unencoded video data, and the protocol field of the IP data packet uses a preset custom field;
所述后端设备接收未经编码的视频数据，并不经解码由显示装置显示，包括，后端设备接收IP数据包并解析IP数据包的协议字段，当协议字段为所述自定义字段时，将该IP数据包承载的视频数据不经解码发送至显示装置。The back-end equipment receives unencoded video data, which is not displayed by the display device after decoding, including, the back-end equipment receives the IP data packet and parses the protocol field of the IP data packet, when the protocol field is the self-defined field , sending the video data carried by the IP data packet to the display device without being decoded.
作为优选技术方案，后端设备还包括用于用户输入信息的输入装置，所述根据设定规则确定感兴趣区域所包括的范围，包括：As a preferred technical solution, the back-end device also includes an input device for the user to input information, and the determination of the scope of the region of interest according to the set rules includes:
当满足设定条件时，捕捉当前关键点在画面中的坐标，所述关键点是根据输入装置输入的信息得到的点，所述设定条件包括关键点在画面范围内；When the setting condition is satisfied, capture the coordinates of the current key point in the screen, the key point is a point obtained according to the information input by the input device, and the setting condition includes that the key point is within the range of the screen;
根据关键点的坐标和预设的几何图形确定感兴趣区域；Determine the region of interest according to the coordinates of the key points and the preset geometry;
或者，输入装置包括压感模块，根据关键点的坐标和压感模块输入的压力信息预设对应的几何图形确定感兴趣区域。Alternatively, the input device includes a pressure-sensing module, and the region of interest is determined according to the coordinates of the key points and the corresponding geometric figures preset by the pressure information input by the pressure-sensing module.
作为优选技术方案，前端设备根据感兴趣区域，不发送非与感兴趣区域所包括的范围对应的视频数据；As a preferred technical solution, the front-end device does not send video data not corresponding to the range included in the region of interest according to the region of interest;
或者，前端设备根据感兴趣区域，对非与感兴趣区域所包括的范围对应的视频数据进行低清编码后发送至后端设备。Or, according to the region of interest, the front-end device performs low-definition encoding on the video data not corresponding to the range included in the region of interest, and then sends it to the back-end device.
本发明第二方面公开了一种感兴趣区域的视频传输方法，应用于视频监控系统中的前端设备，所述视频监控系统至少包括前端设备和后端设备，后端设备包括用于显示画面的显示装置，所述感兴趣区域的视频传输方法包括：The second aspect of the present invention discloses a video transmission method for an area of interest, which is applied to front-end equipment in a video surveillance system. The video surveillance system at least includes front-end equipment and back-end equipment, and the back-end equipment includes a Display device, the video transmission method of the region of interest includes:
根据已确定的感兴趣区域的范围，发送与感兴趣区域所包括的范围对应的视频数据至后端设备，所述视频数据是未经编码的视频数据，以使后端设备接收未经编码的视频数据并不经解码由显示装置显示。According to the range of the determined region of interest, send video data corresponding to the range included in the region of interest to the back-end device, the video data is unencoded video data, so that the back-end device receives unencoded The video data is not decoded and displayed by the display device.
本发明第三方面公开了一种感兴趣区域的视频传输装置，应用于视频监控系统，所述视频监控系统至少包括前端设备和后端设备，后端设备包括用于显示画面的显示装置，所述感兴趣区域的视频传输装置包括：The third aspect of the present invention discloses a video transmission device for an area of interest, which is applied to a video surveillance system. The video surveillance system includes at least a front-end device and a back-end device, and the back-end device includes a display device for displaying images. The video transmission devices for the above-mentioned regions of interest include:
感兴趣区域确定单元，用于根据设定规则确定感兴趣区域所包括的范围；A region of interest determining unit, configured to determine the range included in the region of interest according to set rules;
数据发送单元，用于使前端设备根据感兴趣区域，发送与感兴趣区域所包括的范围对应的视频数据至后端设备，所述视频数据是未经编码的视频数据；A data sending unit, configured to enable the front-end device to send video data corresponding to the range included in the region of interest to the back-end device according to the region of interest, the video data being unencoded video data;
数据接收单元，用于使后端设备接收未经编码的视频数据，并不经解码由显示装置显示。The data receiving unit is used for enabling the back-end equipment to receive unencoded video data and display it on the display device without decoding it.
作为优选技术方案，还包括：As a preferred technical solution, it also includes:
数据包封装单元，用于使前端设备采用IP数据包发送所述未经编码的视频数据，IP数据包的协议字段使用预设的自定义字段；A data packet encapsulation unit, configured to enable the front-end equipment to send the unencoded video data using an IP data packet, and the protocol field of the IP data packet uses a preset custom field;
数据包解析单元，用于使后端设备解析接收到的IP数据包的协议字段，以使后端设备在协议字段为所述自定义字段时将该IP数据包承载的视频数据不经解码发送至显示装置。The packet parsing unit is used to make the back-end device parse the protocol field of the received IP packet, so that the back-end device sends the video data carried by the IP packet without decoding when the protocol field is the self-defined field to the display device.
作为优选技术方案，后端设备还包括用于用户输入信息的输入装置，As a preferred technical solution, the backend device also includes an input device for the user to input information,
所述感兴趣区域确定单元具体用于当满足设定条件时捕捉当前关键点在画面中的坐标，其中，所述关键点是根据输入装置输入的信息得到的点，所述设定条件包括关键点在画面范围内；The interest area determination unit is specifically used to capture the coordinates of the current key point in the screen when the set condition is satisfied, wherein the key point is a point obtained according to the information input by the input device, and the set condition includes the key Point within the screen range;
感兴趣区域确定单元还具体用于，根据关键点的坐标和预设的几何图形确定感兴趣区域；The region-of-interest determination unit is also specifically configured to determine the region-of-interest according to the coordinates of key points and preset geometric figures;
或者，感兴趣区域确定单元还具体用于，输入装置包括压感模块，根据关键点的坐标和压感模块输入的压力信息预设对应的几何图形确定感兴趣区域。Alternatively, the ROI determining unit is further specifically configured that the input device includes a pressure-sensing module, and determines the ROI according to the coordinates of the key points and the pressure information input by the pressure-sensing module to preset a corresponding geometric figure.
作为优选技术方案，数据发送单元还用于，前端设备根据感兴趣区域，不发送非与感兴趣区域所包括的范围对应的视频数据；As a preferred technical solution, the data sending unit is also used for the front-end device not to send video data not corresponding to the range included in the region of interest according to the region of interest;
或者，数据发送单元还用于，前端设备根据感兴趣区域，对非与感兴趣区域所包括的范围对应的视频数据进行低清编码后发送至后端设备。Alternatively, the data sending unit is further used for the front-end device to perform low-definition encoding on the video data not corresponding to the range included in the region of interest according to the region of interest, and then send it to the back-end device.
本发明第四方面公开了一种感兴趣区域的视频传输装置，应用于视频监控系统中的前端设备，所述视频监控系统至少包括前端设备和后端设备，后端设备包括用于显示画面的显示装置，所述感兴趣区域的视频传输方法包括：The fourth aspect of the present invention discloses a video transmission device for an area of interest, which is applied to front-end equipment in a video surveillance system. The video surveillance system at least includes front-end equipment and back-end equipment, and the back-end equipment includes a Display device, the video transmission method of the region of interest includes:
数据发送单元，用于根据已确定的感兴趣区域的范围，发送与感兴趣区域所包括的范围对应的视频数据至后端设备，所述视频数据是未经编码的视频数据，以使后端设备接收未经编码的视频数据并不经解码由显示装置显示。The data sending unit is used to send video data corresponding to the range included in the region of interest to the back-end device according to the determined range of the region of interest, the video data is unencoded video data, so that the back-end The device receives unencoded video data and decodes it for display by the display device.
采用上述技术方案后，本发明具有如下优点：After adopting the technical scheme, the present invention has the following advantages:
由于前端设备在传输感兴趣区域的视频数据时省去了编码所需耗费的时间，同时后端设备在通过显示装置显示画面时省去了解码所需耗费的时间，从而能够有效降低延时，提高感兴趣区域这一局部的视频实时性，缓解局部图像延迟的问题。Since the front-end equipment saves the time required for encoding when transmitting the video data of the region of interest, and the back-end equipment saves the time required for decoding when displaying the picture through the display device, which can effectively reduce the delay. Improve the local video real-time performance of the region of interest and alleviate the problem of local image delay.
附图说明Description of drawings
图1为本发明实施例中视频监控系统的组网示意图；Fig. 1 is a schematic diagram of networking of a video surveillance system in an embodiment of the present invention;
图2为本发明实施例一中的实施步骤的示意图；Fig. 2 is a schematic diagram of the implementation steps in Embodiment 1 of the present invention;
图3为本发明实施例二中的实施装置的硬件示意图；FIG. 3 is a schematic diagram of the hardware of the implementing device in Embodiment 2 of the present invention;
图4为本发明实施例二中的实施装置的示意图。Fig. 4 is a schematic diagram of the implementing device in the second embodiment of the present invention.
具体实施方式detailed description
这里将详细地对示例性实施例进行说明，其示例表示在附图中。下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反，它们仅是与如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.
在本申请使用的术语是仅仅出于描述特定实施例的目的，而非旨在限制本申请。在本申请和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式，除非上下文清楚地表示其他含义。还应当理解，本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。The terminology used in this application is for the purpose of describing particular embodiments only, and is not intended to limit the application. As used in this application and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.
应当理解，尽管在本申请可能采用术语第一、第二、第三等来描述各种信息，但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如，在不脱离本申请范围的情况下，第一信息也可以被称为第二信息，类似地，第二信息也可以被称为第一信息。取决于语境，如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”。It should be understood that although the terms first, second, third, etc. may be used in this application to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of the present application, first information may also be called second information, and similarly, second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "at" or "when" or "in response to a determination."
见图1，本发明提供的感兴趣区域的视频传输方法及装置应用于视频监控系统，图1是一种示例性的前端设备与后端设备的组网方式，在示例性实施例中，前端设备是指IPC(Internet Protocol Camera，网络摄像机)，可用于拍摄并发送视频数据，可以是一个组网下若干IPC中的某一特定选中的IPC，后端设备是指NVR(Network Video Recorder，网络视频录像机)及作为显示装置的显示器、作为输入装置的鼠标。See Fig. 1, the video transmission method and device of the region of interest provided by the present invention are applied to a video surveillance system, Fig. 1 is an exemplary networking mode of front-end equipment and back-end equipment, in an exemplary embodiment, the front-end The device refers to an IPC (Internet Protocol Camera, network camera), which can be used to shoot and send video data. It can be a specific selected IPC among several IPCs under a network. The back-end device refers to an NVR (Network Video Recorder, network video recorder), a monitor as a display device, and a mouse as an input device.
本领域普通技术人员应当清楚，显示器只是显示装置的一种示例，其他诸如电视机、投影、手机屏幕等一切可以正常显示监控画面的设备均可以作为显示装置而在本发明的技术方案中使用。在本发明中，前端设备不局限于IPC，也可以是提供所需视频数据的任意其他设备、装置，如存有视频数据SAN(StorageArea Network，存储域网络)、另一台NVR等；后端设备不局限于NVR，也可以是需要播放监控视频的任意其他设备、装置，如电脑、移动客户端等。It should be clear to those skilled in the art that the display is only an example of a display device, and all other devices that can normally display monitoring images such as televisions, projectors, and mobile phone screens can be used as display devices in the technical solution of the present invention. In the present invention, front-end equipment is not limited to IPC, also can be any other equipment, device that provides required video data, as there is video data SAN (StorageArea Network, storage area network), another NVR etc.; The device is not limited to NVR, but can also be any other device or device that needs to play surveillance video, such as a computer, mobile client, etc.
在本发明所指的前端设备或后端设备，以后端设备为例，后端设备所包括的各装置可以不是硬件实体上与后端设备成为单一设备的模块，且这些装置可以与后端设备位于同一地点，也可以位于不同地点通过远程通信连接，甚至例如，本实施例中NVR所包括的显示装置显示器除了可以是单独设置在本地或远程的显示器，还可以是其他设备附带的显示器，例如笔记本电脑或手机的屏幕。同样，输入装置也可以是其他设备附带的输入装置，如笔记本电脑的键盘、鼠标，手机的触屏等，可以是与显示装置直接相关联的，也可以是与显示装置没有除了NVR以外其他途径相关联的。In the front-end equipment or back-end equipment referred to in the present invention, take the back-end equipment as an example, each device included in the back-end equipment may not be a module of a single device with the back-end equipment on the hardware entity, and these devices may be connected with the back-end equipment Be located in the same place, also can be located in different places through remote communication connection, even for example, the display device display included in the NVR in this embodiment can not only be a local or remote display, it can also be a display attached to other equipment, such as Laptop or mobile phone screen. Similarly, the input device can also be an input device attached to other equipment, such as the keyboard and mouse of a notebook computer, the touch screen of a mobile phone, etc., which can be directly associated with the display device, or can be connected to the display device without other means except NVR. associated.
实施例一Embodiment one
一种感兴趣区域的视频传输方法，应用于视频监控系统，所述视频监控系统至少包括前端设备和后端设备，后端设备包括用于显示画面的显示装置，所述感兴趣区域的视频传输方法包括：A video transmission method for a region of interest, applied to a video surveillance system, the video surveillance system at least includes a front-end device and a back-end device, the back-end device includes a display device for displaying a picture, and the video transmission method for the region of interest Methods include:
根据设定规则确定感兴趣区域所包括的范围；Determine the range included in the region of interest according to the set rules;
前端设备根据感兴趣区域，发送与感兴趣区域所包括的范围对应的视频数据至后端设备，所述视频数据是未经编码的视频数据；The front-end device sends video data corresponding to the range included in the region of interest to the back-end device according to the region of interest, and the video data is unencoded video data;
后端设备接收未经编码的视频数据，并不经解码由显示装置显示。The back-end equipment receives unencoded video data and displays it on the display device without decoding it.
见图2，在本实施例中，使用感兴趣区域的视频传输方法实现感兴趣区域的视频传输的具体步骤包括：See Fig. 2, in this embodiment, the specific steps of using the video transmission method of the region of interest to realize the video transmission of the region of interest include:
步骤S01，根据设定规则确定感兴趣区域所包括的范围；Step S01, determine the scope included in the region of interest according to the set rules;
步骤S02，前端设备根据步骤S01已确定的感兴趣区域，发送与感兴趣区域所包括的范围对应的视频数据至后端设备，其中视频数据未经编码；Step S02, the front-end device sends video data corresponding to the range included in the region of interest to the back-end device according to the region of interest determined in step S01, wherein the video data is not encoded;
步骤S03，后端设备将接收到步骤S02中前端设备发送的视频数据，并不经解码由显示装置显示。In step S03, the back-end device will receive the video data sent by the front-end device in step S02, and display it on the display device without decoding it.
在上述实施例中，由于前端设备在传输感兴趣区域的视频数据时省去了编码所需耗费的时间，同时后端设备在通过显示装置显示画面时省去了解码所需耗费的时间，从而能够有效降低延时，提高感兴趣区域这一局部的视频实时性，缓解局部图像延迟的问题。此外，作为未经编码的视频数据可以提供高清晰度图像画面。In the above embodiment, because the front-end device saves the time spent on encoding when transmitting the video data of the region of interest, and at the same time, the back-end device saves the time spent on decoding when displaying the picture through the display device, thus It can effectively reduce the delay, improve the real-time performance of the local video in the region of interest, and alleviate the problem of local image delay. In addition, high-definition image frames can be provided as unencoded video data.
传输感兴趣区域的数据的方法具体为，前端设备将画面划分为若干宏块，宏块可以是任意形状，两两间没有特定的形状、位置要求，但是一般地，采用矩形块划分，更具体地，将画面按照横纵以小方块为单位划分为若干等大的宏块，如1920*1080分辨率的画面中，以20*20像素(10*10或其他根据需要可预设的数值)为单位，划分为96*54个宏块，然后前端设备比对感兴趣区域与画面，若某一宏块与感兴趣区域相交具有重叠部分或完全被感兴趣区域覆盖，则将该宏块标记为感兴趣宏块，前端设备在传输感兴趣区域的视频数据时，提取所有感兴趣宏块并创术感兴趣宏块对应的视频数据。实际应用中，划分宏块、获取感兴趣宏块的计算工作可以由视频监控系统中任意具有计算能力的设备完成，上述实施例中前端设备完成该部分工作仅为一种特定举例。The specific method of transmitting the data of the region of interest is that the front-end device divides the picture into several macroblocks. The macroblocks can be of any shape, and there is no specific shape and position requirements between two, but generally, rectangular blocks are used. More specifically, Generally, the picture is divided into several equal-sized macroblocks in units of small squares horizontally and vertically. For example, in a picture with a resolution of 1920*1080, 20*20 pixels (10*10 or other values that can be preset according to needs) The unit is divided into 96*54 macroblocks, and then the front-end device compares the region of interest with the picture, and if a macroblock intersects with the region of interest and has overlapping parts or is completely covered by the region of interest, it will mark the macroblock For the macroblocks of interest, the front-end device extracts all the macroblocks of interest and creates video data corresponding to the macroblocks of interest when transmitting the video data of the region of interest. In practical applications, the calculation work of dividing macroblocks and obtaining interested macroblocks can be completed by any device with computing capability in the video surveillance system, and the front-end device completing this part of the work in the above embodiment is only a specific example.
作为优选技术方案，为了进一步降低延时，在步骤S02中，前端设备发送视频数据时，采用IP数据包发送所述未经编码的视频数据，IP数据包的8比特位长度的协议字段使用预设的自定义字段，具体的，在IP报文头的协议字段可以用一个未经使用自定义字段，目前现有的UDP采用的是17、TCP采用的是6，而目前数值处于143到252的范围都是未定义状态，选取其中一个即可，这里假设选取为155，当然也可以选取143、252等在所述范围内的任意一个值。As a preferred technical solution, in order to further reduce the delay, in step S02, when the front-end device sends video data, it uses an IP data packet to send the unencoded video data, and the protocol field of the 8-bit length of the IP data packet uses a preset The custom field set, specifically, an unused custom field can be used in the protocol field of the IP packet header. At present, the existing UDP uses 17, and TCP uses 6, and the current value is between 143 and 252 The range of is undefined, just choose one of them. Here, it is assumed to be 155. Of course, you can also choose any value within the range such as 143, 252, etc.
相对应的，在步骤S03中，后端设备接收到IP数据包后，对IP数据包的报文头进行解析，并解析出其中协议字段的值，将该值与预设约定的自定义字段进行对比，即例如在本实施例中判定是否为155，若是，则说明该IP数据包中承载的视频数据是与感兴趣区域对应的未经编码的视频数据，然后后端设备将该IP数据包承载的视频数据不经解码发送至显示装置。Correspondingly, in step S03, after receiving the IP data packet, the back-end device parses the header of the IP data packet, and parses out the value of the protocol field, and compares the value with the preset custom field For comparison, that is, for example, in this embodiment, it is determined whether it is 155, and if so, it means that the video data carried in the IP data packet is unencoded video data corresponding to the area of interest, and then the back-end device takes the IP data The video data carried by the packet is sent to the display device without being decoded.
在实际应用场景中，前端设备不仅需要发送感兴趣区域的视频数据，也很可能需要发送非感兴趣区域的视频数据，在本发明中，非感兴趣区域指的是，在完整的视频画面中，除去感兴趣区域以外的其他所有区域。在解码前，对于感兴趣区域或者非感兴趣区域的IP数据包，甚至其他IP数据包，后端设备并不能区分。在上述优选技术方案中，利用对于IP数据包的报文头协议字段部分的自定义，使得后端设备可以在解封IP数据包后辨认出感兴趣区域的IP数据包，省去了将感兴趣区域的未经编码的视频数据送予解码模块的步骤，从而进一步降低延迟。作为补充说明，感兴趣区域与非感兴趣区域的视频数据是分开发送的，即，同一IP数据包中，只可能包括感兴趣区域的视频数据或者非感兴趣区域的视频数据中的一种。In actual application scenarios, the front-end device not only needs to send video data of the region of interest, but also probably needs to send video data of the region of non-interest. In the present invention, the region of non-interest refers to the area in the complete video , excluding all regions except the region of interest. Before decoding, the back-end device cannot distinguish the IP data packets in the area of interest or non-interest area, or even other IP data packets. In the above preferred technical solution, the self-definition of the header protocol field of the IP data packet is used to enable the back-end device to identify the IP data packet in the area of interest after decapsulating the IP data packet. The unencoded video data of the region of interest is sent to the step of the decoding module, thereby further reducing the delay. As a supplementary note, the video data of the region of interest and the video data of the non-interest region are sent separately, that is, in the same IP packet, only one of the video data of the region of interest or the video data of the non-interest region may be included.
作为优选技术方案，后端设备还包括用于用户输入信息的输入装置，在本实施例中输入装置指的是鼠标，但是本领域普通技术人员应当理解，输入装置并不局限于鼠标，能够在显示设备的画面中正确定位操作人员想要选定的点的任意输入装置均是可选的，例如摇杆、轨迹球、触摸板、触控屏、按键。As a preferred technical solution, the back-end device also includes an input device for the user to input information. In this embodiment, the input device refers to a mouse, but those of ordinary skill in the art should understand that the input device is not limited to the mouse. Any input device that correctly positions the point that the operator wants to select on the screen of the display device is optional, such as a joystick, trackball, touchpad, touch screen, keys.
上述优选技术方案具体地，在步骤S01中，根据设定规则确定感兴趣区域所包括的范围具体指的是：Specifically, in the above preferred technical solution, in step S01, determining the range included in the region of interest according to the set rules specifically refers to:
当满足设定条件时，捕捉当前关键点在画面中的坐标，所述关键点是根据输入装置输入的信息得到的点，所述设定条件包括关键点在画面范围内；When the setting condition is satisfied, capture the coordinates of the current key point in the screen, the key point is a point obtained according to the information input by the input device, and the setting condition includes that the key point is within the range of the screen;
根据关键点的坐标和预设的几何图形确定感兴趣区域；Determine the region of interest according to the coordinates of the key points and the preset geometry;
或者，输入装置包括压感模块，根据关键点的坐标和压感模块输入的压力信息预设对应的几何图形确定感兴趣区域。Alternatively, the input device includes a pressure-sensing module, and the region of interest is determined according to the coordinates of the key points and the corresponding geometric figures preset by the pressure information input by the pressure-sensing module.
当关键点不在画面范围内时，则无需生成感兴趣区域，例如鼠标指针滑出画面，又如触摸屏操作时点击画面以外的范围。而设定条件除了包括关键点在画面范围内这一条件，还可以选择性地额外包括关键点坐标保持不变达到阈值时间或输入装置附加其他设定的输入信息，如使用鼠标时，指针保持1秒不动，或鼠标发生点击等。关键点是指根据输入装置输入的信息得到的点，本领域普通技术人员应当理解，这个点不应仅局限于一个像素点/坐标点，也可以是一个恰当的范围，例如在触摸屏或触控板作为输入装置时，这个点的大小范围取决于手指与触摸屏或触控板接触的面积，而在捕捉当前关键点在画面中的坐标时，可以根据需要预设一个方式在这个范围内选定一个像素点作为代表确定坐标。When the key point is not within the range of the screen, there is no need to generate a region of interest, for example, the mouse pointer slides out of the screen, or clicks outside the screen when operating the touch screen. In addition to the condition that the key point is within the scope of the screen, the setting conditions can also optionally include the time when the key point coordinates remain unchanged and reach the threshold value or the input device adds other set input information, such as when the mouse is used, the pointer remains 1 second of no movement, or mouse clicks, etc. The key point refers to the point obtained according to the information input by the input device. Those of ordinary skill in the art should understand that this point should not be limited to a pixel point/coordinate point, but can also be an appropriate range, such as on a touch screen or touch screen. When the board is used as an input device, the size range of this point depends on the area where the finger is in contact with the touch screen or touchpad. When capturing the coordinates of the current key point in the screen, you can preset a method to select within this range according to your needs. A pixel point is used as a representative to determine the coordinates.
在关键点的坐标确定后就可以确定感兴趣区域所包括的范围，具体地，可以预设一个几何图形，如均已确定尺寸参数的圆形、矩形、三角、不规则形等任意想要选用的图形，然后预设关键点与该图形的关系，如以关键点的坐标作为圆心坐标、中心坐标、设定顶角的坐标等，以此根据关键点的坐标和预设的几何图形就可以确定感兴趣区域。After the coordinates of the key points are determined, the scope of the region of interest can be determined. Specifically, a geometric figure can be preset, such as circles, rectangles, triangles, irregular shapes, etc. that have all determined size parameters. , and then preset the relationship between the key point and the graphic, such as using the coordinates of the key point as the center coordinates, the center coordinates, the coordinates of the top corner, etc., so that the coordinates of the key points and the preset geometry can be Determine the area of interest.
当输入装置带有压感模块时，还可以结合压感模块输入的压力信息确定感兴趣区域，如，在上述方案中加入图形尺寸参数的与压力参数相关的缩放比，其中缩放比可以是与压力参数正相关或负相关，可以是线性相关或非线性相关，可以是任意需要的函数关系。在一些特定应用场景下，也可以使压力参数与不同形状的几何图形对应，例如1-5牛顿的力对应由小变大的圆形，而5-15牛顶对应由小变大的矩形。根据其他输入参数动态调整感兴趣区域形状尺寸的技术方案不局限于压力参数，也可以使用诸如距离传感器感应观看者与屏幕的间距并根据间距的大小调整感兴趣区域大小、调节旋钮/滚轮调整感兴趣区域的形状尺寸等。When the input device has a pressure-sensitive module, the region of interest can also be determined in combination with the pressure information input by the pressure-sensitive module. For example, in the above scheme, a scaling ratio related to the pressure parameter of the graphic size parameter is added, wherein the scaling ratio can be the same as The pressure parameters are positively or negatively correlated, can be linearly correlated or nonlinearly correlated, and can be any desired functional relationship. In some specific application scenarios, the pressure parameters can also be made to correspond to geometric figures of different shapes, for example, a force of 1-5 Newton corresponds to a circle that changes from small to large, and a force of 5-15 Newton corresponds to a rectangle that changes from small to large. The technical solution to dynamically adjust the shape and size of the region of interest according to other input parameters is not limited to pressure parameters, and can also use distance sensors to sense the distance between the viewer and the screen and adjust the size of the region of interest according to the size of the distance. The shape and size of the region of interest, etc.
此外，根据关键点的坐标和预设的几何图形确定感兴趣区域可以不局限于一个关键点，也可以是两个或两个以上的关键点，只要分别赋予每个关键点分别与几何图形的关系即可，本发明对此不做进一步限制。In addition, the region of interest determined according to the coordinates of the key point and the preset geometric figure may not be limited to one key point, but may also be two or more key points, as long as each key point is assigned with the geometric figure relationship, which is not further limited in the present invention.
当然，感兴趣区域也可以是非动态地、预先设定好的，或是在若干种是非动态地、预先设定好的方案中可选的。Of course, the region of interest may also be non-dynamic and pre-set, or selectable from several non-dynamic and pre-set schemes.
作为优选技术方案，前端设备根据感兴趣区域，不发送非与感兴趣区域所包括的范围对应的视频数据；As a preferred technical solution, the front-end device does not send video data not corresponding to the range included in the region of interest according to the region of interest;
或者，前端设备根据感兴趣区域，对非与感兴趣区域所包括的范围对应的视频数据进行低清编码后发送至后端设备。Or, according to the region of interest, the front-end device performs low-definition encoding on the video data not corresponding to the range included in the region of interest, and then sends it to the back-end device.
前端设备与后端设备间通信连接的带宽必定是有限的，在感兴趣区域使用未经编码的视频数据占用带宽后，相较于普通传输方式，总带宽中用于传输其他数据的剩余带宽必定是减少的，即，在总带宽有限的条件下，可能会无法做到所有画面均采用未经编码的视频数据传输。例如，720P(1280*720像素)画面每秒25帧时所需的带宽为527Mbps，超过百兆网口速率，而1080P(1920*1080像素)画面每秒25帧时所需的带宽上升到1.2Gbps，超过千兆网口速率，若720P画面的帧率达到60，则同样会超过千兆网口速率。为了解决这一问题，可以对分感兴趣区域的画面进行低清编码后发送，或者不发送该部分数据，以解决带宽不足的问题。此处所述的低清编码是指，任意带宽占用小于等于能够用于传输非感兴趣区域的视频数据的剩余带宽的编码方式，例如清晰度小于原始画面的编码方式和/或画面细节有损失的编码方式。The bandwidth of the communication connection between the front-end device and the back-end device must be limited. After using unencoded video data to occupy the bandwidth in the area of interest, compared with the ordinary transmission method, the remaining bandwidth used to transmit other data in the total bandwidth must be is reduced, that is, under the condition of limited total bandwidth, it may not be possible to transmit all pictures using unencoded video data. For example, the bandwidth required for a 720P (1280*720 pixel) picture at 25 frames per second is 527Mbps, which exceeds the rate of a 100M network port, while the bandwidth required for a 1080P (1920*1080 pixel) picture at 25 frames per second rises to 1.2 Gbps, exceeding the rate of the Gigabit Ethernet port, if the frame rate of the 720P picture reaches 60, it will also exceed the rate of the Gigabit Ethernet port. In order to solve this problem, it is possible to perform low-definition encoding on the pictures of the sub-region of interest and send them, or not to send this part of the data, so as to solve the problem of insufficient bandwidth. The low-definition coding mentioned here refers to any coding method whose bandwidth occupation is less than or equal to the remaining bandwidth that can be used to transmit the video data of the non-interest area, for example, the coding method whose resolution is lower than the original picture and/or the picture details are lost encoding method.
在具体应用中，还可以加入动态调整低清编码的方式，例如在前述使用根据其他输入信息动态调整感兴趣区域的形状尺寸参数的优选技术方案中，当感兴趣区域的面积增大时，传输感兴趣区域的视频数据所需的带宽增大，对应非感兴趣区域的可用带宽下降，此时降低非感兴趣区域视频数据的编码清晰度，直至不传输非感兴趣区域的视频数据；反之亦然，当感兴趣区域的面积减小时，传输感兴趣区域的视频数据所需的带宽减小，对应非感兴趣区域的可用带宽上升，此时提高非感兴趣区域视频数据的编码清晰度。前述方案可在提高带宽利用率的同时改善感兴趣区域的画面清晰度和实时性。此外，根据实际总带宽情况，可以设置感兴趣区域的面积上限，从而避免感兴趣区域的面积过大造成带宽不足带来的画面滞带等不良影响。In specific applications, it is also possible to add a method of dynamically adjusting the low-definition encoding, for example, in the above-mentioned optimal technical solution of dynamically adjusting the shape and size parameters of the region of interest according to other input information, when the area of the region of interest increases, the transmission The bandwidth required for the video data in the region of interest increases, and the available bandwidth corresponding to the region of non-interest decreases. At this time, the encoding resolution of the video data in the region of non-interest is reduced until the video data of the region of interest is not transmitted; vice versa However, when the area of the ROI decreases, the bandwidth required to transmit the video data of the ROI decreases, and the available bandwidth corresponding to the non-ROI increases. At this time, the coding resolution of the video data of the non-ROI is improved. The aforementioned solution can improve the image clarity and real-time performance of the region of interest while increasing the bandwidth utilization rate. In addition, according to the actual total bandwidth, the upper limit of the area of the region of interest can be set, so as to avoid adverse effects such as screen lag caused by insufficient bandwidth caused by an excessively large area of interest.
在本实施例中，根据感兴趣区域编码视频数据、封装成IP数据包的工作由前端设备完成，捕获关键点坐标、解析IP数据包、解码视频数据、显示视频画面的工作由后端设备完成，感兴趣区域的确定可以由前端设备、后端设备或其他系统中的设备完成。In this embodiment, the work of encoding video data according to the region of interest and encapsulating them into IP data packets is completed by the front-end equipment, and the work of capturing key point coordinates, parsing IP data packets, decoding video data, and displaying video images is completed by the back-end equipment , the determination of the region of interest can be done by front-end equipment, back-end equipment or other equipment in the system.
在本实施例中，合理地调整各步骤的顺序同样可以实现技术方案和技术目的。In this embodiment, rationally adjusting the order of each step can also achieve the technical solution and technical purpose.
实施例二Embodiment two
与前述感兴趣区域的视频传输方法的实施例相对应，本发明还提供了感兴趣区域的视频传输装置的实施例。Corresponding to the foregoing embodiments of the video transmission method for the region of interest, the present invention also provides embodiments of a video transmission device for the region of interest.
本发明感兴趣区域的视频传输装置的实施例可以应用在视频监控系统上。装置实施例可以通过软件实现，也可以通过硬件或者软硬件结合的方式实现。以软件实现为例，作为一个逻辑意义上的装置，是其组成部分的各个单元通过各单元具体所在的视频监控系统中的设备的处理器将对应的非易失性存储器中对应的计算机程序指令读取到内存中运行形成的。从硬件层面而言，如图3所示，为本发明感兴趣区域的视频传输装置所在视频监控系统的一种硬件结构图，除了图3所示的处理器11、内存12、网络接口13、非易失性存储器14以及用于各部件通信的内部总线15之外，实施例中装置所在的视频监控系统通常根据该视频监控系统的实际功能，还可以包括其他硬件，对此不再赘述。The embodiment of the video transmission device for the region of interest of the present invention can be applied to a video surveillance system. The device embodiments can be implemented by software, or by hardware or a combination of software and hardware. Taking software implementation as an example, as a device in a logical sense, each unit of its component will pass the corresponding computer program instructions in the corresponding non-volatile memory through the processor of the device in the video surveillance system where each unit is specifically located. Read into memory and run. From the hardware level, as shown in Figure 3, it is a hardware structural diagram of the video monitoring system where the video transmission device in the area of interest of the present invention is located, except for the processor 11 shown in Figure 3, memory 12, network interface 13, In addition to the non-volatile memory 14 and the internal bus 15 used for the communication of various components, the video surveillance system where the device in the embodiment is usually based on the actual functions of the video surveillance system may also include other hardware, which will not be repeated here.
如图4所示，一种感兴趣区域的视频传输装置，应用于视频监控系统，所述视频监控系统至少包括前端设备和后端设备，后端设备包括用于显示画面的显示装置，所述感兴趣区域的视频传输装置包括：As shown in Figure 4, a video transmission device for an area of interest is applied to a video surveillance system, the video surveillance system includes at least a front-end device and a back-end device, and the back-end device includes a display device for displaying a picture, the Video transmission devices in the area of interest include:
感兴趣区域确定单元21，用于根据设定规则确定感兴趣区域所包括的范围，其中，感兴趣区域确定单元可以设置并应用于前端设备或后端设备或视频监控系统中的其他设备；The region of interest determination unit 21 is used to determine the scope of the region of interest according to the set rules, wherein the region of interest determination unit can be set and applied to front-end equipment or back-end equipment or other equipment in the video surveillance system;
数据发送单元22，用于使前端设备根据感兴趣区域，发送与感兴趣区域所包括的范围对应的视频数据至后端设备，所述视频数据是未经编码的视频数据，其中，数据收发单元可以设置并应用于前端设备；The data sending unit 22 is used to make the front-end device send video data corresponding to the range included in the region of interest to the back-end device according to the region of interest, the video data is unencoded video data, wherein the data transceiver unit Can be set and applied to front-end equipment;
数据接收单元23，用于使后端设备接收未经编码的视频数据，并不经解码由显示装置显示，其中，数据接收单元可以设置并应用于后端设备。The data receiving unit 23 is used to enable the back-end equipment to receive unencoded video data and display it on the display device without decoding, wherein the data receiving unit can be set and applied to the back-end equipment.
感兴趣区域的视频传输装置一般还包括一个处理单元20，用于处理数据并协调各单元协同工作。The video transmission device in the region of interest generally also includes a processing unit 20 for processing data and coordinating the cooperative work of various units.
作为优选技术方案，还包括：As a preferred technical solution, it also includes:
数据包封装单元24，用于使前端设备采用IP数据包发送所述未经编码的视频数据，IP数据包的协议字段使用预设的自定义字段，其中，数据收发单元可以设置并应用于前端设备；The packet encapsulation unit 24 is used to make the front-end equipment send the unencoded video data by using an IP packet, and the protocol field of the IP packet uses a preset custom field, wherein the data transceiver unit can be set and applied to the front-end equipment;
数据包解析单元25，用于使后端设备解析接收到的IP数据包的协议字段，以使后端设备在协议字段为所述自定义字段时将该IP数据包承载的视频数据不经解码发送至显示装置，其中，数据接收单元可以设置并应用于后端设备。Packet parsing unit 25 is used to make the protocol field of the IP packet received by the back-end device, so that the video data carried by the IP packet is not decoded when the protocol field is the self-defined field by the back-end device Send to the display device, where the data receiving unit can be set and applied to the back-end equipment.
作为优选技术方案，后端设备还包括用于用户输入信息的输入装置，As a preferred technical solution, the backend device also includes an input device for the user to input information,
所述感兴趣区域确定单元具体用于当满足设定条件时捕捉当前关键点在画面中的坐标，其中，所述关键点是根据输入装置输入的信息得到的点，所述设定条件包括关键点在画面范围内；The interest area determination unit is specifically used to capture the coordinates of the current key point in the screen when the set condition is satisfied, wherein the key point is a point obtained according to the information input by the input device, and the set condition includes the key Point within the screen range;
感兴趣区域确定单元还具体用于，根据关键点的坐标和预设的几何图形确定感兴趣区域；The region-of-interest determination unit is also specifically configured to determine the region-of-interest according to the coordinates of key points and preset geometric figures;
或者，感兴趣区域确定单元还具体用于，输入装置包括压感模块，根据关键点的坐标和压感模块输入的压力信息预设对应的几何图形确定感兴趣区域。Alternatively, the ROI determining unit is further specifically configured that the input device includes a pressure-sensing module, and determines the ROI according to the coordinates of the key points and the pressure information input by the pressure-sensing module to preset a corresponding geometric figure.
作为优选技术方案，数据发送单元还用于，前端设备根据感兴趣区域，不发送非与感兴趣区域所包括的范围对应的视频数据；As a preferred technical solution, the data sending unit is also used for the front-end device not to send video data not corresponding to the range included in the region of interest according to the region of interest;
或者，数据发送单元还用于，前端设备根据感兴趣区域，对非与感兴趣区域所包括的范围对应的视频数据进行低清编码后发送至后端设备。Alternatively, the data sending unit is further used for the front-end device to perform low-definition encoding on the video data not corresponding to the range included in the region of interest according to the region of interest, and then send it to the back-end device.
上述装置中各个单元的功能和作用的实现过程具体详见上述方法中对应步骤的实现过程，在此不再赘述。For the implementation process of the functions and effects of each unit in the above-mentioned device, please refer to the implementation process of the corresponding steps in the above-mentioned method for details, and details will not be repeated here.
对于装置实施例而言，由于其基本对应于方法实施例，所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本申请方案的目的。本领域普通技术人员在不付出创造性劳动的情况下，即可以理解并实施。As for the device embodiment, since it basically corresponds to the method embodiment, for related parts, please refer to the part description of the method embodiment. The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this application. It can be understood and implemented by those skilled in the art without creative effort.
实施例三Embodiment Three
基于实施例一，一种感兴趣区域的视频传输方法，应用于视频监控系统中的前端设备，所述视频监控系统至少包括前端设备和后端设备，后端设备包括用于显示画面的显示装置，所述感兴趣区域的视频传输方法包括：Based on Embodiment 1, a video transmission method for an area of interest is applied to a front-end device in a video surveillance system, the video surveillance system includes at least a front-end device and a back-end device, and the back-end device includes a display device for displaying a picture , the video transmission method of the region of interest includes:
根据已确定的感兴趣区域的范围，发送与感兴趣区域所包括的范围对应的视频数据至后端设备，所述视频数据是未经编码的视频数据，以使后端设备接收未经编码的视频数据并不经解码由显示装置显示。According to the range of the determined region of interest, send video data corresponding to the range included in the region of interest to the back-end device, the video data is unencoded video data, so that the back-end device receives unencoded The video data is not decoded and displayed by the display device.
实施例四Embodiment four
基于实施例二，一种感兴趣区域的视频传输装置，应用于视频监控系统中的前端设备，所述视频监控系统至少包括前端设备和后端设备，后端设备包括用于显示画面的显示装置，所述感兴趣区域的视频传输方法包括：Based on Embodiment 2, a video transmission device for an area of interest is applied to front-end equipment in a video surveillance system, the video surveillance system at least includes front-end equipment and back-end equipment, and the back-end equipment includes a display device for displaying pictures , the video transmission method of the region of interest includes:
数据发送单元，用于根据已确定的感兴趣区域的范围，发送与感兴趣区域所包括的范围对应的视频数据至后端设备，所述视频数据是未经编码的视频数据，以使后端设备接收未经编码的视频数据并不经解码由显示装置显示。The data sending unit is used to send video data corresponding to the range included in the region of interest to the back-end device according to the determined range of the region of interest, the video data is unencoded video data, so that the back-end The device receives unencoded video data and decodes it for display by the display device.
以上所述仅为本申请的较佳实施例而已，并不用以限制本申请，凡在本申请的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本申请保护的范围之内。The above is only a preferred embodiment of the application, and is not intended to limit the application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the application should be included in the application. within the scope of protection.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610409967.4ACN105979216A (en) | 2016-06-12 | 2016-06-12 | Video transmission method and device of region of interest |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610409967.4ACN105979216A (en) | 2016-06-12 | 2016-06-12 | Video transmission method and device of region of interest |
| Publication Number | Publication Date |
|---|---|
| CN105979216Atrue CN105979216A (en) | 2016-09-28 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610409967.4APendingCN105979216A (en) | 2016-06-12 | 2016-06-12 | Video transmission method and device of region of interest |
| Country | Link |
|---|---|
| CN (1) | CN105979216A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106488241A (en)* | 2016-10-13 | 2017-03-08 | 千目聚云数码科技（上海）有限公司 | Region-of-interest setting method |
| CN107896312A (en)* | 2016-10-04 | 2018-04-10 | 三十九度C | Image processor and image treatment method |
| CN109413417A (en)* | 2018-12-17 | 2019-03-01 | 南京普物科技有限公司 | A kind of System and method for of interactive television service quality testing |
| CN110035289A (en)* | 2019-04-24 | 2019-07-19 | 润电能源科学技术有限公司 | A kind of layered compression method of screen picture, system and relevant apparatus |
| CN110301137A (en)* | 2017-02-21 | 2019-10-01 | 索尼半导体解决方案公司 | Video transmission equipment and video reception apparatus |
| CN110505481A (en)* | 2019-07-15 | 2019-11-26 | 杭州亿圣信息技术有限公司 | A method of it is monitored using eye movement and improves the low damage code efficiency of video POI |
| CN113099161A (en)* | 2021-04-13 | 2021-07-09 | 北京中科深智科技有限公司 | Conference video reconstruction method and system based on deep neural network |
| CN113342239A (en)* | 2021-05-31 | 2021-09-03 | 锐迪科微电子科技（上海）有限公司 | Region-of-interest determination method and apparatus |
| CN113766274A (en)* | 2021-09-23 | 2021-12-07 | 阿里云计算有限公司 | Image encoding, decoding method, electronic device and storage medium |
| CN115623217A (en)* | 2022-11-30 | 2023-01-17 | 泉州艾奇科技有限公司 | Image preprocessing method, device and system |
| EP4300988A1 (en)* | 2022-07-01 | 2024-01-03 | Meta Platforms Technologies, LLC | Foveated readout of an image sensor using regions of interest |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100158135A1 (en)* | 2005-10-12 | 2010-06-24 | Peng Yin | Region of Interest H.264 Scalable Video Coding |
| CN102801955A (en)* | 2011-08-17 | 2012-11-28 | 南京金柏图像技术有限公司 | Digital video transmission method based on local high definition |
| CN102938827A (en)* | 2012-11-29 | 2013-02-20 | 深圳英飞拓科技股份有限公司 | Stratified monitoring command system and cross-camera virtual tracking method |
| CN102938839A (en)* | 2012-11-13 | 2013-02-20 | 浙江宇视科技有限公司 | Monitoring front-end equipment and encoding server |
| CN103460250A (en)* | 2011-04-11 | 2013-12-18 | 英特尔公司 | Object of interest based image processing |
| CN104185078A (en)* | 2013-05-20 | 2014-12-03 | 华为技术有限公司 | Video monitoring processing method, device and system thereof |
| US20150131920A1 (en)* | 2013-11-08 | 2015-05-14 | Korea University Research And Business Foundation | Method and Apparatus for Encoding Image and Method and Apparatus for Decoding Image |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100158135A1 (en)* | 2005-10-12 | 2010-06-24 | Peng Yin | Region of Interest H.264 Scalable Video Coding |
| CN103460250A (en)* | 2011-04-11 | 2013-12-18 | 英特尔公司 | Object of interest based image processing |
| CN102801955A (en)* | 2011-08-17 | 2012-11-28 | 南京金柏图像技术有限公司 | Digital video transmission method based on local high definition |
| CN102938839A (en)* | 2012-11-13 | 2013-02-20 | 浙江宇视科技有限公司 | Monitoring front-end equipment and encoding server |
| CN102938827A (en)* | 2012-11-29 | 2013-02-20 | 深圳英飞拓科技股份有限公司 | Stratified monitoring command system and cross-camera virtual tracking method |
| CN104185078A (en)* | 2013-05-20 | 2014-12-03 | 华为技术有限公司 | Video monitoring processing method, device and system thereof |
| US20150131920A1 (en)* | 2013-11-08 | 2015-05-14 | Korea University Research And Business Foundation | Method and Apparatus for Encoding Image and Method and Apparatus for Decoding Image |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107896312A (en)* | 2016-10-04 | 2018-04-10 | 三十九度C | Image processor and image treatment method |
| CN106488241A (en)* | 2016-10-13 | 2017-03-08 | 千目聚云数码科技（上海）有限公司 | Region-of-interest setting method |
| US11323617B2 (en) | 2017-02-21 | 2022-05-03 | Sony Semiconductor Solutions Corporation | Video transmission apparatus and video reception apparatus |
| CN110301137B (en)* | 2017-02-21 | 2022-11-15 | 索尼半导体解决方案公司 | Video transmission apparatus and video reception apparatus |
| CN110301137A (en)* | 2017-02-21 | 2019-10-01 | 索尼半导体解决方案公司 | Video transmission equipment and video reception apparatus |
| US12028618B2 (en) | 2017-02-21 | 2024-07-02 | Sony Semiconductor Solutions Corporation | Video transmission apparatus and video reception apparatus |
| CN109413417A (en)* | 2018-12-17 | 2019-03-01 | 南京普物科技有限公司 | A kind of System and method for of interactive television service quality testing |
| CN109413417B (en)* | 2018-12-17 | 2020-12-04 | 南京普物科技有限公司 | System and method for detecting interactive television service quality |
| CN110035289B (en)* | 2019-04-24 | 2022-04-01 | 润电能源科学技术有限公司 | Layered compression method, system and related device for screen image |
| CN110035289A (en)* | 2019-04-24 | 2019-07-19 | 润电能源科学技术有限公司 | A kind of layered compression method of screen picture, system and relevant apparatus |
| CN110505481B (en)* | 2019-07-15 | 2021-06-01 | 杭州亿圣信息技术有限公司 | Method for improving low-loss coding efficiency of video POI (point of interest) by eye movement monitoring |
| CN110505481A (en)* | 2019-07-15 | 2019-11-26 | 杭州亿圣信息技术有限公司 | A method of it is monitored using eye movement and improves the low damage code efficiency of video POI |
| CN113099161A (en)* | 2021-04-13 | 2021-07-09 | 北京中科深智科技有限公司 | Conference video reconstruction method and system based on deep neural network |
| CN113342239A (en)* | 2021-05-31 | 2021-09-03 | 锐迪科微电子科技（上海）有限公司 | Region-of-interest determination method and apparatus |
| CN113766274A (en)* | 2021-09-23 | 2021-12-07 | 阿里云计算有限公司 | Image encoding, decoding method, electronic device and storage medium |
| EP4300988A1 (en)* | 2022-07-01 | 2024-01-03 | Meta Platforms Technologies, LLC | Foveated readout of an image sensor using regions of interest |
| CN115623217A (en)* | 2022-11-30 | 2023-01-17 | 泉州艾奇科技有限公司 | Image preprocessing method, device and system |
| Publication | Publication Date | Title |
|---|---|---|
| CN105979216A (en) | Video transmission method and device of region of interest | |
| JP7221957B2 (en) | Game engine application for video encoder rendering | |
| CN107771395B (en) | Method and apparatus for generating and transmitting metadata for virtual reality | |
| US20070024705A1 (en) | Systems and methods for video stream selection | |
| WO2016065913A1 (en) | Video image processing method, device and system | |
| EP3412031B1 (en) | Method and apparatus for creating and rendering hdr images | |
| CN110602506B (en) | Video processing method, network device and computer-readable storage medium | |
| CN106454388B (en) | A kind of method and apparatus for determining live streaming setting information | |
| WO2018045789A1 (en) | Method and device for adjusting grayscale values of image | |
| CN112153413B (en) | A method and server for dealing with blurry screen by broadcasting on the same screen | |
| US20190104330A1 (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| WO2021057705A1 (en) | Video encoding and decoding methods, and related apparatuses | |
| CN106302760A (en) | Desktop screen capture control method and system | |
| CN111083450A (en) | Vehicle-mounted-end image remote output method, device and system | |
| WO2021249562A1 (en) | Information transmission method, related device, and system | |
| CN114666477B (en) | Video data processing method, device, equipment and storage medium | |
| TWI430663B (en) | Multi-stream video system, video monitoring device and multi-stream video transmission method | |
| US20140297718A1 (en) | Apparatus and method for transmitting image of multi-user | |
| US11962859B2 (en) | System and method for implementation of region of interest based streaming | |
| TWI509563B (en) | Graphics server and method for managing streaming parameters | |
| KR102126794B1 (en) | Apparatus and Method for Transmitting Video Data | |
| US20240297977A1 (en) | Head motion dependent viewport region modification for omnidirectional conversational vdd | |
| US20250016454A1 (en) | Encoding and decoding method, electronic device, communication system, and storage medium | |
| CN107318021B (en) | Data processing method and system for remote display | |
| CN111225238A (en) | Information processing method and related equipment |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination |