Movatterモバイル変換


[0]ホーム

URL:


CN115190259A - Small ball game camera method and camera system - Google Patents

Small ball game camera method and camera system
Download PDF

Info

Publication number
CN115190259A
CN115190259ACN202110373065.0ACN202110373065ACN115190259ACN 115190259 ACN115190259 ACN 115190259ACN 202110373065 ACN202110373065 ACN 202110373065ACN 115190259 ACN115190259 ACN 115190259A
Authority
CN
China
Prior art keywords
angle
wide
image
full
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110373065.0A
Other languages
Chinese (zh)
Inventor
唐郁松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xingti Guangzhou Intelligent Technology Co ltd
Original Assignee
Xingti Guangzhou Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xingti Guangzhou Intelligent Technology Co ltdfiledCriticalXingti Guangzhou Intelligent Technology Co ltd
Priority to CN202110373065.0ApriorityCriticalpatent/CN115190259A/en
Publication of CN115190259ApublicationCriticalpatent/CN115190259A/en
Pendinglegal-statusCriticalCurrent

Links

Images

Classifications

Landscapes

Abstract

Translated fromChinese

本发明涉及图像处理技术领域,尤其是一种小球比赛摄像方法及摄像系统。所述方法包括:对目标场地进行环绕广角拍摄并拼接为全角度广角图像;按拍摄时刻的先后将各所述广角图像存储为视频;检测调节操作,沿调节操作的指令调节视频的播放角度或画面比例;所述系统包括拍摄模块、存储模块、调节模块和处理模块。本发明通过全角度拍摄并合成为立体视角的广角图像,结合自由度较大的调节方式,实现无人操作拍摄比赛视频,同时可给予用户自由选择任意观看效果的视频画面,具有优良的体验感。

Figure 202110373065

The invention relates to the technical field of image processing, in particular to a shooting method and a shooting system for a small ball game. The method includes: taking a surrounding wide-angle shooting on the target site and splicing it into a full-angle wide-angle image; storing each of the wide-angle images as a video in the order of shooting time; The aspect ratio; the system includes a shooting module, a storage module, an adjustment module and a processing module. The present invention shoots and synthesizes a wide-angle image with a stereoscopic viewing angle from a full angle, and combines an adjustment method with a large degree of freedom to achieve unmanned operation to shoot a game video. .

Figure 202110373065

Description

Translated fromChinese
小球比赛摄像方法及摄像系统Small ball game camera method and camera system

技术领域technical field

本发明涉及图像处理技术领域,尤其是一种小球比赛摄像方法及摄像系统。The invention relates to the technical field of image processing, in particular to a shooting method and a shooting system for a small ball game.

背景技术Background technique

目前,乒乓球、网球、羽毛球等小球比赛活动和赛事越来越多,赛事录像和直播也成为宣传和分享这些赛事的途径之一,在录制时对于比赛人员的身影、球体运动画面以及扣杀画面捕捉尤为重要,然而球体运动速度十分块,加上目前大部分业余比赛场地没有专业的设备和人员拍摄、录制、直播这些活动,造成对于这种体育活动的录制变得十分困难。At present, there are more and more small ball games and events such as table tennis, tennis, badminton, etc. The video and live broadcast of the events have also become one of the ways to publicize and share these events. It is particularly important to capture the scene, but the speed of the ball is very slow, and most amateur competition venues currently do not have professional equipment and personnel to shoot, record, and live broadcast these activities, making it very difficult to record such sports activities.

发明内容SUMMARY OF THE INVENTION

本发明的目的是提供一种小球比赛摄像方法及摄像系统,以克服现有小球比赛录制时难以获得良好拍摄效果的缺陷。The purpose of the present invention is to provide a shooting method and a shooting system for a small ball game, so as to overcome the defect that it is difficult to obtain a good shooting effect during the recording of the existing small ball game.

第一方面,提供了一种小球比赛摄像方法,包括以下步骤:In a first aspect, a method for photographing a small ball game is provided, including the following steps:

对目标场地进行环绕广角拍摄并拼接为全角度广角图像;Surround wide-angle shooting of the target site and stitch it into a full-angle wide-angle image;

按拍摄时刻的先后将各所述广角图像存储为视频;storing each of the wide-angle images as a video according to the sequence of shooting moments;

检测调节操作,沿调节操作的指令调节视频的播放角度或画面比例。The adjustment operation is detected, and the playback angle or aspect ratio of the video is adjusted along the instruction of the adjustment operation.

进一步的,还包括以下步骤:Further, the following steps are also included:

对组成全角度广角图像的组成图像进行畸变校正,选取相邻两幅组成图像中的重合像素点作为求解单应性矩阵的参考点;Perform distortion correction on the component images that make up the full-angle wide-angle image, and select the coincident pixels in the two adjacent component images as the reference points for solving the homography matrix;

在全角度广角图像中建立统一的坐标系,通过透视变换消除部分重合像素点后再次将组成图像映射至全角度广角图像的对应区域中。A unified coordinate system is established in the full-angle wide-angle image, and some overlapping pixels are eliminated through perspective transformation, and the composed image is mapped to the corresponding area of the full-angle wide-angle image again.

进一步的,还包括以下步骤:Further, the following steps are also included:

利用RANSAC算法剔除所选重合像素点中的误匹配点,并计算剔除后剩余重合像素点的单应性矩阵的初始值,使用Levenberg-Marquardt非线性迭代最小逼近法进行求精剔除。The RANSAC algorithm is used to eliminate the mismatched points in the selected coincident pixels, and the initial value of the homography matrix of the remaining coincident pixels after the elimination is calculated, and the Levenberg-Marquardt nonlinear iterative minimum approximation method is used to refine the elimination.

进一步的,还包括以下步骤:Further, the following steps are also included:

截取全角度广角图像内的一片区域,得到包含整个目标场地在内的截取图像并作为视频的播放画面;Intercept an area in the full-angle wide-angle image to obtain the intercepted image including the entire target site and use it as the video playback screen;

调节操作为调节视频的播放角度时,根据转向操作调节视频的播放视角,等比例截取全角度广角图像该角度下的区域,使播放画面内始终包含整个目标场地。When the adjustment operation is to adjust the playback angle of the video, adjust the playback angle of the video according to the steering operation, and proportionally intercept the area of the full-angle wide-angle image at this angle, so that the playback screen always includes the entire target site.

进一步的,还包括以下步骤:Further, the following steps are also included:

对全角度广角图像进行Gabor滤波处理并转化为灰度图像;Perform Gabor filtering on the full-angle wide-angle image and convert it into a grayscale image;

根据全角度广角图像的滤波响应情况,通过阈值化对所述灰度图像进行二值化处理,获取高梯度特征并进行偏心化处理,进而排除夹杂其中的非目标场地特征;According to the filtering response of the full-angle wide-angle image, the grayscale image is binarized by thresholding to obtain high gradient features and perform eccentric processing, so as to exclude the non-target site features included therein;

反复进行Gabor滤波处理及对灰度图像进行二值化处理,整合对输出的二值化图像,确定目标场地检测关键区域并进行截取。Repeat Gabor filtering and binarization of grayscale images, integrate the output binarized images, determine the key areas of the target site to detect and intercept them.

进一步的,调节操作为调节视频的画面比例时,以目标场地为中心进行比例缩放。Further, when the adjustment operation is to adjust the aspect ratio of the video, scaling is performed with the target site as the center.

第二方面,提供了一种小球比赛摄像系统,包括:In a second aspect, a small ball game camera system is provided, including:

拍摄模块,用于对目标场地进行环绕广角拍摄并拼接为全角度广角图像;The shooting module is used for surrounding wide-angle shooting of the target site and splicing it into a full-angle wide-angle image;

存储模块,用于按拍摄时刻的先后将各所述广角图像存储为视频;a storage module, used for storing each of the wide-angle images as videos according to the sequence of shooting moments;

调节模块,用于检测调节操作;An adjustment module for detecting adjustment operations;

处理模块,用于沿调节操作的指令调节视频的播放角度或画面比例。The processing module is used to adjust the playback angle or the aspect ratio of the video along the instruction of the adjustment operation.

进一步的,所述处理模块还用于对组成全角度广角图像的组成图像进行畸变校正,选取相邻两幅组成图像中的重合像素点作为求解单应性矩阵的参考点;以及在全角度广角图像中建立统一的坐标系,通过透视变换消除部分重合像素点后再次将组成图像映射至全角度广角图像的对应区域中。Further, the processing module is also used to perform distortion correction on the constituent images of the full-angle wide-angle image, and select the coincident pixels in the adjacent two constituent images as the reference point for solving the homography matrix; and in the full-angle wide-angle image. A unified coordinate system is established in the image, and some overlapping pixels are eliminated through perspective transformation, and the composed image is mapped to the corresponding area of the full-angle wide-angle image again.

进一步的,处理模块还用于截取全角度广角图像内的一片区域,得到包含整个目标场地在内的截取图像并作为视频的播放画面;调节操作为调节视频的播放角度时,根据转向操作调节视频的播放视角,等比例截取全角度广角图像该角度下的区域,使播放画面内始终包含整个目标场地。Further, the processing module is also used to intercept an area in the full-angle wide-angle image to obtain the intercepted image including the entire target site and use it as a playback screen of the video; when the adjustment operation is to adjust the playback angle of the video, adjust the video according to the steering operation. The viewing angle of the playback is proportional to the full-angle wide-angle image, so that the entire target site is always included in the playback screen.

进一步的,处理模块还用于对全角度广角图像进行Gabor滤波处理并转化为灰度图像;根据全角度广角图像的滤波响应情况,通过阈值化对所述灰度图像进行二值化处理,获取高梯度特征并进行偏心化处理,进而排除夹杂其中的非目标场地特征;反复进行Gabor滤波处理及对灰度图像进行二值化处理,整合对输出的二值化图像,确定目标场地检测关键区域并进行截取。Further, the processing module is also used to perform Gabor filtering processing on the full-angle wide-angle image and convert it into a grayscale image; according to the filtering response of the full-angle wide-angle image, binarize the grayscale image through thresholding, and obtain the result. High gradient features and eccentric processing to eliminate non-target site features; Gabor filter processing and grayscale image binarization are repeatedly performed, and the output binarized images are integrated to determine the key area of target site detection. and intercept.

本发明的有益效果:通过全角度拍摄并合成为立体视角的广角图像,结合自由度较大的调节方式,实现无人操作拍摄比赛视频,同时可给予用户自由选择任意观看效果的视频画面,具有优良的体验感。The beneficial effects of the present invention are as follows: through full-angle shooting and synthesizing into a wide-angle image with a stereoscopic viewing angle, combined with an adjustment method with a large degree of freedom, unmanned operation can be achieved to shoot a game video, and at the same time, the user can freely choose a video screen with any viewing effect, with Excellent experience.

附图说明Description of drawings

图1是应用本申请的小球比赛摄像方法及摄像系统的实施例的示例性系统架构。FIG. 1 is an exemplary system architecture to which embodiments of the small ball game camera method and camera system of the present application are applied.

图2是根据第一个实施例示出的一种小球比赛摄像方法的流程图。Fig. 2 is a flow chart of a method for photographing a small ball game according to the first embodiment.

图3是一种示例性的视频图像画面调节方法的流程图。FIG. 3 is a flow chart of an exemplary method for adjusting a picture of a video image.

图4是一种示例性的特征点分布范围信息对全角度广角图像进行感兴趣区域搜索的流程图。FIG. 4 is a flowchart of an exemplary region-of-interest search for a full-angle wide-angle image based on feature point distribution range information.

图5是根据一实施例示出的一种小球比赛摄像系统的框图。Fig. 5 is a block diagram of a small ball game camera system according to an embodiment.

具体实施方式Detailed ways

为使本发明实施例的目的、技术方案和优点更加清晰,下面将结合实施例和附图,对本发明作进一步的描述。In order to make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the present invention will be further described below with reference to the embodiments and the accompanying drawings.

这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as recited in the appended claims.

图1示出了可以应用本申请的运动人体跟踪摄像方法和摄像系统的实施例的示例性系统架构。FIG. 1 shows an exemplary system architecture to which embodiments of the moving body tracking camera method and camera system of the present application may be applied.

如图1所示,系统架构可以包括摄像机101、102、103,连接介质104和处理终端105。连接介质104用以在摄像机101、102、103和处理终端105之间提供传输链路的介质。连接介质104可以包括各种连接类型,例如有线、无线传输链路或者光纤电缆等。As shown in FIG. 1 , the system architecture may includecameras 101 , 102 , and 103 , aconnection medium 104 and aprocessing terminal 105 . Theconnection medium 104 is a medium for providing a transmission link between thecameras 101 , 102 , 103 and theprocessing terminal 105 .Connection medium 104 may include various connection types, such as wired, wireless transmission links, or fiber optic cables, among others.

应当理解,图1中的摄像机、连接介质和处理终端的数目仅仅是示意性的,根据实现需要,可以具有任意数目的摄像机、连接介质和处理终端,并且摄像机、连接介质和处理终端可以是一体设置,也可以是分开设置。It should be understood that the numbers of cameras, connection media and processing terminals in FIG. 1 are only illustrative, and according to implementation needs, there may be any number of cameras, connection media and processing terminals, and the cameras, connection media and processing terminals may be integrated settings, or separately.

根据本发明的第一方面,提供一种小球比赛摄像方法。According to a first aspect of the present invention, a method for photographing a small ball game is provided.

图2是根据第一个实施例示出的一种小球比赛摄像方法的流程图,在本实施例中,本申请实施例的小球比赛摄像方法由摄像机、连接介质和处理终端执行。参见图2,所述方法包括以下步骤:FIG. 2 is a flowchart of a method for photographing a small ball game according to the first embodiment. In this embodiment, the method for photographing a small ball game according to the embodiment of the present application is performed by a camera, a connection medium and a processing terminal. Referring to Figure 2, the method includes the following steps:

S21.对目标场地进行环绕广角拍摄并拼接为全角度广角图像。S21. Take a surrounding wide-angle shooting of the target site and stitch it into a full-angle wide-angle image.

S22.按拍摄时刻的先后将各所述广角图像存储为视频。S22. Store each of the wide-angle images as a video in the order of shooting time.

S23.检测调节操作,沿调节操作的指令调节视频的播放角度或画面比例。S23. Detect the adjustment operation, and adjust the playback angle or the aspect ratio of the video along the instruction of the adjustment operation.

在本实施例中,采用至少四个摄像机对目标场地进行广角拍摄,摄像机的型号为4096*2160鱼眼镜头,拍摄获得的广角图像可达到135°,并自带广角图像畸变修复功能,实时输出修复图像。需要说明的是,目标场地可以是乒乓球桌、网球场或羽毛球场。In this embodiment, at least four cameras are used for wide-angle shooting of the target site. The model of the cameras is 4096*2160 fisheye lens, and the wide-angle image obtained by shooting can reach 135°. Fix images. It should be noted that the target venue can be a table tennis table, a tennis court or a badminton court.

在步骤S21中,全角度广角图像由各个摄像机拍摄得到的广角图像拼接而成,具体地,通过四个摄像机分别对目标场地的前、后、左、右四个方位进行拍摄,以乒乓球比赛为例,四个摄像机分别捕捉乒乓球桌前、后、左、右四个方位的画面信息,四个摄像机拍摄得到的广角图像发送至处理终端,由处理终端通过图像拼接算法作图像拼接处理,以获得全角度广角图像,即覆盖乒乓球桌四周视角的图像画面。In step S21, the full-angle wide-angle image is formed by splicing the wide-angle images obtained by each camera. Specifically, four cameras are used to photograph the front, rear, left, and right directions of the target site, respectively, to play a table tennis match. For example, four cameras capture the picture information of the front, back, left and right directions of the table tennis table respectively, and the wide-angle images captured by the four cameras are sent to the processing terminal, and the processing terminal performs image stitching processing through the image stitching algorithm. In order to obtain a full-angle wide-angle image, that is, an image that covers the viewing angle around the table tennis table.

获得全角度广角图像的步骤如下:The steps to obtain a full-angle wide-angle image are as follows:

对组成全角度广角图像的组成图像进行畸变校正,选取相邻两幅组成图像中的重合像素点作为求解单应性矩阵的参考点。Distortion correction is performed on the component images that make up the full-angle wide-angle image, and the coincident pixels in the two adjacent component images are selected as the reference points for solving the homography matrix.

在全角度广角图像中建立统一的坐标系,通过透视变换消除部分重合像素点后再次将组成图像映射至全角度广角图像的对应区域中。A unified coordinate system is established in the full-angle wide-angle image, and some overlapping pixels are eliminated through perspective transformation, and the composed image is mapped to the corresponding area of the full-angle wide-angle image again.

在本实施例中,还包括利用RANSAC算法剔除所选重合像素点中的误匹配点,并计算剔除后剩余重合像素点的单应性矩阵的初始值,使用Levenberg-Marquardt非线性迭代最小逼近法进行求精剔除。In this embodiment, it also includes using the RANSAC algorithm to eliminate the mismatched points in the selected coincident pixels, and calculating the initial value of the homography matrix of the remaining coincident pixels after the elimination, using the Levenberg-Marquardt nonlinear iterative minimum approximation method. Refinement elimination.

在步骤S23中,执行步骤S22形成的视频被处理终端读取并播放,观看用户通过向处理终端发出调节操作,处理终端接收调节操作,从而调节视频的播放角度或画面比例。示例性地,处理终端可以是手机和平板电脑等移动终端,处理终端播放视频时,默认的播放角度为正对着乒乓球桌左侧的摄像机的视角,用户通过在触摸屏产生调节操作,例如沿水平方向或竖直方向拖动,处理终端接收到拖动信号后确定需要调节的方向和角度大小,视频的播放画面沿拖动方向调整一定角度,同理,触摸屏检测到两个触点同时向相反方向扩张或靠近时,视频的播放画面根据扩张或靠近的幅度放大比例或缩小比例,从而让用户获得更为自由且个性化的观看效果。In step S23, the video formed by performing step S22 is read and played by the processing terminal, the viewing user sends an adjustment operation to the processing terminal, and the processing terminal receives the adjustment operation, thereby adjusting the playback angle or aspect ratio of the video. Exemplarily, the processing terminal may be a mobile terminal such as a mobile phone and a tablet computer. When the processing terminal plays a video, the default playback angle is the viewing angle of the camera facing the left side of the table tennis table. Drag in the horizontal or vertical direction, the processing terminal determines the direction and angle to be adjusted after receiving the drag signal, and the video playback screen adjusts a certain angle along the drag direction. When expanding or approaching in the opposite direction, the playback screen of the video is enlarged or reduced in proportion according to the extent of expansion or approach, thereby allowing users to obtain a more free and personalized viewing effect.

图3是一种示例性的视频图像画面调节方法的流程图,如图3所示,包括以下步骤:FIG. 3 is a flowchart of an exemplary video image adjustment method, as shown in FIG. 3 , including the following steps:

S31.截取全角度广角图像内的一片区域,得到包含整个目标场地在内的截取图像并作为视频的播放画面。S31. Intercept an area in the full-angle wide-angle image to obtain the intercepted image including the entire target site and use it as a playback image of the video.

S32.调节操作为调节视频的播放角度时,根据转向操作调节视频的播放视角,等比例截取全角度广角图像该角度下的区域,使播放画面内始终包含整个目标场地。S32. When the adjustment operation is to adjust the playback angle of the video, adjust the playback angle of the video according to the steering operation, and proportionally intercept the area under the full-angle wide-angle image, so that the playback screen always includes the entire target site.

S33.调节操作为调节视频的画面比例时,以目标场地为中心进行比例缩放。S33. When the adjustment operation is to adjust the aspect ratio of the video, perform scaling with the target site as the center.

需要说明的是,上述步骤S31~S33的目的在于解决用户无法快速地调节到该角度的最佳观看位置,因此,处理终端在确定用户所需调节的方向和角度后,通过自行截取该角度一较为优选画面范围进行该次调节的调节结果,可以是当调节角度后乒乓球桌不能完全进入播放画面时,处理终端自动以乒乓球桌为中心,等比例截取该角度的全角度广角图像,并且在下一次调节操作产生时,维持使用该角度的画面。It should be noted that the purpose of the above steps S31 to S33 is to solve the problem that the user cannot quickly adjust to the best viewing position of the angle. Therefore, after determining the direction and angle that the user needs to adjust, the processing terminal intercepts the angle by itself. The adjustment result of this adjustment is preferably performed on the screen range. When the ping-pong table cannot completely enter the playback screen after adjusting the angle, the processing terminal automatically takes the ping-pong table as the center, and proportionally intercepts the full-angle wide-angle image of the angle, and When the next adjustment operation occurs, the screen using this angle is maintained.

更为具体地,图4是一种示例性的特征点分布范围信息对全角度广角图像进行感兴趣区域搜索的流程图。参见图4,包括以下步骤:More specifically, FIG. 4 is a flowchart of an exemplary region-of-interest search for a full-angle wide-angle image based on feature point distribution range information. See Figure 4, including the following steps:

S41.对全角度广角图像进行Gabor滤波处理并转化为灰度图像。S41. Perform Gabor filtering on the full-angle wide-angle image and convert it into a grayscale image.

S42.根据全角度广角图像的滤波响应情况,通过阈值化对所述灰度图像进行二值化处理,获取高梯度特征并进行偏心化处理,进而排除夹杂其中的非目标场地特征。S42. Perform binarization processing on the grayscale image through thresholding according to the filtering response of the full-angle wide-angle image to obtain high gradient features and perform eccentric processing, thereby excluding non-target site features.

S43.反复进行Gabor滤波处理及对灰度图像进行二值化处理,整合对输出的二值化图像,确定目标场地检测关键区域并进行截取。S43. Repeat the Gabor filtering process and the binarization process on the grayscale image, integrate the output binarized image, determine the key area of the target site detection and intercept it.

需要说明的是,上述步骤S41~S43使用Gabor滤波响应作为图像特征,用于提取目标场地的线条特征。Gabor变换属于加窗傅立叶变换,可以在频域不同方向和不同尺度上抽取相关特征,因此可以看成是方向、尺度可调的线条检测器。本实施例的Gabor滤波器包含六个方向(0°、45°、60°、90°、120°、135°)和4个频段(0.05至0.4)共24个Gabor滤波器,每个Gabor滤波器只允许与其频率和方向相对应的目标场地特征顺利通过,通过对各Gabor滤波器输出的幅度响应应用特定阈值进行二值化处理,获得图像的背景信息(像素值为0)和线条信息(像素值为1)。It should be noted that, the above steps S41 to S43 use the Gabor filter response as the image feature to extract the line feature of the target site. Gabor transform is a windowed Fourier transform, which can extract relevant features in different directions and scales in the frequency domain, so it can be regarded as a line detector with adjustable direction and scale. The Gabor filter of this embodiment includes 24 Gabor filters in six directions (0°, 45°, 60°, 90°, 120°, 135°) and 4 frequency bands (0.05 to 0.4). Each Gabor filter The filter only allows the target site features corresponding to its frequency and direction to pass smoothly, and the background information (pixel value is 0) and line information ( The pixel value is 1).

根据本发明的第二方面,提供了一种小球比赛摄像系统。According to a second aspect of the present invention, a small ball game camera system is provided.

图5是根据一实施例示出的一种小球比赛摄像系统的框图,参见图5,该系统包括:FIG. 5 is a block diagram of a small ball game camera system according to an embodiment. Referring to FIG. 5 , the system includes:

拍摄模块51,用于对目标场地进行环绕广角拍摄并拼接为全角度广角图像;The photographingmodule 51 is used for taking a surrounding wide-angle photograph of the target site and splicing it into a full-angle wide-angle image;

存储模块52,用于按拍摄时刻的先后将各所述广角图像存储为视频;Thestorage module 52 is used to store each of the wide-angle images as videos according to the sequence of shooting moments;

调节模块53,用于检测调节操作;anadjustment module 53 for detecting an adjustment operation;

处理模块54,用于沿调节操作的指令调节视频的播放角度或画面比例。Theprocessing module 54 is configured to adjust the playback angle or the aspect ratio of the video along the instruction of the adjustment operation.

进一步的,所述处理模块54还用于对组成全角度广角图像的组成图像进行畸变校正,选取相邻两幅组成图像中的重合像素点作为求解单应性矩阵的参考点;以及在全角度广角图像中建立统一的坐标系,通过透视变换消除部分重合像素点后再次将组成图像映射至全角度广角图像的对应区域中。Further, theprocessing module 54 is also used to perform distortion correction on the composition images that form the full-angle wide-angle image, and select the coincident pixels in the adjacent two composition images as the reference points for solving the homography matrix; A unified coordinate system is established in the wide-angle image, and some overlapping pixels are eliminated through perspective transformation, and then the composed image is mapped to the corresponding area of the full-angle wide-angle image.

进一步的,处理模块54还用于截取全角度广角图像内的一片区域,得到包含整个目标场地在内的截取图像并作为视频的播放画面;调节操作为调节视频的播放角度时,根据转向操作调节视频的播放视角,等比例截取全角度广角图像该角度下的区域,使播放画面内始终包含整个目标场地。Further, theprocessing module 54 is also used to intercept an area in the full-angle wide-angle image to obtain the intercepted image including the entire target site and use it as the playback screen of the video; when the adjustment operation is to adjust the playback angle of the video, adjust according to the steering operation. The playback angle of the video, the area under the full-angle wide-angle image is proportionally intercepted, so that the playback screen always includes the entire target site.

进一步的,处理模块54还用于对全角度广角图像进行Gabor滤波处理并转化为灰度图像;根据全角度广角图像的滤波响应情况,通过阈值化对所述灰度图像进行二值化处理,获取高梯度特征并进行偏心化处理,进而排除夹杂其中的非目标场地特征;反复进行Gabor滤波处理及对灰度图像进行二值化处理,整合对输出的二值化图像,确定目标场地检测关键区域并进行截取。Further, theprocessing module 54 is also used to perform Gabor filtering processing on the full-angle wide-angle image and convert it into a grayscale image; according to the filtering response of the full-angle wide-angle image, the grayscale image is subjected to binarization processing by thresholding, Obtain high gradient features and perform eccentric processing to exclude non-target site features; repeatedly perform Gabor filtering and binarization processing on grayscale images, integrate the output binarized images, and determine the key to target site detection area and intercept.

需要说明的是,摄像模块51、存储模块52、调节模块53和处理模块54可以是一体设置,也可以是分开设置。It should be noted that thecamera module 51 , thestorage module 52 , theadjustment module 53 and theprocessing module 54 may be integrally provided, or may be provided separately.

关于上述实施例中的系统,其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述,此处将不做详细阐述说明。Regarding the system in the above-mentioned embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be described in detail here.

以上所述实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above-described embodiments can be combined arbitrarily. For the sake of brevity, all possible combinations of the technical features in the above-described embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be regarded as the scope described in this specification.

在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,除了包含所列的那些要素,而且还可包含没有明确列出的其他要素。As used herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, in addition to those elements listed, but also other elements not expressly listed.

以上所述仅为本发明的优选实施例,并不用于限制本发明,尽管参照前述实施例对本发明进行了详细说明,对于本领域技术人员来说,其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换。凡在本发明的精神和原则之内,所作任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art can still understand the descriptions in the foregoing embodiments. The technical solution is modified, or some technical features thereof are equivalently replaced. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims (10)

Translated fromChinese
1.一种小球比赛摄像方法,其特征在于,包括以下步骤:1. a small ball game camera method, is characterized in that, comprises the following steps:对目标场地进行环绕广角拍摄并拼接为全角度广角图像;Surround wide-angle shooting of the target site and stitch it into a full-angle wide-angle image;按拍摄时刻的先后将各所述广角图像存储为视频;storing each of the wide-angle images as a video according to the sequence of shooting moments;检测调节操作,沿调节操作的指令调节视频的播放角度或画面比例。The adjustment operation is detected, and the playback angle or aspect ratio of the video is adjusted along the instruction of the adjustment operation.2.根据权利要求1所述的小球比赛摄像方法,其特征在于,还包括以下步骤:2. small ball game photographing method according to claim 1, is characterized in that, also comprises the following steps:对组成全角度广角图像的组成图像进行畸变校正,选取相邻两幅组成图像中的重合像素点作为求解单应性矩阵的参考点;Perform distortion correction on the component images that make up the full-angle wide-angle image, and select the coincident pixels in the two adjacent component images as the reference points for solving the homography matrix;在全角度广角图像中建立统一的坐标系,通过透视变换消除部分重合像素点后再次将组成图像映射至全角度广角图像的对应区域中。A unified coordinate system is established in the full-angle wide-angle image, and some overlapping pixels are eliminated through perspective transformation, and the composed image is mapped to the corresponding area of the full-angle wide-angle image again.3.根据权利要求2所述的小球比赛摄像方法,其特征在于,还包括以下步骤:3. small ball game photographing method according to claim 2, is characterized in that, also comprises the following steps:利用RANSAC算法剔除所选重合像素点中的误匹配点,并计算剔除后剩余重合像素点的单应性矩阵的初始值,使用Levenberg-Marquardt非线性迭代最小逼近法进行求精剔除。The RANSAC algorithm is used to eliminate the mismatched points in the selected coincident pixels, and the initial value of the homography matrix of the remaining coincident pixels after the elimination is calculated, and the Levenberg-Marquardt nonlinear iterative minimum approximation method is used to refine the elimination.4.根据权利要求1所述的小球比赛摄像方法,其特征在于,还包括以下步骤:4. small ball game photographing method according to claim 1, is characterized in that, also comprises the following steps:截取全角度广角图像内的一片区域,得到包含整个目标场地在内的截取图像并作为视频的播放画面;Intercept an area in the full-angle wide-angle image to obtain the intercepted image including the entire target site and use it as the video playback screen;调节操作为调节视频的播放角度时,根据转向操作调节视频的播放视角,等比例截取全角度广角图像该角度下的区域,使播放画面内始终包含整个目标场地。When the adjustment operation is to adjust the playback angle of the video, adjust the playback angle of the video according to the steering operation, and proportionally intercept the area of the full-angle wide-angle image at this angle, so that the playback screen always includes the entire target site.5.根据权利要求4所述的小球比赛摄像方法,其特征在于,还包括以下步骤:5. small ball game photographing method according to claim 4, is characterized in that, also comprises the following steps:对全角度广角图像进行Gabor滤波处理并转化为灰度图像;Perform Gabor filtering on the full-angle wide-angle image and convert it into a grayscale image;根据全角度广角图像的滤波响应情况,通过阈值化对所述灰度图像进行二值化处理,获取高梯度特征并进行偏心化处理,进而排除夹杂其中的非目标场地特征;According to the filtering response of the full-angle wide-angle image, the grayscale image is binarized by thresholding to obtain high gradient features and perform eccentric processing, so as to exclude the non-target site features included therein;反复进行Gabor滤波处理及对灰度图像进行二值化处理,整合对输出的二值化图像,确定目标场地检测关键区域并进行截取。Repeat Gabor filtering and binarization of grayscale images, integrate the output binarized images, determine the key areas of the target site to detect and intercept them.6.根据权利要求4所述的小球比赛摄像方法,其特征在于,所述调节操作为调节视频的画面比例时,以目标场地为中心进行比例缩放。6 . The method for photographing a small ball game according to claim 4 , wherein the adjustment operation is to perform scaling with the target field as the center when adjusting the screen ratio of the video. 7 .7.一种小球比赛摄像系统,其特征在于,包括:7. A small ball game camera system, characterized in that, comprising:拍摄模块,用于对目标场地进行环绕广角拍摄并拼接为全角度广角图像;The shooting module is used for surrounding wide-angle shooting of the target site and splicing it into a full-angle wide-angle image;存储模块,用于按拍摄时刻的先后将各所述广角图像存储为视频;a storage module, used for storing each of the wide-angle images as videos according to the sequence of shooting moments;调节模块,用于检测调节操作;An adjustment module for detecting adjustment operations;处理模块,用于沿调节操作的指令调节视频的播放角度或画面比例。The processing module is used to adjust the playback angle or the aspect ratio of the video along the instruction of the adjustment operation.8.根据权利要求7所述的小球比赛摄像系统,其特征在于,所述处理模块还用于对组成全角度广角图像的组成图像进行畸变校正,选取相邻两幅组成图像中的重合像素点作为求解单应性矩阵的参考点;以及在全角度广角图像中建立统一的坐标系,通过透视变换消除部分重合像素点后再次将组成图像映射至全角度广角图像的对应区域中。8. The small-ball game camera system according to claim 7, wherein the processing module is also used to perform distortion correction on the composition images forming the full-angle wide-angle image, and select the coincident pixels in the adjacent two composition images. The point is used as the reference point for solving the homography matrix; and a unified coordinate system is established in the full-angle wide-angle image, and some overlapping pixels are eliminated through perspective transformation, and the composed image is mapped to the corresponding area of the full-angle wide-angle image again.9.根据权利要求7所述的小球比赛摄像系统,其特征在于,所述处理模块还用于截取全角度广角图像内的一片区域,得到包含整个目标场地在内的截取图像并作为视频的播放画面;调节操作为调节视频的播放角度时,根据转向操作调节视频的播放视角,等比例截取全角度广角图像该角度下的区域,使播放画面内始终包含整个目标场地。9. The small ball game camera system according to claim 7, wherein the processing module is also used to intercept an area in the full-angle wide-angle image to obtain the intercepted image including the entire target field and use it as a video image. Play screen; when the adjustment operation is to adjust the playback angle of the video, adjust the playback angle of the video according to the steering operation, and proportionally intercept the area under the full-angle wide-angle image, so that the playback screen always includes the entire target site.10.根据权利要求7所述的小球比赛摄像系统,其特征在于,所述处理模块还用于对全角度广角图像进行Gabor滤波处理并转化为灰度图像;根据全角度广角图像的滤波响应情况,通过阈值化对所述灰度图像进行二值化处理,获取高梯度特征并进行偏心化处理,进而排除夹杂其中的非目标场地特征;反复进行Gabor滤波处理及对灰度图像进行二值化处理,整合对输出的二值化图像,确定目标场地检测关键区域并进行截取。10. The small ball game camera system according to claim 7, wherein the processing module is also used to carry out Gabor filtering processing on the full-angle wide-angle image and convert it into a grayscale image; according to the filter response of the full-angle wide-angle image In some cases, the grayscale image is binarized by thresholding to obtain high-gradient features and eccentricity processing, so as to exclude non-target site features. Integrate the output binarized images, determine the target site to detect key areas and intercept them.
CN202110373065.0A2021-04-072021-04-07 Small ball game camera method and camera systemPendingCN115190259A (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202110373065.0ACN115190259A (en)2021-04-072021-04-07 Small ball game camera method and camera system

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202110373065.0ACN115190259A (en)2021-04-072021-04-07 Small ball game camera method and camera system

Publications (1)

Publication NumberPublication Date
CN115190259Atrue CN115190259A (en)2022-10-14

Family

ID=83512016

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202110373065.0APendingCN115190259A (en)2021-04-072021-04-07 Small ball game camera method and camera system

Country Status (1)

CountryLink
CN (1)CN115190259A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN116612168A (en)*2023-04-202023-08-18北京百度网讯科技有限公司 Image processing method, device, electronic device, image processing system and medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP2005347885A (en)*2004-05-312005-12-15Casio Comput Co Ltd Imaging apparatus, imaging range adjustment method, and program
CN101072332A (en)*2007-06-042007-11-14深圳市融合视讯科技有限公司Automatic mobile target tracking and shooting method
CN102148965A (en)*2011-05-092011-08-10上海芯启电子科技有限公司 Multi-target tracking close-up shooting video surveillance system
US20150193970A1 (en)*2012-08-012015-07-09Chengdu Idealsee Technology Co., Ltd.Video playing method and system based on augmented reality technology and mobile terminal
CN105657517A (en)*2016-02-022016-06-08上海逗屋网络科技有限公司Method and equipment used for playing multi-user interactive video
CN105933695A (en)*2016-06-292016-09-07深圳市优象计算技术有限公司Panoramic camera imaging device and method based on high-speed interconnection of multiple GPUs
CN106034216A (en)*2015-03-102016-10-19北京同步科技有限公司Camera image positioning system and camera image positioning method based on image identification
CN207304732U (en)*2017-10-182018-05-01北京伟开赛德科技发展有限公司The collection of tunnel type panoramic video, distribution and locating and tracking system
CN109104633A (en)*2018-08-302018-12-28Oppo广东移动通信有限公司Video screenshot method and device, storage medium and mobile terminal
CN109889900A (en)*2019-01-182019-06-14北京睿峰文化发展有限公司A kind of method and apparatus that instructional video arbitrarily selects performance scene
WO2019219065A1 (en)*2018-05-172019-11-21杭州海康威视数字技术股份有限公司Video analysis method and device
CN111355966A (en)*2020-03-052020-06-30上海乐杉信息技术有限公司Surrounding free visual angle live broadcast method and system

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP2005347885A (en)*2004-05-312005-12-15Casio Comput Co Ltd Imaging apparatus, imaging range adjustment method, and program
CN101072332A (en)*2007-06-042007-11-14深圳市融合视讯科技有限公司Automatic mobile target tracking and shooting method
CN102148965A (en)*2011-05-092011-08-10上海芯启电子科技有限公司 Multi-target tracking close-up shooting video surveillance system
WO2012151777A1 (en)*2011-05-092012-11-15上海芯启电子科技有限公司Multi-target tracking close-up shooting video monitoring system
US20150193970A1 (en)*2012-08-012015-07-09Chengdu Idealsee Technology Co., Ltd.Video playing method and system based on augmented reality technology and mobile terminal
CN106034216A (en)*2015-03-102016-10-19北京同步科技有限公司Camera image positioning system and camera image positioning method based on image identification
CN105657517A (en)*2016-02-022016-06-08上海逗屋网络科技有限公司Method and equipment used for playing multi-user interactive video
CN105933695A (en)*2016-06-292016-09-07深圳市优象计算技术有限公司Panoramic camera imaging device and method based on high-speed interconnection of multiple GPUs
CN207304732U (en)*2017-10-182018-05-01北京伟开赛德科技发展有限公司The collection of tunnel type panoramic video, distribution and locating and tracking system
WO2019219065A1 (en)*2018-05-172019-11-21杭州海康威视数字技术股份有限公司Video analysis method and device
CN109104633A (en)*2018-08-302018-12-28Oppo广东移动通信有限公司Video screenshot method and device, storage medium and mobile terminal
CN109889900A (en)*2019-01-182019-06-14北京睿峰文化发展有限公司A kind of method and apparatus that instructional video arbitrarily selects performance scene
CN111355966A (en)*2020-03-052020-06-30上海乐杉信息技术有限公司Surrounding free visual angle live broadcast method and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN116612168A (en)*2023-04-202023-08-18北京百度网讯科技有限公司 Image processing method, device, electronic device, image processing system and medium

Similar Documents

PublicationPublication DateTitle
US9544498B2 (en)Method for forming images
CN106713755B (en)Panoramic image processing method and device
CN104270560B (en)A kind of multi-spot method and apparatus
US20190019299A1 (en)Adaptive stitching of frames in the process of creating a panoramic frame
WO2021139728A1 (en)Panoramic video processing method, apparatus, device, and storage medium
CN105376471A (en)Panorama shooting system based on moving platform and method
CN104392416B (en)Video stitching method for sports scene
CN101764925A (en)Shallow depth of field simulation method for digital image
CN103501409A (en)Ultrahigh resolution panorama speed dome AIO (All-In-One) system
CN108200360A (en)A kind of real-time video joining method of more fish eye lens panoramic cameras
KR20150108774A (en)Method for processing a video sequence, corresponding device, computer program and non-transitory computer-readable medium
CN110278366B (en) A panoramic image blurring method, terminal and computer-readable storage medium
CN107911621A (en)A kind of image pickup method of panoramic picture, terminal device and storage medium
CN106162157B (en)The test method of the spatial frequency response of fish-eye camera
El-Saban et al.Improved optimal seam selection blending for fast video stitching of videos captured from freely moving devices
CN111866523B (en)Panoramic video synthesis method and device, electronic equipment and computer storage medium
CN113052119B (en)Ball game tracking camera shooting method and system
CN106919246A (en)The display methods and device of a kind of application interface
CN114331835A (en)Panoramic image splicing method and device based on optimal mapping matrix
CN108513057A (en) Image processing method and device
CN115190259A (en) Small ball game camera method and camera system
CN108234904A (en)A kind of more video fusion method, apparatus and system
El-Saban et al.Fast stitching of videos captured from freely moving devices by exploiting temporal redundancy
CN107094232B (en) Positioning device based on image recognition
KR101132976B1 (en)Mobile device with a plurality of camera, method for display using the sane

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination

[8]ページ先頭

©2009-2025 Movatter.jp