Movatterモバイル変換


[0]ホーム

URL:


CN113938651A - Monitoring method, monitoring system, device and storage medium for panoramic video interaction - Google Patents

Monitoring method, monitoring system, device and storage medium for panoramic video interaction
Download PDF

Info

Publication number
CN113938651A
CN113938651ACN202111188574.2ACN202111188574ACN113938651ACN 113938651 ACN113938651 ACN 113938651ACN 202111188574 ACN202111188574 ACN 202111188574ACN 113938651 ACN113938651 ACN 113938651A
Authority
CN
China
Prior art keywords
area
display interface
parameter
instruction
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111188574.2A
Other languages
Chinese (zh)
Inventor
任伟
刘帅
谷敏永
黄骞
付振
孟祥涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Meike Tianma Automation Technology Co Ltd
CCTEG Beijing Tianma Intelligent Control Technology Co Ltd
Original Assignee
Beijing Meike Tianma Automation Technology Co Ltd
CCTEG Beijing Tianma Intelligent Control Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Meike Tianma Automation Technology Co Ltd, CCTEG Beijing Tianma Intelligent Control Technology Co LtdfiledCriticalBeijing Meike Tianma Automation Technology Co Ltd
Priority to CN202111188574.2ApriorityCriticalpatent/CN113938651A/en
Publication of CN113938651ApublicationCriticalpatent/CN113938651A/en
Pendinglegal-statusCriticalCurrent

Links

Images

Classifications

Landscapes

Abstract

The application provides a panoramic video interaction working surface monitoring method and system. The monitoring system comprises a plurality of multi-view image display interfaces corresponding to the multi-view panoramic camera and at least one local display interface, wherein the local display interface is used for displaying a partial image area of a panoramic image area displayed by the multi-view image display interface. According to the embodiment of the application, the focused image area is dynamically selected from the collected panoramic image for key display, so that the monitoring target can be more conveniently positioned, and the method and the device are more suitable for being used in an underground field.

Description

Monitoring method, monitoring system, monitoring device and storage medium for panoramic video interaction
Technical Field
The application relates to the technical field of computer vision, in particular to a panoramic video interaction working surface monitoring method and system.
Background
The panoramic camera is a camera capable of realizing wide-range angle monitoring, the multi-view panoramic camera is one type of panoramic camera, a plurality of image sensors and lenses in different directions are packaged in the multi-view panoramic camera, and panoramic images are obtained by splicing images of all sub-pictures.
When the panoramic image is directly displayed on the display, because the panoramic image has a large range and more information, the monitoring personnel can increase fatigue and disperse attention when checking, and a dizzy feeling can also be generated.
Disclosure of Invention
In order to solve the problems, the application provides a panoramic video interaction working surface monitoring method and a panoramic video interaction monitoring system. The technical scheme of the application is as follows:
according to a first aspect of the embodiments of the present application, a method for monitoring a working surface of panoramic video interaction is provided, where a monitoring system includes a plurality of multi-view image display interfaces corresponding to a multi-view panoramic camera, and at least one local display interface, where the local display interface is configured to display a partial image area of a panoramic image area displayed by the multi-view image display interface; the method comprises the following steps:
s1, responding to the interaction request, generating a moving picture instruction;
s2, obtaining a second area parameter of a second visual area according to a first image area currently displayed on a first local display interface controlled by the interaction request and the instruction type of the moving picture instruction; the second visual area represents an image area displayed on the first local display interface and adjusted according to the moving picture instruction;
s3, adjusting the image area displayed on the first local display interface according to the second area parameter;
and S4, stopping the moving picture command and ending the interactive request.
According to a second aspect of the embodiments of the present application, a monitoring system is provided, where the monitoring system includes a plurality of multi-view image display interfaces corresponding to the multi-view panoramic camera, and at least one local display interface, where the local display interface is configured to display a partial image area of a panoramic image area displayed by the multi-view image display interfaces; the system further comprises:
the instruction generation module is used for responding to the interaction request and generating a moving picture instruction;
the parameter acquisition module is used for acquiring a second area parameter of a second visual area according to a first image area currently displayed on a first local display interface controlled by the interaction request and the instruction type of the moving picture instruction; the second visual area represents an image area displayed on the first local display interface and adjusted according to the moving picture instruction;
the picture adjusting module is used for adjusting the image area displayed on the first local display interface according to the second area parameter;
and the interaction stopping module is used for stopping the moving picture instruction and ending the interaction request.
According to a third aspect of embodiments of the present application, there is provided a computer apparatus, comprising a memory, a processor and a computer program stored on the memory, wherein the processor executes the computer program to implement the monitoring method for panoramic video interaction of the monitoring system according to the first aspect.
According to a fourth aspect of embodiments of the present application, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to implement the monitoring method for panoramic video interaction of the monitoring system of the first aspect.
According to the working face monitoring method and the monitoring system, the concerned image area is dynamically selected from the collected panoramic image to be displayed in a key mode, the monitoring target can be conveniently located, and the method and the system are suitable for being used in underground sites.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the application and are not to be construed as limiting the application.
Fig. 1 is a flowchart illustrating a method for monitoring a working surface for panoramic video interaction according to an exemplary embodiment.
FIG. 2 is a deployment diagram of a multi-view panoramic camera of a fully mechanized coal face, according to an exemplary embodiment.
FIG. 3 is a schematic diagram illustrating a portion of a monitoring interface of a monitoring system according to an exemplary embodiment.
Fig. 4 is a flowchart illustrating a method of panoramic video interactive work surface monitoring, according to another exemplary embodiment.
FIG. 5 is a block diagram illustrating a monitoring system in accordance with an exemplary embodiment.
FIG. 6 is a block diagram illustrating a computer device according to an example embodiment.
Detailed Description
In order to make the technical solutions of the present application better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in this application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
When the panoramic image is directly displayed on the display, because the panoramic image has a large range and more information, the monitoring personnel can increase fatigue and disperse attention when checking, and a dizzy feeling can also be generated. In order to solve the above problems, the present application provides a local display method interacting with a panoramic image, where the method dynamically selects an image area of interest from a collected panoramic image to perform an emphasis display, and is more suitable for an underground field.
Fig. 1 is a flowchart of a monitoring method for panoramic video interaction of a monitoring system according to an embodiment of the present application. It should be noted that the monitoring method for panoramic video interaction of the monitoring system in the embodiment of the present application can be applied to the monitoring system in the embodiment of the present application. As shown in fig. 1, the monitoring method of panoramic video interaction of the monitoring system may include the following steps.
In one implementation, the monitoring system includes a plurality of multi-view image display interfaces corresponding to the multi-view panoramic camera, and at least one local display interface, where the local display interface is configured to display a partial image area of a panoramic image area displayed by the multi-view image display interface.
For example, as shown in fig. 2, a comprehensive mining working surface is provided with a plurality of multi-view panoramic cameras, each multi-view panoramic camera can cover a large range of scenes, and the multi-view panoramic cameras transmit collected panoramic videos to a monitoring system host through an ethernet for image display. As an example, as shown in fig. 3, the display interface of the monitoring system includes two panoramic image display interfaces for displaying a panoramic image and two partial display interfaces for displaying partial image areas of the panoramic image area, and the two partial display interfaces are respectively used for displaying a front drum area and a rear drum area of the shearer. Because the coal mining machine travels along the coal wall, the display area of the local display interface is dynamically adjusted when the coal mining machine is monitored, so that the important monitoring of the front roller area and the rear roller area is realized.
The panoramic video interaction working surface monitoring method comprises the following steps:
s101, responding to the interaction request, and generating a moving picture instruction;
in one implementation, an interactive request is input by moving a handle rocker, and a moving picture instruction is generated in response to the interactive request.
It should be noted that, besides the implementation of the joystick, there are many implementations for inputting the interactive request, such as a keyboard, a mouse, and the like.
Optionally, the instruction types of the moving picture instruction include picture up, down, left, right, left up, right up, left down, right down, zoom in, and zoom out.
S102, obtaining a second area parameter of a second visual area according to a first image area currently displayed on a first local display interface controlled by the interaction request and the instruction type of the moving picture instruction; the second visual area represents an image area displayed on the first local display interface and adjusted according to the moving picture instruction;
in one implementation manner, obtaining a second area parameter of a second visual area according to a first image area currently displayed on a first local display interface controlled by the interaction request and an instruction type of the moving picture instruction includes:
acquiring a first region parameter of the first image region in the panoramic image region; wherein the first region parameter includes coordinate information and size information of the first image region;
acquiring a region change parameter according to the instruction type of the moving picture instruction; the area change parameters comprise coordinate change information and size scaling information;
and obtaining a second area parameter of a second visual area according to the first area parameter and the area change parameter, wherein the second area parameter comprises coordinate information and size information of the second image area.
S103, adjusting the image area displayed on the first local display interface according to the second area parameter;
and S104, stopping the moving picture instruction and finishing the interactive request.
In one implementation, when the interactive request is input by moving the handle lever in step S101, the moving picture command is stopped in response to the input operation by stopping the handle lever in this step, and the interactive request is ended.
The monitoring method for panoramic video interaction of the monitoring system provided by the embodiment realizes that an image area concerned or interested is dynamically selected from the collected panoramic image, and the focused display is carried out through the local display interface, so that the monitoring method is more suitable for being used in a downhole field.
Fig. 4 is a flowchart of a monitoring method for panoramic video interaction of a monitoring system according to another embodiment of the present application. As shown in fig. 4, the monitoring method of panoramic video interaction of the monitoring system may include the following steps.
S201, responding to the interaction request, and generating a moving picture instruction;
s202, obtaining a second area parameter of a second visual area according to a first image area currently displayed on a first local display interface controlled by the interaction request and the instruction type of the moving picture instruction; the second visual area represents an image area displayed on the first local display interface and adjusted according to the moving picture instruction;
s203, adjusting the image area displayed on the first local display interface according to the second area parameter;
s204, judging whether the image area currently displayed on the first local display interface moves to a target visual area:
if the image area displayed on the first local display interface is not moved to the target visual area, jumping to step S201; if the image area displayed on the first local display interface moves to the target visible area, the process goes to step S205.
After the image area displayed by the first partial display interface is adjusted according to the second area parameter, it may not be achieved that the image area currently displayed by the first partial display interface has moved to the target visual area, in this case, it may be necessary to continue the interaction request and generate the move screen instruction until the image area currently displayed by the first partial display interface has moved to the target visual area.
S205, stopping the moving picture command and ending the interactive request.
It should be noted that steps S201 to S203, and S205 are the same as the implementation manners of steps S101 to S104 in the embodiment shown in fig. 1, and are not described again.
The monitoring method for panoramic video interaction of the monitoring system provided by the embodiment realizes that an image area concerned or interested is dynamically selected from the collected panoramic image, and the focused display is carried out through the local display interface, so that the monitoring method is more suitable for being used in a downhole field.
Fig. 5 is a block diagram of a monitoring system according to an embodiment of the present application, as shown in fig. 5, the monitoring system includes a plurality of multi-view image display interfaces 401 corresponding to the multi-view panoramic camera, and at least onelocal display interface 402, wherein the local display interface is configured to display a partial image area of a panoramic image area displayed by the multi-view image display interfaces; the system also comprises an instruction generation module, a parameter acquisition module, a picture adjustment module, a judgment module and an interaction stopping module.
Aninstruction generating module 403, configured to generate a moving picture instruction in response to the interaction request; optionally, the instruction types of the moving picture instruction include picture up, down, left, right, left up, right up, left down, right down, zoom in, and zoom out.
Aparameter obtaining module 404, configured to obtain a second area parameter of a second visual area according to a first image area currently displayed on the first local display interface controlled by the interaction request and an instruction type of the moving picture instruction; the second visual area represents an image area displayed on the first local display interface and adjusted according to the moving picture instruction;
apicture adjusting module 405, configured to adjust an image area displayed on the first local display interface according to the second area parameter;
a determiningmodule 406, configured to determine whether the currently displayed image area of the first local display interface moves to the target visible area:
if the image area displayed on the first local display interface is not moved to the target visual area, calling an instruction generation module; if the image area displayed on the first local display interface moves to the target visual area, calling an interaction stopping module;
and theinteraction stopping module 407 is configured to stop the moving picture instruction and end the interaction request.
In some embodiments of the present application, theparameter obtaining module 404 is specifically configured to:
acquiring a first region parameter of the first image region in the panoramic image region; wherein the first region parameter includes coordinate information and size information of the first image region;
acquiring a region change parameter according to the instruction type of the moving picture instruction;
and obtaining a second area parameter of a second visual area according to the first area parameter and the area change parameter, wherein the second area parameter comprises coordinate information and size information of the second image area.
In some embodiments of the present application, the monitoring system further comprises a handle rocker, wherein the interaction request is input by moving the handle rocker, and the interaction request is stopped by stopping the input action of the handle rocker.
Fig. 5 is a schematic structural diagram of a computer device according to an embodiment of the present application. The computer device provided in the embodiment of the present application may execute the processing flow provided in the monitoring method embodiment of panoramic video interaction of the monitoring system, as shown in fig. 5, thecomputer device 500 includes amemory 501, aprocessor 502, and a computer program; wherein a computer program is stored in thememory 501 and configured to be executed by theprocessor 502 for the monitoring method of panoramic video interaction of the monitoring system as described in the above embodiments. In addition, thecomputer device 500 may further have acommunication interface 503 for receiving control instructions.
The computer apparatus in the embodiment shown in fig. 5 can be used to implement the technical solution of the above method embodiment, and the implementation principle and technical effect are similar, which are not described herein again.
In addition, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the monitoring method for panoramic video interaction of the monitoring system described in the foregoing embodiment.
The monitoring system provided by the embodiment of the application realizes that the concerned or interested image area is dynamically selected from the collected panoramic image by setting the multi-view image display interface and the local display interface, and the focused display is carried out through the local display interface, so that the monitoring system is more suitable for being used on the underground site.
It should also be noted that the exemplary embodiments mentioned in this patent describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims (12)

CN202111188574.2A2021-10-122021-10-12 Monitoring method, monitoring system, device and storage medium for panoramic video interactionPendingCN113938651A (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202111188574.2ACN113938651A (en)2021-10-122021-10-12 Monitoring method, monitoring system, device and storage medium for panoramic video interaction

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202111188574.2ACN113938651A (en)2021-10-122021-10-12 Monitoring method, monitoring system, device and storage medium for panoramic video interaction

Publications (1)

Publication NumberPublication Date
CN113938651Atrue CN113938651A (en)2022-01-14

Family

ID=79278499

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202111188574.2APendingCN113938651A (en)2021-10-122021-10-12 Monitoring method, monitoring system, device and storage medium for panoramic video interaction

Country Status (1)

CountryLink
CN (1)CN113938651A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2023051138A1 (en)*2021-09-292023-04-06腾讯科技(深圳)有限公司Immersive-media data processing method, apparatus, device, storage medium and program product
WO2025092588A1 (en)*2023-11-022025-05-08索尼集团公司Electronic device, method for electronic device, and computer-readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN107765964A (en)*2017-09-072018-03-06深圳岚锋创视网络科技有限公司A kind of method, apparatus and portable terminal of the regional area for browsing full-view image file
CN108881720A (en)*2018-06-292018-11-23广州盈可视电子科技有限公司A kind of picture obtains output method, device, server and a kind of real training all-in-one machine
CN108933920A (en)*2017-05-252018-12-04中兴通讯股份有限公司A kind of output of video pictures, inspection method and device
CN109525819A (en)*2018-12-192019-03-26深圳市宇通联发科技有限公司Shooting shows equipment with picture-in-picture
CN111913343A (en)*2020-07-272020-11-10微幻科技(北京)有限公司Panoramic image display method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN108933920A (en)*2017-05-252018-12-04中兴通讯股份有限公司A kind of output of video pictures, inspection method and device
CN107765964A (en)*2017-09-072018-03-06深圳岚锋创视网络科技有限公司A kind of method, apparatus and portable terminal of the regional area for browsing full-view image file
CN108881720A (en)*2018-06-292018-11-23广州盈可视电子科技有限公司A kind of picture obtains output method, device, server and a kind of real training all-in-one machine
CN109525819A (en)*2018-12-192019-03-26深圳市宇通联发科技有限公司Shooting shows equipment with picture-in-picture
CN111913343A (en)*2020-07-272020-11-10微幻科技(北京)有限公司Panoramic image display method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2023051138A1 (en)*2021-09-292023-04-06腾讯科技(深圳)有限公司Immersive-media data processing method, apparatus, device, storage medium and program product
WO2025092588A1 (en)*2023-11-022025-05-08索尼集团公司Electronic device, method for electronic device, and computer-readable storage medium

Similar Documents

PublicationPublication DateTitle
JP6970283B2 (en) Image stitching method and device, storage medium
CN107908296B (en)KVM control method, device, storage medium and computer equipment
CN112000306B (en)Reverse control method, device, equipment and storage medium for multi-terminal screen projection
KR102187974B1 (en) Information processing apparatus, method, and program for generation of virtual viewpoint images
CN110162288A (en)A kind of method, apparatus, equipment and the medium of determining display area
CN109218656B (en)Image display method, device and system
CN103680470B (en)The method for displaying image that large-size screen monitors control and system
CN104572004A (en)Information processing method and electronic device
US20100253768A1 (en)Apparatus and method for generating and displaying a stereoscopic image on a mobile computing device
DE112016002373T5 (en) TRACKING SUPPORT DEVICE, TRACKING SUPPORT SYSTEM AND TRACKING SUPPORT PROCESS
CN113938651A (en) Monitoring method, monitoring system, device and storage medium for panoramic video interaction
CN107204044B (en)Picture display method based on virtual reality and related equipment
CN107870795B (en)Method and device for displaying electronic map
KR20140039312A (en)Information processing device, information processing system, server, information processing method, and computer program
CN105208323A (en)Panoramic splicing picture monitoring method and panoramic splicing picture monitoring device
CN110262866A (en)A kind of switching method, device and the readable storage medium storing program for executing of the more picture layouts of screen
CN113157154A (en)Data acquisition method and device
CN112379815A (en)Image capturing method and device, storage medium and electronic equipment
KR20130061106A (en)Method and apparatus for visualizing a data set
CN103036741A (en)Determination method and determination device of flow monitoring base line
US20130265420A1 (en)Video processing apparatus, video processing method, and recording medium
CN104285199A (en)Cursor movement control method, computer program, cursor movement control device and image display system
CN111930326B (en) Image processing method, device and system
CN104378621A (en)Processing method and device for three-dimensional scene
KR100362383B1 (en)Post-processing method for motion captured data using 3D interface

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
RJ01Rejection of invention patent application after publication
RJ01Rejection of invention patent application after publication

Application publication date:20220114


[8]ページ先頭

©2009-2025 Movatter.jp