Disclosure of Invention
In order to solve the problems, the application provides a panoramic video interaction working surface monitoring method and a panoramic video interaction monitoring system. The technical scheme of the application is as follows:
according to a first aspect of the embodiments of the present application, a method for monitoring a working surface of panoramic video interaction is provided, where a monitoring system includes a plurality of multi-view image display interfaces corresponding to a multi-view panoramic camera, and at least one local display interface, where the local display interface is configured to display a partial image area of a panoramic image area displayed by the multi-view image display interface; the method comprises the following steps:
s1, responding to the interaction request, generating a moving picture instruction;
s2, obtaining a second area parameter of a second visual area according to a first image area currently displayed on a first local display interface controlled by the interaction request and the instruction type of the moving picture instruction; the second visual area represents an image area displayed on the first local display interface and adjusted according to the moving picture instruction;
s3, adjusting the image area displayed on the first local display interface according to the second area parameter;
and S4, stopping the moving picture command and ending the interactive request.
According to a second aspect of the embodiments of the present application, a monitoring system is provided, where the monitoring system includes a plurality of multi-view image display interfaces corresponding to the multi-view panoramic camera, and at least one local display interface, where the local display interface is configured to display a partial image area of a panoramic image area displayed by the multi-view image display interfaces; the system further comprises:
the instruction generation module is used for responding to the interaction request and generating a moving picture instruction;
the parameter acquisition module is used for acquiring a second area parameter of a second visual area according to a first image area currently displayed on a first local display interface controlled by the interaction request and the instruction type of the moving picture instruction; the second visual area represents an image area displayed on the first local display interface and adjusted according to the moving picture instruction;
the picture adjusting module is used for adjusting the image area displayed on the first local display interface according to the second area parameter;
and the interaction stopping module is used for stopping the moving picture instruction and ending the interaction request.
According to a third aspect of embodiments of the present application, there is provided a computer apparatus, comprising a memory, a processor and a computer program stored on the memory, wherein the processor executes the computer program to implement the monitoring method for panoramic video interaction of the monitoring system according to the first aspect.
According to a fourth aspect of embodiments of the present application, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to implement the monitoring method for panoramic video interaction of the monitoring system of the first aspect.
According to the working face monitoring method and the monitoring system, the concerned image area is dynamically selected from the collected panoramic image to be displayed in a key mode, the monitoring target can be conveniently located, and the method and the system are suitable for being used in underground sites.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Detailed Description
In order to make the technical solutions of the present application better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in this application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
When the panoramic image is directly displayed on the display, because the panoramic image has a large range and more information, the monitoring personnel can increase fatigue and disperse attention when checking, and a dizzy feeling can also be generated. In order to solve the above problems, the present application provides a local display method interacting with a panoramic image, where the method dynamically selects an image area of interest from a collected panoramic image to perform an emphasis display, and is more suitable for an underground field.
Fig. 1 is a flowchart of a monitoring method for panoramic video interaction of a monitoring system according to an embodiment of the present application. It should be noted that the monitoring method for panoramic video interaction of the monitoring system in the embodiment of the present application can be applied to the monitoring system in the embodiment of the present application. As shown in fig. 1, the monitoring method of panoramic video interaction of the monitoring system may include the following steps.
In one implementation, the monitoring system includes a plurality of multi-view image display interfaces corresponding to the multi-view panoramic camera, and at least one local display interface, where the local display interface is configured to display a partial image area of a panoramic image area displayed by the multi-view image display interface.
For example, as shown in fig. 2, a comprehensive mining working surface is provided with a plurality of multi-view panoramic cameras, each multi-view panoramic camera can cover a large range of scenes, and the multi-view panoramic cameras transmit collected panoramic videos to a monitoring system host through an ethernet for image display. As an example, as shown in fig. 3, the display interface of the monitoring system includes two panoramic image display interfaces for displaying a panoramic image and two partial display interfaces for displaying partial image areas of the panoramic image area, and the two partial display interfaces are respectively used for displaying a front drum area and a rear drum area of the shearer. Because the coal mining machine travels along the coal wall, the display area of the local display interface is dynamically adjusted when the coal mining machine is monitored, so that the important monitoring of the front roller area and the rear roller area is realized.
The panoramic video interaction working surface monitoring method comprises the following steps:
s101, responding to the interaction request, and generating a moving picture instruction;
in one implementation, an interactive request is input by moving a handle rocker, and a moving picture instruction is generated in response to the interactive request.
It should be noted that, besides the implementation of the joystick, there are many implementations for inputting the interactive request, such as a keyboard, a mouse, and the like.
Optionally, the instruction types of the moving picture instruction include picture up, down, left, right, left up, right up, left down, right down, zoom in, and zoom out.
S102, obtaining a second area parameter of a second visual area according to a first image area currently displayed on a first local display interface controlled by the interaction request and the instruction type of the moving picture instruction; the second visual area represents an image area displayed on the first local display interface and adjusted according to the moving picture instruction;
in one implementation manner, obtaining a second area parameter of a second visual area according to a first image area currently displayed on a first local display interface controlled by the interaction request and an instruction type of the moving picture instruction includes:
acquiring a first region parameter of the first image region in the panoramic image region; wherein the first region parameter includes coordinate information and size information of the first image region;
acquiring a region change parameter according to the instruction type of the moving picture instruction; the area change parameters comprise coordinate change information and size scaling information;
and obtaining a second area parameter of a second visual area according to the first area parameter and the area change parameter, wherein the second area parameter comprises coordinate information and size information of the second image area.
S103, adjusting the image area displayed on the first local display interface according to the second area parameter;
and S104, stopping the moving picture instruction and finishing the interactive request.
In one implementation, when the interactive request is input by moving the handle lever in step S101, the moving picture command is stopped in response to the input operation by stopping the handle lever in this step, and the interactive request is ended.
The monitoring method for panoramic video interaction of the monitoring system provided by the embodiment realizes that an image area concerned or interested is dynamically selected from the collected panoramic image, and the focused display is carried out through the local display interface, so that the monitoring method is more suitable for being used in a downhole field.
Fig. 4 is a flowchart of a monitoring method for panoramic video interaction of a monitoring system according to another embodiment of the present application. As shown in fig. 4, the monitoring method of panoramic video interaction of the monitoring system may include the following steps.
S201, responding to the interaction request, and generating a moving picture instruction;
s202, obtaining a second area parameter of a second visual area according to a first image area currently displayed on a first local display interface controlled by the interaction request and the instruction type of the moving picture instruction; the second visual area represents an image area displayed on the first local display interface and adjusted according to the moving picture instruction;
s203, adjusting the image area displayed on the first local display interface according to the second area parameter;
s204, judging whether the image area currently displayed on the first local display interface moves to a target visual area:
if the image area displayed on the first local display interface is not moved to the target visual area, jumping to step S201; if the image area displayed on the first local display interface moves to the target visible area, the process goes to step S205.
After the image area displayed by the first partial display interface is adjusted according to the second area parameter, it may not be achieved that the image area currently displayed by the first partial display interface has moved to the target visual area, in this case, it may be necessary to continue the interaction request and generate the move screen instruction until the image area currently displayed by the first partial display interface has moved to the target visual area.
S205, stopping the moving picture command and ending the interactive request.
It should be noted that steps S201 to S203, and S205 are the same as the implementation manners of steps S101 to S104 in the embodiment shown in fig. 1, and are not described again.
The monitoring method for panoramic video interaction of the monitoring system provided by the embodiment realizes that an image area concerned or interested is dynamically selected from the collected panoramic image, and the focused display is carried out through the local display interface, so that the monitoring method is more suitable for being used in a downhole field.
Fig. 5 is a block diagram of a monitoring system according to an embodiment of the present application, as shown in fig. 5, the monitoring system includes a plurality of multi-view image display interfaces 401 corresponding to the multi-view panoramic camera, and at least onelocal display interface 402, wherein the local display interface is configured to display a partial image area of a panoramic image area displayed by the multi-view image display interfaces; the system also comprises an instruction generation module, a parameter acquisition module, a picture adjustment module, a judgment module and an interaction stopping module.
Aninstruction generating module 403, configured to generate a moving picture instruction in response to the interaction request; optionally, the instruction types of the moving picture instruction include picture up, down, left, right, left up, right up, left down, right down, zoom in, and zoom out.
Aparameter obtaining module 404, configured to obtain a second area parameter of a second visual area according to a first image area currently displayed on the first local display interface controlled by the interaction request and an instruction type of the moving picture instruction; the second visual area represents an image area displayed on the first local display interface and adjusted according to the moving picture instruction;
apicture adjusting module 405, configured to adjust an image area displayed on the first local display interface according to the second area parameter;
a determiningmodule 406, configured to determine whether the currently displayed image area of the first local display interface moves to the target visible area:
if the image area displayed on the first local display interface is not moved to the target visual area, calling an instruction generation module; if the image area displayed on the first local display interface moves to the target visual area, calling an interaction stopping module;
and theinteraction stopping module 407 is configured to stop the moving picture instruction and end the interaction request.
In some embodiments of the present application, theparameter obtaining module 404 is specifically configured to:
acquiring a first region parameter of the first image region in the panoramic image region; wherein the first region parameter includes coordinate information and size information of the first image region;
acquiring a region change parameter according to the instruction type of the moving picture instruction;
and obtaining a second area parameter of a second visual area according to the first area parameter and the area change parameter, wherein the second area parameter comprises coordinate information and size information of the second image area.
In some embodiments of the present application, the monitoring system further comprises a handle rocker, wherein the interaction request is input by moving the handle rocker, and the interaction request is stopped by stopping the input action of the handle rocker.
Fig. 5 is a schematic structural diagram of a computer device according to an embodiment of the present application. The computer device provided in the embodiment of the present application may execute the processing flow provided in the monitoring method embodiment of panoramic video interaction of the monitoring system, as shown in fig. 5, thecomputer device 500 includes amemory 501, aprocessor 502, and a computer program; wherein a computer program is stored in thememory 501 and configured to be executed by theprocessor 502 for the monitoring method of panoramic video interaction of the monitoring system as described in the above embodiments. In addition, thecomputer device 500 may further have acommunication interface 503 for receiving control instructions.
The computer apparatus in the embodiment shown in fig. 5 can be used to implement the technical solution of the above method embodiment, and the implementation principle and technical effect are similar, which are not described herein again.
In addition, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the monitoring method for panoramic video interaction of the monitoring system described in the foregoing embodiment.
The monitoring system provided by the embodiment of the application realizes that the concerned or interested image area is dynamically selected from the collected panoramic image by setting the multi-view image display interface and the local display interface, and the focused display is carried out through the local display interface, so that the monitoring system is more suitable for being used on the underground site.
It should also be noted that the exemplary embodiments mentioned in this patent describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.