CN108668060B - Image processing method, panoramic camera, panoramic projection method, panoramic projection system and computer-readable storage medium - Google Patents
Image processing method, panoramic camera, panoramic projection method, panoramic projection system and computer-readable storage mediumDownload PDFInfo
- Publication number
- CN108668060B CN108668060BCN201810465509.1ACN201810465509ACN108668060BCN 108668060 BCN108668060 BCN 108668060BCN 201810465509 ACN201810465509 ACN 201810465509ACN 108668060 BCN108668060 BCN 108668060B
- Authority
- CN
- China
- Prior art keywords
- panoramic
- camera
- image
- sub
- cameras
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
Description
[ technical field ] A method for producing a semiconductor device
The present invention relates to the field of image processing technologies, and in particular, to an image processing method, a panoramic camera, a panoramic projection method, a panoramic projection system, and a computer-readable storage medium.
[ background of the invention ]
In daily life, the projector can be widely applied to places such as families, offices, schools and the like. The camera collects images and displays the images through the projector, so that the condition of the area to be known can be clearly observed. At present, a camera can correspond to a projector, and the camera can only collect the image of single angle to do not pass through other data processing processes, directly export the image of an angle that collects to the projector, and show the projection through the projector.
However, in the prior art, the camera can only collect images at a single angle, which results in a single display angle of the images projected and output by the projector, and tends to generate blind areas.
[ summary of the invention ]
In view of this, embodiments of the present invention provide an image processing method, a panoramic camera, a panoramic projection method, a panoramic projection system, and a computer-readable storage medium, so as to solve the problems in the prior art that an image projected and output by a projector has a single display angle and is prone to generate a blind area because the camera can only acquire an image at a single angle.
In a first aspect, an embodiment of the present invention provides an image processing method, which is executed in a panoramic camera, where the panoramic camera includes at least two sub-cameras, and the image processing method includes:
in response to receiving a panoramic mode instruction, carrying out panoramic stitching on the images acquired by the at least two sub-cameras to obtain a panoramic image;
and outputting the panoramic image.
The above aspects and any possible implementation further provide an implementation, in which the panoramic camera is a virtual reality VR camera; or, the panoramic camera is an Augmented Reality (AR) camera.
In the aspect and any possible implementation manner described above, there is further provided an implementation manner that, when the panoramic camera is a virtual reality VR camera, the panoramic mode instruction is a virtual reality VR mode instruction; or,
when the panoramic camera is an augmented reality AR camera, the panoramic mode instruction is an augmented reality AR mode instruction or a virtual reality VR mode instruction.
As to the above-mentioned aspects and any possible implementation manner, there is further provided an implementation manner, where the panoramic stitching is performed on the images collected by the at least two sub-cameras to obtain a panoramic image, including:
controlling the at least two sub-cameras to respectively acquire images;
and carrying out panoramic stitching on the images collected by the at least two sub-cameras to obtain the panoramic image.
As to the above-mentioned aspects and any possible implementation manner, there is further provided an implementation manner, where the panoramic stitching is performed on the images collected by the at least two sub-cameras to obtain a panoramic image, including:
and carrying out panoramic stitching on the images acquired by the at least two sub-cameras through at least one of a stitching algorithm and a stitching algorithm to obtain the panoramic image.
The above aspect and any possible implementation manner further provide an implementation manner, where in response to receiving a panoramic mode instruction, before performing panoramic stitching on images acquired by the at least two sub-cameras to obtain a panoramic image, the method further includes:
controlling the at least two sub-cameras to respectively acquire images;
and respectively storing the images collected by the sub-cameras.
The above-described aspect and any possible implementation manner further provide an implementation manner, where the at least two sub-cameras are respectively configured to acquire images at least two different angles.
The above aspect and any possible implementation manner further provide an implementation manner, when the panoramic mode instruction is an augmented reality AR mode instruction, outputting the panoramic image, including:
performing AR processing on the panoramic image to obtain an AR-processed panoramic image;
and outputting the panoramic image after the AR processing.
The above-described aspects and any possible implementations further provide an implementation in which the AR processing includes: at least one of voice conversion caption display, character recognition and statistical information.
The above-described aspects and any possible implementations further provide an implementation, and the method further includes:
in response to receiving a common mode instruction, determining a target image in the images acquired by the at least two sub-cameras;
and outputting the target image.
The above aspect and any possible implementation manner further provide an implementation manner that determining a target image in the images acquired by the at least two sub-cameras includes:
determining a target camera in the at least two sub-cameras;
and determining the image acquired by the target camera as the target image.
The above aspect and any possible implementation manner further provide an implementation manner, where determining a target camera in the at least two sub-cameras includes:
randomly selecting one camera from the at least two sub-cameras as the target camera; or,
and selecting one camera from the at least two sub-cameras as the target camera according to a preset rule.
The above aspect and any possible implementation manner further provide an implementation manner, where determining a target camera in the at least two sub-cameras includes:
acquiring target camera indication information carried in the common mode instruction;
and determining the camera indicated by the target camera indication information as the target camera.
In a second aspect, an embodiment of the present invention provides a panoramic camera, including:
the at least two sub-cameras are used for acquiring images at least two different angles;
the processor is used for responding to the received panoramic mode instruction and carrying out panoramic stitching on the images acquired by the at least two sub-cameras to obtain a panoramic image; and, for outputting the panoramic image.
In a third aspect, an embodiment of the present invention provides a panoramic projection method, which is executed in a panoramic projection system including a terminal, a panoramic camera, and a projector, where the panoramic camera includes at least two sub-cameras, and the panoramic projection method includes:
the terminal sends a panoramic mode instruction to the panoramic camera;
the panoramic camera responds to the received panoramic mode instruction, and carries out panoramic stitching on the images collected by the at least two sub-cameras to obtain a panoramic image;
the panoramic camera outputs the panoramic image to a projector;
and the projector performs projection display on the panoramic image.
In a fourth aspect, an embodiment of the present invention provides a panoramic projection system, including:
the terminal is used for sending a panoramic mode instruction to the panoramic camera head;
the panoramic camera comprises at least two sub-cameras and is used for responding to the received panoramic mode instruction, carrying out panoramic stitching on the images collected by the at least two sub-cameras to obtain a panoramic image and outputting the panoramic image to the projector;
and the projector is used for receiving the panoramic image and projecting and displaying the panoramic image.
In a fifth aspect, an embodiment of the present invention provides a panoramic projection method, which is executed in a panoramic projection system including a panoramic camera and a projector, where the panoramic camera includes at least two sub-cameras, and the panoramic projection method includes:
the panoramic camera responds to the received panoramic mode instruction, and carries out panoramic stitching on the images collected by the at least two sub-cameras to obtain a panoramic image;
the panoramic camera outputs the panoramic image to a projector;
and the projector performs projection display on the panoramic image.
In a sixth aspect, an embodiment of the present invention provides a panoramic projection system, including:
the panoramic camera comprises at least two sub cameras and is used for responding to a received panoramic mode instruction, carrying out panoramic stitching on images collected by the at least two sub cameras to obtain a panoramic image and outputting the panoramic image to the projector;
and the projector is used for receiving the panoramic image and projecting and displaying the panoramic image.
In a seventh aspect, an embodiment of the present invention provides a computer-readable storage medium, where the computer-readable storage medium includes: computer-executable instructions which, when executed, perform any of the image processing methods as described above.
In the embodiment of the invention, the panoramic camera comprises at least two sub-cameras which are respectively used for collecting images at least two different angles, and the panoramic camera can respond to the received panoramic mode instruction to carry out panoramic mosaic processing on the images at least two different angles to generate and output a panoramic image containing at least two different angles.
[ description of the drawings ]
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of an image processing method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a panoramic camera provided in an embodiment of the present invention;
FIG. 3 is a schematic diagram of information interaction of a panoramic projection method according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a panoramic projection system according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of another information interaction of the panoramic projection method according to the embodiment of the present invention;
FIG. 6 is a schematic view of another embodiment of a panoramic projection system according to the present invention.
[ detailed description ] embodiments
For better understanding of the technical solutions of the present invention, the following detailed descriptions of the embodiments of the present invention are provided with reference to the accompanying drawings.
It should be understood that the described embodiments are only some embodiments of the invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
Example one
The embodiment of the invention provides an image processing method, which is executed in a panoramic camera, wherein the panoramic camera comprises at least two sub-cameras.
Fig. 1 may be referred to as a schematic flow chart of an image processing method according to an embodiment of the present invention, where the image processing method specifically includes the following steps:
and S101, responding to the received panoramic mode instruction, and carrying out panoramic stitching on the images acquired by the at least two sub-cameras to obtain a panoramic image.
The panoramic camera comprises at least two sub-cameras which are respectively used for collecting images at least two different angles. The panoramic camera may be a Virtual Reality (VR) camera, or an Augmented Reality (AR) camera. When the panoramic camera is a virtual reality VR camera, the panoramic mode instruction is a virtual reality VR mode instruction; when the panoramic camera is augmented reality AR camera, the panoramic mode instruction is augmented reality AR mode instruction or virtual reality VR mode instruction, has richened the variety of mode instruction selection. The virtual reality VR is a computer simulation system capable of creating and experiencing a virtual world, a simulation environment is generated by a computer, and the virtual reality VR is a system simulation of an interactive three-dimensional dynamic view and entity behaviors of multi-source information fusion; augmented reality AR is a technology that calculates the position and angle of a camera image in real time and adds a corresponding image, and can wrap a virtual world around the real world on a screen and perform interaction.
It should be noted that, when the panoramic mode instruction is a VR mode instruction, the panoramic camera performs panoramic stitching on the images acquired by at least two sub-cameras, so as to obtain a panoramic image; and when the panoramic mode instruction is an AR mode instruction, the panoramic camera further performs AR processing on the panoramic image obtained by panoramic stitching and outputs the panoramic image, wherein the AR processing may include but is not limited to at least one of voice conversion subtitle display, person recognition and statistical information.
Specifically, the panoramic camera processes at least two images at different angles collected by at least two sub-cameras according to received different panoramic mode instructions, and combines the panoramas of the at least two images at different angles into one image, so as to obtain a panoramic image. The method of panorama stitching may include, but is not limited to, at least one of a stitching algorithm and a stitching algorithm.
It should be noted that, before the step of performing the panorama stitching in S101, the panorama camera needs to control each sub-camera to capture an image.
For convenience of understanding, the embodiment of the present invention provides the following two implementation manners of acquiring images:
first, only when a panoramic mode instruction is received, at least two sub-cameras are controlled to respectively collect images, and real-time panoramic stitching processing is performed on the collected images, so that invalid image data is prevented from occupying memory resources.
And secondly, responding to the received panoramic mode instruction, performing panoramic stitching on the images acquired by the at least two sub-cameras, controlling the at least two sub-cameras to acquire the images respectively before acquiring the panoramic image, and then storing the images acquired by the sub-cameras respectively.
In the application scene, the panoramic camera can continuously control each sub-camera to collect images and store the images, so that after receiving a panoramic mode instruction, the stored images collected by each sub-camera are directly subjected to panoramic stitching to obtain a panoramic image, the time is saved, and the image processing efficiency is improved.
Specifically, the panoramic camera includes at least two sub-cameras, which are sub-camera 1 and sub-camera 2, respectively, and sub-camera 1 and sub-camera 2 are used for acquiring images at different angles, and then storing the acquired images respectively. It should be noted that the storage location may be a memory in the panoramic camera or a network cloud disk, which is not particularly limited in this embodiment.
For example, the memory in the panoramic camera includes at least two storage locations, which are uniquely corresponding to each sub-camera, respectively, for example, the sub-camera 1 corresponds to the storage location 1, and the sub-camera 2 corresponds to the storage location 2, or the memory in the panoramic camera has only one storage location, and images collected by the corresponding sub-cameras are placed in different folders, for example, an image collected by the sub-camera 1 is placed in the folder 1, and an image collected by the sub-camera 2 is placed in the folder 2.
And S102, outputting the panoramic image.
The panoramic camera outputs the panoramic image subjected to panoramic stitching processing to display equipment, such as a terminal and a projector.
The specific implementation manner may include the following three cases:
first, a panoramic camera is wired to a projector, and outputs a panoramic image to the projector through an actual line.
Secondly, before the panoramic camera outputs the panoramic image to the projector, a Wireless connection is established between the panoramic camera and the projector in a Wireless connection mode, such as bluetooth or Wireless-Fidelity (Wi-Fi), and then the panoramic camera outputs the panoramic image to the projector in a Wireless connection mode.
And thirdly, the panoramic camera sends the panoramic image to the terminal firstly, and then the panoramic image is sent to the projector by the terminal for displaying.
The panoramic camera in this embodiment may also have a preset normal mode instruction in addition to responding to the received panoramic mode instruction, and when the panoramic camera receives the normal mode instruction, display an image of a single camera. Then, at this time, the present image processing method may further include the steps of:
and responding to the received common mode instruction, determining a target image from the images collected by the at least two sub-cameras, and further outputting the target image.
In a specific implementation process, the panoramic camera may determine a target camera from at least two sub-cameras, so that an image acquired by the determined target camera is used as a target image.
Based on the above, the target camera is determined in the at least two sub-cameras, and one camera can be randomly selected from the at least two sub-cameras to serve as the target camera; or selecting one camera from the at least two sub-cameras as a target camera according to a preset rule.
For example, the panoramic camera includes two sub-cameras, namely a sub-camera 1 and a sub-camera 2, and if the processor of the panoramic camera randomly selects the sub-camera 2 from the sub-cameras, the sub-camera 2 is a target camera, and an image collected by the sub-camera 2 is used as a target image.
Alternatively, for example, the sub-cameras 1 and 2 are respectively used as target cameras in an alternating cycle, so that the images captured by the sub-cameras 1 and 2 can be respectively displayed as target images. The alternation period may be an integer greater than zero, such as 1 second or 2 seconds, and this embodiment is not particularly limited thereto.
Alternatively, the target camera may be designated.
In a specific application scenario, the indication information of the target camera may be carried in a normal mode command, or may be separately sent.
Based on this, the target camera is determined in the at least two sub-cameras, and the camera indicated by the target camera indication information can be determined as the target camera by acquiring the target camera indication information carried in the common mode instruction.
Specifically, the general mode instruction carries indication information for identifying the target camera, the processor in the panoramic camera compares the indication information with the identification information in each sub-camera one by one, and if the indication information is the same as the identification information, the sub-camera indicated by the indication information of the target camera is determined as the target camera.
On the basis of the embodiment shown in fig. 1, the present embodiment further provides a panoramic camera. Please refer to fig. 2, which is a schematic structural diagram of a panoramic camera according to an embodiment of the present invention. As shown in fig. 2, thepanoramic camera 21 includes:
at least two sub-cameras (shown assub-camera 201 and sub-camera 202 in fig. 2) for acquiring images of at least two different angles;
theprocessor 203 is configured to perform panoramic stitching on the images acquired by the at least two sub-cameras in response to receiving the panoramic mode instruction, so as to obtain a panoramic image; and, for outputting the panoramic image.
On the basis of the above embodiments, the present embodiment provides a computer-readable storage medium.
Specifically, the computer-readable storage medium includes therein computer-executable instructions that, when executed, are capable of executing the image processing method given in the present embodiment.
In the embodiment of the invention, the panoramic camera comprises at least two sub-cameras which are respectively used for collecting images at least two different angles, and the panoramic camera can respond to the received panoramic mode instruction to carry out panoramic mosaic processing on the images at least two different angles to generate and output a panoramic image containing at least two different angles.
Example two
The embodiment provides a panoramic projection method, which is executed in a panoramic projection system comprising a terminal, a panoramic camera and a projector, wherein the panoramic camera comprises at least two sub-cameras. Please refer to fig. 3, which is a schematic information interaction diagram of a panoramic projection method according to an embodiment of the present invention, and the method specifically includes the following steps:
s301, the terminal sends a panoramic mode instruction to the panoramic camera.
The specific implementation manner may include the following two cases:
firstly, the terminal directly sends a panoramic mode instruction to the panoramic camera.
Secondly, before the terminal sends the panoramic mode instruction to the panoramic camera, the terminal firstly establishes wireless connection with the panoramic camera in a wireless connection mode such as Bluetooth and wireless network Wi-Fi, and then sends the panoramic mode instruction to the panoramic camera.
And S302, the panoramic camera responds to the received panoramic mode instruction, and carries out panoramic stitching on the images collected by the at least two sub-cameras to obtain a panoramic image.
And S303, outputting the panoramic image to a projector by the panoramic camera.
Specifically, the panoramic camera is in wired connection with the projector, and the panoramic camera outputs the panoramic image to the projector through an actual line, or before the panoramic camera outputs the panoramic image to the projector, a wireless connection is established between the panoramic camera and the projector in a wireless connection mode, such as bluetooth and wireless network Wi-Fi, and then the panoramic camera outputs the panoramic image to the projector through the wireless connection mode.
It should be noted that the terminal according to the embodiment of the present invention may include, but is not limited to, a Personal Computer (PC), a Personal Digital Assistant (PDA), a wireless handheld device, a Tablet Computer (Tablet Computer), a mobile phone, and the like.
And S304, the projector performs projection display on the panoramic image.
Based on the embodiment shown in fig. 3, the present embodiment further provides a panoramic projection system. As shown in fig. 4, which is a schematic structural diagram of a panoramic projection system according to an embodiment of the present invention, thepanoramic projection system 41 includes:
a terminal 401, configured to send a panoramic mode instruction to a panoramic camera;
thepanoramic camera 402 comprises at least two sub-cameras and is used for responding to a received panoramic mode instruction, performing panoramic stitching on images collected by the at least two sub-cameras to obtain a panoramic image and outputting the panoramic image to the projector;
and aprojector 403 for receiving the panoramic image and projecting and displaying the panoramic image.
For the parts of the embodiments of the present invention not described in detail, reference may be made to the related descriptions of the pair of panoramic cameras in the embodiments.
In the embodiment of the invention, the panoramic camera comprises at least two sub-cameras which are respectively used for collecting images at least two different angles, and the panoramic camera can respond to the received panoramic mode instruction to carry out panoramic mosaic processing on the images at least two different angles to generate and output a panoramic image containing at least two different angles.
EXAMPLE III
The embodiment provides another panoramic projection method, which is executed in a panoramic projection system comprising a panoramic camera and a projector, wherein the panoramic camera comprises at least two sub-cameras. Please refer to fig. 5, which is another schematic information interaction diagram of the panoramic projection method according to the embodiment of the present invention, specifically including the following steps:
s501, the panoramic camera responds to a received panoramic mode instruction and carries out panoramic stitching on images collected by at least two sub-cameras to obtain a panoramic image;
specifically, a panoramic mode instruction may be manually issued to the panoramic camera by a user. For example, a panoramic mode command is issued by operating a key on the panoramic camera.
S502, outputting a panoramic image to a projector by the panoramic camera;
specifically, the panoramic camera is in wired connection with the projector, and the panoramic camera outputs the panoramic image to the projector through an actual line, or before the panoramic camera outputs the panoramic image to the projector, a wireless connection is established between the panoramic camera and the projector in a wireless connection mode, such as bluetooth and wireless network Wi-Fi, and then the panoramic camera outputs the panoramic image to the projector through the wireless connection mode.
And S503, the projector displays the panoramic image in a projection mode.
Based on the embodiment shown in fig. 5, the present embodiment further provides a panoramic projection system. As shown in fig. 6, which is another schematic structural diagram of the panoramic projection system according to the embodiment of the present invention, thepanoramic projection system 61 includes:
thepanoramic camera 601 comprises at least two sub-cameras and is used for responding to a received panoramic mode instruction, performing panoramic stitching on images collected by the at least two sub-cameras to obtain a panoramic image and outputting the panoramic image to the projector;
and aprojector 602, configured to receive the panoramic image and perform projection display on the panoramic image.
For the parts of the embodiments of the present invention not described in detail, reference may be made to the related descriptions of the pair of panoramic cameras in the embodiments.
In the embodiment of the invention, the panoramic camera comprises at least two sub-cameras which are respectively used for collecting images at least two different angles, and the panoramic camera can respond to the received panoramic mode instruction to carry out panoramic mosaic processing on the images at least two different angles to generate and output a panoramic image containing at least two different angles.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions in actual implementation, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) or a Processor (Processor) to execute some steps of the methods according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (13)
1. An image processing method executed in a panoramic camera including at least two sub-cameras, the image processing method comprising:
in response to receiving a panoramic mode instruction, carrying out panoramic stitching on the images acquired by the at least two sub-cameras to obtain a panoramic image;
outputting the panoramic image;
in response to receiving the panoramic mode instruction, performing panoramic stitching on the images acquired by the at least two sub-cameras, and before obtaining a panoramic image, the method further includes:
controlling the at least two sub-cameras to respectively acquire images;
respectively storing the images collected by the sub-cameras;
after outputting the panoramic image, the method further comprises:
in response to receiving a common mode instruction, determining a target image in the images acquired by the at least two sub-cameras;
outputting the target image;
wherein, determining a target image in the images collected by the at least two sub-cameras comprises:
acquiring target camera indication information carried in the common mode instruction;
determining the camera indicated by the target camera indication information as the target camera;
and determining the image acquired by the target camera as the target image.
2. The image processing method of claim 1, wherein the panoramic camera is a Virtual Reality (VR) camera; or, the panoramic camera is an Augmented Reality (AR) camera.
3. The image processing method of claim 2, wherein when the panoramic camera is a Virtual Reality (VR) camera, the panoramic mode instruction is a Virtual Reality (VR) mode instruction; or,
when the panoramic camera is an augmented reality AR camera, the panoramic mode instruction is an augmented reality AR mode instruction or a virtual reality VR mode instruction.
4. The image processing method according to claim 1, wherein the panoramic stitching is performed on the images acquired by the at least two sub-cameras to obtain a panoramic image, and the method comprises the following steps:
and carrying out panoramic stitching on the images acquired by the at least two sub-cameras through at least one of a stitching algorithm and a stitching algorithm to obtain the panoramic image.
5. The image processing method according to any one of claims 1 to 4, wherein the at least two sub-cameras are respectively used for acquiring images of at least two different angles.
6. The image processing method according to claim 1 or 3, wherein outputting the panoramic image when the panoramic mode instruction is an Augmented Reality (AR) mode instruction comprises:
performing AR processing on the panoramic image to obtain an AR-processed panoramic image;
and outputting the panoramic image after the AR processing.
7. The image processing method of claim 6, wherein the AR processing comprises: at least one of voice conversion caption display, character recognition and statistical information.
8. A panoramic camera, comprising:
the at least two sub-cameras are used for acquiring images at least two different angles;
the processor is used for responding to the received panoramic mode instruction and carrying out panoramic stitching on the images acquired by the at least two sub-cameras to obtain a panoramic image; and, for outputting the panoramic image;
in response to receiving the panoramic mode instruction, performing panoramic stitching on the images acquired by the at least two sub-cameras, and before obtaining a panoramic image, the method further includes:
controlling the at least two sub-cameras to respectively acquire images;
respectively storing the images collected by the sub-cameras;
after outputting the panoramic image, the method further comprises:
in response to receiving a common mode instruction, determining a target image in the images acquired by the at least two sub-cameras;
outputting the target image;
wherein, determining a target image in the images collected by the at least two sub-cameras comprises:
acquiring target camera indication information carried in the common mode instruction;
determining the camera indicated by the target camera indication information as the target camera;
and determining the image acquired by the target camera as the target image.
9. A panoramic projection method is executed in a panoramic projection system comprising a terminal, a panoramic camera and a projector, wherein the panoramic camera comprises at least two sub-cameras, and the panoramic projection method comprises the following steps:
the terminal sends a panoramic mode instruction to the panoramic camera;
the panoramic camera responds to the received panoramic mode instruction, and carries out panoramic stitching on the images collected by the at least two sub-cameras to obtain a panoramic image;
the panoramic camera outputs the panoramic image to a projector;
the projector performs projection display on the panoramic image;
in response to receiving the panoramic mode instruction, performing panoramic stitching on the images acquired by the at least two sub-cameras, and before obtaining a panoramic image, the method further includes:
controlling the at least two sub-cameras to respectively acquire images;
respectively storing the images collected by the sub-cameras;
the terminal also sends a common mode instruction to the panoramic camera;
the panoramic camera responds to the received common mode instruction, and determines a target image in the images acquired by the at least two sub-cameras;
the panoramic camera outputs the target image to a projector;
wherein, determining a target image in the images collected by the at least two sub-cameras comprises:
acquiring target camera indication information carried in the common mode instruction;
determining the camera indicated by the target camera indication information as the target camera;
and determining the image acquired by the target camera as the target image.
10. A panoramic projection system, comprising:
the terminal is used for sending a panoramic mode instruction to the panoramic camera head;
the panoramic camera comprises at least two sub-cameras and is used for responding to the received panoramic mode instruction, carrying out panoramic stitching on the images collected by the at least two sub-cameras to obtain a panoramic image and outputting the panoramic image to the projector;
the projector is used for receiving the panoramic image and projecting and displaying the panoramic image;
in response to receiving the panoramic mode instruction, performing panoramic stitching on the images acquired by the at least two sub-cameras, and before obtaining a panoramic image, the method further includes:
controlling the at least two sub-cameras to respectively acquire images;
respectively storing the images collected by the sub-cameras;
the terminal also sends a common mode instruction to the panoramic camera;
the panoramic camera responds to the received common mode instruction, and determines a target image in the images acquired by the at least two sub-cameras;
the panoramic camera outputs the target image to a projector;
wherein, determining a target image in the images collected by the at least two sub-cameras comprises:
acquiring target camera indication information carried in the common mode instruction;
determining the camera indicated by the target camera indication information as the target camera;
and determining the image acquired by the target camera as the target image.
11. A panoramic projection method, implemented in a panoramic projection system including a panoramic camera and a projector, the panoramic camera including at least two sub-cameras, the panoramic projection method comprising:
the panoramic camera responds to the received panoramic mode instruction, and carries out panoramic stitching on the images collected by the at least two sub-cameras to obtain a panoramic image;
the panoramic camera outputs the panoramic image to a projector;
the projector performs projection display on the panoramic image;
in response to receiving the panoramic mode instruction, performing panoramic stitching on the images acquired by the at least two sub-cameras, and before obtaining a panoramic image, the method further comprises:
controlling the at least two sub-cameras to respectively acquire images;
respectively storing the images collected by the sub-cameras;
after the projector performs projection display on the panoramic image, the method further comprises the following steps:
the panoramic camera responds to the received common mode instruction, and determines a target image in the images acquired by the at least two sub-cameras;
the panoramic camera outputs the target image to a projector;
wherein, determining a target image in the images collected by the at least two sub-cameras comprises:
acquiring target camera indication information carried in the common mode instruction;
determining the camera indicated by the target camera indication information as the target camera;
and determining the image acquired by the target camera as the target image.
12. A panoramic projection system, comprising:
the panoramic camera comprises at least two sub cameras and is used for responding to a received panoramic mode instruction, carrying out panoramic stitching on images collected by the at least two sub cameras to obtain a panoramic image and outputting the panoramic image to the projector;
the projector is used for receiving the panoramic image and projecting and displaying the panoramic image;
in response to receiving the panoramic mode instruction, performing panoramic stitching on the images acquired by the at least two sub-cameras, and before obtaining a panoramic image, the method further includes:
controlling the at least two sub-cameras to respectively acquire images;
respectively storing the images collected by the sub-cameras;
the panoramic camera is also used for responding to a received common mode instruction, determining a target image in the images collected by the at least two sub-cameras and outputting the target image to the projector;
wherein, determining a target image in the images collected by the at least two sub-cameras comprises:
acquiring target camera indication information carried in the common mode instruction;
determining the camera indicated by the target camera indication information as the target camera;
and determining the image acquired by the target camera as the target image.
13. A computer-readable storage medium, comprising: computer program for performing an image processing method according to any of claims 1-7 when said computer program is run.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810465509.1ACN108668060B (en) | 2018-05-16 | 2018-05-16 | Image processing method, panoramic camera, panoramic projection method, panoramic projection system and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810465509.1ACN108668060B (en) | 2018-05-16 | 2018-05-16 | Image processing method, panoramic camera, panoramic projection method, panoramic projection system and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108668060A CN108668060A (en) | 2018-10-16 |
| CN108668060Btrue CN108668060B (en) | 2020-12-04 |
Family
ID=63779536
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810465509.1AExpired - Fee RelatedCN108668060B (en) | 2018-05-16 | 2018-05-16 | Image processing method, panoramic camera, panoramic projection method, panoramic projection system and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108668060B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106066701A (en)* | 2016-07-05 | 2016-11-02 | 成都福兰特电子技术股份有限公司 | A kind of AR and VR data handling equipment and method |
| CN106210547A (en)* | 2016-09-05 | 2016-12-07 | 广东欧珀移动通信有限公司 | Method, device and system for panoramic shooting |
| CN106453696A (en)* | 2016-08-15 | 2017-02-22 | 李文松 | VR mobile phone, VR video system based on VR mobile phone and AR application thereof |
| CN107734244A (en)* | 2016-08-10 | 2018-02-23 | 深圳看到科技有限公司 | Panorama movie playback method and playing device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10536633B2 (en)* | 2015-02-06 | 2020-01-14 | Panasonic Intellectual Property Management Co., Ltd. | Image processing device, imaging system and imaging apparatus including the same, and image processing method |
- 2018
- 2018-05-16CNCN201810465509.1Apatent/CN108668060B/ennot_activeExpired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106066701A (en)* | 2016-07-05 | 2016-11-02 | 成都福兰特电子技术股份有限公司 | A kind of AR and VR data handling equipment and method |
| CN107734244A (en)* | 2016-08-10 | 2018-02-23 | 深圳看到科技有限公司 | Panorama movie playback method and playing device |
| CN106453696A (en)* | 2016-08-15 | 2017-02-22 | 李文松 | VR mobile phone, VR video system based on VR mobile phone and AR application thereof |
| CN106210547A (en)* | 2016-09-05 | 2016-12-07 | 广东欧珀移动通信有限公司 | Method, device and system for panoramic shooting |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108668060A (en) | 2018-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11747893B2 (en) | Visual communications methods, systems and software | |
| CN109064545B (en) | Method and device for data acquisition and model generation of house | |
| CN111914819B (en) | A method, device, storage medium and terminal for crowd density prediction based on multi-camera fusion | |
| EP2866088B1 (en) | Information processing apparatus and method | |
| CN105554372B (en) | Shooting method and device | |
| CN108259810A (en) | A kind of method of video calling, equipment and computer storage media | |
| CN109032039A (en) | A kind of method and device of voice control | |
| CN114140528A (en) | Data annotation method and device, computer equipment and storage medium | |
| CN112995491B (en) | Video generation method and device, electronic equipment and computer storage medium | |
| CN109640070A (en) | A kind of stereo display method, device, equipment and storage medium | |
| EP3062506B1 (en) | Image switching method and apparatus | |
| JP2011217202A (en) | Image capturing apparatus | |
| CN110286906B (en) | User interface display method and device, storage medium and mobile terminal | |
| CN108702482A (en) | Information processing equipment, information processing system, information processing method and program | |
| CN108961424B (en) | Virtual information processing method, device and storage medium | |
| US20190138803A1 (en) | Image processing apparatus, image processing system, and image processing method, and program | |
| WO2015072091A1 (en) | Image processing device, image processing method, and program storage medium | |
| US20160381322A1 (en) | Method, Synthesizing Device, and System for Implementing Video Conference | |
| CN112328150B (en) | Automatic screenshot method, device and equipment, and storage medium | |
| EP3673464A1 (en) | Visual communications methods, systems and software | |
| CN108668060B (en) | Image processing method, panoramic camera, panoramic projection method, panoramic projection system and computer-readable storage medium | |
| JP2020101897A (en) | Information processing apparatus, information processing method and program | |
| KR101700651B1 (en) | Apparatus for tracking object using common route date based on position information | |
| CN109688381B (en) | VR monitoring method, device, equipment and storage medium | |
| CN113784189B (en) | Round table video conference generation method and device, medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | Address after:100094 9 / F, 10 / F, building 1, zone 1, 81 Beiqing Road, Haidian District, Beijing Patentee after:Beijing baicaibang Technology Co.,Ltd. Address before:100085 Beijing Haidian District city information industry base development road 1, 3 tier 3001 Patentee before:Beijing Bai Caibang Technology Co.,Ltd. | |
| CP03 | Change of name, title or address | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20201204 | |
| CF01 | Termination of patent right due to non-payment of annual fee |