US20140226952A1 - Method and system for split-screen video display - Google Patents

Abstract

A system includes a first camera operable to capture omnidirectional images and send omnidirectional-image data representing the omnidirectional images, a second camera operable to capture narrow-view images and send narrow-view-image data representing the narrow-view images, a video processor coupled to the first camera and the second camera and operable to form combined-image data using at least part of the omnidirectional-image data and the narrow-view-image data, and a display module interoperably coupled to the video processor and operable to display combined images from the combined-image data. The combined images each comprise a narrow-view-display portion and an omnidirectional-display portion.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
• This application is a continuation of U.S. patent application Ser. No. 13/109,557, filed on May 17, 2011. U.S. patent application Ser. No. 13/109,557 claims priority from U.S. Provisional Patent Application No. 61/345,663, filed May 18, 2010, entitled METHOD AND SYSTEM FOR SPLIT-SCREEN VIDEO DISPLAY. U.S. patent application Ser. No. 13/109,557 and U.S. Provisional Patent Application No. 61/345,663 are incorporated herein by reference. In addition, this patent application incorporates by reference U.S. patent application Ser. No. 12/362,381 filed Jan. 29, 2009, entitled OMNIDIRECTIONAL CAMERA FOR USE IN POLICE CAR EVENT RECORDING and U.S. patent application Ser. No. 12/188,273 filed Aug. 8, 2008, entitled COMBINED WIDE-ANGLE/ZOOM CAMERA FOR LICENSE-PLATE IDENTIFICATION.
BACKGROUND
• 1. Field of the Invention
• In general, this patent application relates to video-recording devices and more particularly, but not by way of limitation, to systems that include split-screen video displays for use with law-enforcement vehicles.
• 2. History of the Related Art
• Cameras and other video-recording devices have long been used to capture still images and video. In general, cameras include an enclosed hollow portion with an opening or aperture at one end to allow light to enter and a recording surface for capturing the light at another end. In addition, cameras often have a lens positioned in front of the aperture along an optical axis to gather incoming light and focus all or part of an image onto the recording surface.
• Use of dashboard cameras in police vehicles has been known for years and is an integral part of a police department's evidence-gathering capability. One limitation of conventional cameras is a limited field of vision. Fields of view vary from camera to camera but, in general, most cameras have a field of view that ranges from a few degrees to, at most, 180°.
• To overcome the limited field of view, surveillance cameras used for monitoring large areas are oftentimes mounted to mechanisms adapted to enable the camera to pan, tilt, and zoom in order to move objects into the camera's field of view. One type of camera, called an omnidirectional camera, has been used to monitor large areas without a need for mechanisms to enable pan, tilt, and zoom.
• Some omnidirectional cameras may be adapted to capture images from all directions (i.e., a full sphere). However, many omnidirectional cameras do not capture a full sphere of images, but rather capture 360 degrees of images along a single axis with the field of view being limited angularly above and below the axis. As referred to herein, an omnidirectional camera is a camera adapted to capture omnidirectional images. The omnidirectional camera is adapted to capture wide-angle images from a wide-angle field of view up to and including 360-degree images from a 360-degree field of view. An omnidirectional image may be a wide-angle image, for example, of 130-190° from a wide-angle field of view, for example, of 130-360°. In some cases, the omnidirectional camera may have a field of view ranging from on the order of 180°, 190°, 200°, 210°, 220°, 230°, 240°, 250°, 260°, 270°, 280°, 290°, 300°, 310°, 320°, 330°, 340°, 350°, or 360° and the omnidirectional images may be less than or equal to a omnidirectional-camera field of view.
• More recently, dual-lens devices have been developed that combine a narrow-view lens and an omnidirectional lens. These dual-lens devices typically allow recording of up to 360 degrees of images at a plurality of different resolutions. However, display of the output from such dual-lens devices in a way that eliminates unimportant portions of images remains problematic.
SUMMARY OF THE INVENTION
• A system includes a first camera operable to capture omnidirectional images and send omnidirectional-image data representing the omnidirectional images, a second camera operable to capture narrow-view images and send narrow-view-image data representing the narrow-view images, a video processor coupled to the first camera and the second camera and operable to form combined-image data using at least part of the omnidirectional-image data and the narrow-view-image data, and a display module interoperably coupled to the video processor and operable to display combined images from the combined-image data. The combined images each comprise a narrow-view-display portion and an omnidirectional-display portion.
• A method includes concurrently capturing omnidirectional images and narrow-view images, storing data representing the captured omnidirectional images as omnidirectional-image data, storing data representing the captured narrow-view images as narrow-view-image data, removing data representing an unimportant portion of the narrow-view images to create cropped narrow-view-image data, creating combined-image data using the cropped narrow-view-image data and at least part of the omnidirectional-image data, and displaying combined images from the combined-image data.
• A system includes an omnidirectional sensor operable to capture images and create therefrom image data, a video processor operable to create, from at least part of the image data, combined-image data includes narrow-view-image data and non-narrow-view-image data, and a display module interoperably coupled to the video processor and operable, using the combined-image data, to display combined images includes narrow-view images and non-narrow-view images. The displayed narrow-view images comprise an enlarged version of a portion of images represented by the image data.
• A method includes capturing omnidirectional images, enlarging a relevant area of the omnidirectional images via a video processor, the enlarging resulting in enlarged relevant-area images, downsampling and cropping the omnidirectional images via the video processor, the downsampling resulting in downsampled cropped omnidirectional images, combining the enlarged-relevant-area images and the downsampled cropped omnidirectional images into combined images via the video processor, and displaying the combined images via a display module.
BRIEF DESCRIPTION OF THE DRAWINGS
• For a more complete understanding of the present invention and for further objects and advantages thereof, reference may now be had to the following description taken in conjunction with the accompanying drawings in which:
• FIG. 1 is a block diagram of a dual-camera system;
• FIG. 2A is a side elevation view of an omnidirectional camera;
• FIG. 2B is a side elevation view of another omnidirectional camera;
• FIG. 3 is an illustrative field of view (FOV) of an omnidirectional camera;
• FIG. 4A is a top view of a dual-camera system;
• FIG. 4B is a top view of another dual-camera system;
• FIG. 4C is a top view of another dual-camera system;
• FIG. 5A is a detailed view of a combined image;
• FIG. 5B is a flow diagram illustrating a process for operation of the camera system ofFIG. 1;
• FIG. 6A is a block diagram of a single-camera system;
• FIG. 6B is a detailed view of an image captured by the camera system ofFIG. 6A;
• FIG. 6C is a detailed view of a modified image displayed by display module of the camera system shown inFIG. 6A; and
• FIG. 7 is a flow diagram illustrating a process for operation of the camera system ofFIG. 6A.
DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS OF THE INVENTION
• Various embodiments of the present invention will now be described more fully with reference to the accompanying drawings. The invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, the embodiments are provided so that this disclosure will be thorough and will fully convey the scope of the invention to those skilled in the art.
• FIG. 1 is a block diagram of a dual-camera system. InFIG. 1, a dual-camera system100 includes anomnidirectional camera10, a narrow-view camera12, avideo processor14, and adisplay module16. Theomnidirectional camera10 is coupled to thevideo processor14 by way of aconnection18. In a typical embodiment, theomnidirectional camera10 is a front-facing camera equipped with a fish-eye lens and has a field of view of at least 90 degrees. However, theomnidirectional camera10 can be any type of omnidirectional camera such as, for example, a conical mirror camera, and typically has a field of view of at least 180 degrees. Although the dual-camera system100 is depicted by way of example as including a singleomnidirectional camera10, a dual-camera system in accordance with principles of the invention can incorporate any number ofomnidirectional cameras10 arranged in any orientation such as, for example, a front-facing omnidirectional camera and a rear-facing omnidirectional camera. The narrow-view camera12 is coupled to thevideo processor14 by way of aconnection20.
• In a typical embodiment, the narrow-view camera12 has a field of view, for example, of approximately 10-50°; however, a camera that has any appropriate field of view may be used. Although theomnidirectional camera10 and the narrow-view camera12 are depicted by way of example as being connected to thevideo processor14 via theconnections18 and20, it is also contemplated that theomnidirectional camera10 and the narrow-view camera12 could be wirelessly connected to thevideo processor14.
• In a typical embodiment, theomnidirectional camera10 and the narrow-view camera12 are placed in close proximity to one another so that the points of view of theomnidirectional camera10 and of the narrow-view camera12 are at least approximately the same. Thevideo processor14 may be, for example, a stand-alone unit or contained within the same housing as one or both of the narrow-view camera12 and theomnidirectional camera10. Thevideo processor12 receives image data from both of the narrow-view camera12 and theomnidirectional camera10. Thedisplay module16 is coupled to thevideo processor14 by way of aconnection22. In a typical embodiment, thedisplay module16 includes a video display that simultaneously displays images captured by theomnidirectional camera10 and the narrow-view camera12 and processed by thevideo processor14. Although thedisplay module16 is depicted by way of example as being connected to thevideo processor14 via theconnection22, thedisplay module16 could be wirelessly connected to thevideo processor14.
• FIG. 2A is a side elevation view of a typical omnidirectional camera. InFIG. 2A, anomnidirectional camera10 includes asensor11 and alens13. In a typical embodiment, thelens13 is a fish-eye lens and has a field of view of approximately 180 degrees; however, lenses having different fields of view may be used. In addition, any lens adapted to focus omnidirectional images, such as, for example, a wide-angle lens, a super-wide-angle lens, a full-circle lens, a spherical mirror-type lens, a conical minor-type lens, or other lens or minor configuration capable of focusing omnidirectional images may be employed in place of thelens13. In a typical embodiment, theomnidirectional camera10 outputs image data to a display module or a video processor.
• FIG. 2B is a side elevation view of another omnidirectional camera. InFIG. 2B, anomnidirectional camera10′ includes asensor24 arranged relative to anexternal mirror26 and adome28, thedome28 being concave relative to thesensor24. Thedome28 and the minor26 in combination are adapted to allow light to pass therethrough. In some embodiments, thedome28 may be convex relative to thesensor24, thedome28 andmirror26 in combination being adapted to reflect light towards thesensor24. A resulting omnidirectional image captured by theomnidirectional camera10′ may be, for example, a 360-degree image of a scene surrounding theomnidirectional camera10′, wherein 360 degrees is relative to acenterline31 of thecamera24. In some embodiments, theomnidirectional camera10′ may be a high-definition camera such as, for example, a camera having a sensor adapted to capture images on the order of several Megapixels. Theomnidirectional camera10′ may be used interchangeably with theomnidirectional camera10 in various embodiments. In a typical embodiment, theomnidirectional cameral10′ output image data to a display module or a video processor.
• FIG. 3 is an illustrative field of view (FOV) of theomnidirectional camera10′. For descriptive purposes, a coordinate system has been superimposed about theomnidirectional camera10′. The coordinate system has anoptical axis30 shown running vertically along thecenterline31 of theomnidirectional camera10′ and ahorizontal axis32 perpendicular thereto and passing through the minor26.
• In general, the FOV of a camera is the area of a scene around the camera that can be captured by the camera. TheFOV34 of theomnidirectional camera10′ along thehorizontal axis32 is shown. TheFOV34 extends both above and below thehorizontal axis32. For example, in the embodiment shown, theFOV34 extends approximately 10 degrees above thehorizontal axis32 and approximately 45 degrees below thehorizontal axis32.
• In various embodiments, theFOV34 may extend more than or less than10 degrees above thehorizontal axis32 and/or may extend more than or less than45 degrees below thehorizontal axis32. AlthoughFIG. 3 shows theFOV34 along one axis, the full FOV of theomnidirectional camera10′ may include all 360 degrees of rotation about theoptical axis30. The entire panorama of theomnidirectional camera10′ would then be a 55°×360° FOV, where the 55 degrees represents the size of the angle relative to thehorizontal axis32. In typical embodiments, a FOV of theomnidirectional camera10 and theFOV34 of theomnidirectional camera10′ would be similar.
• FIG. 4A is a top view of the dual-camera system100 in an illustrative environment. During operation, theomnidirectional camera10 and the narrow-view camera12 are positioned, for example, on a dashboard of apolice vehicle36. In a typical embodiment, the narrow-view camera12 is oriented to capture images in front of thepolice vehicle36 as shown by a field ofview35 and output image data representing the captured images. Theomnidirectional camera10 is oriented to have a similar point of view as that of the narrow-view camera12. A field of view of theomnidirectional camera10 is illustrated byarrows40. Theomnidirectional camera10 captures images of objects in front of thepolice vehicle36 as well as objects on the sides of thepolice vehicle36 that are outside the field ofview35 of the narrow-view camera12.
• FIG. 4B is a top view of another dual-camera system in an illustrative environment. InFIG. 4B, asystem102 includes anomnidirectional camera10″ that has a field of view that is greater than the 180 degrees illustrated in thesystem100 ofFIG. 4A. The field of view of theomnidirectional camera10″ is illustrated byarrows40′. Similarly to thesystem100, the narrow-view camera12 and theomnidirectional camera10″ are placed in close proximity to each other such as, for example, on the dashboard of thepolice vehicle36. In a typical embodiment, the narrow-view camera12 is oriented to capture images in front of the police vehicle as shown by the field ofview35 and output image data representing the captured images.
• FIG. 4C is a top view of another dual-camera system in an illustrative environment. InFIG. 4C, asystem104 includes omnidirectional cameras10(1) and10(2). Those having skill in the art will recognize that the number of omnidirectional or narrow-view cameras in a given system need not be limited to any particular number and that a plurality of either type of camera as dictated by design considerations may be used. The omnidirectional camera10(1) is shown arranged in a front-facing orientation while the omnidirectional camera10(2) is shown arranged in a rear-facing orientation relative to thepolice vehicle36.
• A field of view of the front-facing omnidirectional camera10(1) is shown by thearrows40. A field of view of the rear-facing omnidirectional camera10(2) is shown byarrows40″. The inclusion of the rear-facing omnidirectional camera10(2) allows thesystem104 to obtain a full360 degrees of coverage. In similar fashion to thesystem100, the narrow-view camera12 and the omnidirectional camera10(1) are placed in close proximity to each other such as, for example, on the dashboard of thepolice vehicle36. In a typical embodiment, the narrow-view camera12 is oriented to capture images occurring directly in front of the police vehicle as shown by the field ofview35 and output image data representing the captured images. In some embodiments, a second narrow-view camera that is rear-facing may also be employed. Output of cameras facing different directions such as, for example the omnidirectional cameras10(1) and10(2), can be displayed simultaneously or sequentially in an automated fashion or responsive to user input.
• FIG. 5A is a detailed view of a combined image displayable via thedisplay module16. InFIG. 5A, a combinedimage42 includes a narrow-view portion44 and anomnidirectional portion46. In a typical embodiment, the narrow-view portion44 includes, for example, about 85% of the total viewable area of the combinedimage42. The narrow-view portion44 typically has a standard resolution of D1. The term D1 is commonly understood to represent a resolution of approximately 720×480. However, the narrow-view portion44 may have a high-definition resolution such as, for example, 720p or 1080i. The narrow-view portion44 typically includes at least part of an image captured by the narrow-view camera12. Theomnidirectional portion46 includes, for example, a lower 15% of the area of the combinedimage42; however, the size and positioning of theomnidirectional portion46 may be altered as needed for particular applications. Theomnidirectional portion46 typically includes at least part of an image captured by an omnidirectional camera such as, for example, theomnidirectional camera10.
• FIG. 5B is a flow diagram illustrating a process for operation of the camera system ofFIG. 1. Referring now toFIGS. 1,5A, and5B, aprocess500 begins atstep502. Atstep504, theomnidirectional camera10 and the narrow-view camera12 each capture images and create image data representing the captured images. Atstep506, the image data are transmitted to thevideo processor14.
• Atstep508, thevideo processor14 digitally unfolds and crops the image data received by thevideo processor14 from theomnidirectional camera10. Unfolding may be performed in an effort to minimize edge distortion caused by the use of, for example, a fish-eye lens. Cropping may be performed to remove undesired or unimportant image portions. In another option, analog unfolding may be accomplished through use of a special lens designed to correct edge distortion. In order to minimize unacceptable image resolution post-unfolding, theomnidirectional camera10 may capture images at a greater resolution than that of images captured by the narrow-view camera12. In some embodiments, one or both of unfolding and cropping of the output by theomnidirectional camera10 may not be performed.
• In a typical embodiment, step508 also includes cropping by the video processor of image data from the narrow-view camera12 that contain irrelevant or unimportant information such as, for example, data representing a hood of a police vehicle. Cropping of the image data from the narrow-view camera12 is performed so that irrelevant image portions are not displayed. In other words, a portion of a captured image that would otherwise be displayed and that often contains irrelevant image portions may be discarded and not displayed without loss of useful information.
• Atstep510, the video processor creates combinedimages42 and transmits data representing the combinedimages42 to thedisplay module16. The combinedimages42 are composed of narrow-view portions44 andomnidirectional portions44. Atstep512, the display module displays the combinedimages42. Theomnidirectional portions46 can be thought of as being displayed in place of a portion of images output from the narrow-view camera12 that are considered unimportant. In some embodiments, data representing the narrow-view portion44 and theomnidirectional portion46 are transmitted from thevideo processor14 to thedisplay module16 as separate data streams and are displayed by thedisplay module16 as separate images to form the combinedimage42, while in other embodiments, a single combined-image data stream is employed.
• FIG. 6A is a block diagram of a single-camera system. InFIG. 6A, a single-camera system200 includes thevideo processor14, thedisplay module16, and a sensor202. Thedisplay module16 is coupled to thevideo processor14 by way of theconnection22. The sensor202 is coupled to thevideo processor14 by way of theconnection18. The sensor202 may be any appropriate video sensor but is typically a 20-40 megapixel sensor. In a typical embodiment, the sensor202 has a field of view of approximately 180 degrees; however, fields of view up to and including 360 degrees may also be utilized.
• FIG. 6B is a detailed view of an image captured by a sensor such as the sensor202. InFIG. 6B, anomnidirectional image204 captured by the sensor202 includes arelevant area206 as well as portions of theomnidirectional image204 that are not within therelevant area206 as illustrated by a shadedarea208. In some embodiments, the shadedarea208 includes all or part of therelevant area206. In a typical embodiment, therelevant area206 may be, for example, the area directly in front of a police vehicle or areas including license plates.
• FIG. 6C is a detailed view of a modified image displayed by thedisplay module16 of the camera system200. InFIG. 6C, a modifiedimage42′ includes a narrow-view portion44′ and anomnidirectional portion46′. The narrow-view portion of44′ is an enlarged version of therelevant area206 and theomnidirectional portion46′ is a cropped version of the shadedarea208. In some embodiments, the croppedomnidirectional portion46′ is also downsampled.
• Referring now toFIGS. 6A-6C, during operation, the sensor202 captures theomnidirectional image204 at very high resolution such as, for example, 20-40 megapixels. Data representing theomnidirectional image204 is transmitted from the sensor202 to thevideo processor14 via theconnection18. Thevideo processor14 identifies and enlarges therelevant area206, the enlargement thereof resulting in the narrow-view portion44′. Thevideo processor14 also crops the shadedarea208, thereby forming a cropped version thereof (i.e., theomnidirectional portion46′). As noted above, in some embodiments, the shadedarea208 includes all or part of therelevant area206. Thedisplay module16 displays the narrow-view portion44′ and the cropped version of the shaded area208 (i.e., theomnidirectional portion46′). In this sense, the system200 creates data representing the narrow-view portion44′ via what is sometimes referred to as digital zoom.
• Thevideo processor14 also typically downsamples at least portions of data representing theomnidirectional image204 not within the relevant area206 (e.g., the shaded area208). In other embodiments, both data representing therelevant area206 and the shadedarea208 are downsampled. Downsampling reduces the amount of data needed to be displayed and, in some cases, transferred between components of the system200. The shadedarea208 need not necessarily include all of theomnidirectional image204 other than therelevant area206. Regardless of whether only the shadedarea208 or both the shadedarea208 and therelevant area206 are downsampled, one or both of therelevant area206 and the enlarged version of therelevant area206 may be retained so as to be available to be presented to and displayed by thedisplay module16. In another option, downsampling may be performed by the sensor202, thereby reducing the amount of data that must be transmitted from the sensor202 to thevideo processor14.
• Thevideo processor14 typically transmits data representing the combinedimage42′ to thedisplay module16 as a single data stream. As illustrated, the combinedimage42′ includes the narrow-view portion44′ and theomnidirectional portion46′. Thedisplay module16 displays at least part of theomnidirectional image204 or a downsampled version thereof in theomnidirectional portion46′ of thedisplay module16. In similar fashion, thedisplay module16 displays therelevant area206 or an enlarged version thereof in the narrow-view portion44′. In this way, more-relevant images are in some embodiments presented at a relatively higher resolution, while less relevant images are presented at a relatively lower resolution.
• In other embodiments, the combinedimage42′ is created by thedisplay module16 from a first video stream containing, for example, the enlarged version of therelevant area206 and a second video stream containing, for example, all or part of a downsampled version of theomnidirectional image204. In such embodiments, thevideo processor14 presents a first video stream to thedisplay module16 containing the enlarged version of therelevant area206. Thevideo processor14 also presents a second video stream containing all or part of the downsampled version of theomnidirectional portion204.
• FIG. 7 is a flow diagram illustrating a process of operation of the camera system200. InFIG. 7, aprocess700 starts atstep702. Fromstep702, execution proceeds to step704. Atstep704, the sensor202 captures an omnidirectional image and transmits the data representing the captured omnidirectional image to thevideo processor14. Fromstep704, execution proceeds to step706. Atstep706, thevideo processor14 identifies therelevant area206. Fromstep706, execution proceeds to step708. Atstep708, thevideo processor14 enlarges therelevant area206 to create an enlarged version thereof; however, in some embodiments,step708 may not be performed such that therelevant area206 is not enlarged. Fromstep708, execution proceeds to step710.
• Atstep710, thevideo processor14 optionally downsamples at least portions of theomnidirectional image204, such as those within the shadedarea208. Atstep711, the video processor creates a combinedimage42′ that includes the enlarged version of therelevant area206 and at least part of the downsampled portions of theomnidirectional image204 and presents the combinedimage42′ to thedisplay module16. In another option, the combinedimage42′ may be created by thedisplay module16 from a first video stream containing the enlarged version of therelevant area206 and a second video stream containing at least part of the downsampled portions of theomnidirectional image204.
• Atstep712, thedisplay module16 displays the combinedimage42′. In other words, thedisplay module16 displays the enlarged version of therelevant area206 in the narrow-view portion44′ and at least part of the downsampled portions of theomnidirectional image204 in theomnidirectional portion46′. The process ends atstep714. Various steps of theprocess700 may be performed concurrently or in a different order than described above without departing from principles of the invention.
• Although various embodiments of the method and apparatus of the present invention have been illustrated in the accompanying Drawings and described in the foregoing Detailed Description, it will be understood that the invention is not limited to the embodiments disclosed, but is capable of numerous rearrangements, modifications and substitutions without departing from the spirit of the invention as set forth herein. For example, although theomnidirectional camera10 and the narrow-view camera12 are described herein as separate units, a system could contain both theomnidirectional camera10 and the narrow-view camera12 in a single housing. Furthermore, components may have different functions from those described herein. In particular, functions described herein as being performed by thevideo processor14 may, in various embodiments, be performed by one or both of theomnidirectional camera10 or the narrow-view camera12. Thesystem100 and the system200 and the displayedimages42 and42′ are only examples of split-screen displayed images that could be created by various embodiments. It is intended that the specification and examples be considered as illustrative only. For example, either of thesystem100 or the system200 could be used to display either or both of the combinedimage42 or the combinedimage42′ or other configurations of combined images in accordance with principles of the invention. In addition, regardless of whether operations performed by thevideo processor14 are described as being performed on images or image data, it will be understood that the operations are digital operations performed on image data.

Claims (19)

1-16. (canceled)

17. A system comprising:

a first camera operable to capture omnidirectional images and send an omnidirectional-image data stream representing the omnidirectional images;

a second camera operable to capture narrow-view images and send a narrow-view-image data stream representing the narrow-view images;

a video processor coupled to the first camera and the second camera and operable to:

identify a relevant image portion of at least one of the omnidirectional-image data stream and the narrow-view-image data stream and remove image data that is not contained within the relevant image portion; and

replace the removed image data with a combined-image data stream, the combined-image data stream comprising other image data selected from one or more of the omnidirectional-image data stream and the narrow-view-image data stream;

a display module interoperably coupled to the video processor and operable to display combined images from the combined-image data stream; and

wherein the combined images each comprise a narrow-view-display portion and an omnidirectional-display portion.

18. The system ofclaim 17, wherein the removed image data comprises image data selected from the omnidirectional-image data.

19. The system ofclaim 17, wherein the removed image data comprises image data selected from the narrow-view-image data.

20. The system ofclaim 17, wherein the omnidirectional-display portion is displayed in place of a portion of the narrow-view images.

21. The system ofclaim 17, wherein the narrow-view images are captured at a greater resolution than the omnidirectional images.

22. A method comprising:

concurrently capturing omnidirectional images and narrow-view images;

storing data representing the captured omnidirectional images as omnidirectional-image data;

storing data representing the captured narrow-view images as narrow-view-image data;

identifying, by a video processor, a relevant image portion in the narrow-view-image data;

removing from the narrow-view-image data, by the video processor, image data that is not contained within the relevant image portion, the removing yielding modified narrow-view-image data;

replacing the removed image data with combined-image data, the combined image data comprising image data selected from the omnidirectional-image data; and

displaying combined images from the combined-image data.

23. The method ofclaim 22, wherein the combined-image data is created by the video processor using the modified narrow-view-image data and at least part of the omnidirectional-image data.

24. The method ofclaim 22, wherein the omnidirectional images are captured at a greater resolution than the narrow-view images.

25. The method ofclaim 22, wherein:

the removed image data comprises image data selected from the narrow-view-image data; and

at least a portion of the omnidirectional images are displayed in place of the removed image data.

26. The method ofclaim 22, wherein the removed image data comprises image data selected from the omnidirectional-image data.

27. The method ofclaim 22, wherein the storing steps are performed concurrently.

28. A method comprising:

capturing omnidirectional images;

identifying, via a processor, one or more relevant areas of the omnidirectional images;

enlarging at least one relevant area of the one or more relevant areas;

downsampling and modifying the omnidirectional images via the video processor, the downsampling resulting in downsampled modified omnidirectional images;

wherein the modifying comprises removing, from the omnidirectional images, image data that is not contained within the one or more relevant areas;

combining, via the video processor, images corresponding to the enlarged at least one relevant area and the downsampled modified omnidirectional images into combined images; and

displaying, via a display, module the combined images.

29. The method ofclaim 28, wherein the displaying comprises displaying the images corresponding to the enlarged at least one relevant area at a higher resolution than the downsampled cropped omnidirectional images.

30. The method ofclaim 28, comprising digitally unfolding the omnidirectional images via the video processor.

31. A computer-program product comprising a non-transitory computer-usable medium having computer-readable program code embodied therein, the computer-readable program code adapted to be executed to implement a method comprising:

concurrently capturing omnidirectional images and narrow-view images;

storing data representing the captured omnidirectional images as omnidirectional-image data;

storing data representing the captured narrow-view images as narrow-view-image data;

identifying, by a video processor, a relevant image portion in the narrow-view-image data;

removing from the narrow-view-image data, by the video processor, image data that is not contained within the relevant image portion, the removing yielding modified narrow-view-image data;

replacing the removed image data with combined-image data, the combined image data comprising image data selected from the omnidirectional-image data; and

displaying combined images from the combined-image data.

32. The computer-program product ofclaim 31, wherein the removed image data comprises image data selected from the omnidirectional-image data.

33. The computer-program product ofclaim 31, wherein the removed image data comprises image data selected from the narrow-view-image data.

34. The computer-program product ofclaim 31, wherein the narrow-view images are captured at a greater resolution than the omnidirectional images.

Images