Disclosure of Invention
The invention provides a method for configuring a fisheye lens camera and an electronic device using the same, which can switch the shooting mode of the fisheye lens camera to make the output image more beautiful.
The invention provides an electronic device which comprises a shell, a fisheye lens camera and a processor. The fisheye lens camera is arranged on the shell. The processor is coupled to the fisheye lens camera, wherein the processor determines that the fisheye lens camera corresponds to at least one mode, and cuts an output image from a field of view of the fisheye lens camera according to the at least one mode.
In an embodiment of the invention, the at least one mode corresponds to one of the following: user-oriented mode and world-oriented mode.
In an embodiment of the invention, the processor positions a center of the cropping range of the output image on a central axis of the fisheye lens camera in response to the at least one mode corresponding to the world-oriented mode.
In an embodiment of the invention, the processor positions the cropping range of the output image between a central axis of the fisheye lens camera and a boundary of the field of view in response to the at least one mode corresponding to the user-facing mode.
In an embodiment of the invention, the at least one mode corresponds to one of the following: vertical mode and horizontal mode.
In an embodiment of the invention, the fisheye lens camera is disposed in the groove of the housing.
In an embodiment of the invention, the fisheye lens camera is obliquely disposed in the groove of the housing, and an included angle between a central axis of the fisheye lens camera and a surface of the housing is between 0 degree and 90 degrees.
In an embodiment of the invention, the housing includes an adjustable rotating member, wherein the fisheye lens camera is disposed on the adjustable rotating member, and an included angle between a central axis of the fisheye lens camera and a surface of the housing is between 0 degree and 90 degrees.
In an embodiment of the invention, the electronic device is one of a notebook computer and a two-in-one computer (2-in-1laptop), and the housing corresponds to the keyboard side.
The invention discloses a method for configuring a fisheye lens camera, which comprises the following steps: arranging a fisheye lens camera on a shell of the electronic device; judging that the fisheye lens camera corresponds to at least one mode; and cutting an output image from the visual field of the fisheye lens camera according to at least one mode.
Based on the above, the present invention can switch the shooting mode of the fisheye lens camera based on different situations, so that the shooting target can be shot at the best angle.
Drawings
The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.
FIGS. 1A and 1B are schematic diagrams illustrating a conventional lens camera capturing an object in different situations;
FIG. 2A shows a schematic view of an electronic device according to an embodiment of the invention;
FIG. 2B illustrates a schematic diagram of one embodiment of an electronic device, in accordance with the present invention;
FIG. 3A shows a schematic view of a fisheye lens camera horizontally disposed in a recess, in accordance with an embodiment of the invention;
FIG. 3B shows a schematic diagram of a fisheye lens camera obliquely arranged in a groove, according to an embodiment of the invention;
FIG. 4 illustrates a flow diagram of a method of configuring a fisheye lens camera, in accordance with an embodiment of the invention;
FIG. 5 shows a detailed flow chart of the steps of a method of configuring a fisheye lens camera according to an embodiment of the invention;
FIGS. 6A and 6B are schematic diagrams illustrating capturing an object with a fisheye lens camera in different contexts according to embodiments of the invention;
FIG. 7A shows a view map and a captured image corresponding to a world-oriented mode, in accordance with an embodiment of the present invention;
FIG. 7B shows a schematic view of a field of view map and a captured image corresponding to a user-oriented mode, according to an embodiment of the invention;
FIG. 7C shows a view diagram and a captured image corresponding to a user-oriented mode, in accordance with another embodiment of the present invention;
FIG. 7D shows a view map and a captured image corresponding to a tilted fisheye lens camera and a user-oriented mode, in accordance with an embodiment of the invention;
FIG. 7E shows a view map and a captured image corresponding to a tilted fisheye lens camera and a world-oriented mode, in accordance with an embodiment of the invention;
fig. 8 is a schematic diagram showing a photographed image corresponding to a horizontal mode and a photographed image corresponding to a vertical mode, respectively, according to an embodiment of the present invention;
fig. 9 illustrates a flowchart of a method of configuring a fisheye lens camera, according to another embodiment of the invention.
Description of the reference numerals
1: a conventional lens camera;
10: an electronic device;
110: a processor;
120: a storage medium;
130: a fisheye lens camera;
131: a central axis of the fisheye lens camera;
140: a housing;
141. 142: a groove;
150: an upper cover;
151: a display;
2: the direction of the field of view;
3: a notebook computer;
4: a user;
5: a target object;
70: a visual field map and a part of the captured image;
710. 730, 750, 770, 790: a field of view map;
711. 712, 731, 732, 751, 752, 771, 772, 791, 792, 811, 812, 821, 822: outputting a cropping range of the image;
720. 740, 760, 780, 800, 810, 820: shooting an image;
s410, S420, S421, S422, S423, S430, S440, S910, S920, S930: a step of;
θ: and (4) an included angle.
Detailed Description
Reference will now be made in detail to exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings and the description to refer to the same or like parts.
Since the field of view of a conventional lens camera is narrow, a user generally needs to configure a fixed field of view direction for the camera according to a use situation. Fig. 1A and 1B are schematic diagrams illustrating a conventional lens camera 1 capturing an object in different situations. Referring to fig. 1A, a conventional lens camera 1 is provided at a lower cover of anotebook computer 3, and the conventional lens camera 1 is defaulted to be used for photographing a user. In other words, the conventional lens camera 1 is configured in a user facing mode, which may also be referred to as a "self-timer mode" or a "front lens mode". Accordingly, when thenotebook computer 3 is placed on a desk, thedirection 2 of the field of view of the conventional lens camera 1 may be just toward theuser 4 seated at thenotebook computer 3, so that the conventional lens camera 1 can acquire a complete image of theuser 4. However, when theuser 4 lifts thenotebook computer 3 to photograph other target objects 5 (e.g., people around theuser 4, buildings, etc.), since thedirection 2 of the field of view of the conventional lens camera 1 is fixed, it is difficult for theuser 4 to orient thedirection 2 of the field of view of the conventional lens camera 1 toward the target objects 5 by operating thenotebook computer 3, as shown in FIG. 1B.
In order to enable the camera to shoot at the best angle in different situations, the invention provides a technology based on a fisheye lens camera, which can shoot in different situations by utilizing the characteristic of the fisheye lens camera with a wide field of view.
FIG. 2A shows a schematic diagram of theelectronic device 10, according to an embodiment of the invention. Theelectronic device 10 may include aprocessor 110, astorage medium 120, afisheye lens camera 130, and ahousing 140. Theelectronic device 10 is, for example, a notebook computer, a tablet computer or a two-in-one computer, but the invention is not limited thereto.
Theprocessor 110 is, for example, a Graphics Processing Unit (GPU), a video signal processor (ISP), an Image Processing Unit (IPU), a Central Processing Unit (CPU), or other programmable general purpose or special purpose Micro Control Unit (MCU), a microprocessor (microprocessor), a Digital Signal Processor (DSP), a programmable controller, an Application Specific Integrated Circuit (ASIC), an Arithmetic Logic Unit (ALU), a Complex Programmable Logic Device (CPLD), a field programmable logic device (FPGA), or other similar components.Processor 110 may be coupled tostorage medium 120 andfisheye lens camera 130 and access and execute a plurality of modules and various applications stored instorage medium 120.
Thestorage medium 120 is, for example, any type of fixed or removable Random Access Memory (RAM), read-only memory (ROM), flash memory (flash memory), hard disk (HDD), Solid State Drive (SSD), or the like or a combination thereof, and is used to store a plurality of modules or various applications executable by theprocessor 110.
Thefisheye lens camera 130 has a wider field of view than the conventional lens camera 1. For example, the field of view offisheye lens camera 130 may be between 135 degrees to 180 degrees.
In an embodiment, theprocessor 110 and thestorage medium 120 may be disposed within thehousing 140, and thefisheye lens camera 130 may be disposed on a surface of thehousing 140. Thehousing 140 is, for example, a lower cover (i.e., keyboard side) of a notebook computer or a two-in-one computer, or a housing of a tablet computer.
FIG. 2B illustrates a schematic diagram of one implementation of theelectronic device 10, according to an embodiment of the invention. In the present embodiment, theelectronic device 10 is a notebook computer (or a two-in-one computer). Theelectronic device 10 may include alower cover 140 and anupper cover 150. Thedisplay 151 may be provided at theupper cover 150. The processor 110 (and/or the storage medium 120) may be disposed in a housing of thelower cover 140, and the fisheye lens camera 130 (or a keyboard, touch pad, or the like) may be disposed on a surface of thelower cover 140.
The arrangement of thefisheye lens camera 130 may include various embodiments. Fig. 3A shows a schematic diagram of afisheye lens camera 130 disposed horizontally in arecess 141, according to an embodiment of the invention. Thegroove 141 is located on the surface of thehousing 140. Thegroove 141 prevents thefisheye lens camera 130 from being damaged. Taking fig. 2B as an example, thefisheye lens camera 130 is disposed in therecess 141 of thehousing 140 to prevent theupper cover 150 of the electronic device 10 (i.e., the notebook computer) from being pressed to hurt thefisheye lens camera 130 when being closed.
Fig. 3B shows a schematic diagram offisheye lens camera 130 obliquely disposed inrecess 142, in accordance with an embodiment of the invention. As shown in fig. 3B, thefisheye lens camera 130 may be obliquely disposed in agroove 142 on the surface of thehousing 140 such that thecentral axis 131 of thefisheye lens camera 130 forms an angle θ with the surface of thehousing 140. In the embodiment, the included angle θ may be 45 degrees, but the invention is not limited thereto. For example, the included angle θ may be between 0 degrees to 90 degrees. In one embodiment, an adjustable rotating member can be disposed in a recess (e.g., recess 142) of thehousing 140. Thefisheye lens camera 130 may be disposed on the adjustable rotating member. The user can operate the adjustable rotating member as required, so as to change an included angle θ between thecentral axis 131 of thelens camera 120 and thehousing 140, wherein the included angle θ can be adjusted to be between 0 degree and 90 degrees.
In this embodiment, theprocessor 110 may automatically adjust the direction of the field of view of thefisheye lens camera 130, so that thefisheye lens camera 130 may be suitable for different situations. Fig. 4 shows a flowchart of a method of configuring thefisheye lens camera 130, which may be implemented by theelectronic device 10 shown in fig. 2A, according to an embodiment of the invention.
In step S410, theprocessor 110 may acquire an image through thefisheye lens camera 130. In step S420, theprocessor 110 may determine a mode corresponding to the fisheye lens camera 130 (or a mode corresponding to an Operating System (OS) of the electronic device 10). The mode corresponding to thefisheye lens camera 130 may include, for example, a user facing mode or a world facing (world facing) mode, but the present invention is not limited thereto. In an embodiment, the mode corresponding to the fisheye lens camera 130 (or the operating system of the electronic device 10) may include, for example, a notebook mode (notebook mode) or a tablet mode (tablet mode), but the invention is not limited thereto. The notebook mode may, for example, correspond to a user-oriented mode, and the tablet mode may, for example, correspond to a world-oriented mode.
In an embodiment, theprocessor 110 may periodically determine the mode corresponding to thefisheye lens camera 130. Fig. 5 illustrates a detailed flowchart of step S420 of the method of configuring thefisheye lens camera 130 according to an embodiment of the invention. In step S421, theprocessor 110 may determine a mode corresponding to thefisheye lens camera 130. For example, theprocessor 110 may determine that the currentfisheye lens camera 130 corresponds to one of a user-oriented mode and a world-oriented mode.
In step S422, theprocessor 110 may determine whether an event occurs that can change the mode. For example, theprocessor 110 may determine whether a user of theelectronic device 10 sends an instruction to theprocessor 110 through an input device (e.g., a touch screen, a touch pad, a keyboard, or a mouse) coupled to theprocessor 110, so as to switch the mode corresponding to thefisheye lens camera 130. For another example, if theelectronic device 10 is a notebook computer as shown in fig. 2B, theprocessor 110 may determine whether the user of theelectronic device 10 switches the mode corresponding to thefisheye lens camera 130 by folding thetop cover 150 of theelectronic device 10. Specifically, theprocessor 110 may switch the mode corresponding to thefisheye lens camera 130 to the notebook computer mode or the tablet computer mode according to the folded state of theupper cover 150.
If theprocessor 110 determines that the event with the changeable mode has occurred, step S421 is entered, and theprocessor 110 determines the mode corresponding to thefisheye lens camera 130 again. If theprocessor 110 determines that the mode-changeable event has not occurred, the process proceeds to step S423. In step S423, theprocessor 110 waits for a default period of time.
Returning to fig. 4, in step S430, theprocessor 110 may cut the output image from the field of view of thefisheye lens camera 130 according to the mode corresponding to thefisheye lens camera 130, wherein theprocessor 110 may determine the cutting range of the output image according to, for example, an image mapping algorithm or a cutting algorithm. In an embodiment, theprocessor 110 may pre-process the image captured by thefisheye lens camera 130 to speed up the operation time of step S430.
Fig. 6A and 6B are schematic diagrams illustrating the photographing of an object with thefisheye lens camera 130 in different situations according to an embodiment of the invention. In this embodiment, when thefisheye lens camera 130 corresponds to the user-oriented mode (as shown in fig. 6A), theprocessor 110 may crop the image captured by thefisheye lens camera 130 so that the output image may be correctly captured to the image of theuser 4. On the other hand, when thefisheye lens camera 130 corresponds to the world-oriented mode (as shown in fig. 6B), theprocessor 110 may crop an image captured by thefisheye lens camera 130 so that the output image may correctly acquire the image of thetarget object 5.
Specifically,processor 110 may position the center of the cropping range of the output image offisheye lens camera 130 on the central axis offisheye lens camera 130 in response tofisheye lens camera 130 corresponding to the world-facing mode, as shown in fig. 7A. Fig. 7A shows schematic diagrams corresponding to a field of view diagram 710 and a capturedimage 720 for a world-oriented mode, where fig. 7A corresponds to afisheye lens camera 130 with a 180 degree field of view, and the centers of a plurality of concentric circles in the field of view diagram 710 (and field of view diagrams 730, 750, 770, and 790) correspond to the central axis of thefisheye lens camera 130, according to an embodiment of the invention. Theprocessor 110 may adjust the cropping range of the output image according to the usage requirements. For example, thetrimming range 711 of the output image corresponds to a field of view of 45 degrees, and thetrimming range 712 of the output image corresponds to a field of view of 60 degrees. Whenfisheye lens camera 130 corresponds to the world-facing mode,processor 110 may position croppingrange 711 of the output image or the center ofcropping range 712 of the output image on the central axis offisheye lens camera 130, as shown inview 710.
On the other hand,processor 110 may position the cropping range of the output image offisheye lens camera 130 between the central axis offisheye lens camera 130 and the boundary of the field of view offisheye lens camera 130 in response tofisheye lens camera 130 corresponding to the user-facing mode, as shown in fig. 7B. Fig. 7B shows schematic diagrams corresponding to a field ofview 730 and a capturedimage 740 for a user-oriented mode according to an embodiment of the present invention, where fig. 7B corresponds to afisheye lens camera 130 with a 180 degree field of view, acropping range 731 of the output image corresponds to a 45 degree field of view, and acropping range 732 of the output image corresponds to a 60 degree field of view. Referring to the view field diagram 730, in the present embodiment, a circle at the outermost side of the view field diagram 730 (i.e., a circle representing 90 degrees) is defined as a boundary of the view field of thefisheye lens camera 130. In other words, the boundary of the field of view of thefisheye lens camera 130 with 180 degree field of view is 90 degrees.
To reduce the number of pixels (pixel count) or increase the pixel density (pixel density) of the output image, afisheye lens camera 130 with a narrower field of view may be employed. However, too narrow a field of view (e.g., less than 180 degrees) offisheye lens camera 130 may result in portions of the image that should be output not being cropped to an output image, as shown in FIG. 7C. Fig. 7C shows a schematic diagram of a field of view diagram 750 and a capturedimage 760 corresponding to a user-facing mode according to another embodiment of the present invention, wherein fig. 7C corresponds to afisheye lens camera 130 with a 135 degree field of view. In the present embodiment, the ideal output image should be the trimming range 751 of the output image corresponding to the 45 degree visual field range or the trimming range 752 of the output image corresponding to the 60 degree visual field range. However, since the field of view of thefisheye lens camera 130 is too narrow, the field ofview image 750 and theportion 70 of the captured image 760 (i.e., the portion 67.5 to 90 degrees of the field of view of the fisheye lens camera 130) cannot be captured by thefisheye lens camera 130, and thus the output image cannot be obtained completely to capture the person to be captured.
Accordingly, in one embodiment, thefisheye lens camera 130 may be obliquely disposed on thehousing 140 of the electronic device 10 (as shown in fig. 3B) to change the area of the image captured by thefisheye lens camera 130 by adjusting the direction of thecentral axis 131 of thefisheye lens camera 130. It is noted that the field of view offisheye lens camera 130 must be greater than or equal to 180-theta.
Fig. 7D shows a schematic diagram of field of view diagram 770 and capturedimage 780 corresponding to a tiltedfisheye lens camera 130 and a user-oriented mode, where fig. 7D corresponds tofisheye lens camera 130 with a 135 degree field of view, croppedrange 771 of the output image corresponds to a 45 degree field of view range, and croppedrange 772 of the output image corresponds to a 60 degree field of view range, according to an embodiment of the invention. On the other hand, fig. 7E shows a schematic diagram of a field ofview 790 and a capturedimage 800 corresponding to a tiltedfisheye lens camera 130 and a world-facing mode, where fig. 7E corresponds to afisheye lens camera 130 with a 135 degree field of view, a cropping range 791 of the output image corresponds to a 45 degree field of view, and a cropping range 792 of the output image corresponds to a 60 degree field of view, according to an embodiment of the invention. As shown in fig. 7D, thecentral axis 131 of the tiltedfisheye lens camera 130 is shifted from its original position, so that thecropping range 771 of the output image or thecropping range 772 of the output image can completely crop the person to be photographed.
Returning to fig. 4, in step S440, theprocessor 110 may output a cropped output image.
In addition to thefisheye lens camera 130 corresponding to the user-oriented mode or the world-oriented mode, in an embodiment, the mode corresponding to the fisheye lens camera 130 (or the mode corresponding to the operating system of the electronic device 10) may further include, for example, a vertical mode (right mode) or a horizontal mode (horizontal mode). Specifically,processor 110 may crop a horizontal output image from the field of view offisheye lens camera 130 in response tofisheye lens camera 130 corresponding to a horizontal mode, and crop a vertical output image from the field of view offisheye lens camera 130 in response tofisheye lens camera 130 corresponding to a vertical mode. Fig. 8 shows schematic diagrams of a photographedimage 810 corresponding to a horizontal mode and a photographedimage 820 corresponding to a vertical mode, respectively, according to an embodiment of the present invention, in which fig. 8 corresponds to thefisheye lens camera 130 having a 180 degree field of view, acropping range 811 of a horizontal output image corresponds to a 45 degree field of view, acropping range 812 of a horizontal output image corresponds to a 60 degree field of view, avertical output image 821 corresponds to a 45 degree field of view, and avertical output image 822 corresponds to a 60 degree field of view.
In one embodiment, thefisheye lens camera 130 may correspond to one of a user-facing mode and a world-facing mode, and to one of a vertical mode and a horizontal mode.
Fig. 9 shows a flowchart of a method of configuring thefisheye lens camera 130 according to another embodiment of the invention, wherein the method may be implemented by theelectronic device 10 as shown in fig. 2A. In step S910, thefisheye lens camera 130 is disposed on thehousing 140 of theelectronic device 10. In step S920, it is determined that thefisheye lens camera 130 corresponds to at least one mode. In step S930, an output image is cut out from the field of view of thefisheye lens camera 130 according to at least one mode.
In summary, the present invention can adjust the direction of the field of view of the fisheye lens camera according to the mode corresponding to the fisheye lens camera. When the fisheye lens camera corresponds to the world-facing mode, the center of the cropped output image will be positioned at the center axis of the fisheye lens camera. On the other hand, when the fisheye lens camera corresponds to the user-facing mode, the output image will be positioned off the central axis. In other words, the present invention can switch the shooting mode of the fisheye lens camera based on different situations, so that the shooting target can be shot at the best angle.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.