Movatterモバイル変換


[0]ホーム

URL:


USRE42898E1 - Electronic zoom image input method - Google Patents

Electronic zoom image input method
Download PDF

Info

Publication number
USRE42898E1
USRE42898E1US11/728,982US72898297AUSRE42898EUS RE42898 E1USRE42898 E1US RE42898E1US 72898297 AUS72898297 AUS 72898297AUS RE42898 EUSRE42898 EUS RE42898E
Authority
US
United States
Prior art keywords
image
input image
compression
optical system
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US11/728,982
Inventor
Eriko Shimizu
Kyozo Shimizu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fotonation Ltd
Original Assignee
DigitalOptics Corp Europe Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DigitalOptics Corp Europe LtdfiledCriticalDigitalOptics Corp Europe Ltd
Assigned to TESSERA TECHNOLOGIES IRELAND LIMITEDreassignmentTESSERA TECHNOLOGIES IRELAND LIMITEDASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).Assignors: TESSERA TECHNOLOGIES HUNGARY KFT.
Application grantedgrantedCritical
Publication of USRE42898E1publicationCriticalpatent/USRE42898E1/en
Assigned to DigitalOptics Corporation Europe LimitedreassignmentDigitalOptics Corporation Europe LimitedCHANGE OF NAME (SEE DOCUMENT FOR DETAILS).Assignors: TESSERA TECHNOLOGIES IRELAND LIMITED
Anticipated expirationlegal-statusCritical
Expired - Lifetimelegal-statusCriticalCurrent

Links

Images

Classifications

Definitions

Landscapes

Abstract

An electronic zoom image input method that enables zooming without declining the resolution by receiving an input image transmitted through a fixed focal distance optical system having a function of compressing the circumferential part of the input image by means of a photo detector with a uniform pixel density and subjecting the received image to image correction and conversion to obtain an output image. Three dimensional image input system is realized by preparing each image input system of both left and right view with this electronic zoom image input method.

Description

TECHNICAL FIELD
This invention relates to a electronic zoom image input method, that can obtain the zoom image through the fixed focal length image input optical lens, without degrading the zoom image resolution.
BACKGROUND ART
Image input systems such as cameras or camcoders, zoom lenses that can vary their focal length are used widely to obtain zoom images, conventionally.
However, as the zoom lens is highly precision instrument, it is expensive and also large in size. Especially, for the digital zoom cameras that have been required to be small size and low price, conventional zoom lenses were obstacles for these requirements. Furthermore, as image input devices or image sensors such as CCDs have been becoming small in size recently, smaller and shorter focal length zoom lenses have been required for cameras that use these devices.
But, it is very difficult to realize the wide angle zoom lens in short focal length, as it become very small and complicated.
On the other hand, in the case of three-dimensional(3D) zoom image input, accurately synchronized zoom action between two zoom lenses for the left and right images become necessary. As such a synchronized zoom action has to be achieved precisely all in mechanical at the conventional zoom lens, it becomes a very complicated and expensive apparatus. Consequently, the introduction of zoom lens to 3D image input has been very difficult.
Sometimes, in digital cameras, it is called as the electronic telephoto zooming to expand simply a part of the input image electronically. But it differs from a real zoom action, because the resolution of the zoom image is degraded along with its expansion.
DISCLOSURE OF INVENTION
This invention realized a all electronic zoom image input method that do not use conventional optical zoom lens, without degrading the image resolution. And also it solved issues that conventional optical zoom lens had.
The electronic zoom image input method of this invention has a fixed focal length lens that has the function of compressing circumferential part of the input image (it is called as the compressing optical system, thereafter) in combination with a usual image input device with the uniformly aligned pixel. And the output zoom image is realized without degrading image resolution throughout the full zooming range, by processing the image of this compressed input image.
And, an electronic zoom image input method that simplify the zoom image processing by applying the compression optical system that compresses the input image only to the vertical and horizontal directions is introduced.
Also, a compression optical system is introduced that compresses the area close to the vertical and horizontal center axes of the input image, in addition to the compression of the circumferential part of the input image to all direction. It realizes an electronic zoom image input method with much smaller image sensor area.
Furthermore, this compression optical system can be composed as the attachment lens. Conventional digital cameras can be changed to zoom camera systems of this invention, by mounting this attachment compression lens to them.
Attachment conversion lenses have been commonly used to change the equivalent focal length of conventional cameras. In the same way, the focal length of the compression optical system can be changed by mounting the conventional attachment conversion lens to the compression optical system. As the result, a different zooming range can be realized by attaching this attachment conversion lens to this invented method.
3D-image input system can be realized easily, by constructing each image input system of both left and right picture with the electronic zoom image input method of this invention. Because, the accurately synchronized zoom action between the two zoom systems can be easily done by electronic operation in this invention.
Functions of each items of this invention are explained, next.
Usually, in a camera including the digital camera and the camcorder, the zoom image of wide angle or telephoto view is obtained through the zoom lens, by changing its equivalent focal length.
On the other hand, at the electronic image sensor such as CCD, it is possible to expand or compress a part of the input image on the image plane of the image sensor, by processing the image data electronically.
Accordingly, applying this image data processing method, it becomes possible to realize an equivalent zoom function, by changing the area that corresponds to the output image to be taken out from the input image plane of the image sensor.
For example, to change an zoom image from a standard view image to a wide angle view image, the image data of wider area on input image plane that corresponds to the wide angle image is taken out, and is processed as the output image of the wide angle view. In this case, if the area of the zoom input image plane is used proportional to the angle of the view image, the area that is needed to cover the wide angle image becomes very large.
And, if the telephoto view image area on the image plane is taken out as the telephoto output image, its needed area becomes small. But as the number of pixel is reduced by this reduced area, the resolution of the output image becomes degraded. And this method to obtain the telephoto zoom image is used in the conventional digital camera named as the electronic zooming with the sacrifice of degraded resolution.
This indicates that the wider angle view image requires the larger area of input image plane that accompanies higher image resolution as the output image. Because, as the pixel is uniform in density, the larger area on the image plane has more image data. Conversely, the area of input image plane of the wide angle image can be compressed to keep its resolution same to that of the narrower angle image such as the standard angle image.
Accordingly, in the image input system with fixed focal length optical lens and with conventional uniform pixel image sensor, it becomes possible to compose an electronic zoom image input method that has a remarkably suppressed area of the input image plane, by preparing the optical system that compresses the circumferential part of the input image that corresponds to the wide angle part of the input image.
The image through the fixed focal length optical system is a fixed data, having exact correspondence between the object scene and its image. These zoom image information can be freely reproduced as the fixed output zoom image, by the data processing of the image conversion and correction.
For example, to obtain the wide angle output image, the image data of its circumferential part is directly used, because this part has been already compressed at the input image. And the image data of its central part is compressed to the reduced size that corresponds to the narrower area at the wide angle output image. Because this part corresponds to the narrower view image such as the standard view image, and occupies the smaller area at the wide angle output image. As the result, the wide angle output image that has the same resolution to the standard view image is realized with minimum increase of input image area.
It is one of the most important features of this invention that the image sensor with conventional uniform pixel density is used in this invented method, which is made possible by applying non-linear compression of the image data to the compression optical system. And this made it easy to manufacture the sensor, and also easy to process the image data.
However, the pixel of the sensor is not necessarily uniform, and it is also possible to apply non-uniform pixel device. Furthermore, although the invention is explained mainly about the 2-dimension input image plane, the input image plane that is explained here includes even the case of the 1-dimension image sensor that composes the 2-dimension input image plane by scanning it mechanically.
In general, the electronic image data can be easily processed as is treated here. And the zoom output image that is reproduced from the input image data of this electronic image input method can be easily and accurately realized by converting and correcting it electronically.
As the fixed focal length optical system that is introduced to this invented zoom method is a fixed optical system, the input image that passed the optical system is also a fixed image. Accordingly, the compression or distortion pattern and the quantity of the image can also be exactly fixed. And the original correct input image can be reproduced by processing the compressed image that contains the fixed amount of compression and distortion as described above.
The ultra wide-angle optical system as the fish-eye lens that compresses the image uniformly, tends to contain large amount of distortion. As its input image is also fixed one including its distortion through the fixed ultra wide-angle compressing optical system, an ultra wide-angle zoom input image system can be composed by combining the ultra wide-angle optical system to the compressing optical system of this invention, where converting and correcting the wide zoom input image is done simultaneously.
Conventionally, there have been proposals of image sensors called silicone retina. But these sensors have pixels with reduced density at the circumferential part of them, and don't have the zoom function preserving the same image resolution. Consequently, they are different at all from this invention in purpose and in principle.
This invented method is embodied as the image input apparatus equipped with the optical system hat has the function of compressing the circumferential part of the input image. This optical system can also be realized as an attachment lens, that is to be attached to the optical lens of the usual image input apparatus. Accordingly, it is possible to realize the electronic zoom image input method of this invention, by adding this attachment optical system to the conventional image input apparatus such as the photo camera or the camcorder.
Pixels of the electronic image sensor such as CCD are generally arranged uniformly along the length and breadth direction on the image plane. A simplified compressing optical system is introduced that limits the compression of the input image only to the vertical and horizontal direction, in accordance with the direction of the pixel arrangement. And it also results in reducing the amount of the image data processing. By the introduction of this compressing optical system, an electronic zoom input image method, that simplified the image compressing process only to the length and breadth direction, is realized.
At the electronic zoom image input system of this invention, the input image is compressed largely as it moves to its circumferential part. In the case that the rectangular object view is compressed to all the direction, its input image of the area in the diagonal line direction is largely compressed, because this area is at a longer distance away from the central point of the image. On the contrary, its image of the area near in the vertical or horizontal axis line direction is compressed small, because this area is at a shorter distance away from the central point of the image. As the result, the rectangular object view is compressed to a barrel shaped image.
Accordingly, if the area near in the vertical and horizontal axis line direction of this image is compressed furthermore, the barrel shaped input image can be compressed to rectangular shaped one. This rectangular image fits well to the form of the input image plane of the image sensor, and can realize the reduction of the image area itself.
Conventionally, to get a wide range of variable-power optical system, the plural number of zoom lenses that have the different range of focal length has been used, because it is difficult to cover all the power range with one zoom lens.
But, the zooming range of the invented electronic zoom image input method can be changed by adding a conventional attachment fixed focal length lens in front of the compressing optical system. Accordingly, at the electronic zoom image input system of this invention, the zoom action of a wider power range becomes possible by mounting conventional magnifying or telephoto attachment converter lenses with fixed focal length, in front of the compressing optical system of the invention.
The electronic zoom image input system of this invention is appropriately applied to the 3D zoom image input system, which has been very difficult to realize by the conventional zoom lens.
Conventionally, the optical system with two zoom lenses that are interlocked mechanically for 3D-images of the right and left view, has been used to realize the 3D zoom image. Where, these two zoom lenses that are combined mechanically, have to be operated simultaneously and accurately for synchronized zooming and accompanied focusing. It has been very complicated and difficult to realize the zoom operation mechanically.
But, at the electronic zoom image input method of this invention, both of these 3D image input optical systems of the right and left view can be realized by fixed focal length optical systems requiring no zooming and no focusing operations mechanically.
Furthermore, the zoom action can be easily realized by interlocking both image input systems of this invention electronically, because the zoom operation is all done electronically without including any mechanical action.
THE BRIEF EXPLANATION OF THE DRAWINGS
FIG. 1 shows the 1st embodiment of the electronic zoom image input method of this invention.
FIG. 2 shows an example of the optical system that compresses the circumferential part of the input image.
FIG. 3 shows an example of the optical system that compresses the circumferential part of the image toward the vertical and horizontal direction that corresponds to the 1 st embodiment of this invention.
FIG. 4 shows the 2nd embodiment of the electronic zoom image input method of this invention.
FIG. 5 shows the 3rd embodiment of the electronic zoom image input system of this invention.
FIG. 6 shows an example of the construction of the invented electronic zoom image input method.
FIG. 7 explains an image compressing method of the image compressing optical system that compresses input image in rectangular, which corresponds to the 3rd embodiment of this invention.
FIG. 8 shows an example of the embodiment of the compressing optical system explained inFIG. 7, that compresses the image in rectangular.
SUCH THE BEST MODE THAT WORKS THE INVENTION
Details of this invention are explained with figures attached.
FIG. 1 shows the 1st embodiment of the electronic zoom image input method of this invention. And it shows the principle of this method.
It is the case that the compression of the image of its circumferential part is limited only to the vertical and horizontal direction.
1A shows the object view of the zoom input image. At the view of1A, the standard angle view1AS is settled as the basic angle of view that provides the standard size and the resolution of the output image of this zoom system. And the zoom images of the object view are taken in, as the zoom image changes to wider angle view, from the intermediate angle view1AM to the more wide angle view1AW that is expected to have the output image of the same size and resolution to1AS.
Also,1B shows the input image at the input image plane of this image sensor, that is formed a compressed zoom image of object scene1A, by passing the compressing optical system that has the function of compressing the circumferential part of the image.
In order to preserve these output images to the same size and resolution to the standard angle view, it is possible to compress the image area of the circumferential part of the image that corresponds to the outside part of the standard angle view. Accordingly, the input image on the input image plane of the image sensor with uniform pixel density can be compressed more largely to the vertical and horizontal direction as it moves to the circumferential part.
Here inFIG. 1, the area surrounded by the wide line1BS is the input image corresponding to the standard angle scene1AS, and also the area surrounded by wide-dotted line1BM and that by point-dotted line1BW are corresponded to the intermediate angle scene1AM and the wide angle scene1AW respectively.
For example, if the case that the wide angle scene1AW is settled 4-times wider in length than the standard angle scene1AS, the size of the wide angle input image1BW at the input image plane of the image sensor is reduced to about 2 times that of the standard angle input image1BS in length. It indicates that by the image compression of the invention, a wide zoom image data 4-times wider in length can be reduced to about the half of that in length comparing to the case without the compression, preserving the same image resolution to the standard angle input image1BS. And the size of the input image plane is reduced to about the half (½) in length and to quarter (¼) in area, comparing to the case that no compression is applied.
Strictly to say, as the compression power at the inner part of the 4-times wide angle image becomes gradually low as it moves toward its central part comparing to that of the circumferential part. As the result the total compression power decreases slightly. Accordingly, the area of the wide-angle image increases slightly than 2 times actually.
The corrected output zoom image1C is finally obtained from the compressed zoom image, after the processing of the image conversion and correction. In this case, the corrected output zoom image1CS,1CM,1CW corresponds to the object view1AS,1AM,1AW respectively with the same image resolution.
Comparing to the standard angle input image data, the wider angle input image data has the same resolution at its outer edge, and has higher image resolution at its inner part as it moves to its center. Accordingly, the wide-angle zoom output image can be realized at the same resolution to the standard angle image through the image processing of reducing the image data of its inner part.
Although, comparing to the basic standard angle image, the resolution of the corrected wide angle output image may increase or decrease slightly in local depending upon the local variation of the degree of compression, the increase of the input image area of the image sensor can be restrained by the electronic zoom input system of this invention.
FIG. 2 shows an example of the optical system that compresses the circumferential part of the input image. It is composed of the concave lens2L, which has the refraction angle that increases as the view angle moves to the circumferential part, as is shown in this figure. Namely, when images of threeobjects21A,22A, and23A of the same size are passed through the concave lens2L, these images are compressed largely as the position of the object image moves to the circumferential part by the compression characteristics of the lens2L, as shown21B,22B, and23B respectively.
As the compressing optical system is that of a fixed focal length, the compressed zoom input image is the fixed image, including its containing distortion. So, it is possible to obtain the correct output image, by the accurate converting and correcting process of the compressed image.
Even if there is some deviation in the degree of compression of the compressing optical lens of this invention, its influence is limited to the slight change of the image resolution. Because, the output image itself is obtained as a corrected one by the reverse conversion of the fixed image compression mode. And its distortion does not relate directly to the image compression mode itself.
Furthermore, aspherical lenses like this compression lens can be easily realized by materials such as plastic lenses, nowadays.
FIG. 3 shows an embodiment of the fixed focal length compressionoptical system3L that compresses the circumferential part of the input image toward the vertical and horizontal direction as explained above.3L is composed of three kind of lenses; the conventional fixed focal length convex lens3L1 for image focusing the vertical concave cylindrical lens3L2 that compresses largely as the part moves to the circumferential part in horizontal direction, and the horizontal concave cylindrical lens3L3 that compresses like3L2 in vertical direction. Needless to say, theoptical system3L can be realized as a single complex function lens like an aspherical lens.
InFIG. 3, the image of theobject view3A is compressed through the compressingoptical system3L to theimage3B on the input image plane. Where,3A and3B correspond respectively to1A and1B ofFIG. 1.
Conventionally, Cinema Scope has been well known in movie that compresses and enlarges the image of the screen in horizontal direction. The image at Cinema Scope is simply compressed and enlarged in proportional to horizontal direction to obtain the enlarged screen. Consequently, it is entirely different system in purpose and in principle from the electronic zoom image input method of this invention that realizes the zoom function through the data processing with non-linear image compression.
FIG. 4 shows the 2nd embodiment of the invented method. This is the case that the compressing optical system compresses the circumferential part of the input image to all direction.
This optical system compresses largely at the outer side of the input image in concentric circle. As the result, theobject view4A is compressed through this compressing optical system to the barrel shapedcompressed input image4B. Just like the case ofFIG. 1, the standard angle view4AS, the intermediate angle view4AM, and the wide angle view4AW in1A are compressed to the compressed zoom input image of4BS,4BM, and4BW in1B respectively.
As this compressed zoom input image is also the fixed electronic data through the fixed compression optical system, the accurate image processing of correcting or converting the compressed zoom input image to the corrected output zoom image can be easily done. Through the image processing theoutput zoom image4C is obtained. Where the output image of standard angle view4CS, the intermediate angle view4CM, and the wide angle view4CW corresponds to the input image of object view4AS,4AM, and4AW respectively. And these output images preserve the same image resolution to the standard view image4CS.
FIG. 5 shows the 3rd embodiment of the electronic zoom image input method of this invention. Even in the compressed zoom input image such as1B inFIG. 1 or4B inFIG. 4, there are areas that contain excessive image data to maintain the same image resolution at the neighboring area of the vertical and horizontal center axes of the image that correspond to the swelled part of the barrel type zoom input image of4B.
By preparing a compressing optical system that compresses the swelled part of theimage4B further more, a compressed zoom input image that has a rectangular shaped outline can be realized. Namely, by the image compression that compresses further at the neighboring area of the vertical and horizontal center axes5XV and5XH of5A, theobject scene5A is compressed to the compressedzoom input image5B that has the smaller area than4B and the rectangle shaped outline.
And the standard angle view5AS, the intermediate angle view5AM, and the wide angle view5AW of5A is compressed to the compressed zoom input image5BS,5BM, and5BW of5B respectively.
Furthermore, the output zoom image5C is obtained through the image processing where the input image of object scene5AS,5AM, and5AW are reproduced as the corrected output zoom image5CS,5CM, and5CW respectively. The electronic zoom image input method ofFIG. 5, that preserves the same zoom image resolution to that ofFIG. 1 andFIG. 4, has been realized with the sensor that has the smaller and rectangular image input plane.
FIG. 6 shows an example of the constitution of the electronic zoom image input method of this invention that is shown inFIG. 5.
It is also same to that ofFIG. 1 andFIG. 4, except the difference of the compressedzoom input image5B to that of1B and4B by the difference of each compressing optical system.
The image of theobject view6A is taken in through the compressingoptical system6L as the compressedzoom input image6B at the input image plane of theimage sensor61. The image data of theinput image6B is changed to the digital image signal by the imagesignal control unit62.
This digital signal can be reproduced to the original object view image of any angle, through the image processing of the conversion from the compressed zoom input image at theconversion unit63. These zoom images are taken out from theoutput unit65 as theoutput image66 or the output signal.
The output image data that is processed to a fixed angle of zoom image is stored at thememory unit64. But the compressed zoom input image data of the input image plane can also be stored at thememory unit64 directly. If the image data is stored as the compressed image data, it become possible to take out any angle of zoom output image from the compressed image data with the same image resolution by processing the stored image data at thememory unit64.
FIG. 7 explains the method of the image compression to realize theinput image5B ofFIG. 5 compressed in rectangular outline.
At first, the image compressing method of this invention is explained by a simple example of the compressed input image1B ofFIG. 1.
The compressed zoom input image1B inFIG. 1 that is compressed only to the vertical and horizontal direction, contains the prolix image data at the neighboring areas of the vertical and horizontal center axes as largely as it moves to the outside area. And it is possible to compress these part furthermore, without causing the degradation of the zoom image resolution.
To simplify the explanation,FIG. 7(a) shows the part of the compressed zoom input image1B that corresponds to its 1st quadrant. In theFIG. 7(a), the area enclosed by the wide line S1 corresponds to a quarter of the standard angle input image1BS inFIG. 1. And in the same way, the area enclosed by the wide line S2 and S4 corresponds to the 2-times wide angle input image1MS, and the 4-times wide angle input image1WS comparing to the standard angle view respectively.
Also, the3-times wide input image area that is enclosed by the wide line S3 is shown between S2 and S4 inFIG. 7(a).
For example, when the zoom input image is expanded from 3-times wide angle image to 4-times wide angle image, the area that is newly expanded at the compressed zoom input image is that surrounded by S4 and S3. It includes the area on diagonal line S44, areas arranged to the horizontal direction S43,S42,S41, and areas arranged to the vertical direction S34,S24,S14.
The area of S43,S42,and S41 is 4/3 times. 2-times, and 4 times larger comparing to S44 respectively, as it approaches to the vertical center axis7XV. As the image sensor is composed of uniform density pixels, the size of the image area is proportional to that of the image data. And these image area have more image data in proportional to their area. The image area described above is arranged S44,S43, S42,S41 in horizontal direction as is shown inFIG. 7(a).
However, the required image data for these image areas that are necessary to realize the 4-times wide angle zoom output image are just same to that of standard angle S44. And it is shown for the each image areas of S43,S42,S41, as the area of oblique line that is equivalent to the area of S44. This indicates that to maintain the same output image resolution, the area of these image area can be reduced to that of S44. Accordingly, the area of S43,S42,S41 can be reduced to ¾, ½, ¼ respectively.
The image area S34,S24,S14 that are arranged in vertical direction to the horizontal center axis7XH, can be also reduced by the same way as described above for horizontal direction.
By the same way as described above about the image areas of S4 for 4-times wide angle zoom input image, it is possible to reduce the size of image areas of S3 for the 3-times wide angle zoom input image, and also that of S2 for 2-times wide angle zoom input image respectively.
InFIG. 7(a), areas equivalent to the image data that are necessary to realize the electronic zoom function with constant image resolution, are shown as the area of oblique line for the all image areas.
To simplify the explanation of this zoom function, it has been explained for the case that the zoom power changes in step in integer such as 2,3,4-times. But, the actual zooming function is done continuously. And the compression of the zoom image is also changed continuously. As the compressed input image of a zoom-power always contains the lower-power zoom image part in its inner area, the area of the compressed image actually increases slightly than that described above.
By taking the continuous change of the zooming power in calculation, the increase of the area of the zoom input image plane for the zoom-power N becomes to the natural logarithm N (InN) in length. And the area increases slightly comparing to the case explained above that estimated the zoom-power changes in step.
These factors to increase the area is shown by the dotted line, and the increased area is also shown by the oblique lattice line inFIG. 7(a).
As the result, the minimum data area to realize the electronic zooming with constant resolution is shown inFIG. 7(a) as the sum of the area of oblique line and the area of oblique lattice line. The blank area in the image area atFIG. 7(a) indicates the area that is possible to compress.
The compressed zoom input image that is composed by these compression is finally shownFIG. 7(b). InFIG. 7(b), the zoom input image is compressed furthermore for the blank area that is shown inFIG. 7(a) as the possible area to compress. And the compressed image area becomes the rhombic form. Finally, the outline of the compressed zoom input image is compressed to the rectangular shape.
The compressed zoom image ofFIG. 7(b) is that of the 1st quadrant part. And the image extended to all quadrant is equal to the compressedzoom input image5B that is the 3rd embodiment of the invention.
As is explained inFIG. 4, the compressed zoom input image of the rectangular object scene becomes the barrel shaped one when it is compressed to all direction. The compressed zoom input image of the further reduced in rectangular shaped outline can be obtained by adding the compressing optical system that compresses the swelled part of the barrel shaped input image. And the input image is compressed to rectangular outline as shown inFIG. 5 finally. In this case, to make the outline of the zoom input image rectangle is very effective to reduce the area of the image sensor, even if the compression is insufficient.
FIG. 8 shows a example of the compressing optical system that realizes the compressedzoom input image5B ofFIG. 5 from theinput image4B ofFIG. 4. The action of image compression is explained for the case of vertical direction at first. The concave lens optical system BLV that compresses the image to vertical direction more largely as it moves to the center axis8Xa is introduced to compress the swelled part of the barrel type input image.
The optical system8LV is shown inFIG. 8(a). The degree of the compression of the image becomes maximum at the vertical center axis8Xa as is shown at the section8DX. And the degree of the compression decreases as it goes away from the center axis8Xa as is shown at the section8DY.
The compressing optical system ofFIG. 8(b) is realized by combining the compressing optical system of vertical direction8LV and that of horizontal direction8LH together. And by passing the barrel type compressedzoom input image8A through this optical system, the compressed zoom input image8B that is equal to theimage5B can be obtained.
If the function of the vertical and horizontal cylindrical convex lens is added to8LV and8LH respectively, the output image from the optical system8B can be compressed to be adjusted to the size of image sensor, by compressing the image to the vertical and horizontal direction freely through the cylindrical lens.
These optical functions or lenses that compose the optical system can be combined to a composite lens as a plastic lens.
THE INDUSTRIAL APPLICABILITY
It became possible to realize the simple zoom image by the electronic zoom image input method of this invention without degrading the zoom image resolution it does not use the conventional zoom lens, and provides the simple fixed focus length lens.
This zooming method of the invention made it possible to use the simple fixed focal length lens and conventional small size image sensor with uniform pixel. And the remarkably small size and low cost zoom image input system that could not realized hitherto, is materialized by this invention.
Furthermore, it became possible to realize the extremely small and low cost 3D-camera by combining two electronic zoom image input system of this invention electronically, that had been very expensive, large, and complicated one conventionally combining two optical zoom lenses. This invention made the conventional optical 3D-zoom lens system absolutely unnecessary that needed two optical zoom lenses combined mechanically.
This electronic zoom image input system of the invention materialized the strong features of small size, low cost, and the 3D-zoom function to the market.
In the remarkably progressing multi-media era, zoom imaging system such as the zoom camera has been strongly required to be more small sized, low cost, and versatile. This invention realized just to solves these issues that could not fulfilled hitherto. Accordingly, this invention accomplish the great contribution to the progress of the coming multi-media era.

Claims (48)

1. An electronic zoom image input method that enables zooming without degrading the resolution, by imaging apparatus, comprising:
a fixed focus input image compressing optical system configured to form a compressed zoom input image having a function of compressing, the compression of the input image more largely as it moves being a function of distance to the a circumferential part, thereof such that the compression of the input image increases as the distance to the circumferential part decreases;
an image sensor configured to receive the compressed zoom input image with reduced input image plane area providing preferably uniform pixel density, and a conversion unit for the processing of the zoom image converting and correcting of to provide data representing the compressed zoom input image to reproduce zoom output images; and
a conversion unit connected to said image sensor for converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
2. An electronic zoom image input method that enables zooming without degrading the resolution, by imaging apparatus, comprising:
a fixed focus input image compressing optical system configured to form a compressed zoom imput image, the compression of the input image having being a function of compressing the distance to a circumferential part, thereof such that the compression of the input image in increases according to a logarithmic function, as the distance to the circumferential part decreases;
an image sensor configured to receive the compressed zoom input image with reduced and to provide data representing the compressed input image plane area,; and a conversion unit for the processing of the zoom connected to said image sensor for converting and correcting of the data representing the compressed zoominput image to reproduce zoom output images. produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
13. An electronic zoom imaging method, comprising:
forming a compressed input image using a fixed focus input image compressing optical system, the compression of the input image being a function of distance to a circumferential part thereof such that the compression of the input image increases as the distance to the circumferential part decreases,
receiving the compressed input image and providing data representing the compressed input image using an image sensor, and
converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
24. An electronic zoom imaging method, comprising:
forming a compressed input image using a fixed focus input image compressing optical system, the compression of the input image being a function of distance to a circumferential part thereof such that the compression of the input image increases according to a logarithmic function as the distance to the circumferential part decreases;
receiving the compressed input image and providing data representing the compressed input image using an image sensor; and
converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
25. An electronic zoom imaging apparatus, comprising:
an input image compressing optical system configured to form a compressed input image, the compression of the input image being a function of distance from a central part thereof such that the compression of the input image increases as the distance from the central part increases;
an image sensor configured to receive the compressed input image and to provide data representing the compressed input image; and
a conversion unit connected to said image sensor for converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
36. An electronic zoom imaging apparatus, comprising:
an input image compressing optical system configured to form a compressed input image, the compression of the input image being a function of distance from a central part thereof such that the compression of the input image increases according to a logarithmic function as the distance from the central part increases;
an image sensor configured to receive the compressed input image and to provide data representing the compressed input image; and
a conversion unit connected to said image sensor for converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
37. An electronic zoom imaging method, comprising:
forming a compressed input image using an input image compressing optical system, the compression of the input image being a function of distance from a central part thereof such that the compression of the input image increases as the distance from the central part increases;
receiving the compressed input image and providing data representing the compressed input image using an image sensor; and
converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
48. An electronic zoom imaging method, comprising:
forming a compressed input image using an input image compressing optical system, the compression of the input image being a function of distance from a central part thereof such that the compression of the input image increases according to a logarithmic function as the distance from the central part increases;
receiving the compressed input image and providing data representing the compressed input image using an image sensor; and
converting and correcting the data representing the compressed input image to produce output data representing a standard angle image and wide angle image, a length of the wide angle image being at least twice a length of the standard angle image, wherein a resolution of the wide angle image is higher in a central portion than a resolution of the standard angle image and the same at an outer edge.
US11/728,9821996-12-171997-12-15Electronic zoom image input methodExpired - LifetimeUSRE42898E1 (en)

Applications Claiming Priority (5)

Application NumberPriority DateFiling DateTitle
JP08/3595091996-12-17
JP359509961996-12-17
JP09/3519581997-12-08
JP35195897AJP4643773B2 (en)1996-12-171997-12-08 Electronic zoom image input method
PCT/JP1997/004611WO1998027718A1 (en)1996-12-171997-12-15Electronic zoom image input method

Related Parent Applications (1)

Application NumberTitlePriority DateFiling Date
US09/331,008ReissueUS6873358B1 (en)1996-12-171997-12-15Electronic zoom image input method

Publications (1)

Publication NumberPublication Date
USRE42898E1true USRE42898E1 (en)2011-11-08

Family

ID=26579534

Family Applications (2)

Application NumberTitlePriority DateFiling Date
US11/728,982Expired - LifetimeUSRE42898E1 (en)1996-12-171997-12-15Electronic zoom image input method
US09/331,008CeasedUS6873358B1 (en)1996-12-171997-12-15Electronic zoom image input method

Family Applications After (1)

Application NumberTitlePriority DateFiling Date
US09/331,008CeasedUS6873358B1 (en)1996-12-171997-12-15Electronic zoom image input method

Country Status (3)

CountryLink
US (2)USRE42898E1 (en)
JP (1)JP4643773B2 (en)
WO (1)WO1998027718A1 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20090115885A1 (en)*2006-09-152009-05-07Gal ShabtayImaging system with improved image quality and associated methods
US8508751B1 (en)*2010-01-282013-08-13Pathway Innovations And Technologies, Inc.Capturing real-time video with zooming capability and scanning high resolution still images of documents using the same apparatus
WO2013136053A1 (en)2012-03-102013-09-19Digitaloptics CorporationMiniature camera module with mems-actuated autofocus
WO2014033099A2 (en)2012-08-272014-03-06Digital Optics Corporation Europe LimitedRearview imaging systems for vehicle
WO2014072837A2 (en)2012-06-072014-05-15DigitalOptics Corporation Europe LimitedMems fast focus camera module
US9001268B2 (en)2012-08-102015-04-07Nan Chang O-Film Optoelectronics Technology LtdAuto-focus camera module with flexible printed circuit extension
US9007520B2 (en)2012-08-102015-04-14Nanchang O-Film Optoelectronics Technology LtdCamera module with EMI shield
US9525807B2 (en)2010-12-012016-12-20Nan Chang O-Film Optoelectronics Technology LtdThree-pole tilt control system for camera module
US9817206B2 (en)2012-03-102017-11-14Digitaloptics CorporationMEMS auto focus miniature camera module with fixed and movable lens groups
US9888181B2 (en)2014-02-282018-02-06Sharp Kabushiki KaishaCamera module and image capturing apparatus with shake correction of image capturing lens or image sensor
US10101636B2 (en)2012-12-312018-10-16Digitaloptics CorporationAuto-focus camera module with MEMS capacitance estimator

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
GB2388265B (en)*2002-04-302005-10-12Hewlett Packard CoImprovements in and relating to processing of images
US7227573B2 (en)*2002-07-292007-06-05Hewlett-Packard Development Company, L.P.Apparatus and method for improved-resolution digital zoom in an electronic imaging device
JP2005077821A (en)*2003-09-012005-03-24Casio Comput Co Ltd Projection apparatus, projection method, and program
JP2005195786A (en)*2004-01-062005-07-21Canon Inc Focus detection device and optical instrument using the same
JP2005252625A (en)2004-03-032005-09-15Canon Inc Imaging apparatus and image processing method
JP2005252626A (en)2004-03-032005-09-15Canon Inc Imaging apparatus and image processing method
JP2005323044A (en)*2004-05-072005-11-17Uniden CorpImage transmitting apparatus and image receiving apparatus
JP2006003427A (en)*2004-06-152006-01-05Canon Inc Focus detection apparatus and photographing apparatus
US7580070B2 (en)*2005-03-312009-08-25Freescale Semiconductor, Inc.System and method for roll-off correction in image processing
JP4596986B2 (en)*2005-06-072010-12-15オリンパス株式会社 Imaging device
JP4596988B2 (en)*2005-06-072010-12-15オリンパス株式会社 Imaging device
US7920200B2 (en)2005-06-072011-04-05Olympus CorporationImage pickup device with two cylindrical lenses
JP4596987B2 (en)*2005-06-072010-12-15オリンパス株式会社 Imaging device
JP2006350017A (en)2005-06-162006-12-28Olympus CorpImaging apparatus
JP2007049266A (en)2005-08-082007-02-22Olympus CorpPicture imaging apparatus
US7839446B2 (en)2005-08-302010-11-23Olympus CorporationImage capturing apparatus and image display apparatus including imparting distortion to a captured image
JP2007096588A (en)*2005-09-282007-04-12Olympus CorpImaging device and method for displaying image
JP2007102061A (en)2005-10-072007-04-19Olympus CorpImaging apparatus
JP2007124088A (en)*2005-10-262007-05-17Olympus CorpImage photographing device
JP4754939B2 (en)*2005-11-012011-08-24オリンパス株式会社 Image processing device
JP2007129403A (en)*2005-11-022007-05-24Olympus CorpImage encoder and image processing system
JP2007135135A (en)2005-11-142007-05-31Olympus CorpMoving image imaging apparatus
DE102005062397A1 (en)*2005-12-232007-07-05Deutsches Zentrum für Luft- und Raumfahrt e.V. Optical system and a method for image acquisition
JP4608436B2 (en)2006-01-052011-01-12オリンパス株式会社 Image shooting device
CN101438577B (en)*2006-03-292013-03-27数字光学欧洲有限公司Image acquisition apparatus with improved image quality
JP4914171B2 (en)*2006-10-162012-04-11キヤノン株式会社 Imaging device control method and camera system
US8525914B2 (en)*2007-10-252013-09-03DigitalOptics Corporation Europe LimitedImaging system with multi-state zoom and associated methods
US8078007B2 (en)*2008-01-082011-12-13Seiko Epson CorporationEnlarging a digital image
US8086073B2 (en)*2008-02-072011-12-27Seiko Epson CorporationNon-uniform image resizer
KR20100082147A (en)*2009-01-082010-07-16삼성전자주식회사Method for enlarging and changing captured image, and phographed apparatus using the same
US8749892B2 (en)2011-06-172014-06-10DigitalOptics Corporation Europe LimitedAuto-focus actuator for field curvature correction of zoom lenses
JPWO2018030319A1 (en)2016-08-122018-08-09パナソニックIpマネジメント株式会社 Ranging system and mobile system
US10607315B2 (en)*2018-01-092020-03-31Immervision, Inc.Constant resolution continuous hybrid zoom system
DE102019121434A1 (en)2019-08-082021-02-11Karl Storz Imaging, Inc. Observation device and method for operating an observation device
CN113132614B (en)*2019-12-312023-09-01中兴通讯股份有限公司 A camera optical zoom electronic device, method, unit and memory

Citations (22)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US4527201A (en)*1983-03-291985-07-02Panavision, Inc.Zoom indicating apparatus for video camera or the like
US4554585A (en)1983-08-121985-11-19Rca CorporationSpatial prefilter for variable-resolution sampled imaging systems
US4897722A (en)1988-04-071990-01-30General Electric CompanyWidescreen television transmission system utilizing conventional equipment including a camera and VCR
US4962429A (en)1988-01-191990-10-09U.S. Philips CorporationTelevision camera having an increased resolution in a portion of the field of view
JPH0411467A (en)1990-04-281992-01-16Olympus Optical Co LtdElectronic image pickup device
US5124840A (en)*1989-06-081992-06-23Trumbull Donald EPortable viewing apparatus
US5175616A (en)1989-08-041992-12-29Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of National Defence Of CanadaStereoscopic video-graphic coordinate specification system
JPH05176212A (en)1991-12-191993-07-13Canon IncImage pickup device
US5309241A (en)1992-01-241994-05-03Loral Fairchild Corp.System and method for using an anamorphic fiber optic taper to extend the application of solid-state image sensors
JPH0715660A (en)*1993-06-251995-01-17Sony CorpPicture processor
JPH0767025A (en)1993-08-301995-03-10Olympus Optical Co LtdVideo processor
US5432404A (en)1993-12-101995-07-11Hitachi, Ltd.Apparatus for detecting a geometric distortion of an image on a display device
US5537149A (en)1992-04-221996-07-16Victor Company Of Japan, Ltd.Display device
JPH08234275A (en)1995-03-011996-09-13Kajima Corp Imaging system for remote operation support
JPH08307753A (en)1995-05-091996-11-22Minolta Co LtdVideo system consisting of camera and display device and display device
US5668666A (en)1995-01-051997-09-16Nikon CorporationZoom lens with an anamorphic converter
US5673086A (en)1990-10-051997-09-30Canon Kabushiki KaishaImage aspect ratio conversion processing apparatus
US5696560A (en)1994-07-251997-12-09Magma, Inc.Motion picture distribution system
US5905530A (en)1992-08-241999-05-18Canon Kabushiki KaishaImage pickup apparatus
US5909312A (en)1996-10-021999-06-01Ramot University Authority For Applied Research & Industrial Development Ltd.Phase-only filter for generating an arbitrary illumination pattern
US5956091A (en)1992-08-071999-09-21British Broadcasting CorporationMethod of showing 16:9 pictures on 4:3 displays
US5959669A (en)*1993-12-311999-09-28Canon Kabushiki KaishaImage pickup apparatus having standard-resolution and high-resolution photographing modes

Patent Citations (22)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US4527201A (en)*1983-03-291985-07-02Panavision, Inc.Zoom indicating apparatus for video camera or the like
US4554585A (en)1983-08-121985-11-19Rca CorporationSpatial prefilter for variable-resolution sampled imaging systems
US4962429A (en)1988-01-191990-10-09U.S. Philips CorporationTelevision camera having an increased resolution in a portion of the field of view
US4897722A (en)1988-04-071990-01-30General Electric CompanyWidescreen television transmission system utilizing conventional equipment including a camera and VCR
US5124840A (en)*1989-06-081992-06-23Trumbull Donald EPortable viewing apparatus
US5175616A (en)1989-08-041992-12-29Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of National Defence Of CanadaStereoscopic video-graphic coordinate specification system
JPH0411467A (en)1990-04-281992-01-16Olympus Optical Co LtdElectronic image pickup device
US5673086A (en)1990-10-051997-09-30Canon Kabushiki KaishaImage aspect ratio conversion processing apparatus
JPH05176212A (en)1991-12-191993-07-13Canon IncImage pickup device
US5309241A (en)1992-01-241994-05-03Loral Fairchild Corp.System and method for using an anamorphic fiber optic taper to extend the application of solid-state image sensors
US5537149A (en)1992-04-221996-07-16Victor Company Of Japan, Ltd.Display device
US5956091A (en)1992-08-071999-09-21British Broadcasting CorporationMethod of showing 16:9 pictures on 4:3 displays
US5905530A (en)1992-08-241999-05-18Canon Kabushiki KaishaImage pickup apparatus
JPH0715660A (en)*1993-06-251995-01-17Sony CorpPicture processor
JPH0767025A (en)1993-08-301995-03-10Olympus Optical Co LtdVideo processor
US5432404A (en)1993-12-101995-07-11Hitachi, Ltd.Apparatus for detecting a geometric distortion of an image on a display device
US5959669A (en)*1993-12-311999-09-28Canon Kabushiki KaishaImage pickup apparatus having standard-resolution and high-resolution photographing modes
US5696560A (en)1994-07-251997-12-09Magma, Inc.Motion picture distribution system
US5668666A (en)1995-01-051997-09-16Nikon CorporationZoom lens with an anamorphic converter
JPH08234275A (en)1995-03-011996-09-13Kajima Corp Imaging system for remote operation support
JPH08307753A (en)1995-05-091996-11-22Minolta Co LtdVideo system consisting of camera and display device and display device
US5909312A (en)1996-10-021999-06-01Ramot University Authority For Applied Research & Industrial Development Ltd.Phase-only filter for generating an arbitrary illumination pattern

Cited By (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20090115885A1 (en)*2006-09-152009-05-07Gal ShabtayImaging system with improved image quality and associated methods
US10586307B2 (en)2010-01-282020-03-10Pathway Innovations And Technologies, Inc.Capturing real-time video with zooming capability and scanning high resolution still images of documents using the same apparatus
US8508751B1 (en)*2010-01-282013-08-13Pathway Innovations And Technologies, Inc.Capturing real-time video with zooming capability and scanning high resolution still images of documents using the same apparatus
US11055817B2 (en)2010-01-282021-07-06Pathway Innovations And Technologies, Inc.Capturing real-time video with zooming capability and scanning high resolution still images of documents using the same apparatus
US9525807B2 (en)2010-12-012016-12-20Nan Chang O-Film Optoelectronics Technology LtdThree-pole tilt control system for camera module
WO2013136053A1 (en)2012-03-102013-09-19Digitaloptics CorporationMiniature camera module with mems-actuated autofocus
US9817206B2 (en)2012-03-102017-11-14Digitaloptics CorporationMEMS auto focus miniature camera module with fixed and movable lens groups
WO2014072837A2 (en)2012-06-072014-05-15DigitalOptics Corporation Europe LimitedMems fast focus camera module
US9001268B2 (en)2012-08-102015-04-07Nan Chang O-Film Optoelectronics Technology LtdAuto-focus camera module with flexible printed circuit extension
US9007520B2 (en)2012-08-102015-04-14Nanchang O-Film Optoelectronics Technology LtdCamera module with EMI shield
WO2014033099A2 (en)2012-08-272014-03-06Digital Optics Corporation Europe LimitedRearview imaging systems for vehicle
US10101636B2 (en)2012-12-312018-10-16Digitaloptics CorporationAuto-focus camera module with MEMS capacitance estimator
US9888181B2 (en)2014-02-282018-02-06Sharp Kabushiki KaishaCamera module and image capturing apparatus with shake correction of image capturing lens or image sensor

Also Published As

Publication numberPublication date
US6873358B1 (en)2005-03-29
JP4643773B2 (en)2011-03-02
JPH10233950A (en)1998-09-02
WO1998027718A1 (en)1998-06-25

Similar Documents

PublicationPublication DateTitle
USRE42898E1 (en)Electronic zoom image input method
US11350038B2 (en)Dual aperture zoom camera with video support and switching / non-switching dynamic control
US5489940A (en)Electronic imaging system and sensor for correcting the distortion in a wide-angle lens
JP6967673B2 (en) Continuous hybrid zoom system with constant resolution
JP4969474B2 (en) Decoding method, decoding device, and decoding program
US5798791A (en)Multieye imaging apparatus
US5740337A (en)Stereoscopic imaging system with electronically controlled convergence angle
US20160078590A1 (en)Coordinate computation device and method, and an image processing device and method
US20070146530A1 (en)Photographing apparatus, image display method, computer program and storage medium
JPWO2007060847A1 (en) Imaging device
US9269131B2 (en)Image processing apparatus with function of geometrically deforming image, image processing method therefor, and storage medium
US9911183B2 (en)Image processing method, image processing apparatus, image pickup apparatus, and non-transitory computer-readable storage medium
US20100045825A1 (en)Image Apparatus and Image Processing Method
DE69633589T2 (en) Method and device for processing visual information
US20050105822A1 (en)Variable distortion aberration image pickup device
JP6961423B2 (en) Image processing equipment, imaging equipment, control methods for image processing equipment, programs and recording media
JP4908350B2 (en) Image processing method and imaging apparatus using the image processing method
US7580622B2 (en)Imaging apparatus
US7683935B2 (en)Imaging device
CN110784642B (en)Image processing apparatus, control method thereof, storage medium, and imaging apparatus
JP4427701B2 (en) Camera device and camera function adjustment method
KR101230909B1 (en)Apparatus and method for processing wide angle image
JP4235683B2 (en) Electronic zoom image input method
JPH0965194A (en) Imaging equipment
WO2018020424A1 (en)A method for image recording and an optical device for image registration

Legal Events

DateCodeTitleDescription
ASAssignment

Owner name:TESSERA TECHNOLOGIES IRELAND LIMITED, IRELAND

Free format text:ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TESSERA TECHNOLOGIES HUNGARY KFT.;REEL/FRAME:025391/0011

Effective date:20100910

ASAssignment

Owner name:DIGITALOPTICS CORPORATION EUROPE LIMITED, IRELAND

Free format text:CHANGE OF NAME;ASSIGNOR:TESSERA TECHNOLOGIES IRELAND LIMITED;REEL/FRAME:027294/0253

Effective date:20110713

REMIMaintenance fee reminder mailed
FPAYFee payment

Year of fee payment:8

SULPSurcharge for late payment

Year of fee payment:7

FPAYFee payment

Year of fee payment:12


[8]ページ先頭

©2009-2025 Movatter.jp