The specific embodiment
Among Fig. 1,electronic endoscope system 2 by fujinonelectronic video endoscope 10,processor device 11, andlight supply apparatus 12 constitute.As everyone knows, fujinonelectronic video endoscope 10 has the endoceliac pliability of insertion inspected object (patient)insertion section 13, is connected withoperating portion 14 in the cardinal extremity ofinsertion section 13 part, is connected inadapter 15, and the generalflexible cord 16 betweenoperating portion 14 and theadapter 15 of linking to each other ofprocessor device 11 andlight supply apparatus 12.
As shown in Figure 2, the front end face ofinsertion section 13 is provided withcamera window 20,illuminating window 21 etc.The depths ofcamera window 20 is furnished with CMOS type imageing sensor (below, claim cmos sensor) 23 by the image pickupoptical system 22 that is made of battery of lens and prism.The behind ofilluminating window 21 is furnished withilluminating lens 25, towards the illumination light of look-out station irradiation from light supply apparatus 12.Be directed to describedilluminating lens 25 by generalflexible cord 16 or thephotoconductions 24 that are equipped in theinsertion section 13 from this illumination light of this light supply apparatus 12.By be configured for the throwing light on Lighting Division of various look-out stations such as theselight supply apparatuses 12,photoconduction 24,illuminating lens 25,illuminating window 21.
Operating portion 14 be provided be used to makeinsertion section 13 front up and down the left and right directions bending angle knob or be used for from theinsertion section 13 front end face and make supplying gas of air, water ejection or send the water button.Andoperating portion 14 is provided with the shutter release button that is used for still image record observation image, the electronics amplification of ordering the observation image that is shown indisplay 17 or the functional units such as zoom button that dwindle.
In addition, the front end face ofoperating portion 14 is provided with the forceps channel of inserting treatment tools such as energising scalpel.Forceps channel is communicated in the pliers outlet (not shown) of passing the pliers passage in theinsertion section 13 and being arranged at the front end ofinsertion section 13.
Processor device 11 is electrically connected withlight supply apparatus 12, the action of blanket control electronic endoscope system 2.Processor device 11 is powered to fujinonelectronic video endoscope 10 by generalflexible cord 16 or the slotting transmission cable that leads ininsertion section 13, and the driving of control cmos sensor 23.In addition,processor device 11 receives from the image pickup signal ofcmos sensor 23 outputs by transmission cable, and it is imposed various processing.The view data that is obtained is sent to thedisplay 17 that cable is connected inprocessor device 11, shows as observing image.
Among Fig. 2, be provided with timing generator (TG) 26, CPU27 in the operating portion 14.In addition, TG26 can be arranged in the cmos sensor 23.In thecmos sensor 23, via describedcamera window 20, described to objectoptical system 22, be incident to camera watch region 50 (with reference to Fig. 3) from the light of look-out station.As everyone knows, be formed with the chromatic filter that constitutes by a plurality of color chips sections in thecamera watch region 50 ofcmos sensor 23, for example be formed with the primary colors (RGB) of Bayer arrangement or the chromatic filter of complementary color (CMY or CMYG).
CPU27 drives TG26 according to the action initiation command of the CPU30 of from processor device 11.TG26 gives clock signal to cmos sensor 23.Cmos sensor 23 is taken action based on the clock signal from TG26, and output image pickup signal (seasonal effect in time series picture element signal).The image pickup signal that is obtained inputs toprocessor device 11 by generalflexible cord 16,adapter 15, is stored in the operation memorizer (not shown) of digital signal processing circuit (to call DSP in the following text) 33 temporarily.
The action of blanketcontrol treatment apparatus 11 integral body of CPU30.CPU30 is connected with each several part by not shown data/address bus or address bus, control line.Store the various programs (OS, application program etc.) or the data (graphical data etc.) of the action that is used forcontrol treatment apparatus 11 among the ROM31.CPU30 reads required program or data from ROM31, and is that RAM32 launches to operation with memorizer, carries out the program of being read one by one.In addition, CPU30 obtains the Word message of check data and time, inspected object or operator etc. frominput operation part 36 or LAN networks such as (Local Area Network), and is stored in RAM32.
Image pickup signal fromcmos sensor 23 is sent to DSP33.This DSP33 imposes various signal processing such as color separation, color interpolation, gain calibration, white balance adjustment, gamma correction and is converted to view data to image pickup signal.The operation that the view data of having carried out Flame Image Process with DSP33 is input to Digital Image Processing circuit (to call DIP in the following text) 34 is with memorizer (not shown).
DIP34 imposes various Flame Image Process such as electronics becomes doubly or color is emphasized, the edge is emphasized to the view data from DSP33.The view data that imposes various Flame Image Process with DIP34 is input to displaycontrol circuit 35.
Display control circuit 35 has the VRAM of storage from the view data of having handled of DIP34.Display control circuit 35 receives the graphical data of ROM31 and RAM32 from CPU30.The demonstration of hiding the invalid pixel zone of observing image and only the showing effective pixel area territory Word message of mask, check data and time or inspected object or operator etc., graphic user interface (GUI) etc. are arranged in the graphical data.35 pairs of view data from DIP34 of display control circuit impose various demonstration control treatment, for example impose the overlapping processing that shows with mask, Word message, GUI, describe processing etc. to the display frame ofdisplay 17.
Display control circuit 35 is read view data from VRAM, and the view data of reading is converted to video signal (component signal, composite signal etc.) based on the display format of display 17.Thus, show the observation image to display 17.
In theinput operation part 36, for facility, comprehensively illustrate the basket that is arranged atprocessor device 11 operation panel, be positioned at the button or the known input equipments such as mouse or keyboard of theoperating portion 14 of fujinon electronic video endoscope 10.CPU30 makes the each several part action based on the operation signal frominput operation part 36.
On theprocessor device 11 except above-mentioned content, also be provided with predetermined compressed format (for example JPEG form) to view data impose compression of images compression processing circuit or and shutter release button operation interlock and and the network I/F etc. that the image data storage of compression carried out the transmission control of various data between the networks such as media I/F, LAN of removable media such as CF card, magneto-optic disk (MO), CD-R.These parts are connected with CPU30 by data/address bus.
Light supply apparatus 12 haslight source 40, wavelengthselective filters 41, reaches CPU42.The CPU42 action control of linelight source driver 43 and wavelengthselective filters 41 of going forward side by side of communicating by letter with the CPU30 ofprocessor device 11.
Light source 40 is to produce the xenon lamp of normal optical (for example white light of the wave band below the above 800nm of 400nm) of the wavestrip from red to blue broad or White LED (light emitting diode) etc., bylight source drive 43 drivings.The illumination light of sending fromlight source 40 is by collectinglens 44 optically focused and from the incident end incident ofphotoconduction 24.
Wavelengthselective filters 41 is a special light from the specific narrow band optical of the light extraction that is sent by light source 40.As shown in Figure 5, wavelengthselective filters 41 has half shape that is cut open of disk, rotates with motor in the mode of crossing betweenlight source 40 and the collecting lens 44.In addition, be provided with the pick off that detects its position of rotation in the wavelength selective filters 41.Wavelengthselective filters 41 cross betweenlight source 40 and the collectinglens 44 during, the illuminated special light of endoceliac look-out station.The barbed portion of wavelengthselective filters 41 cross betweenlight source 40 and the collectinglens 44 during, the illuminated normal optical of look-out station.As special light, for example use 450,500,550,600, near the wavelength light the 780nm.
Near the 450nm special light is suitable for the observation of the minute structure on look-out station surfaces such as the blood vessel on top layer or pit pattern.If use near the illumination light the 500nm, then can observe macroscopic sag and swells such as the depression of look-out station or protuberances.Near the 550nm its absorbance based on hemoglobin of illumination light is higher, is suitable for the observation of trickle blood vessel or skin rubefaction.Near the 600nm illumination light is suitable for plump observation.For the observation of deep-level blood vessel, by intravenous injection Indocyanine green (ICG; ) wait fluorescent material and use near the illumination light of 780nm, can clearly observe.
In addition, aslight source 40, aslight source 40, then can omit wavelengthselective filters 41 as if a plurality of LED that use the light that different-waveband takes place, laser diode etc.And, by controlling opening and closing of these, switch normal optical and special light.In addition, also can use the fluorophor that green~xanchromatic exciting light takes place for blue laser light source and the irradiation by blue laser to produce normal optical, and further produce special light with wavelength selective filters.Can certainly under the state that keeps wavelengthselective filters 41, append a plurality of LED, laser diode etc.
Photoconduction 24 is the parts for making optical fiber and tie together with a plurality of quartz of boundlings such as coiling adhesive tape for example.Spread the illumination light that derives from the exit end ofphotoconduction 24 withilluminating lens 25, and be radiated at the intravital look-out station of inspected object byilluminating window 21.
Among Fig. 3,cmos sensor 23 comprisescamera watch region 50,vertical scanning circuit 51, correlated-double-sampling processing (CDS)circuit 52,column selection transistor 53,output circuit 54 andhorizontal scanning circuit 55.
As everyone knows, be furnished with a plurality ofpixels 56 two-dimensionally in mode in the camera watchregion 50 along line direction (horizontal line direction) and column direction (vertical line direction).Vertical scanning circuit 51 is driven by TG26, moves the row that should read successively.In addition,horizontal scanning circuit 55 moves the row that should read successively by TG26 control.CPU is except the action of controlling described TG26, and controlvertical scanning circuit 51 is specified the row that should be read out when the part of pixel is read.Vertical scanning circuit 51 andhorizontal scanning circuit 55 constitute scanner section, and TG26 and CPU27 formation scan control section.
Described eachpixel 56 has photodiode D1, amplifies with transistor M1, pixel and select with transistor M2 and reset to use transistor M3.Photodiode D1 generates based on the signal charge of incident light quantity by opto-electronic conversion and puts aside.Savings the signal charge of photodiode D1 based on the voltage of accumulative signal charge be exaggerated and be read out as picture element signal with transistor M2 by the pixel selection after amplifying with transistor M1.Therefore, when the reading of signal charge, signal charge can not passed on from pixel as CCD, but remains in each pixel.
In addition, if read end, the signal charge that then remains in the pixel forces be expelled to drain electrode with transistor M3 with the unit of going by resetting.Say that correctly this resets and relies on photodiode D1, the capacitor of savings signal charge is charged to power supply potential forcibly.Pixel is selected with transistor M2 and resets with transistor M3 to be the N channel transistor, to become opening when grid is applied High rank " 1 ", become closed condition when applying Low rank " 0 ".
In thecamera watch region 50, when horizontal direction (directions X) distribution has row to select line L1 and horizontal reset line L2, to vertical direction (Y direction) distribution column signal line L3 is arranged fromCDS circuit 52 from vertical scanning circuit 51.Row selects line L1 to be connected in the grid that pixel selects to use transistor M2, and horizontal reset line L2 is connected in the grid that resets with transistor M3.In addition, column signal line L3 is connected in the source electrode that pixel selects to use transistor M2, and is connected in thecolumn selection transistor 53 of pairing row by CDS circuit 52.In addition, row selects line L2 and column signal line L3 to be also sometimes referred to as horizontal scanning line and vertical scan line.
CDS circuit 52 keeps selecting the picture element signal of thepixel 56 of line L1 from the row that is connected in 51 selections of vertical scanning circuit according to the clock signal from the TG26 input, and carries out noise removal.Horizontal scanning circuit 55 produces horizontal time-base according to the clock signal from the TG26 input, and the opening and the closed condition of controlcolumn selection transistor 53.
Column selection transistor 53 is arranged between theoutput bus circuit 57 andCDS circuit 52 that isconnected output circuit 54, and selecting based on horizontal time-base should be to the pixel ofoutput bus circuit 57 output pixelsignals.Output circuit 54 amplifies successively fromCDS circuit 52 after the picture element signal thatoutput bus circuit 57 passes on, and carries out the A/D conversion and exports as digital signal.Based on the amplification of the picture element signal ofoutput circuit 54 by regulating tooutput circuit 54 input gain conditioning signals from CPU27.
As shown in Figure 4,vertical scanning circuit 51 possesses has vertical scanning to use shift register 61 with shift register 60 with resetting.Vertical scanning produces vertical scanning signal with shift register 60 according to the clock signal from the TG26 input, selects row to select line L1 to change the row that picture element signal should be exported to thepixel 56 of column signal line L3 with per 1 behavior unit.Reset and select horizontal reset line L2 with per 1 behavior unit, and the signal charge of thepixel 56 that will select with the unit of going is expelled to drain electrode via resetting with transistor M3 with shift register 61.
Each shift register the 60, the 61st, series connection input-output type in parallel has number D flip-flop 62a~62n, the 63a~63n corresponding with line number.As everyone knows, when clock signal (clk) was imported, the trigger of the next line that shift register connects to cascade successively (next section) passed on the maintenance data (" 1 " or " 0 ") of each trigger.So, keeping data is that unit is passed on by clock signal (clk) with per 1 step.
Vertical scanning is furnished with trigger 62a with the 1st row of shift register 60.When carrying out vertical scanning, the input terminal D (start) of this trigger 62a is endowed the enable signal synchronous with clock signal " 1 ".Similarly, reset with the 1st capable trigger 63a that is furnished with of shift register 61.When carrying out homing action, this trigger 63a its input terminal D (start) is endowed the enable signal synchronous with clock signal " 1 ".
Be connected with on vertical scanning its each lead-out terminal Q of trigger 62a~62n with shift register 60 each row select line L1_1, L1_2 ..., L1_n-1, L1_n.In addition, reset be connected with on its each lead-out terminal Q of trigger 63a~63n with shift register 61 horizontal reset line L2_1, L2_2 ..., L2_n-1, L2_n.Is that unit shifts between trigger 62a~62n by enable signal " 1 " accompanying clock signal with per 1 step, select line L1_1~L1_n to give " 1 " to row successively, and pixel is selected to become opening successively with transistor M2.The picture element signal of each row is exported successively thus.In addition, be that unit shifts between trigger 63a~63n by enable signal " 1 " accompanying clock signal with per 1 step, give " 1 " to horizontal reset line L2_1~L2_n successively, resetting becomes opening successively with transistor M3.The signal charge of each row is discharged to drain electrode successively thus.
Vertical scanning with the trigger of the odd-numbered line of shift register 60 for example the trigger of the lead-out terminal Q of 62a and even number line for example be connected with change-over switch 64a between the input terminal D of 62b.In addition, the trigger of even number line for example the trigger of the lead-out terminal Q of 62b and odd-numbered line for example be connected with change-over switch 64b between the input terminal D of 62c.These change-over switches 64a, 64b are switched by the CPU27 interlock.
The trigger of odd-numbered line for example is furnished with by-pass line 65 between 62a and the 62c.Change-over switch 64a, 64b switch to based on switching signal (swich) from CPU27 each trigger that connects institute's adjacency input and output terminal D, Q state (non-action state shown in Figure 4) and connect state (operating state) between the trigger 62c of odd-numbered line by the trigger 62b that by-pass line 65 is skipped even number line.
By change-over switch 64a, 64b, under the state between the trigger 62 that connects odd-numbered line, enable signal can not be imparted to the trigger of even number line, so the trigger of even number line remains " 0 ".Therefore, the row of dual numbers row select line for example the L1_2 data of giving still be " 0 ", do not carry out the reading of signal charge of even number line.Therefore, change-over switch 64a, when 64b is in operating state passes in shift register 60 at vertical scanning when keeping data once to skip 1 trigger.Its result is every 1 capable read (reading with 1 between-line spacing) of carrying out signal charge.
Reset to be provided with among trigger 63a~63n with shift register 61 and be used for not using clock signal and import input terminal P, C for the signal (preset, clear) of the data that keep " 1 " or " 0 " forcibly.When both sides' input of input terminal P, C had " 0 ", the data that are imparted to input terminal D were read into based on clock signal.At this moment, carry out the shift action of data based on clock signal between trigger 63a~63n, the signal charge of each row is discharged to drain electrode successively.On the other hand, input terminal P is transfused to " 1 " and input terminal C when being transfused to " 0 ", has no relation with the data that are imparted to input terminal D, is resetting with the data that keep " 1 " among all trigger 63a~63n of shift register 61.At this moment, all horizontal reset line L2 are endowed the data of " 1 ", and all pixels one that execution is expelled to drain electrode simultaneously with signal charges of all row are drawn together and resetted.
After all pixels one were drawn together and resetted, input terminal P was transfused to " 0 ", and input terminal C is transfused to " 1 ".At this moment, have no relation, resetting with the data that keep " 0 " among all trigger 63a~63n of shift register 61 with the data that are imparted to input terminal D.That is, all trigger 63a~63n are eliminated.
Have common screening-mode, special screening-mode and while screening-mode in selectable mode in the electronic endoscope system 2.Common screening-mode is to look-out station irradiation normal optical and take normal image.Special screening-mode is to look-out station irradiation special light and take particular image.Screening-mode alternately shines normal optical and special light and while (being continuously strictly speaking) shooting normal image and particular image both sides to look-out station simultaneously.
Can select near the wavelength light aforesaid 450,500,550,600, the 780nm in the special screening-mode.In addition, in the screening-mode, select the side in frame rate mode of priority and the picture quality mode of priority to carry out at the same time.The selection of each pattern is undertaken by the operation ofinput operation part 36.
Though the frame rate mode of priority is obtained image owing to the pixel number that reduces normal image and particular image makes the picture quality variation with the frame rate identical with common screening-mode or special screening-mode.The picture quality mode of priority is compared with common screening-mode or special screening-mode, though make the frame rate variation, obtains the image of the high image quality identical with common screening-mode or special screening-mode.
When selecting common screening-mode, CPU30 openslight source 40 by the driving of CPU42 control light source drive 43.In addition, make wavelengthselective filters 41 actions, and the barbed portion that makes wavelengthselective filters 41 is betweenlight source 40 and collectinglens 44 according to the output of position of rotation detecting sensor.The illumination light that is radiated at look-out station has only normal optical.On the other hand, when selecting special screening-mode, when being opened,light source 40 make wavelengthselective filters 41 betweenlight source 40 and collecting lens 44.The illumination light that is radiated at look-out station has only special light.
In common screening-mode and special screening-mode,cmos sensor 23 carries out the action of roller shutter shutter mode shown in Figure 10.Change-over switch 64a, 64b are the state of Fig. 4 of input and output terminal D, Q of each trigger 62 of connection institute adjacency, and, all be transfused to " 0 " among input terminal P, the C of resetting with the trigger 63 of shift register 61.At this moment, each shift register 60,61 is selected line L1, horizontal reset line L2 with per 1 behavior unit base line successively respectively.Owing to can't switch illumination light, even makecmos sensor 23 actions in roller shutter shutter mode, each pixel is also put aside the signal charge based on equal illumination light, therefore can not make vision-mix.
Put aside electric charge if horizontal reset line L2 is transfused to reset signal and be reset (becoming " 0 " from " 1 " to the input that resets with shift register M3), then eachpixel 56 restarts to carry out the electric charge savings.And, based on selecting the input of the vertical scanning signal of line L1 to carry out reading of signal charge to row.By walking to last column this action repeatedly successively from first, carry out the reading of signal charge of the image of 1 frame amount.
At the same time in the screening-mode, when selecting the frame rate mode of priority,cmos sensor 23 as shown in Figure 6 as action.Change-over switch 64a, 64b become the state between connection is connected in odd-numbered line by the swich signal the trigger 62.Thus, skip the pixel of even number line, read the picture element signal (reading at interval) of the pixel of odd-numbered line.
On the other hand, at the same time in the screening-mode, when selecting the picture quality mode of priority,cmos sensor 23 as shown in Figure 7 as action.Change-over switch 64a, 64b are identical during with common screening-mode, special screening-mode, become the state of Fig. 4 of input and output terminal D, the Q of each trigger 62 that connects institute's adjacency, read all each pixel signal charges (all pixels are read) successively with behavior unit.
Frame rate is preferential, the picture quality mode of priority all after the reading of the signal charge that finishes 1 frame amount, the input terminal P that resets with all trigger 63a~63n of shift register 61 is transfused to " 1 " (input terminal C is transfused to " 0 ").Thus, when the signal charge of all pixels is expelled to drain electrode (all pixels one are drawn together and resetted) simultaneously, begin the electric charge savings of all pixels.After all pixels one were drawn together and resetted, the input terminal P of trigger 63 was transfused to " 0 ", and input terminal C is transfused to " 1 ", is eliminated to the default of trigger 63.
And, during reading the signal charge of all pixels (from begin reading out to of first row finish till the reading of last column during),light source 40 is closed.In addition, wavelengthselective filters 41 rotates as follows, i.e. mode of alternately shining normal optical and special light with unit during the savings of cmos sensor 23.Thus, unit across the down periods and during with the savings ofcmos sensor 23 switches to normal optical and special light successively.In addition, the lightproof area that normal optical and special light also can be set in wavelengthselective filters 41 replaces closinglight source 40, and rotation wavelengthselective filters 41 is consistent so that lightproof area is entered during the shading of light path between reading duration with all signal charges of 1 frame.
During the frame rate mode of priority because the read-only signal charge that goes out odd-numbered line, so the required time of read output signal electric charge be when reading picture quality mode of priority of all row successively half.Therefore, the frame rate mode of priority can generate image with 2 times frame rate of picture quality mode of priority.But, to compare with the frame rate mode of priority of reading at interval, the picture quality mode of priority of reading all pixels can access the higher qualitative picture of vertical resolution.
When selecting the frame rate mode of priority, processor device DSP33 will carry out interpolation processing from the image pickup signal that fujinon electronic video endoscope reads in, and form the image of 1 frame.Particularly, the picture element signal that uses odd-numbered line carries out interpolation to the picture element signal of the even number line skipped.Display control circuit 35 is in common screening-mode or special screening-mode, and the animation of normal image or particular image or static picture are shown indisplay 17.
In addition, in the screening-mode, select a side of normal image and particular image to show its animation or static picture at the same time based on the operation of input operation part 36.Perhaps, animation or the static picture with 2 kinds of images is shown indisplay 17 simultaneously.Particularly, normal image and particular image arranged be shown in display, or carry out nested demonstration (face in the picture, PinP).And, can also be with the mode Alternation Display (overlapping demonstration) that repeats 2 kinds of images.In addition, this display mode is an example, can carry out various deformation.For example, can prepare many display, with first as normal image usefulness, with second as particular image with (a plurality of display form).At this moment, normal image and particular image are shown in 2 display individually.
Then, the effect toelectronic endoscope system 2 describes.When observing inspected object, fujinonelectronic video endoscope 10 is connected in and respectively installs 11,12.Open and respectively to install after 11,12 the power supply, operationinput operation part 36 is also imported the information etc. of relevant inspected object.
Afterprocessor device 11 orders beginning inspection,insertion section 13 is inserted in the body cavity of inspected object.After the insertion, the limit is used from the illumination light oflight supply apparatus 12 throwing light in the body cavity, and endoceliac look-out station is taken withcmos sensor 23 in the limit.The observation pictorial display that obtains by this shooting is indisplay 17.
Be input to the DSP33 ofprocessor device 11 from the image pickup signal ofcmos sensor 23 outputs.DSP33 to image pickup signal impose after the various signal processing with its as image data transmission to DIP34.
In DIP34, under the control of CPU30, view data is imposed various Flame Image Process.Be sent to the VRAM ofdisplay control circuit 35 with DIP34 processed images data.Indisplay control circuit 35, according to carry out various demonstration control treatment from the graphical data of CPU30.Thus, view data is as observing pictorial display indisplay 17.
When usingelectronic endoscope system 2 to check, the position is that the object of the look-out station of mucosa or SM blood vessel and so on, the decisions such as pathological changes classification of look-out station should be radiated at the wave band of the illumination light of look-out station according to the observation.In addition, the wave band of this illumination light can see that observing the image limit suitably changes to the wave band of diagnosing easily in the limit in observing the way.
Usually, select common screening-mode, limit to observe to shine upon time ininsertion section 13 insertion patients' the body cavity and insert operation on the normal image limit of display 17.Select special screening-mode during the pathological changes that within look-out station, find to need to observe in detail.At this moment, select to shine diseased region according to the special light of the wave band of the classification of pathological changes etc.In thedisplay 17, the look-out station image that throws light on special light is shown as particular image.
When desire comparison normal image and particular image are observed, select screening-mode simultaneously.The relatedness of attention and normal image or particular image and when wishing to get image under the same number of frames speed, select the frame rate mode of priority.Select the picture quality mode of priority when paying attention to picture quality.And, select common screening-mode or special screening-mode as required and the rest image under the selected pattern is shown in display 17.Need when look-out station is disposed, make various treatment tools plug in the pliers passage that leads at fujinonelectronic video endoscope 10, impose disposal such as excision pathological changes or dispensing.
When selecting common screening-mode byinput operation part 36,light source 40 is opened under the instruction of CPU30, the barbed portion of wavelengthselective filters 41 betweenlight source 40 and collectinglens 44, the illuminated normal optical of look-out station.When selecting special screening-mode, wavelengthselective filters 41 is arranged betweenlight source 40 and the collectinglens 44, and the special light that is extracted is radiated at look-outstation.Cmos sensor 23 moves in roller shutter shutter mode shown in Figure 10.That is, in thecmos sensor 23, owing to reset and read with the unit of going, so each row carries out the electric charge savings with the mutually different cycle.In thedisplay 17, according to selected screening-mode, normal image or particular image are shown as animation or static picture.
On the other hand, when selecting simultaneously screening-mode, rotation wavelengthselective filters 41 is so that alternately shine normal optical and special light with unit during the savings of cmos sensor 23.And between the reading duration of the signal charge ofcmos sensor 23,light source 40 is closed.
When selecting the frame rate mode of priority, as shown in Figure 6, odd-numbered line is carried out read (the reading at interval) of signal charge by the operation of input operation part 36.When selecting the picture quality mode of priority, as shown in Figure 7, all row are carried out reading of signal charge.In arbitrary pattern, all carry out all pixels one and draw together and reset, and begin the electric charge savings of allpixels 56 simultaneously in the down periods of illumination light.In thedisplay 17,2 kinds of images of normal image and particular image are arranged demonstration, so that compare easily.These 2 kinds of images can be any in animation or the static picture.Perhaps, also can on display, overlap 2 kinds of images.
In the present embodiment, read the signal charge ofcmos sensor 23, to switch normal optical and special plain edge is alternately obtained normal image and particular image in unit limit during the savings ofcmos sensor 23 in the down periods of illumination light.Therefore, normal image and particular image can be used as continuous images and are alternately read incessantly from cmos sensor 23.And, read the decline that can prevent frame rate and can make the frame rate of normal image and particular image identical by execution interval.
In the present embodiment, except the frame rate mode of priority that execution interval is read, also possess the picture quality mode of priority of reading all pixels, and these patterns are made as switchable mode, therefore can be according to the observation or situation about disposing select more appropriate mode.Therefore, compare with the situation that each pattern is set separately, convenience improves more.
At the same time in the screening-mode, draw together by all pixels one and to reset, the accumulative beginning of electric charge is consistent in all row opportunity.And use the dark place of fujinonelectronic video endoscope 10 in the inspected object body and so on, therefore makes the accumulative end of electric charge consistent in all row opportunity by closing light source 40.Therefore, its simple structure of cmos sensor of the present invention and cheap, and unlike roller shutter shutter mode, between each row, depart from during the electric charge savings, even the crooked phenomenon of image can not take place in the bigger subject of shooting activity yet.
In the above-described embodiment, select every 1 row in the frame rate mode of priority, the pixel number of achieving tangible results is half observation image of all pixel numbers.Also can select to replace above-mentioned situation every 1 row.At this moment,, regulate the clock signal that inputs tohorizontal scanning circuit 55, and make the column selection transistor become opening every 1 row read output signal electric charge in mode every 1 though scan all row successively.In addition, also can regulate the clock signal that inputs tovertical scanning circuit 51 orhorizontal scanning circuit 55, make the 56 one-tenth so-called black and white grid apperances of pixel that to read.
During discarded signal charge, constant when the illumination of normal optical or special light for electric charge savings time (time of exposure) that makes each pixel, need carry out all pixels one and draw together and reset.But, when carrying out resetting of all pixels, can reset with the unit of going in the down periods of illumination light.For example, can be in the time reading at interval the limit with after the mode of 1 row is selected limit read output signal electric charge, the signal charge of this row of reading is expelled to drain electrode pixel is resetted.At this moment, capable the resetting of n that will reset with shift register is made as identical opportunity with the vertical scanning of (n+1) row with reading of shift register.Similarly, after the read output signal electric charge, at once to this advance horizontal reset and the discarded signal charge of having read.In addition, to skipping the row of reading, also can be after finishing the reading of 1 frame successively (or one draw together) signal charge is expelled to drain electrode.
In the above-described embodiment, carry out reading of signal charge every 1 row.Also can in camera watch region, specify read range to replace above-mentioned situation.For example, in embodiment shown in Figure 8, usevertical scanning circuit 70 to specify and read begin column and end line, and only read the row of successive predetermined number.
When using the frame rate mode of priority, arrange according to chromatic filter and to select row, so that in the RGB pixel, do not produce the color that to read.According to the arrangement of chromatic filter, can not every 1 row but every 2 row read output signal electric charges.At this moment, the pixel number of reading in vertical direction becomes 1/3 of all pixels.Be not limited to RGB and arrange, the selection of going too during the arrangement of complementary color.For example, during with 2 row periodic arrangement chromatic filters, every 2 row read output signal electric charges.
In addition, the pixel interpolation among the DSP33 is also carried out the pixel interpolation according to color arrangement of reading pixel or reading method (every 1 row or every 2 row).In addition, when selecting the frame rate mode of priority, select the pixel of the chromatic filter that its reflected light or fluorescence sees through and read its signal charge according to the wavestrip of special light.
Among Fig. 8,vertical scanning circuit 70 has vertical scanning shift register 71.This vertical scanning is series connection input and input-output type in parallel in parallel, a plurality of D flip-flop 72a~72n with line number amount with shift register 71.Trigger 63a~63n with shown in Figure 4 amongtrigger 72a~72n is identical, is provided with the input terminal P of preset signal and the input terminal C of clear signal.The preset signal inputs to eachtrigger 72a~72n individually.In vertical scanning (shift action) way, if input terminal P is transfused to " 0 " and input terminal C is transfused to " 1 ", then alltrigger 72a~72n are held " 0 " data, and the action of reading of signal charge is forced to stop.In addition, it is identical with thevertical scanning circuit 51 of Fig. 4 with the structure of shift register to reset, and therefore omits diagram and explanation.
Carry out the part when reading, to input terminal P input " 0 " and to input terminal C input " 1 ", make alltrigger 72a~72n keep " 0 " afterwards, to input terminal C input " 0 ", and to the trigger of the row that begins to read, the input terminal P input " 1 " of for example 72a.And, identical when reading all pixels on the basis of input terminal P, C input " 0 ", make to keep data based clock signal betweentrigger 72a~72n, to shift successively, and output belongs to the signal charge of the pixel of reading begin column successively.Finish after the reading of the signal charge that belongs to the pixel of reading end line,, make alltrigger 72a~72n keep " 0 " to input terminal P input " 0 " and to input terminal C input " 1 ".Thus, remove alltrigger 72a~72n, and force the action of reading of stop signal electric charge.
For example, will move ahead most (the 1st row) as read that begin column is selected and with center row when reading end line and select, the first half of thecamera watch region 50 ofcmos sensor 23 is read out.As reading that begin column is selected and will going (n is capable) at last when reading end line and select, the latter half is read out with center row.With move ahead most and center row in the middle of row select as reading begin column, and, can read middle body with going in the middle of center row and the last row when reading end line and select.In addition, when reading beginning behavior the 1st row, need not to make thetrigger 72a that moves ahead most keep " 1 ", get final product but read action according to clock signal to input terminal D input enable signal " 1 " to input terminal P input " 1 ".
In addition, thepixel 56 that carries out reading at interval is not limited to half of camera watch region 50.For example, when using the illumination light of the inadequate wave band of light exposure, for example thepixel 56 that carries out reading at interval can be made as 1/3 of integral body, the required time of read output signal electric charge is shortened, and the time of exposure of lengthening respective amount.In contrast, in the time of can obtaining sufficient light exposure within a short period of time, thepixel 56 that carries out reading is at interval increased and make the required time lengthening of read output signal electric charge, shortening time of exposure but, from more pixel picked up signal electric charge, observe image preferably thereby can obtain picture quality.
In the above-described embodiment, chromatic filter is arranged in the mode that 1cmos sensor 23 ofcamera watch region 50 takes is illustrated using, be radiated at look-out station successively, and take frame sequential style of shooting this image, so-called with timesharing with monochromatic cmos sensor but also can use illumination light with RGB wave band of all kinds.
At this moment, for example use discoidconvolutional filter 80 shown in Figure 9.Convolutional filter 80 has R rayedzone 81, G rayedzone 82, the B rayedzone 83 of the light that is used to shine RGB wave band of all kinds and is used to shine the speciallight irradiation area 84 of special light.Eachzone 81~84 is arranged at respectively in the zoning withconvolutional filter 80 6 five equilibriums.Speciallight irradiation area 84 is equipped with 3 respectively altogether between R rayedzone 81, G rayedzone 82, B rayed zone 83.Thisconvolutional filter 80 is arranged betweenlight source 40 and the collectinglens 44, and,convolutional filter 80 is rotated continuously with the illumination light of sending RGB wave band of all kinds successively and the mode of special light.And, identical during screening-mode in the time of with above-mentioned embodiment, make cmos sensor andlight source 40 actions.
Normal image serves as that the basis generates with the image pickup signal of all kinds of the illumination light of illuminated RGB wave band of all kinds.Particularly, RGBRGB ... during so continuous output image pickup signal, from successive like this each group of RGB, GBR, BRG, generate normal image respectively.Therefore, though be radiated on the look-out station illumination light with R light, special light, G light, special light, B light, special light ... such order is passed, but alternately exports normal image and particular image.
When only obtaining particular image, the speciallight irradiation area 84 that makesconvolutional filter 80 is betweenlight source 40 and collecting lens 44.When only obtaining normal image, except thatconvolutional filter 80, though also prepare the zoning that R rayedzone 81, G rayedzone 82, B rayedzone 83 are arranged in trisection is not existed the convolutional filter (not shown) of special light irradiation area 84.This convolutional filter replacesconvolutional filter 80, is sleeved betweenlight source 40 and the collectinglens 44 and is rotated.
Also can use the combination of for example clock control formula phase inverter, clock row and decoder to wait replaces using D flip-flop in the vertical scanning circuit.
In addition, also can use the cmos sensor that is made as other structures to replace thecmos sensor 23 of simulation output type shown in Figure 3.For example, can use and A/D converter is equipped in theCDS circuit 52 and will comes the pick off of parallel output from the signal charge digitized thatpixel 56 is read and make digitized data carry out the pick off that serialization is exported by parallel/serial conversion circuit.
In addition, 1pixel 56 is made of 3 transistor M1~M3, but also can constitute 1 pixel by 4 transistors.And, also can select to use transistor M2 by a plurality ofpixel 56 total pixels.In addition, also can use the present invention for the signal charge of photodiode D1 being transferred to the common situation of using the diffusion part that floats of each photodiode D1 in the situation of diffusion part of floating, a plurality of relativelypixel 56 etc. with transistor.
In the above-described embodiment, the example that normal optical and special light are used as the illumination light that is radiated on the look-out station is illustrated, but use therein normal optical and special light are as long as wave band is different.And, also can use the different a plurality of special lights of wavestrip, shine 3 kinds of all illumination light successively, thereby obtain the image more than 3 kinds and these arrangements are presented on the display.
In addition, the illumination light of specific band that will be different with white visible light is illustrated as special light, but, can be to emphasize to show the infrared light of blood vessel or in white light, wave band is constrained to monochromatic or pleochroic light etc. for the self-intensity of fluorescence of emphasizing to show normal structure and pathological tissues as special light.Preferred these multiple special lights are made as can be according to optional structures such as the position that will observe or pathological changes.And, see that on the viewing duration limit display limit freely changes the structure of its wave band or composition that will blended wave band but preferably be made as.