US9270919B2 - Simultaneous display of two or more different sequentially processed images - Google Patents

Abstract

A medical imaging system having a processor with software executing thereon is provided for processing and display of multiple bandwidths of video in multiple display areas. The system receives a video signal with a plurality of portions and generates at least two signals there from. Each of the two signals has a bandwidth for display in a different display area. The two signals are updated so that each component displays a different portion of the input video signal, and the two signals may be combined for display on a single display device having two display areas.

Description

FIELD OF THE INVENTION

The invention relates to image capture, processing and display devices, and more particularly medical imaging and devices.

BACKGROUND OF THE INVENTION

During medical procedures, endoscopes and other imaging devices are used to perform minimally invasive surgery and diagnostics. These imaging devices typically use a broad band light source to illuminate the tissue inside a cavity so that an image sensor can capture the reflected light and send a signal to a processor for display.

A difficulty with the use of a white light or wide band light source is that hemoglobin absorbs the majority of optical light, and the penetration depth of light is closely related to the absorption spectrum of hemoglobin. In the visible spectrum, hemoglobin shows the highest absorption of blue (˜410-440 nm) and green (˜530-580 nm) wavelength regions. Therefore, optical information obtained in the blue and green spectral region can discriminate hemoglobin concentration an optimal way. Due to the short penetration depth of blue light (˜1 mm), intermediate penetration depth of green light (˜3 mm) and high penetration depth of red light (˜5 mm), the tissue structures near the surface are easily identified, but information in the red spectral region cannot be easily obtained due to the high penetration depth.

There are some known imaging systems that are capable of reducing the contribution of the red light region to a displayed image. For example U.S. Pat. No. 7,420,151 to Fengler et al. discloses a system for performing short wavelength imaging with a broadband illumination source includes an image processor that receives signals from a color image sensor. The image processor reduces the contribution of red illumination light to an image by computing blue, green, and blue-green (cyan) color components of display pixels from the signals received from the image sensor. The blue, green, and cyan color component values are coupled to inputs of a color monitor for display to produce a false-color image of the tissue.

U.S. Pat. No. 4,742,388 to Cooper et al. discloses a color video endoscope system having a light source and a solid state image sensor that transmits a signal to a video processor that converts the signal from the image sensor in to a composite RGB video signal, this RGB signal is received by the video processor and the signal is filtered electronically to vary the color image. Cooper discloses a number of potentiometers that allow the user to select and change red, green and blue gains applied to the signal.

U.S. Pat. No. 6,147,705 to Krauter discloses a video colposcope with a microcomputer having algorithms for color balance. A video camera obtains an electronic image. A CCD sensor converts an image into an analog electrical signal which is amplified and digitized. Using an algorithm-driven digital signal processing circuitry, color saturation, hue and intensity levels of the electronic image are modified according to the DSP reference filter algorithm.

U.S. Pat. No. 7,050,086 to Ozawa discloses a system for displaying a false-color image with reduced red component. The red, green and blue (“RGB”) signals are cyclically and sequentially read from a frame memory, and the frames are used to generate a digital video signal for display. The RGB components are emitted from the distal end face of a light guide and these RGB signals are sequentially and cyclically focused on the light receiving surface of a CCD image sensor. These RGB signals are then sequentially used to update a display or display memory. Optionally, the red component may be reduced by a switching circuit to display a false-color image.

Current systems synchronize the display of wide band and narrow band images. When the wide and narrow band images are both displayed on a monitor using a split screen, or on two monitors, the images are updated at the same time. Further, the required resolution for medical imaging devices may be rather high. Fengler appears to disclose that the wide band and narrow band images can be displayed at the same time, but the processor would need sufficient processing speed to accomplish this task.

Cooper appears to disclose a processor including a series of potentiometers that modify the RGB signal in a way that would allow for the elimination of the red component. These potentiometers allow for an adjustable filter that may be set or checked at the beginning of each procedure

Ozawa appears to disclose cyclically and sequentially reading image signals. However, wide and narrow band display regions are updated at the same time. Thus if one were to display both wide band and narrow band images on a split screen or two separate monitors, both the wide band and narrow band images would be updated simultaneously.

Improved visualization techniques can be used to provide a system that uses less processing power for the same resolution. Likewise, a higher resolution may be obtained with reduced processing power requirements in comparison to prior art systems.

It is therefore an object of the present invention to provide a system for display of wide and narrow band images that uses a cost effective processing technology.

Yet another object of the present invention is to provide an imaging system that can primarily display information obtained from the blue and green wavelength regions that suppresses the red region while reducing the required processing power in comparison to prior art systems.

It is further an object of the present invention to provide an imaging system with sufficient visibility of wide band and narrow band images with reduced hardware costs.

It is yet another object of the present invention to provide a narrow band imaging system that offers simplified settings for display of narrow band images.

It is yet another object of the present invention to provide a system with enhanced resolution without an increase in processing power.

SUMMARY OF THE INVENTION

These and other objects are achieved by providing a medical imaging system having a processor for receiving a video signal having a plurality of portions. A first signal generated according to a first signal processing mode, such as a first bandwidth. The first signal is generated by the processor from a first one of the plurality of portions of the video signal. A second signal is generated according to a second signal processing mode, such as a second bandwidth. The second signal is generated by the processor from a second one of the plurality of portions of the video signal. The processor alternately updates the first and second signals with portions of the video signal, the first and second signals each updated from a different one of the plurality of portions of the video signal. The first signal is for display in a first display area, the second signal is for display in a second display area.

The processor can combine the first and second signals for display on one display having the first and second display areas. The first and second display areas can also be on a two separate monitors. The first and second display areas can be configured as a picture-in-picture display.

The imaging system can include an interface provided by software executing on the processor. At least one bandwidth selection is received by the interface, the bandwidth selection indicative of at least one the first and second bandwidths.

In one aspect, one of the first and second signals is updated with one of the portions of the video signal to create an updated signal. A previously updated one of the first and second signals is for display at the same time as the updated signal, the updated signal and the previously updated signal for display in different display areas.

Other objects are achieved by providing a medical imaging system having at least one input module having a processor. A video signal is received by each of the input modules. A processed video signal is generated by each of the input modules from each of the video signals, and the processed video signal has a plurality of portions. A control module having a processor receives each of the processed video signals. A first signal generated according to a first signal processing mode, such as a first bandwidth. The first signal is generated by the processor of the control module from a first one of the plurality of portions of the processed video signal. A second signal is generated according to a second signal processing mode, such as a second bandwidth. The second signal is generated by the processor of the control module from a second one of the plurality of portions of the processed video signal. The processor of the control module alternately updates the first and second signals with portions of the processed video signal, the first and second signals are each updated from a different one of the plurality of portions of the video signal. The first signal is for display in a first display area, the second signal is for display in a second display area.

The processor of the control module can combine the first and second signals for display on one display having the first and second display areas. The first and second display areas can also be on a single monitor. The first and second display areas can be configured as a picture-in-picture display.

The imaging system can include an interface provided by software executing on the processor of the control module. At least one bandwidth selection is received by the interface, the bandwidth selection indicative of at least one the first and second bandwidths.

In one aspect, the first and second signals are updated with one of the portions of the video signal to create an updated signal. A previously updated one of the first and second signals is for display at the same time as the updated signal, the updated signal and the previously updated signal for display in different display areas.

In another aspect at least a first and a second video signal are received by the processor. The processor generating first and second signals from each of the first and second video signals. Each of the first signals are respectively for display in a first and third display areas. Each of the second signals are respectively for display in a second and fourth display areas. The first and third display areas are for display of the first bandwidth, the second and fourth display areas for display of the second bandwidth.

Other objects are achieved by providing a medical imaging system having a processor receiving an input video signal having a plurality of portions. An output video signal is generated by the processor from the output video signal. A plurality of components of the output video signal are generated in an order by the processor. Each component is generated according to one of a plurality of bandwidths. Each one of the plurality of components is generated by the processor from a different one of the plurality of portions of the input video signal. Each component of the output video signal is updated by the processor with portions of said input video signal according to the order. Each one of the plurality of components is for display in one of a plurality of display areas.

The plurality of components can be for display on a single display device or a single monitor.

The system can include an interface provided by software executing on the processor. At least one bandwidth selection is received by the interface, the bandwidth selection is indicative of at least one the first and second bandwidths.

Further, one of the components of the output video signal can be updated with one of the portions of the input video signal to create an updated component. A previously updated component of the output video signal can be included in the output video signal for display at the same time as the updated component, where the updated component and the previously updated component are for display in different display areas.

Each portion of the input video signal can have red, green and blue color components. Other color combinations are possible, and may depend on the camera sensor. For example, a CMYG sensor can be used in the camera, and the corresponding components can be reduced or enhanced depending on filter characteristics.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A is a schematic view of the medical imaging system according to an exemplary embodiment.

FIG. 1B is another schematic view of another exemplary embodiment of the system ofFIG. 1A.

FIG. 1C is another schematic view of another exemplary embodiment of the system ofFIG. 1A.

FIG. 1D is another schematic view of another exemplary embodiment of the system ofFIG. 1A.

FIGS. 2A and 2B are schematic view of prior art medical imaging systems.

FIG. 3A-3D are yet other schematic views of a medical imaging system ofFIG. 1A according to another exemplary embodiment.

FIG. 4 is a schematic view of an exemplary embodiment of the output signal generation shown inFIGS. 1B,1D and3A,3C.

FIG. 5 is a schematic view of an exemplary embodiment of the generation of two signals as shown inFIGS. 1A,1C and3B,3D.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1A shows a medical imaging system having an image capture device or camera, such as anendoscope2. Alight source22 illuminates the body cavity where theendoscope2 is inserted. Thelight source22 will typically be a broad band or white light source. Theendoscope2 produces avideo signal20, and the video signal has a plurality of portions etc. The video signal may come to the processor already divided into the plurality of portions. Alternately, theprocessor4 can divide the video signal into the portions for processing and display. Theprocessor4 can exist on a camera control unit or other imaging system. Thevideo signal20 is processed according to a pattern where different portions of thevideo signal20 are processed according to one or more signal processing modes, for example the video signal may be processed according to different bandwidth selections. Theselections60 are received by the processor. Theseselections60 can indicate, for example, different signal processing modes such as bandwidth ranges. For example, if it is desirable to reduce or eliminate the red component, a selection of the appropriate bandwidths can be received through aninterface6. The interface may exist on a separate device, such as a computer or wireless device. The interface may also be part of a camera control unit or imaging system having theprocessor4.

As shown inFIG. 1A, theselection60 results in two bandwidth ranges462,502 that are used to process the portions of thevideo signal20. Eachbandwidth range462,502 the video signal forms asignal46,50. The processor generates. Thesignals46,50 are alternately updated48 for displayed onmonitor8 and8′ havingdisplay areas80,82.

FIG. 1B shows one aspect where thesignals46,50 are displayed asingle monitor8 having twodisplay areas80,82. Also shown, signals46 and50 combined to form anoutput video signal400 for display on themonitor8.

FIG. 1C shows another aspect ofFIG. 1A where eachsignal46,50 is processed according to asignal mode462′ and502′.FIG. 1D shows another aspect ofFIG. 1B where eachsignal46,50 is processed according to asignal mode462′ and502′. It is contemplated that the signal mode can include many different image modification, formatting, filtering and processing techniques. These signal modes will modify the incoming signal, for example, to enhance those aspects or structures that are important to be able to see during a procedure. Optionally, aspects or structures that are less important to see during a procedure are suppressed. Some signal processing modes include a bandwidth selection as shown inFIGS. 1A and 1B, other signal processing modes may include, for example, edge enhancement, image sharpening or others. Combinations of signal modes are contemplated. For example, a bandwidth mode forsignal46 and an edge enhancement mode may be used forsignal50. Other combinations and permutations are contemplated.

FIG. 2A shows a prior art imaging system with anendoscope21 having alight source1. Asignal10 produced by theendoscope21 includes red101, green103 and blue105 components. Aprocessor121 computes thesignal10 to reduce thered component141. Thiscomputed image signal181 is sent to adisplay memory161.

FIG. 2B shows another prior art imaging system with anendoscope21 having alight source1. Asignal10 produced by theendoscope21 includes red, green and blue components. Aprocessor121 creates a whitelight image signal183 and acomputed image signal181. Thesignals183 and181 are sent to adisplay3, with twodisplay areas31,33. As shown in the figures, the whitelight image signal183 and the computedimage signal181 are both produced from the same part of the image signal.

FIG. 3A shows another embodiment of the imaging system of the present invention. In this case, multiple image capture devices, such asendoscopes2,2′ are each connected to aninput module2000,2000′. The input modules each have aprocessor2002,2002′. Each input module receives avideo signal20,20′ from the endoscope. The input module processes thevideo signal20,20′ to create a processedvideo signal2020,2020′. The control module receives the processed video signals and generates anoutput video signal4000, which is formatted4042 for display. Additional processing can take place after the alternate updating or after the generation of the output video signal. Theformatting4042 can prepare the signal(s) for the appropriate display, for example DVI, VGA, S-Video, Composite, 3G-SDI. In some areas, digital video formats and standards are currently being developed and adopted. The Society of Motion Picture and Television Engineers (SMPTE) is typically in the business of defining and adopting voluminous digital video formal standards. As each is adopted, various applications, and application improvements generally will also be realized. Some digital video standards currently in use are: IEEE-1394 FireWire®, ISO/IEC IS 13818, International Standard (1994), MPEG-2, and ITU-R BT.601-4 (1994) Encoding Parameters of Digital Television for Studios.

FIG. 3B shows another aspect of the imaging system of the present invention that is similar toFIG. 3A. In this case, the twosignals4110 and4120 are not combined into a single output signal and thesignals4110 and4120 are separately sent todisplays8000,8000′. It should be understood that various combinations of combined or un-combined signals are possible, for example, avideo signal20 may be processed into two signals that are combined to an output video signal, andvideo signal20′ may be processed into two signals that are not combined and are displayed on separate monitors.

FIGS. 3C and 3D show other aspects wheresignal modes4130′ and4140′ are used to generate thesignals4110 and4120. As previously discussed, the signal modes may be bandwidth selections, for example. Other signal modes as discussed herein are contemplated.

The control module can format4042 the signals and/or the output video signal for display. As shown inFIGS. 3A and 3B, the twosignals4110 and4120 are generated from different portions of each of the processedvideo signals2020,2020′. Each of the twosignals4110,4120 is processed according to abandwidth4130,4140.FIGS. 3C and 3D show a similar system where the two signals are processed according to asignal processing mode4130′,4140′. Theoutput video signal4000 is alternately updated4048 with the twosignals4110,4120 so that thedisplay areas8002 display different portions of the processedvideo signal2020. Other embodiments can include more than two signals, where each signal is processed according to a bandwidth and each of the signals is updated according to an order. For example, if there are three signals, the update order could beupdate signal1,update signal2,update signal3, repeat. Other orders are envisioned and this example should not be seen as limiting, however in many cases, each of the updates is taken from a different portion of the processed video signal. The example of the order can apply to an imaging system that does not use an input and control module configuration, similar to the system shown inFIG. 1A.

Thebandwidths4130 and4140 can be selected through aninterface6′ that can receivemultiple selections60′.Signal processing modes4130′ and4140′ can also be selected through theinterface6′. Theselections60′ may indicate the bandwidth selections or the processing mode selection for processing and display, and these selections are received by the processor. Although twobandwidths4130,4140 are shown inFIGS. 3A and 3B, more than two bandwidths may be selected. The same is true for the twosignal processing modes4130′ and4140′ shown inFIGS. 3C and 3D. Theinterface6′ can also select different numbers of bandwidths or signal processing modes for each camera. As an example, thevideo signal20 fromendoscope2 can be displayed in two display areas each with a different bandwidth, and thevideo signal20′ ofendoscope2′ can be displayed in four display areas, each with a different bandwidth. Therefore, the interface is configured to allow selections specific to each endoscope. The interface can be configured to have a number of pre-set filter characteristics that adjust the red, green and/or blue components of the video signal. There is also an option for customized settings that would allow settings to be adjusted depending on the specific needs of the physician. For example, customized filter settings. The interface may also be arranged to allow modification to filter characteristics or signal processing mode during a medical procedure to modify the resulting image in a customized way.

In the case of two cameras and two bandwidth selections, there would be four display areas used. The system can combine all four components generated from the video signals for display on a single monitor. Alternately, each camera can be associated with a particular monitor, with each monitor displaying the selected components or signals.

Each ofFIGS. 1A-D and3A-D show an imaging system that generates two signals or components for each camera, each with a different bandwidth. It may be desirable to generate more than two signals or components for each camera. In this case, theinterface6 would receive more than twoselections60. The system may also be programmed with multiple signal processing modes and more than two filter or bandwidth ranges. Each selection would indicate a particular bandwidth or range of bandwidths for use in generating a signal or component of an output video signal. Each signal or component would be generated from a different portion of the video signal or processed video signal, and each signal or component would be associated with a display area. The interface may be, for example, a touch screen, computer interface, buttons, switches, knobs, software or other mechanical, electrical and digital systems that may allow for human interaction with the system to set the parameters of the signal processing mode. It is also understood that a single signal processing mode may be selected for the one of the signals (or components thereof) where the other signal (or component thereof) is processed without modifying the content of the displayed signal. For example, when a bandwidth selection is received, the color components are modified to reduce or enhance a particular color or colors. If not processed according to a signal processing mode in the example of one signal being in false color mode, the other signal could be displayed with no color modification. Similar scenarios are contemplated with other processing modes discussed herein.

It is contemplated that mixtures of combined and uncombined signals can be displayed. Forexample endoscope2 can have two signals generated, each with a bandwidth or signal processing mode. The signals ofendoscope2 are then combined for display on a single monitor having two areas.Endoscope2′ can have two signals generated, each with a bandwidth. The two signals can then be displayed on two separate monitors. Thus in the present example, there would be 3 monitors for a total of 4 display areas. Other combinations are contemplated.

FIG. 4 shows an example of an output video signal having two components alternately updated for display where the signal processing mode is a false-color image having a bandwidth selection. The first portion of thevideo signal2100 is processed according to afirst bandwidth range4100, to generate afirst component4101 of a first portion of theoutput video signal4001. Thesecond component4102 of the first portion of theoutput video signal4001 as shown is generated fromportion 0. Sinceportion 0 may not contain data, the first portion of theoutput video signal4001 may only have one of the display areas showing content. As shown, the first portion of theoutput video signal4001 is displayed8100 on a monitor.

Thesecond portion2200 of the video signal is received by the processor and thisportion2200 is processed according to asecond bandwidth range4200 to generate thesecond component4202 of the second portion of theoutput video signal4002. Thefirst component4201 of the second portion of theoutput video signal4002 is retained from the first portion of theoutput video signal4001. That is,component4101 and4201 display the same content, and both are generated from thefirst portion2100 of the video signal. Thesecond portion2200 of the output video signal is used to update thedisplay8200.

Thethird portion2300 of the video signal is processed according to thefirst bandwidth range4300, the third portion of theoutput video signal4003 includes thecomponent4301, which is generated fromportion2300. Thesecond component4302 of the third portion of theoutput video signal4003 is the same ascomponent4202, and again,components4302 and4301 are generated from different portions of the video signal. Thethird portion2300 of the output video signal is used to update thedisplay8300

The fourth portion of thevideo signal2400 is received by the processor and processed according to the second bandwidth range to generate thesecond component4402 of the fourth portion of theoutput video signal4004. Thefirst component4401 of the fourth component of theoutput video signal4004 is the same as thefirst component4301 of the third portion of theoutput video signal4003. The fourth portion of theoutput video signal4004 is used to update thedisplay8400. The process is repeated with each successive portion of the video signal being alternately processed according to the first or second bandwidth range. The previously processed portion is retained for the non-updated component. Therefore, if theportions2100,2200,2300 and2400 are received at 60 Hz, each component of the output video signal is updated at 30 Hz. Likewise, if there are three bandwidth selections, the portions are received at 60 Hz, and each of the three components of the output video signal is updated at 20 Hz.

AlthoughFIG. 4 shows that the components are generated according to bandwidth ranges, it would be understood by one of skill in the art that the bandwidth ranges shown in the figures can be replaced with other signal modes. For example, the first and/or second components could be generated according to an edge enhancement signal processing mode and the second component can be generated according to a first bandwidth range. The system would alternately update the signal as referenced above, but with the different processing modes. The processing modes may be pre-set in some cases, and in others, the system can receive a selection of processing modes and characteristics of the processing modes. In the case of a false-color processing mode, the selection could first indicate a false-color mode and secondly indicate a particular bandwidth or selection of bandwidth ranges for use with the false-color mode.

FIG. 5 shows an example of two signals are alternately updated for display. The first portion of thevideo signal2100′ is processed according to afirst bandwidth range4100′, to generate afirst portion4101′ thefirst signal46. Thesecond portion4201′ of thefirst signal46 is retained from thefirst portion4101′ of thefirst signal46. Thethird portion4301′ of thefirst signal46 is generated from thethird portion2300′ of the video signal and processed according to thefirst bandwidth range4300′. Thefourth portion4401′ of thefirst signal46 is retained from thethird portion4301′ of thefirst signal46

Thefirst portion4102′ of thesecond signal50 as shown is generated fromportion 0. Sinceportion 0 may not contain data, the first portion of the second signal may only have one of the display areas showing content. Thesecond portion4202′ of thesecond signal50 is generated from thesecond portion2200′ of the video signal and processed according to asecond bandwidth range4200′. Thethird portion4302′ of thesecond signal50 is retained from thesecond portion4202′ of thesecond signal50 Thefourth portion4402′ of thesecond signal50 is generated from afourth portion2400′ of the video signal and processed according to thesecond bandwidth range4400′.

As shown, the first portions of the respective signals are for display indisplay areas8101′ and8102′. The second, third and fourth portions of the respective signals are for updating thedisplay8202′,8301′ and8402′ The non updatedportion8201′,8302′ and8401′ may be retained from the previously updated portion of the signal. The updating may repeat continuously during display according to the order shown.

AlthoughFIG. 5 shows that the components are generated according to bandwidth ranges, it would be understood by one of skill in the art that the bandwidth ranges shown in the figures can be replaced with other signal modes. For example, the first and/or second signals could be generated according to an edge enhancement signal processing mode and the second component can be generated according to a first bandwidth range. The system would alternately update the signal as referenced above, but with the different processing modes. The processing modes may be pre-set in some cases, and in others, the system can receive a selection of processing modes and characteristics of the processing modes. In the case of a false-color processing mode, the selection could first indicate a false-color mode and secondly indicate a particular bandwidth or selection of bandwidth ranges for use with the false-color mode.

The process is repeated with each successive portion of the video signal being alternately processed according to the first or second bandwidth range. The previously processed portion is retained for the non-updated component. Therefore, if theportions2100′,2200′,2300′ and2400′ are received at 60 Hz, the twosignals46′,50′ are each updated at 30 Hz. Likewise, if there are three bandwidth selections, the portions are received at 60 Hz, and each of the three signals are updated at 20 Hz. The display updating is continuous according to the order shown, but other orders or patterns are contemplated.

As discussed previously, it is often desirable to process a signal with reduced red component to better visualize tissue structures. The video signal can be processed to reduce or enhance different color components. The system can also be adapted to process a video signal from a CMYG color sensor. In such a case, the relevant color components from the CMYG sensor can be reduced or enhanced depending on the desired filter characteristics.

The present system includes a computed virtual chromoendoscopy (CVC) system that provides for enhanced visibility between certain structures with different hemoglobin concentrations and to enhance visibility of surface structures to distinguish and classify types of tissue.

The present system uses a broadband white-light illumination (light source), and endoscope optics and video sensors, and a Camera Control Unit (CCU) having a processor or a Modular Camera Control Unit having a processor. The control unit is capable of a full color conversion calculation using software-based image processing. A Red-Green-Blue (RGB) color image sensor can be used. The image processor utilizes matrices that transform acquired color channels into a false-color image in order to display relevant tissue features more clearly. The color channels may be, for example, CCD or CMOS. Primarily, blue and green spectral wavelength regions are utilized, while the red spectral wavelength region is suppressed or attenuated. CMYG sensors can also be used to capture the video signal and likewise, the relevant components from the CMYG sensor can be enhanced, reduced or otherwise modified according to the desired filter.

In the present system, the settings in the color conversion can be chosen so that: a normal white-light image rendering (with natural colors) is obtained; or a false-color image rendering is obtained, in particular, where the signals from the blue and green input channels are essentially used to generate the output image, while the signal from the red color channel is strongly suppressed. The system provides one or more different filter options for obtaining a false-color image. Each filter may produce a different intensity of the false-color scheme for assisting the practitioner in imaging the tissue of interest.

One example of the color transformation coefficient matrices used for the present filter modes are as follows, with the coefficients represented by letters a-i, and SPIE representing the transformed or false-color image:

$\left[\begin{array}{c}r\\ g\\ b\end{array}\right]\mathrm{SPIE}=\left[\begin{array}{ccc}a& b& c\\ d& e& f\\ g& h& i\end{array}\right]\times \left[\begin{array}{c}R\\ G\\ B\end{array}\right]=\left[\begin{array}{ccc}\mathrm{aR}& +\mathrm{bG}& \mathrm{cB}\\ \mathrm{dR}& \mathrm{eG}& \mathrm{fB}\\ \mathrm{gR}& \mathrm{hG}& \mathrm{iB}\end{array}\right]$
In one example, the filter coefficients may be as follows:

$\begin{array}{c}\left[\begin{array}{c}r\\ g\\ b\end{array}\right]\mathrm{SPIEs}=\left[\begin{array}{ccc}-0.0409& 1.3204& -0.3128\\ -0.0409& 0.1836& 1.0032\\ -0.0409& 0.0324& 1.0088\end{array}\right]\times \left[\begin{array}{c}R\\ G\\ B\end{array}\right]\\ =\left[\begin{array}{ccc}-0.0409R& +1.3204G& -0.3128B\\ -0.0409R& +0.1836G& +1.0032B\\ -0.0409R& +0.0324G& +1.0088B\end{array}\right]\end{array}$

The present system is implemented with matrix multiplication in a color space where luminance and chrominance are combined. In this design, the input color signal is a combined RGB signal. The output is a RGB signal, which may have been color converted to a false-color image rendering. Other filter coefficients are contemplated and the example above should not be seen as limiting.

Although aspects of the present system have been described with reference to a reduced red component, the video signal may be processed for reduced blue, green or other components. In this case, the above example of the filter coefficients, reduced blue or green component would require different filter characteristics. The same holds true for a CMYG sensor or any other type of sensor in that the filter can be selected to modify the image to show desired characteristics.

As discussed previously, many signal processing modes display modes are contemplated with the present system. The signal processing modes modify the incoming image signal so that a modified image signal can be displayed. Some of these include switching between a normal white-light image or a computed mode image on a singular display; displaying both the normal white-light image and the computed mode image side-by-side on a singular display; a picture-in-picture display featuring both the normal white-light image and the computed mode image; and displaying the normal white-light image and the computed mode image on two separate displays. Further, switching from white-light image rendering to computed mode may not require additional white balance. The system can also update various other types of signal processing modes for display. The types of signal processing modes can include, for example, false or enhanced color, edge enhancement, texture enhancement, sharpness adjustment, fiber image bundle. The fiber image bundle may remove a honeycomb mosaic resulting from different optical fiber bundles. This list should not be seen as exhaustive as other signal processing modes can be used to modify the incoming signal or portion of a signal for display.

Edge enhancement may include a signal processing technique that recognizes certain tissue structures based on their reaction to the light source. The edge enhancement technique would therefore modify the signal based on a computation that would identify the location of an edge of a particular tissue structure or type of tissue structure. This may help a physician identify the tissue structure.

In the present system, the white light and computed images are processed by alternating portions of the video image. It is also contemplated that different types of computed images may be used where appropriate, the computed images may be processed according to a signal processing mode. In some cases, it may be desirable to have all displays showing computed images of different types. It is also contemplated that different color enhancements can be used, for example, red, blue and green components can all be attenuated, enhanced or suppressed to create different false-color images. As an example, the first captured portion is processed to display a first white light image. The second captured portion is processed to display a first computed image. The third captured portion is processed to update the white light image. The fourth captured portion is processed to update the computed image, and so on. As discussed above, it is contemplated that the first white light image may be replaced with a second computed image. It is also contemplated that more than two processing modes can be displayed and alternately updated. For example, a first portion is processed to display a first computed image, a second portion processed to display a second computed image, a third portion processed to display a third computed image and a fourth portion processed to display the first computed image, with the pattern repeating as additional portions are processed for display. It is also understood that different bandwidth selections within a false or enhanced color mode can be considered different signal processing modes. For example, a first signal processing mode could be a white light or wide band mode and a second processing mode could be a reduced-red light or narrow band mode. These examples provided are not intended to be limiting as other combinations and updating patterns can be used to display the computed image(s).

Claims (35)

What is claimed is:

1. A medical imaging system comprising:

a video signal having a plurality of portions;

a processor for receiving said video signal;

a first signal having a first bandwidth generated by said processor from a first one of the plurality of portions of said video signal; and

a second signal having a second bandwidth generated by said processor from a second one of the plurality of portions of said video signal;

said processor alternately updating said first and second signals with portions of said video signal, said first and second signals each updated from a different one of the plurality of portions of said video signal;

said first signal for display in a first display area, said second signal for display in a second display area;

one of said first and second signals updated with one of the portions of said video signal to create an updated signal, a previously updated one of said first and second signals for display at the same time as the updated signal, the updated signal and said previously updated signal for display in different display areas.

2. The imaging system ofclaim 1 wherein said processor combines said first and second signals for display on one display having the first and second display areas.

3. The imaging system ofclaim 1 wherein the first and second display areas are on a single monitor.

4. The imaging system ofclaim 3 wherein the first and second display areas are configured as a picture-in-picture display.

5. The imaging system ofclaim 1 further comprising:

an interface provided by software executing on said processor;

at least one bandwidth selection received by said interface, said bandwidth selection indicative of at least one the first and second bandwidths.

6. The medical imaging system ofclaim 1 wherein each portion of said video signal has red, green and blue color components.

7. A medical imaging system comprising:

at least one input module having a processor;

a video signal received by each said input module;

a processed video signal generated by each said input module from each said video signal, said processed video signal having a plurality of portions;

a control module having a processor for receiving each said processed video signal;

a first signal having a first bandwidth generated by the processor of said control module from a first one of the plurality of portions of said processed video signal; and

a second signal having a second bandwidth generated by the processor of said control module from a second one of the plurality of portions of said processed video signal;

the processor of said control module alternately updating said first and second signals with portions of said processed video signal, said first and second signals each updated from a different one of the plurality of portions of said video signal;

said first signal for display in a first display area, said second signal for display in a second display area;

one of said first and second signals updated with one of the portions of said video signal to create an updated signal, a previously updated one of said first and second signals for display at the same time as the updated signal, the updated signal and said previously updated signal for display in different display areas.

8. The medical imaging system ofclaim 7 wherein said processor combines said first and second signals for display on one display having the first and second display areas.

9. The medical imaging system ofclaim 7 wherein:

at least a first and a second video signals are received by said processor;

said processor generating first and second signals from each of said first and second video signals;

each said first signals respectively for display in a first and third display areas;

each said second signals respectively for display in a second and fourth display areas;

the first and third display areas for display of the first bandwidth;

the second and fourth display areas for display of the second bandwidth.

10. The imaging system ofclaim 9 wherein said first and second signals are for display on separate display devices.

11. The imaging system ofclaim 7 further comprising:

an interface provided by software executing on the processor of said control module;

at least one bandwidth selection received by said interface, said bandwidth selection indicative of at least one the first and second bandwidths.

12. The medical imaging system ofclaim 7 wherein each portion of said processed video signal has red, green and blue color components.

13. A medical imaging system comprising:

an input video signal having a plurality of portions;

a processor for receiving said input video signal; an output video signal generated by said processor from said input video signal; and

a plurality of components of said output video signal generated in an order by said processor, each component generated according to one of a plurality of bandwidths;

each one of said plurality of components generated by said processor from a different one of the plurality of portions of said input video signal;

each said component of said output video signal updated by said processor with portions of said input video signal according to the order;

each one of said plurality of components for display in one of a plurality of display areas;

one of said components of said output video signal updated with one of the portions of said input video signal to create an updated component, and a previously updated component of said output video signal included in the output video signal for display at the same time as the updated component, the updated component and said previously updated component for display in different display areas.

14. The imaging system ofclaim 13 wherein said plurality of components are for display on a single display device.

15. The imaging system ofclaim 13 further comprising:

an interface provided by software executing on said processor;

at least one bandwidth selection received by said interface, said bandwidth selection indicative of at least one the first and second bandwidths.

16. The medical imaging system ofclaim 13 wherein each portion of said input video signal has red, green and blue color components.

17. A medical imaging system comprising:

a video signal having a plurality of portions;

a processor for receiving said video signal;

a first signal having a first signal processing mode generated by said processor from a first one of the plurality of portions of said video signal; and

a second signal having a second signal processing mode generated by said processor from a second one of the plurality of portions of said video signal;

said processor alternately updating said first and second signals with portions of said video signal, said first and second signals each updated from a different one of the plurality of portions of said video signal;

said first signal for display in a first display area, said second signal for display in a second display area;

one of said first and second signals updated with one of the portions of said video signal to create an updated signal, a previously updated one of said first and second signals for display at the same time as the updated signal, the updated signal and said previously updated signal for display in different display areas.

18. The imaging system ofclaim 17 wherein said processor combines said first and second signals for display on one display having the first and second display areas.

19. The imaging system ofclaim 17 wherein the first and second display areas are on a single monitor.

20. The imaging system ofclaim 19 wherein the first and second display areas are configured as a picture-in-picture display.

21. The imaging system ofclaim 17 further comprising:

an interface provided by software executing on said processor;

at least one bandwidth selection received by said interface, said bandwidth selection indicative of at least one of the signal processing modes.

22. The medical imaging system ofclaim 17 wherein each portion of said video signal has red, green and blue color components.

23. The imaging system ofclaim 17 wherein one or both of said first and second signal processing modes is selected from the group consisting of: a bandwidth, enhanced color, edge enhancement, texture enhancement, sharpness adjustment, and combinations thereof.

24. A medical imaging system comprising:

at least one input module having a processor;

a video signal received by each said input module;

a processed video signal generated by each said input module from each said video signal, said processed video signal having a plurality of portions;

a control module having a processor for receiving each said processed video signal;

a first signal having a first signal processing mode generated by the processor of said control module from a first one of the plurality of portions of said processed video signal; and

a second signal having a second signal processing mode generated by the processor of said control module from a second one of the plurality of portions of said processed video signal;

the processor of said control module alternately updating said first and second signals with portions of said processed video signal, said first and second signals each updated from a different one of the plurality of portions of said video signal;

said first signal for display in a first display area, said second signal for display in a second display area;

one of said first and second signals updated with one of the portions of said video signal to create an updated signal, a previously updated one of said first and second signals for display at the same time as the updated signal, the updated signal and said previously updated signal for display in different display areas.

25. The medical imaging system ofclaim 24 wherein said processor of said control module combines said first and second signals for display on one display having the first and second display areas.

26. The medical imaging system ofclaim 24 wherein: at least a first and a second processed video signals are received by said processor of said control module;

said processor of said control module generating said first and said second signals for each of said first and second video signals;

each said first signals respectively for display in a first and third display areas;

each said second signals respectively for display in a second and fourth display areas;

the first and third display areas for display of the first signal processing mode;

the second and fourth display areas for display of the second signal processing mode.

27. The imaging system ofclaim 26 wherein said first and second signals are for display on separate display devices.

28. The imaging system ofclaim 24 further comprising:

an interface provided by software executing on the processor of said control module;

at least one bandwidth selection received by said interface, said bandwidth selection indicative of at least one of the signal processing modes.

29. The medical imaging system ofclaim 24 wherein each portion of said processed video signal has red, green and blue color components.

30. The imaging system ofclaim 24 wherein one or both of said first and second signal processing modes is selected from the group consisting of: a bandwidth, enhanced color, edge enhancement, texture enhancement, sharpness adjustment, and combinations thereof.

31. A medical imaging system comprising:

an input video signal having a plurality of portions;

a processor for receiving said input video signal;

an output video signal generated by said processor from said input video signal; and

a plurality of components of said output video signal generated in an order by said processor, each component generated according to one of a plurality of signal processing modes;

each one of said plurality of components generated by said processor from a different one of the plurality of portions of said input video signal;

each said component of said output video signal updated by said processor with portions of said input video signal according to the order;

each one of said plurality of components for display in one of a plurality of display areas;

one of said components of said output video signal updated with one of the portions of said input video signal to create an updated component, a previously updated component of said output video signal included in the output video signal for display at the same time as the updated component, the updated component and said previously updated component for display in different display areas.

32. The imaging system ofclaim 31 wherein said plurality of components are for display on a single display device.

33. The imaging system ofclaim 31 further comprising: an interface provided by software executing on said processor;

at least one bandwidth selection received by said interface, said bandwidth selection indicative of at least one of the plurality of signal processing modes.

34. The medical imaging system ofclaim 31 wherein each portion of said input video signal has red, green and blue color components.

35. The imaging system ofclaim 31 wherein one or all of said plurality of signal processing modes is selected from the group consisting of: a bandwidth, enhanced color, edge enhancement, texture enhancement, sharpness adjustment, and combinations thereof.

Images