CONSOLIDATED USER INTERFACE SYSTEMS AND
METHODS
CROSS-REFERENCE TO RELATED APPLICATION
[0001 ] This application claims priority to prior U.S. Patent Application
Serial No, 60/842,633, filed September 6, 2006, the entire disclosure of which is incorporated herein by reference.
BACKGROUND
[0002] This invention relates to a consolidated user interface systems and methods and in particular, to an interface for operating multiple medical systems.
[0003] Many of today's most advanced and effective diagnostic and therapeutic procedures involve the coordinated use of multiple separate medical systems. Each of these separate medical systems may include its own visual display
and its own input device. These visual displays and input devices can take up valuable space in the procedure room, as they must be placed in position for convenient access and use. These multiple displays and input device also pose a risk
of confusion among the various displays and input devices.
SUMMARY
[0004] Generally, the present invention relates to the coordinated operation of multiple separate medical systems. Embodiments of the present invention provide systems and methods for the coordinated operation of two or more medical systems, each having a visual display and adapted to receive control signals
from a separate input device.
[0005] Generally, a preferred embodiment of a system for controlling multiple separate medical systems comprises a display with an active display portion and an inactive display portion, an input device, and a controller for selecting one of the medical systems whose visual display is displayed on the active region of the display and which is controlled by the input device. The controller selects the medical system, at least in part, according to a predetermined routine based upon the procedure being performed. Alternatively or in additional, the controller selects the medical system, at least in part, based upon information from at least one of the medical systems. Alternatively or additional, the controller selects the medical system, at least in part, based upon user selection.
[0006] Generally, a preferred embodiment of a method for controlling multiple separate medical systems comprises displaying the visual display output of a selected one of the medical systems on a dedicated active display area, and displaying the visual display output of at least one non-selected medical systems on an inactive display area; communicating commands from at least one input device to the medical system whose visual display output is being displayed on the active area, and actively switching the medical system whose visual display output is displayed on the active area. The medical system whose visual display output displayed on the active display area is selected, at least in part, according to a predetermined order based upon the type of procedure being performed with the medical systems. Alternatively or additional, the medical system selected to have its visual display output displayed on the active display is selected, at least in part, based upon input received from at least some of the medical systems. Alternatively or additional, the medical system selected to have its visual display output displayed on the active display is selected, at least in part based, upon user input.
[0007] Embodiments of this invention provide systems and methods facilitating the operation of multiple separate medical systems, simplifying the procedure site and reducing the risk of confusion. BRIEF DESCRIPTION OF DRAWINGS
[0008] Fig. 1 is a schematic view of a preferred embodiment of a system for controlling multiple medical devices in accordance with the principles of this invention;
[0009] Fig, 2 is an elevation view of an example display of a system for controlling multiple medical devices in accordance with the principles of this invention; and
[0010] Corresponding reference numerals indicate corresponding parts throughout the several views of the drawings DETAILED DESCRIPTION
[0011 ] A preferred embodiment of a system for controlling multiple medical systems is indicated generally as 20 in Fig. 1. As shown in Figure 1, the system 20 is adapted for use in controlling two or more separate medical systems. For example as shown in Fig. 1, the system 20 is adapted for controlling three separate medical systems, a remote navigation system 22, a localization system 24, and an X- ray imaging system 26. While the preferred embodiment is described in the context of three systems 22, 24, and 26, the invention is not so limited, and can be used with any number of medical systems, and furthermore, can be used with additional or different medical systems such as an Ultrasound imaging system or an ECG recording system. Each of these separate medical systems preferably generates visual display data, and preferably also is adapted to receive input commands from an input device. Most of these separate medical systems are pc or computer based, with a conventional monitor, and a conventional input device such as a keyboard and mouse, track ball, joy stick, etc. [0012] In this preferred embodiment, the system 20 includes a display
28, having an active display area 30 and a passive display area 32. The active and passive display areas 30 and 32 can be dedicated portions of a single display device, or they can be dynamically determined portions of a single display device, or they can be portions of separate display devices, which are preferably integrated together.
[0013] In this preferred embodiment, the system 20 also includes at least one input device, such as a keyboard 34 and/or a mouse 36. The system 20 can also include additional or different input devices such as track balls, joysticks, haptic devices, touch screens, etc.
[0014] In this preferred embodiment, the system 20 also includes a controller 38, which in this preferred embodiment includes a computer, such as pc 40. The computer is programmed to display the visual display data from a selected one of the medical systems (e.g. one of systems 22, 24, and 26) on the active area 30 of the display 28. The computer is also programmed so provide control signals from the input devices (e.g. keyboard 34 and mouse 36) to the selected medical system, so that the input devices control the medical system whose visual display data is displayed on the active display area 30 of the display 28. This helps eliminate confusion in operating the separate medical systems in the course of a procedure.
[0015] In this preferred embodiment, the computer is preferably programmed to intelligently select the medical system based, at least in part, upon a predetermined routine for the medical procedure being performed. Thus, for example, some identification of the medical procedure being performed is provided to the computer, and the computer then selects the medical system to display in the active display area 30 of the display 28. For example, this selection can be made based on the time since the start of the procedure, based upon indications of completion of various phases of the procedure either obtained from the various medical systems or from the user. For example, after a particular action or command using one medical system, the computer may be programmed to automatically select another medical system. Alternatively or in addition, the computer may select the medical system, at least in part, based upon information received from the various medical systems. For example, if the computer receives an alarm from a particular system, it might automatically select that system to facilitate the user's response to the alarm. Alternatively or in addition, the computer may select the medical system, at least in part, based upon information received from the user, including an express instruction to switch to a different medical system.
[0016] In particular, the computer can be programmed to select the medical system based, at least in part, on a predetermined routine for a given medical procedure, and can take into account signals, including emergency signals, from the various medical systems being used, as well as inputs from the user reflecting the starting or completion of various phases of the procedure, and specific requests to select a specific medical system.
[0017] As shown in Fig. 2, the active display portion 30 of the display
28 is preferably more prominent, for example in size and in location, than the inactive display portions 32. Thus, it is immediately apparent what system is being actively displayed, and what system will be controlled by the use of the input devices (e.g. keyboard 34 and mouse 36). When the computer automatically changes selection of the medical system, there is preferably some sort of indication prior to the switch, and preferably some visible and/or audible signal at the switch. Furthermore, the input devices (e.g. keyboard 34 and mouse 36) may be temporarily locked out just prior to the switch until just after the switch, to reduce the risk that commands intended for one system are communicated to a different system.
[0018] The computer 40 can be programmed to prompt the use through a predetermined sequence of steps to conduct the procedure, the program automatically changing the selected medical system as the user responds to the onscreen prompts, thereby automatically passing control of appropriate medical system to the keyboard 34 and mouse 36 (or other input devices) at the appropriate times. A portion of the display 28 can be dedicated to displaying prompts, or the prompts can be dynamically allocated
[0019] For example, a Clinical Workflow Manager program can be run on the computer 40 to direct the user to perform the steps necessary to perform the procedure, such as setting up a imaging, localization, and magnetic navigation systems for performing a procedure with magnetically navigated devices, and to make the systems required to perform the procedure accessible to the user via the system 20, and in particular, the display 28, the keyboard 34, and the mouse 36.
[0020] The Clinical Workflow Manager Program might begin with a prompt on the display 28 to "Import Pre-Op image" or similar designation. When the user selects this, a Pre-Op window is opened, and a dialog box enables selection of the appropriate image. The image is loaded into the Pre-Op window. A prompt on the display 28 then prompts the user to move to the next step of acquiring a first X-ray image for registration.
[0021 ] During the acquisition of the first X-ray image for registration, the user takes an X-ray image, and the active portion 30 of the display 28 displays the same image as the X-ray monitor. The x-ray system controls (zoom level, frame rate, etc.) are available on this "Live X-ray" display using the keyboard 34, mouse 36, or other input devices. As the user moves a cursor across this active portion 30 of the display 28 with the mouse 36, mouse movements are suitably scaled by the processor and fed to the x-ray system computer. Mouse clicks are also fed to the x-ray system computer. Thus, X-ray system control settings may be changed if desired. When the user presses the X-ray pedal to take an X-ray image, the user can directly observe the image on the active portion 30 of the display. The image is automatically stored to a separate "Reference X-ray" window.
[0022] The Clinical Workflow Manager can then display a prompt on the display 28 to prompt the user to move to the next step of acquiring a second X-ray image for registration. The x-ray system controls are accessible to the user from the "Live X-ray" window. When the second image is also selected, the Clinical Workflow Manager can then display a prompt on the display 28 to move to the next step of marking landmarks on the pair of X-ray images. A pair of x-ray images are displayed to the user on the active portion 30 of the display. After the user marks a set of corresponding points on the two images (thus defining a set of 3D points) using the keyboard 34 and mouse 36, the Clinical Workflow Manager can then display a prompt on the display 28 to select corresponding points on the Pre-Op image. The Clinical Workflow Manager can then display the Pre-Op image in the active portion 30 of the display 28. The user may rotate and translate the Pre-Op image as desired and select a set of landmarks. The landmarks can be matched with the corresponding set of X-ray landmarks from the previous step and the system effects a registration between the Pre-Op image and X-ray coordinates.
[0023] The Clinical Workflow Manager can then display a prompt on the display 28 to start Auto Map moves (apply preset field sequence, etc.) and switch the localization/mapping system display to the active portion 30 of the display 28. A sequence of moves is made and the user may move the mouse 36 to select and "freeze" points as one would typically do with a localization system in order to create an anatomical/ECG map. Mouse moves made on (or with reference to) the active portion 30 of the display 28 are suitably scaled and fed to the localization system computer, so that localization user interface tools can be accessed and used via system 20.
[0024] The mapping process continues until a complete or suitable anatomical map is obtained. The Pre-Op image may at any time be displayed, as well upon user selection, so that anatomical targets can be selected from this image as locations to drive the catheter to (in order to further refine a map, for instance). This sequence outlines a mapping procedure that can be carried out with the system 20 coordinating separate imaging and localization and navigation systems. Although it demonstrates an implementation with user selected screen displays on the system 20, other variations can consist entirely of an automated selection of displays (for instance: (i) as soon as an X-ray is transferred, the computer picks the next window/system to display, or (ii) instead of prompting the user to select the next display as in the above, the processor directly switches the display as appropriate), or a combination of automatically selected and user selected displays at various steps. Likewise, the displays of various systems such as Localization system, ECG system, pressure monitoring system, X-ray, Ultrasound or other imaging system, remote navigation system, and so on, can be displayed on the Consolidated UI in various sequences as appropriate for the procedure.
OPERATION
[0025] In the preferred embodiment shown in Fig. 1, a single keyboard
34 and mouse 36 is attached to the controlling pc 40. This pc 40 produces a background image output to a video output that is combined with other clinical video streams by a Video sealer/multiplexer 42. The scaler multiplexer does the image processing necessary to produce an integrated display. An example, of an available video sealer/multiplexer is the TVOne C2-7100 w/ RS-232 control. It provides two programmable PIP (Picture in picture) windows overlaid on a main window and accepts multiple DVI and VGA inputs with an HDTV output.
[0026] A software program on the controlling pc 40 monitors the keyboard 34 and mouse 36 and passes information on as necessary to the remotely switchable kvm 44. The remotely switch able kvm 44 routes keystrokes to the appropriate pc as commanded by the controlling pc. An example of a remote KVM that could do this is the Black Box KV3108SA-R5, 8 port controllable KVM
[0027] The medical systems (e.g. systems 22, 24, and 26) can have their own mouse/keyboards that serve as backup controls. These could be attached via keyboard splitter and mouse splitter cables.
[0028] Of course the system 20 does not have to use a pc 40, and instead any device capable of producing a video image could be substituted. The computer would need to at least have a microprocessor with some software. Any clinical video producing device that could be controlled by a keyboard/mouse would be plugged into the KVM. It is possible that some medical systems will only produce video display data, and not accept inputs. These devices could nonetheless be integrated with the system 20, and displayed at appropriate times on the active display area 30 of the display 28, even though the input devices do not provide any control signals.