US8390694B2 - Medical video communication systems and methods - Google Patents

Abstract

A medical communication system includes a plurality of end-user audio/video recording and playback devices (40) disposed with recipients of medical assistance, and a medical server (10) configured to receive audio/video messages (90′) generated by the end-user audio/video devices and to generate and transmit audio/video responses (94) to targeted end-user audio/video devices. The medical server includes an audio/video recording and playback device (12) configured to playback received audio/video messages and to record audio/video responses, and the end user audio/video recording and playback devices are configured to playback audio/video responses (94′) received from the server. In some embodiments, each end-user audio/video device includes: a video recording lens (62); a microphone (64); and an automatic lens cover (63) arranged to physically block the video recording lens except during recording of audio/video content. In some embodiments, each end-user audio/video device includes a consumer entertainment device (50, 52).

Description

CROSS REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of U.S. provisional application Ser. No. 60/887,823 filed Feb. 2, 2007, which is incorporated herein by reference.

The following relates to the medical arts. It finds application in treatment, care, monitoring, and so forth of patients in homes, apartments, nursing care facilities, hospices, hospitals, treatment centers, and so forth.

Maintenance of open lines of communication between medical professionals and chronically ill patients is a recognized factor in effective medical treatment. Good communication generally correlates with a more positive medical outcome. Poor communication can adversely affect the patient in numerous ways. The patient's self-care (e.g., taking medications in a timely manner, maintaining exercise and diet regimens, and so forth) can be adversely affected though patient misunderstanding regarding dosages or other therapy aspects. Poor communication can also adversely affect the patient's psychological health, for example leading to patient depression, apathy, or so forth. Poor communication can also result in the patient not reporting medically probative physiological or psychological symptoms, or loss of such reports in the communication chain. Where communication is limited to telephone or writing, non-verbal communication such as gestures, overall demeanor, and so forth are lost.

Although open lines of communication have recognized benefits, there are also disadvantages. Medical professionals are valuable specialized caregivers. Having a doctor constantly fielding telephone calls or other inquiries from patients is not an effective use of this resource. This is especially true where, as is often the case, the patient is lonely and primarily wants to talk, but does not have medically pertinent information or questions. Such psychological needs, while important, are better satisfied though the intervention of psychologists, case workers, or other personnel.

In an attempt to provide effective communication while not overburdening medical personnel, a structured communication paradigm is typically used. For example, telephone calls to a doctor's office are typically fielded by a receptionist who screens the calls and takes messages where appropriate. The doctor then receives messages of importance, and relays information back to the patient either via the receptionist or through a direct return telephone call to the patient. These approaches provide numerous opportunities for miscommunication or lost communication, and typically leave the patient feeling that the doctor has little interest in his or her medical condition.

Another structured communication approach is the medical form. Such forms are ubiquitous in medical care settings, and typically comprise a questionnaire of medical or medically related questions for the patient to fill out. For home care, it is known to transmit such questionnaires electronically to the patient, e.g. over a broadband Internet connection. Using a questionnaire has the advantage of providing a written record of information, but the quality of that information can be compromised by patient misunderstandings regarding the questions, or patient apathy leading to incomplete or incorrect answers. Moreover, patients typically do not like filling out forms, and again feel that the doctor is avoiding them.

Scheduled visits to the doctor's office or to other medical facilities provide another line of communication. Advantageously, the patient and doctor can engage in personal two-way conversation during such visits. However, this approach is time-consuming for the doctor, and scheduled visits are typically infrequent and short, sometimes being limited to fifteen minutes or less per visit, with a scheduled visit every month, every six months, or at some other infrequent interval. Thus, scheduled visits are insufficient to maintain an open line of communication with the patient.

A television-based interactive healthcare platform called Motiva® has been developed by Koninklijke Philips Electronics N.V. (Eindhoven, Netherlands). This system transmits scheduled motivational, instructional, or other medically related audio/video content to the patient, and can receive biometric measurement data, survey responses, and so forth from the patient. The content is scheduled by a nurse or other caregiver, and is personalized for each patient.

A problem with the scheduled communication paradigm is that medical problems and concerns generally do not follow a pre-determined schedule. A patient may experience a new symptom or other medical situation calling for communication with a nurse, physician or other medical person at any time.

Heretofore, the principal apparatus for addressing such unscheduled issues has been the telephone. The patient telephones the doctor's office during business hours, or perhaps telephones a nurse call line having twenty-four availability for after-hours usage. Some such telephonic lines of communication are intended for emergency situations only. Even where a telephonic line of communication is intended for broader purposes, such as to address more routine patient questions, it is not uncommon for a patient to avoid using them unless and until an acute medical problem develops. The audio-only nature of telephonic communication leaves the patient unfulfilled. Additionally, the spontaneous nature of telephonic communication can result in the responding nurse seeming to be curt or unsympathetic to the patient.

The following provides a new and improved apparatuses and methods which overcome the above-referenced problems and others.

In accordance with one aspect, a medical communication system is disclosed, comprising: a plurality of patient audio/video recording and playback devices disposed with patients receiving medical assistance; and a medical server configured to receive audio/video messages generated by the patient audio/video devices and to generate and transmit audio/video responses to targeted patient audio/video devices, the medical server including an audio/video recording and playback device configured to playback received audio/video messages and to record audio/video responses, the patient audio/video recording and playback devices being configured to playback audio/video responses received from the server.

In accordance with another aspect, an audio/video recording and playback device is disclosed, comprising: a video recording lens; a microphone; and an automatic lens cover arranged to physically block the video recording lens except during recording of audio/video content.

In accordance with another aspect, an apparatus is disclosed, comprising: a handheld remote controller for controlling a television, DVD, set top box, or other electronic device, the handheld remote controller including tactile controls for entering control commands; a built-in microphone built into the handheld remote controller; and a transmitter for transmitting audio picked up by the built-in microphone from the handheld remote controller.

In accordance with another aspect, a medical communication method is disclosed that is operative in conjunction with a medical communication network including patient audio/video recording and playback devices disposed with associated patients and a medical server storing care plan schedules for the patients and configured to transmit audio/video content to the audio/video recording and playback devices of targeted patients according to the care plan schedules. The medical communication method includes: initiating via one of the end user audio video recording and playback devices a query transmitted over the medical communication network to the medical server and addressed to one or more medical professionals; and generating a two way real time audio/video call between the end user associated with the initiating end user audio/video recording and playback device and an available medical professional.

In accordance with another aspect, a medical communication system is disclosed, comprising: a camera; local storage; and a processor configured to (i) play audio/video content in cooperation with a consumer entertainment device, (ii) record audio/video content in cooperation with the camera, (iii) store audio/video content at the local storage; (iv) send to and receive from the medical server audio/video messages and responses over a communication link, and (v) provide a graphical user interface in cooperation with the consumer entertainment device enabling at least selective playback of pre-recorded audio/video content received from the medical server, recording and sending audio/video messages to the medical server, and receiving and playing audio/video responses from the medical server.

In accordance with another aspect, a medical communication method is disclosed, comprising: pushing audio/video content from a medical server to the residence of an end user via a communication pathway; playing the pushed audio/video content on a television disposed in the residence of the end user; recording an audio/video message at the instigation of the end user; transmitting the recorded audio/video message from the end user to the medical server via the same communication pathway across which the audio/video content is pushed; receiving an audio/video response from the medical server via the same communication pathway across which the audio/video content is pushed; and playing the received audio/video response on the television viewable by the end user.

One advantage resides in improved communication between medical professionals and chronically ill patients.

Another advantage resides in improved patient attitudes and outcomes.

Another advantage resides in reduced health care costs.

Still further advantages of the present invention will be appreciated to those of ordinary skill in the art upon reading and understand the following detailed description.

FIG. 1 diagrammatically shows an illustrative medical communication system.

FIG. 2 diagrammatically shows an illustrative embodiment of the medical server of the illustrative medical communication system ofFIG. 1.

FIGS. 3A and 3B diagrammatically shows an illustrative embodiment of one of the end-user audio/video recording and playback devices of the illustrative medical communication system ofFIG. 1. More particularly:

FIG. 3A shows the illustrative end-user device when it is not recording audio/video content; and

FIG. 3B shows the illustrative end-user device when it is recording audio/video content.

FIG. 4 diagrammatically shows illustrative audio/video content, message and response transfers across the illustrative medical communication system ofFIG. 1.

FIG. 5 diagrammatically shows a perspective view of a handheld remote controller including a microphone.

With reference toFIG. 1, a medical communication system includes amedical server10 having storage and including an audio/video recording andplayback device12. Themedical server10 is operatively connected with theInternet14 to send and receive data in an addressed manner. For example, at an Internet Protocol/Transmission Control Protocol (IP/TCP) level, the medical server is addressed using its Internet Protocol (IP) address, diagrammatically indicated as “IP #S” inFIG. 1. At the hypertext transfer protocol level (http, i.e., the world wide web level), the server can be suitably identified by a uniform resource locator (URL) such as, for example, “http://www.medserver.com/”, which is converted to an IP address using a Domain Name System or Service or Server (DNS) lookup. In some embodiments, the IP address changes dynamically, and a URL and suitably updated DNS provides the conversion to IP address. While the illustrated embodiment uses theInternet14 for intercommunication, it is also contemplated to use another network, such as an Ethernet or wireless Ethernet. For Ethernet-based communication, a Media Access Control (MAC) address is suitably used. The communication pathway may include multiple communication media, such as theInternet14 with an Ethernet link at the server end in the illustrated embodiment.

With reference toFIG. 2, an illustrativemedical server10 includes a central processing unit (CPU)20 that contains or accesses storage and supports a wireless local area network (WLAN or WiFi, for example), a wired network such as a wired Ethernet, or some combination of wired and wireless local networking. In the illustrative embodiment ofFIG. 2, a WLAN is accessed at wireless access points such as an illustratedwireless access point22 by suitable digital devices such as anillustrated notebook computer24, or a desktop computer, or a dumb terminal, or so forth. The accessing digital device provides adisplay26 for displaying video and one or more input devices such as an illustratedkeyboard28 andtouchpad29. Medical personnel use thenotebook computer24 or other accessing devices to communicate with themedical server10. Such medical personnel may include, for example, nurse assistants, nurses, doctors, medical administrative personnel, support or contract workers for a medical or medically related organization, or so forth.

In the illustrated embodiment, the accessing digital device also defines the audio/video recording andplayback device12. Thenotebook computer24 includes thedisplay26 to provide video playback, and typically also includes built-in speakers to provide audio playback. Alternatively or additionally, external speakers (not shown) may be connected with the computer. For recording, an illustratedcamera30 includes avideo recording lens32 and amicrophone34. An indicator light36 or other indicator optionally activates during recording. In various embodiments, the camera may be integrated into the computer, or may be embodied as a standalone camcorder or so forth. In some embodiments, it may be undesired to have the medical person be video-recorded. In such a circumstance, the video of the medical person can be replaced by a suitable animated virtual avatar simulating a medical professional implemented by asuitable avatar engine38. (Theavatar engine38 is illustrated diagrammatically, and may for example be physically embodied as software executing on thenotebook computer24, software executing on theserver CPU20, or so forth).

With reference toFIG. 1, themedical server10 is intended to service a substantial number of chronically ill patients, elderly patients, ill persons, or other end-users. As used herein, the term “patient” is to be broadly construed as encompassing conventional patients in hospitals as well as out-patients, chronically ill persons under continuing out-patient-type medical care for a chronic condition, elderly or frail persons under ongoing medical surveillance through scheduled visits to the doctor's office, or so forth. In one approach, the serviced persons are members of a virtual community that is serviced by themedical server10. The community members may include, for example, patients of a medical facility, outpatients of a hospital system, nursing home residents, retirees, or so forth who sign up for or otherwise agree to join the virtual medical community. Such a virtual community may be open to anyone who wants to join, or may be restricted to a certain class of members, such as retirees of a sponsoring corporation or patients of a selected medical institution or medical system. The virtual community is a distributed community in which the community members reside in their own homes, or in nursing home residences, or so forth. Each community member has an end-user audio/video recording andplayback device40 operatively connected with themedical server10 via theInternet14. Such access is addressed, for example using the IP addresses of the end-user audio/video recording andplayback devices40 as illustrated, so that communication from themedical server10 can be targeted to specific end-user audio/video recording andplayback devices40. While four end-user audio/video recording andplayback devices40 are illustrated inFIG. 1 as examples, typically the number of end-user audio/video recording and playback devices may number in the dozens, hundreds, or more. Typically, the end-user audio/video recording andplayback device40 are located in the residences (e.g., homes, apartments, nursing home rooms, hospice rooms, retirement community rooms, or so forth) of the associated end-users.

With reference toFIG. 2, to accommodate this substantial number of end-users, apatients database42 is maintained at themedical server10. Thepatients database42 typically includes address information, such as the illustrated IP addresses, for each end-user audio/video recording andplayback device40. In some embodiments, thepatients database42 further includes care plan schedules44 that schedule audio/video content or other information to target to each end-user. Thus, for example, an end-user having heart problems may be scheduled for cardiac therapy videos, diet videos, or so forth, while an end-user suffering from diabetes may be scheduled for insulin injection instructional videos, low-salt diet videos, and so forth.

FIG. 2 diagrammatically illustrates the examplemedical server10. More generally, the medical server can be embodied by various combinations of hardware and software. For example, in some embodiments a single computer may both host the server and provide user interfacing including embodying the audio/video recording and playback device. In other embodiments, the server may be embodied by a cluster or network of computers, or so forth. Although the singleinterfacing notebook computer24 is illustrated as an example, it is contemplated for numerous medical personnel, possibly numbering in the tens, hundreds, or more, to access themedical server10 via one, two, a few, a few dozen, a few hundred, or more computers or other interfacing digital devices. In some embodiments, some such interfacing computers or digital devices may omit the audio/video recording and playback device, or may omit the recording capability.

With continuing reference toFIG. 1 and with further reference toFIGS. 3A and 3B, an illustrated end-user audio/video recording andplayback device40 is diagrammatically shown as an example. The end-user audio/video recording andplayback device40 differs from the audio-video recording andplayback device12 of themedical server10 in certain ways that reflect substantial differences between the typical end-user as compared with the typical medical person. End-users tend to be older, more frail (i.e., less healthy), and, as a group, less technically sophisticated than medical personnel. For example, some end-users may be uncomfortable with a computer, or may be unable to operate a computer due to physical or mental limitations. To alleviate these concerns, the illustrated end-user audio/video recording andplayback device40 is built around a consumer entertainment device, such as an illustratedtelevision50 andDVD player52. Thetelevision50 may be a standard definition television or a high-definition television, may employ a cathode-ray tube display, LCD display, plasma display, or so forth, and may include built-in audio speakers or be connected with external speakers or an external sound system such as a surround-sound system. TheDVD player52 is optionally omitted, or replaced or supplemented by a video cassette recorder (VCR), a DVD recording device, a digital video recorder (DVR), or so forth. The consumer entertainment device optionally includes other components such as, for example, a gaming machine, cable television box, satellite dish, or so forth.

The end-user audio/video recording andplayback device40 further includes aprocessor54 that facilitates interfacing with themedical server10 via theInternet14. The illustratedprocessor54 is housed in a designated housing such as an illustrated set-top box56 or other unit, and hence theprocessor54 is shown in phantom. In other embodiments the processor may be integrated into thetelevision50, or integrated into a cable box (arrangement not shown), an Internet interface or gateway, or so forth. The illustrated set-top box56 also houses adata storage58, such as an illustrated hard drive again shown in phantom since it is enclosed in the set-top box56. In other embodiments, the data storage may include a solid state electronic storage medium such as a flash memory, an optical medium such as a recordable optical drive, or so forth.

As is known in the art, consumer entertainment devices such as theillustrative television50 andDVD player52 are commonly controlled by one or more hand-held remote controllers. In the illustrated embodiment, a common hand-heldremote controller60 is effective to operate thetelevision50, theDVD player52, and the set-top box56. The hand-heldremote controller60 may be a commercial universal-type remote controller, for example, that is readily configured to control themultiple devices50,52,56. In other embodiments, the hand-heldremote controller60 may be a specially constructed remote controller that, for example, includes extra-large shape-encoded buttons, simplified controls, or so forth, to facilitate ease-of-use by the end-user who may be ill, infirm, have weak eyesight, or be otherwise impaired. Although the illustrated hand-heldremote controller60 is a universal-type remote controller that enables control of all thedevices50,52,56, it is also contemplated to have a hand-held remote controller for operating the set-top box56 that is separate and distinct from one or more other hand-held remote controllers for controlling theconsumer entertainment devices50,52.

In some embodiments the end-user audio/video recording andplayback device40 is located in the end-user's home, for example in the living room or bedroom. Some end-users may therefore be concerned about personal privacy and security, especially in view of the audio/video recording capability of the end-user audio/video recording andplayback device40. To alleviate these concerns, the recording components are optionally configured to reassure the end-user that recording is not performed surreptitiously or without the end-user's knowledge and control. In the illustrated end-user audio/video recording andplayback device40, avideo recording lens62 includes anautomatic lens cover63 arranged to physically block the video recording lens62 (as shown inFIG. 3A) except during recording of audio/video content (as shown inFIG. 3B, where theautomatic lens cover63 is automatically moved away to reveal the video recording lens62). That is, theautomatic lens cover63 is programmed or otherwise interlocked to be open whenever video is being recorded, and to be closed otherwise. By physically blocking thevideo recording lens62 from view when it is not in use, the end-user is reassured of his or her privacy. Similarly, amicrophone64 is configured to extend at least partially out of the set-top housing during recording (as shown inFIG. 3B) and retracts into the housing otherwise (as shown inFIG. 3A). While such retraction does not in fact prevent recording, the hiding of themicrophone64 when not in use may nonetheless be reassuring to the end-user.

FIGS. 3A and 3B diagrammatically illustrate the example end-user audio/video recording devices40. For example, the illustrated embodiment advantageously makes use of the existingtelevision50. However, it is also contemplated to replace the television by a dedicated replacement consumer entertainment device that integrates the processor, hard drive, and optionally other components into a single housing. While the illustratedvideo recording lens62 with automaticblocking lens cover63 andretractable microphone64 advantageously reassure the end-user of his or her privacy and security, in other embodiments a recording device without such privacy reassurances is contemplated. On the other hand, it will be appreciated that the automaticblocking lens cover63 and theretractable microphone64 will find broader application that is not limited to the disclosed medical communication systems. For example, the automatic blocking lens cover63 can be usefully employed in any situation where it is advantageous to assure the subject of privacy and security, and may for example be used in cameras for studios that record children, in cameras used for photographing drivers for use on drivers' licenses, and so forth.

With continuing reference toFIGS. 1,3A and3B and with further reference toFIG. 4, a typical operation of the illustrated medical communication system is described. Typically, the medical communication system is used to push content from themedical server10 to targeted end users. Toward this end, based on the care plan schedules44 themedical server10 conveys pre-recorded audio/video content70 targeted to a particular end-user by transmitting the pre-recorded audio/video content70 to the end-user audio/video recording andplayback device40. For example, in IP/TCP such targeting is suitably achieved by transmitting the pre-recorded audio/video content70 to the end-user audio/video recording andplayback device40 using the IP address of thedevice40 for targeted addressing. Alternatively, the pre-recorded content may be stored on the set-top box56 of the targeted end-user, and themedical server10 conveys an identification of the portion of such pre-recorded content to be presented.

The selection of pre-recorded audio/video content70 is selected based on thecare plan schedule44 to relate to health concerns, issues, wellness, or the like pertaining to the targeted end-user. For example, if the end-user has heart problems, the pre-recorded audio/video content70 may include exercise videos, diet lessons, instructions on taking medications, or so forth. The pre-recorded audio/video content70 may also include encouragement messages. In some embodiments, the pre-recorded audio/video content70 is interactive in a structured way. For example, the pre-recorded audio/video content70 may include an interactive survey which the end-user answers by inputting responses using the hand-heldremote controller60, and these structured responses are sent back to themedical server10 via theInternet14.

At the end-user audio/video recording andplayback device40, the transmitted pre-recorded audio/video content70 is stored, for example on thehard disk58, and played back at the end-user's request. In a suitable approach, theprocessor54 provides a graphical user interface in cooperation with thetelevision50 which enables selective playback of pre-recorded audio/video content70 received from themedical server10. For example, theprocessor54 may be programmed to receive the pre-recorded audio/video content70 at night when Internet usage is low, and stores received pre-recorded audio/video content70′ on thehard drive58. (In this description, primed reference numbers indicate received audio/video material). The user then turns on thetelevision50 and selects the medical graphical user interface using suitable power and select buttons on the hand-heldremote controller60. In response, theprocessor54 causes thetelevision50 to display a menu of textual and optionally graphical items including a list of audio/video offerings including at least the received pre-recorded audio/video content70′.

The pre-recorded audio/video content70,70′ is principally one-way (i.e., server-to-end user), with optional structured responses such as survey responses optionally communicated from the end-user back to themedical server10. However, it in some circumstances the end-user may want to send unscheduled or unstructured responses. For example, the end-user may be experiencing a new physiological symptom (e.g., pain, numbness, lack of appetite, or so forth) that the end-user wants to report to medical personnel. As another example, after seeing a diet video the end-user may have questions regarding the permissibility of certain foods.

Accordingly, the end-user may initiate aninquiry80. In some embodiments, theinquiry80 may be a general inquiry to be answered by any medical personnel who are available at themedical server10. In other embodiments, theinquiry80 may be specifically addressed to a particular medical person, such as a nurse assigned to the end-user. Theinquiry80 is suitably generated by accessing the graphical user interface. For example, theprocessor54 may generate a graphical selection option (e.g., a button or so forth) labeled, for example, “Send video message to Nurse Jones”, and the end-user generates theinquiry80 by selecting that option using the hand-heldremote controller60. Theinquiry80 may be addressed to a specific medical person (e.g., Nurse Jones) or to a group of medical personnel (e.g., using a selection option labeled “Send video message to the Nurse on call”). Theinquiry80 is sent via theInternet14 and received at themedical server10, where adecision82 is made as to whether a suitable medical person is available in real time to field the inquiry.

If an addressed medical person is available in real time, then optionally an audio/video conference or real-time video call84 is initiated between the end-user associated with the initiating end-user audio/video recording andplayback device40 that sent theinquiry80 and the medical professional. This is suitably implemented at themedical server10 by displaying the audio/video content of thevideo call84 on thecomputer24, and is suitably implemented at the initiating end-user audio/video recording andplayback device40 by displaying the audio/video content on thetelevision50, either in a full-screen mode or in a window, picture-in-picture display region, or other limited region of the display of thetelevision50. Audio is suitably provided through the built-in television speakers or through external speakers or an external sound system operatively connected with thetelevision50.

On the other hand, if no suitable medical personnel are available in real time to field theinquiry80, then the initiating end-user audio/video recording andplayback device40 is informed of this. In response, the initiating end-user audio/video recording andplayback device40 records an audio/video message90 that is transmitted via the Internet14 (diagrammatically indicated inFIG. 1 byarrow92 inFIGS. 1 and 4 for an audio/video message sent by the end-user device with IP address #2) to themedical server10. The video recording is suitably performed by thevideo recording lens62 with the automatic blocking lens cover63 opened as inFIG. 3B to reveal the lens62 (thus emphatically informing the end-user that recording is engaged) and the audio recording is suitably performed by theretractable microphone64 in its extended position as shown inFIG. 3B (again, emphatically informing the end-user that recording is engaged). The end-user suitably presses a selected button of theremote control60 to start and stop the recording. Optionally, after recording is complete the graphical user interface provides an option for the end-user to playback the recorded audio/video message90 on thetelevision50 before sending. If it is unsatisfactory, the end-user can delete the recorded audio/video message90 and optionally record a new version. Once the end-user is satisfied with the recorded audio/video message90, the end-user selects a “Send” option or other suitably labeled control of the graphical user interface, and theprocessor54 sends the recorded audio/video message90 to themedical server10, with suitable addressing information such as an IP address, email address, MAC address, or so forth.

At themedical server10, the received audio/video message90′ is stored and played back. For example, the received audio/video message90′ is typically stored, until an appropriate medical person becomes available in real-time to field the inquiry. Optionally, the received audio/video message90′ is stored in the patient's data file, so as to be referenced by the patient's doctor or other medical personnel for diagnostic or when designing the care plan schedules44, or so forth. For example, the central processing unit (CPU)20 suitably implements an audio/video handling and routing system that accepts the incoming received audio/video message90′, stores a copy of the received audio/video message90′ in the patient's electronic file in theelectronic database42, and routes a copy of the received audio/video message90′ to a received video messages queue for playback by the next available medical person, or routes a copy of the received audio/video message90′ to a video mailbox of the medical person to which the audio/video message90′ is addressed, if such addressing information is included with the message.

When a suitable medical person becomes available, he or she plays back the received audio/video message90′, for example on thenotebook computer24. The playback at themedical server10, or more specifically at thecomputer24, can use dedicated playback software. However, since the medical person is typically relatively knowledgeable about computers, it is also contemplated to have the received audio/video message90′ forwarded to the medical professional as an email attachment, which the medical professional plays back by routine manipulations performed in the medical professional's email reading program (possibly operating in conjunction with a plug-in or other associated software such as a media player program).

Preferably, the medical person records an audio/video response94, for example using thecamera30, and the recorded audio/video response94 is transmitted via the Internet14 (diagrammatically indicated inFIG. 1 byarrow96 inFIGS. 1 and 4 for an audio/video response sent back to the end-user device with IP address #2) to the initiating end-user audio/video recording andplayback device40, where it is stored as a queued audio/video response94′ and played back at the convenience of the end user. For example, the graphical user interface suitably lists the received audio/video response that can be selected for playback by the end-user using the handheldremote control device60.

The illustrated embodiment includes the option of the real-time video call84 which is used if a suitable medical person is available in real time when theinquiry80 is made. In other embodiments, the option of a real-time video call is omitted (along with omission of the decision82), and every inquiry is made as an audio/video message and every response is made as a recorded audio/video response. It is also contemplated for thedecision82 to employ different criteria or timing; for example, it is contemplated to always record the audio/video message, and to initiate the video call only at the medical person's option. In such an embodiment, for example, the medical person may review the audio/video message. If it is non-urgent, then a recorded audio/video response is appropriate. On the other hand, if the audio/video message indicates a possibly urgent problem such as a medical symptom that may indicate a medical condition requiring rapid intervention, then the medical person can initiate the video call.

Advantageously, the audio/video message90,90′ enables the end-user to convey non-verbal information by gestures and so forth. Indeed, some such non-verbal communication may be unintended—for example, the receiving medical person may be able to discern aspects of the end-user's condition from the video. For example, the end-user may appear pale, or thin, or disoriented. As another option, if the patient believes a medical emergency may be imminent, the patient can leave the camera “on” so that the medical person who video calls back can see that the patient has passed out or is otherwise unable to respond. These are all substantial advantages over the conventional audio-only telephonic message used heretofore.

Typically, the audio/video response94,94′ employs thevideo recording lens32 of thecamera30 to record video of the responding medical person. This approach advantageously provides the end-user with personal contact which can counteract loneliness or depression. In some embodiments, however, it is contemplated for theavatar engine38 to produce the video portion of the audio/video response94,94′ as an animated avatar simulating a medical professional in the generated audio/video responses94,94′. Such an avatar is suitably substituted for recording video of the responding medical person. One situation in which an animated avatar may be advantageous is where themedical server10 is staffed by different medical personnel at different times. For example, a busy medical server may employ a bank of responders, such that each time a given end-user sends an audio/video message a different medical person may in general respond. In such a case, the avatar provides a consistent interface. In some other embodiments, video of the medical person is recorded, but the background is configured to provide a more patient-comforting setting. For example, rather than having the medical person shown in his or her actual environment, such as a hospital with other medical personnel moving about, a replacement background can be inserted by suitable digital video processing to show the medical person in a quiet doctor's office, a library, interview room, or other more comforting setting.

The systems and methods described with reference toFIG. 4 are also readily adapted for use as a medical emergency alert system or method. In such embodiments, the medical center is a continuously staffed medical emergency center staffed by nurses or other medical personnel trained to respond to medical emergencies by calling 911, acquiring medical information from the caller, or taking other such emergency measures as appropriate. In these embodiments, most calls are processed by the available emergency responder (corresponding to the illustratedavailable nurse82 inFIG. 4) by a real-time video call84. However, if the medical emergency center is overloaded (that is, attempts to process more calls at the same time than there are emergency responders) then the message is logged as audio/video message90,90′ and stored until the next available emergency responder is available. For such an emergency response system, the receivedmessage90′ should be automatically flagged with the MAC address or other address of the sending audio/video device so that the emergency responder can quickly get back to the caller. Moreover, in such an emergency response system the residence-end hardware illustrated inFIGS. 3A and 3B (including theconsumer electronics devices50,52 and the set-top box56) is suitably replaced by a more compact, preferably portable system such as a battery-powered audio/video recording and playback device that connects with theInternet14 or another network via a wireless card or other wireless link. A cellular telephone with video call capability is one suitable portable audio/video device—in this case theInternet14 is suitably replaced by the cellular telephone network, and addressing is by telephone number. The user can readily program the telephone number of the emergency center as a quick-dial number (for example, dialed upon pressing “1” followed by “Send”) so that in an emergency the user can quickly query the emergency response system. Such emergency response systems have certain advantages over existing telephonic emergency response systems in that the person experiencing the emergency is reassured by seeing an actual person instead of merely receiving a telephonic voice response, and the emergency responder can better assess the person's condition based on visual appearance and visually perceptible behavior.

With reference toFIG. 5, in some embodiments amicrophone164 is disposed on the handheldremote controller60, and themicrophone164 substitutes for themicrophone64 on or in the set-top box56. To enable transmission of audio recorded by themicrophone164, theremote controller60 suitably includes anaudio transmitter166 to transmit the audio picked up by themicrophone164 to the set-top box56. The output of themicrophone164 may be transmitted to the set-top box56 in analog form, or may be first digitized by processing (not shown) in the handheldremote controller60 and then transmitted to the set-top box56 by a thetransmitter166 which in such embodiments may be, for example, a Bluetooth transmitter. The transmitted audio is thenceforth processed at the set-top box56 and transmitted across theInternet14 to themedical server10 in the same way as the audio recorded by themicrophone64.

Thetransmitter166 for transmitting the picked up audio may be the same as, or different from, the transmitter used to transmit indications operation of thebuttons168 or other tactile controls of theremote controller60. For example, theaudio transmitter166 may be a Bluetooth or radio frequency transmitter, while button operation may be transmitted using a pulsed infrared transmitter. It is also contemplated for the built-inmicrophone164 to be configured to enable the patient to convey voice commands to the set-top box56, or to thetelevision50,DVD52, or otherconsumer entertainment device50,52 controlled by theremote controller60. Such audio command capability, utilizing suitable voice recognition software executing on the handheldremote controller60 or at the set-top box56 or other receivingdevice50,52,56, can be particularly convenient for certain patients who may have limited manual dexterity.

An advantage of themicrophone164 over the set-top box microphone64 is that the user can hold themicrophone164 close to his or her lips during recording. Since themicrophone164 is built into the hand-heldremote controller60, it is assured that the microphone is readily available to the patient as he or she uses the medical communication system. In the case of a frail person with a weak voice, having themicrophone164 built into theremote controller60 may be more convenient and may produce a better quality audio recording as compared with using the relatively more remote set-top microphone64.

In some embodiments, themicrophone164 is used for audio-only recording, either as an additional function or as a substitute function for the described video messaging. For example, as an additional function themicrophone164 can be used to record a voice message for medical personnel. In some such embodiments, a voice-over-Internet protocol (VOIP) is used to send the message and store it at theserver10 until it is retrieved and played back by medical personnel. For example, the patient may press a “Help Desk”button170 to indicate that he or she wishes to send a voice message to a nurse or other medical person at theserver10. Alternatively, suitable voice recognition capability may be built into the remote60 or the set-top box56 so as to recognize a suitable verbal initiation command such as “help desk” or “record”. The system suitably responds by informing the patient (for example, via a display on the television50) that he or she should hold down the “Help Desk”button170 and speak into themicrophone164 to record the message. The message may be transmitted in real-time by a VOIP to theserver10, or may be recorded locally at the set-top box56 and then transmitted.

An advantage of the illustrative voice messaging using themicrophone164 is that it allows the patient to send a one-way message to medical personnel. The patient may prefer this to the alternative of discussing the issue with a medical person in real time. In an example, a patient may be using the medical communication system when the patient receives an invitation from a friend to go on a fishing trip the next day, which would conflict with a survey scheduled by the patient'scare plan44. The patient suitably presses the “Help Desk”button170 and themicrophone166 is activated. The patient leaves a voice message with the help desk indicating that the patient was scheduled to participate in a survey tomorrow, but that the patient wants to reschedule one day later. It will be noted that the patient does not need to explain this change of plan or argue with a nurse about rescheduling, because the voice message is a one-way message from the patient's side. The settop box56 switches to a helpdesk mode or otherwise establishes the VOIP or other suitable connection to theserver10 for recording voice message. As the patient talks into themicrophone164, the settop box56 passes the continuous voice streams of the patient (in the case of real-time VOIP communication) to theserver10 where the patient's voice is recorded and stored for later retrieval. When finished, the patient switches to normal usage mode (or, alternatively, such a switch is made automatically). The voice message is stored at theserver10 as a voice message or other distinguishable audio file. A helpdesk employee preferably checks the voice mail or other help desk audio repository at a regular interval to play back any queued audio messages, via a convenient user interface such as the speakers of thecomputer24. The employee listens to the voice message and may, for example, decide that it is acceptable to re-schedule the survey for the next day. The employee suitably uses information stored on theserver10 to make this decision. On the other hand, if the patient's request or information is more critical (such as, for example, informing the help desk that the patient plans to double the dosage of his or her medication) then the employee may forward the message to the patient's doctor or another person qualified to respond. The employee may optionally send a responsive voice or video message back to the patient.

The illustrated embodiment of the help desk employs the built-inmicrophone164 and theInternet14. However, another audio recording device can be used instead, such as the set-top box microphone64. Similarly, another communication pathway can be used, such as a cellular telephone network.

Claims (11)

1. A medical communication system comprising:

a plurality of patient audio/video recording and playback devices disposed with patients receiving medical assistance; and

a medical server configured to receive audio/video messages generated by the patient audio/video devices and to generate and transmit audio/video responses to targeted patient audio/video devices, the medical server including an audio/video recording and playback device configured to playback received audio/video messages and to record audio/video responses, the patient audio/video recording and playback devices being configured to playback audio/video responses received from the server;

wherein each patient audio/video recording and playback device and the medical server are configured to provide two-way real-time audio/video communication; and

wherein the medical communication system is configured to perform the operations of:

initiating via one of the plurality of patient audio/video recording and playback devices a query transmitted to the medical server and addressed to one or more medical professionals;

generating a two-way real-time audio/video call between the patient associated with the initiating patient audio/video recording and playback device and an available medical professional; and

conditional upon there being no available medical professional, recording an audio/video message including video of the patient at the initiating patient audio-video recording and playback device, transmitting the audio/video message to the medical server, and playing back the audio/video message at the medical server at a subsequent time when a medical professional becomes available.

2. The medical communication system as set forth inclaim 1, wherein the medical server is further configured to identify or transmit pre-recorded audio-video content to targeted patient audio/video devices or targeted groups of patient audio/video devices in accordance with one or more medically related care plan schedules configured for associated patient or group of patients.

3. The medical communication system as set forth inclaim 1, wherein each patient audio/video recording and playback device includes:

local storage associated with each of the patient audio/video recording and playback devices for storing received audio/video responses.

4. The medical communication system as set forth inclaim 1, wherein each patient audio/video recording and playback device includes:

a digital processor operatively coupled with a television to display on the television a video portion of the received audio/video response during playback.

5. The medical communication system as set forth inclaim 1, wherein each patient audio/video recording and playback device includes:

a video recording lens; and

an automatic lens cover arranged to physically block the video recording lens except during recording of audio/video content.

6. The medical communication system as set forth inclaim 1, wherein each patient audio/video recording and playback device comprises a set top box for a television and the set top box includes a microphone configured to extend at least partially out of the set top box during recording of audio/video content and to be retractable into the set top box otherwise.

7. The medical communication system as set forth inclaim 1, wherein the medical server further includes:

an avatar engine configured to cooperate with the audio/video recording and playback device of the medical server to include an animated avatar simulation in the audio/video responses.

8. The medical communication system as set forth inclaim 1, wherein the medical server is further configured to store received audio/video messages generated by the patient audio/video devices in patient records of a patients database.

9. A medical communication method operative in conjunction with a medical communication network including patient audio/video recording and playback devices disposed with associated patients and a medical server storing care plan schedules for the patients and configured to transmit audio/video content to the audio/video recording and playback devices of targeted patients according to the care plan schedules, the medical communication method comprising:

initiating via one of the end-user audio-video recording and playback devices a query transmitted over the medical communication network to the medical server and addressed to one or more medical professionals;

generating a two-way real-time audio/video call between the end-user associated with the initiating end-user audio/video recording and playback device and an available medical professional; and

conditional upon there being no available medical professional, recording an audio/video message including video of the end-user at the initiating end-user audio-video recording and playback device, transmitting the audio/video message to the medical server via the medical communication network, and playing back the audio/video message at the medical server at a subsequent time when a medical professional becomes available.

10. The medical communication method as set forth inclaim 9, further including:

subsequent to the playing back, recording an audio/video response at the medical server, the audio/video response including either video of the medical professional or an animated avatar representing a medical professional;

transmitting the audio/video response to the initiating end-user audio-video recording and playback device; and

playing back the audio/video response at the initiating end-user audio-video recording and playback device.

11. The medical communication method as set forth inclaim 9, further including:

physically blocking from view a video recording lens of each end-user audio/video recording and playback device when said video recording lens is not in use.

Images