~L3C6~45 Field of the Invention The present invention relates to a teleconferencing terminal which enables communicating parties to have eye contact with each other.
Backqround of the Invention Face-to-face conversation is universally recognized as the preferred form of human communication. For decades this fact has been the impetus for the development of video teleconferencing systems. In a typical teleconferencing system, a pair of te.rminals, each with a video camera and a video display device, a microphone and a speaker, are connected by a telecommunications link to permit face-to-face communications at a distance.
However, such systems as have been developed to date have failed to address the fact that communication is best when video conference participants have eye contact with each other.
In a typical teleconferencing terminal, the video camera and the video display device are not in line with one another, but are so disposed that a communicant in a teleconference has the choice of faciny the camera and not directly facing the display device or -- the usual choice -- facing the display device, with the result that the camera captures a face seemingly staring off into space, no eye contact then being possibla with the other communicant in the teleconference.
one prior art attempt to alleviate this problem has been to place within a telecon~erencing terminal a half-silvered mirror with a camera behind it and the displaydevice off to one side. In this case, the image from the display device is reflected by the half-silvered mirror toward the local communicant while the camera scans the local communicant head-on through the half- silvered mirror, thus providing eye contact with the remote communicant:. One problem with this terminal arrangement .. ~
~3¢6~45 is that the video display device no longer offers a front-surface view, but an image recessed into the terminal. The loss of the sense of immediacy, of presence, is felt at once, vitiating much of the eye-contact gain that was the aim of the design.
This half-silvered mirror arrangement, often used for teleprompting, is a purely mechanical one -- a half-silvered mirror in a box -- at which both th~ video camera and the video display are pointed. The camera and the display work independently of each other, no attempt being made to coordinate their operation.
In view of the shortcomings of the above-described conventional teleconferencing terminals, it is an object of the present invention to provide a teleconferencing terminal which enables communicating parties to have eye contact with each other, and enjoy a heightened sense of each other's presence, with improved image quality.
SummarY of the Invention The present invention i5 a teleconferencing terminal which enables communicants in a teleconference to have eye contact with one another. In an illustrative embodiment of the invention, a teleconferencing terminal includes a video projection source for presentation to a local communicant of an imaga of a remote communicant, and a video camera to capture an image of the local communicant for transmission to a remote terminal for display to a remote communicant. The terminal incorporates a half-silvered mirror. This mirror serves to reflect radiation generated by the video projection source onto the rear surface of a translucent front viewing screen to form a video image of the remote communicant. Illustratively, the front viewing screen is a liquid-crystal screen. The liquid crystal screen has the property that it can be rapidly switched from a transparent state to a scattering or translucent state by the application of a suitable control voltage.
The terminal of the present invention operates in an ~3~iO4~i image display mode and an image capture mode. During operation in khe image display mode, the liquid crystal screen is made to be translucent so that it serves as a rear-projection screan to display a video image formed from radiation generated by the video projection source and reflected off the half-silvered mirror.
During operation in the image capture mode, the liquid crystal screen is made transparent. The video camera in the terminal is positioned so that it views its local communicant head-on, directly through the (now transparent) liquid crystal screen, ensuring eye contact.
The terminal operates alternately in the image capture mode and the image display mode. The operation of the video projection source, the video camera and the liquid crystal screen is synchronized by a control unit to switch between the image capture mode and the image display mode. Thus, during operation in the image capture mode, the video camera's image capture circuitry is turned on and the liquid crystal screen is made transparent.
During operation in the video image display mode, the liquid crystal screen is made translucent for display via rear projection of a video image and the video camera's image capture circuitry is blanked. Preferably, operation in the image capture mode taXes place during the vertical retrace intervaI of the vidso image to be displayed. In this manner, each teleconference participant receives a h~ad-on view of the other teleconference participant with eye contact.
The alternation between the image capture mode and the image display mode may ba more clearly understood as follows. In a video system based on the National Television Standards Committea (NTSC) transmission format, a first field of video imagery to be displayed comprises some 245 lines of active video scanned, line- by-line, 3S from the top of the display screen to the bottom of the display screen in just under 1/60 second. When the scan is completed, the scan returns to the top of the screen, ~L3~i0~aS
but displaced horizontally by one-half line, to commence the display of a second field of video imagery, interleaved with the first field of video imagery, the two fields comprising what is known as a frame of video imaqery. The return to the top of the screen is known as the vertical retrace interval. It typically comprises some 17.5 scan lines and occupies at least one thousandth of a second. The vertical retrace interval plus its associated field scan interval together last for exactly 1/60 second in the NTSC transmission format. The terminal of the present invention operates in the image capture mode during each vertical retrace interval and otherwise operates in the image display mode.
Operation in the image capture mode during the vertical retrace interval makes use of modern video cameras such as the so-called high-speed shutter electronic CCD video cameras. Such video cameras have image capture circuitry which is sufficiently fast to capture an image in less than one-thousandth of a second.
For operation in the image capture mode, the control unit of the inventive terminal switches on the video camera's image captura circuitry at the beginning of the vertical retrace interval of the video signal arriving from the remote communicant when the terminal has no video imagery to display. Simultaneously, the control unit switches the tarminal's liquid crystal screen from a translucent, image display state to a transparent state. The video camera captures a head-on image of its local communicant through the now-transparent screen during a brief glimpse coincident with the vertical retrace interval of the arriving video signal. At the completion of the vertical retrace interval, in order to switch to operation in the image display mode, the camera's image-capture circuitry is switched off by the terminal's control unit and the liquid crystal screen is returned to a translucent, image display state in order to enable the display of the next field of video imagery that is being received from the : L3~
remote communicant. Simultaneously with the display of an arriving field of video imagery, the terminal's video camera also scans out, line-by-line, for transmission to the remote terminal, the video image it has captured in the directly preceding vertical retrace interval.
In the above described manner, the operation of the terminal's camera and display are synchronized to be non-interfering: whenever a field of remote video imagery is being received from the remote terminal, and is being displayed, a field of local video imagery, captured by the local camera is being transmitted to the remote terminal for display there. The local camera's only glimpse of the local communicant comes during the vertical retrace interval, when no video is being displayed.
The disposition of each terminal's camera to effectively view the local communicant directly through the display screen ensures eye contact between the communicating partias.
Brief Description of the Drawinq FIG. 1 schematically illustrates one terminal of a prior art teleconferencing system, its remote counterpart not being shown.
FIG. 2A schematically illustrates a teleconferencing terminal operating in its image capture mode in accordance with an illustrative embodiment of the present invention.
FIG. 2B schematically illustrates a teleconferencing terminal operating in its image display mode in accordance with an illustrative embodiment of the present invention.
FIGS. 3 shows a system timing diagram that illustrates the operation of a terminal of the present invention in terms of the sequence of video image capture, video image transmission and video display functions.
FIG. 4 schematically illustrates a teleconferencing terminal in accordance with an alternative embodiment of the present invention.
Detailed Description of the Invention Turning to FIG. 1, a local communicant 110 is shown ~3~6~45 facing a prior art terminal 100 that uses an arrangement of components similar to that used for teleprompting purposes.
The terminal 100 comprises a video image display device 2 with a viewing surface 1, a half-silvered mirror 3, and a video camera 4. The purpose of the video camera 4 is to capture an image of l-he local communicant 110 for transmission to a remote terminal (not shown) where it can be displayed to a remote communicant located there. The purpose of the video image display device 2 is to display to the local communicant 110 the image of the remote communicant captured by a video camera in the remote terminal, and thence transmitted to the local terminal 100 .
The half-silvered mirror 3 serves to reflect to the local communicant 110 the image of the remote communicant displayed on the surface 1 of the display device 2, while, at the same time, permitting the video camera 4 to see through it, capturing the image of the local communicant 110 for transmission to the remote terminal where it may be displayed.
Note that this is a purely mechanical arrangement, with no synchronization between the video camera 4 and the video display 2. Both are on simultaneously and operate independently of each other. Note that the displayed image lacks "presence" -- a sense of realism -- since it appears to be significantly recesssd into terminal 100, a dim and somewhat remote presentation. A further disadvantage of a recessed display is that it is unacceptable for certain specialized accessories to a video terminal such as a light pen which requires a front surface display.
FIG. 2A shows a local communicant 110 facing a terminal 200 in accordance with the present invention.
The terminal 200 comprises a liquid crystal rear projection screen 5, a video image projection device 12, a video camera 4, a half-silvered mirror 3, a control unit ~3~6~5 6, composite video output line 41, composite video input line 21, and synchronization and control lines 22, 42 and 52. The liquid crystal screen S can be switched between a transparent state and a translucent image display state by application of a suitable voltage via line 52.
The terminal 200 is here shown operating in its image- capture mode. The liq[uid crystal screen 5 is in its unactivated, transparent state, affording video camera 4, switched on by control uni.t 6 through control line 42, a clear head-on view of local. communicant 110, through half-silvered mirror 3. Vide!o image projection device 12 is in its vertical retrace interval so there is no video image to display. The video image projection device 12 is in communication with control unit 6 through control line 22, so control unit 6 can synchronize its control of the liquid crystal screen 5, via line 52, and video camera 4, via line 42, with an incoming video signal received by the projection device 12 via line 21.
In FIG. 2A, video camera 4 is capturing the image of local communicant 110, so, as yet, no video of that image is being transmitted to the remote terminal through outgoing composite video line 41.
FIG. 2B again shows terminal 200, but now oparating in its image-display mode. In FIG.~ 2B, the projection device 12 is now projecting an image of a remote communicant that has been received from the remote terminal on incoming video signal line ~1 as a composite video signal, i.e. including the synchronization signals needed for its reconstruction and display. The image is formed by reflecting radiation generated by the projection device 12 off o~ the half-silvered mirror 3 to form a rear projection image on the rear surface of the liquid crystal screen 5 which is now set to a translucent state by control unit 6 through control line 52.
Video camera 4 now has its image capture circuitry switched off, so it no longer views local communicant 110, but insteacl outputs the previously captured image of ~3~6~
communicant 110, along with the synchronization signals needed for the reconstruction and display of that image, as a composite video signal, on line 41, for transmission to the remote terminal.
FIG. 3, lines A, ~ and C are timing diagrams for the video projection device 12, the video camera 4, and the liquid crystal screen 5, res]pectively, of the terminal 200 of FIGS. 2A and 2B. Thus, line A of FIG. 3 shcws that the video projection device 12 rleceives and displays successive fields of video images, which successive fields are separated by a vertical retrace interval. Line B of ~IG. 3 shows that the video camera 4 captures its image while the projection device 12 is in its vertical retrace interval. Line B also shows that the captured imags is scanned out by the camera 4 for remote transmission, while the projection device 12 is scanning the display screen to display a field of incoming video. Line C of FIG. 3 shows that the liquid crystal screen 5 is transparent during the vertical retrace interval of the video projection device 12 which is simultaneous with image capture by the camera 4. Line C also shows that the screen 5 is translucent when a field of incoming video is being displayed. As indicated above, synchronization between the projection device 12, the liquid crystal screen 5 and the video camera 4 is achieved by means of the controller 6. To insure synchronization between the local terminal and the remote terminal, frame store buffers may be utilized for incoming video frames. Such buffers may be utilized if the image capture and image display operations of the remote and local terminals are not quite synchronized with one another.
When operated in the above-descrioed manner, the terminal 200 switches between its image display mode and its image capture mode so rapidly, that the local communicant 110 is provided with a flicker free image of the remote communicant, while at the same time, the camera 4 acquires a head-on image of the local communicant 110 ~3(P~04~
g .
for transmission to the remote communicant. Thus, when terminals of the type 200 are utilized in a teleconferencing system, both the remote and local communicants have eye contact with each other.
FIG. 4 illustrates an aLternative teleconferencing terminal in accordance with the present invention. Like elements in FIGS. 2A and 2B and FIG. 4 have the same identifying numerals. The terminal 300 of FIG. 4 is in its image display mode.
The terminal 300 of FIG. 4 comprises a liquid crystal display screen 15, used for the actual display of a video ima~e during operation in the image display mode, a liquid crystal screen 10 positioned in front of liquid crystal display screen 15, and used as a diffuser screen, liquid crystal screens 8 and 9, used as shutters, a video camera 4, a video image receiving system 32 that uses liquld crystal display screen 15 as its display element, light source 7, used to backlight liquid crystal display 15, incoming composite video signal line 21, outgoin~
composite video signal line 41, control unit 6, and synchronization and control lines 22, 42, ~1, 91, 101 and 102. The control unit 6 communicates synchronization signals with video receiving system 32 and video camera 4 through synchronization lines 22 and 42 respectively, and liquid crystal state control voltages through control lines Bl, 91, 101 and 102.
When the terminal 300 of FIG. 4 is in the image display mode, the video image receiving system 32 displays the incoming image of the remote communicant directly on the liquid crystal display screen 15, thereby eliminating use oP the half-silvered mirror 3 of FIGS. 2A and 2B.
Thus, the liquid~crystal display screen 15 co~prises an array of separately addressabla pixels, each of which can be made transparent or of controllable transmissivity by the application of suitable control voltages to state control wires Inot shown) embedded in the liquid crystal display screen 15. The state control wires cross each ~3~6(3~L~
other in an X-Y grid pattern. To display an image on screen 15, the control voltages for the individual pixels are supplied by the video receiving system 32 via the line 103. For operation in the image capture mode, the screen 15 can be made transparent under control of the control unit 6 by the application of suitable control voltage transmitted via line 102. The screen 10 is switched as a whole between transparent and translucent states via the control line 101 during the image capture and image display modes respectively.
A liquid crystal display screen such as screen 15 produces no light of its own, so li~uid crystal screen 15 is illuminated from the rear by light source 7, producing a bright, high- contrast image that retains excellent quality even when viewed undar conditions of high ambient light.
The diffuser screen 10 is here shown in a translucent state achieved by control unit 6 through its application of a state control voltage to control line 101 during operation in the image-display mode, thus serving to spread the image of each o f the pixels of the image display screen 15, which would otherwise appear as tiny image points near the activated regions of the state-control-wire crossings (not shownl. Ligh~ source 7 is positioned so that it illuminates liquid crystal display screen 15 but so that its light cannot be directly observed by video camera 4. Similarly, to prevent the backscatter of light from light source 7 to the video camera 4, the terminal 300 is contained in a housing tnot shswn) whose interior is non- reflective.
Despite the fact that the position of light source 7 keeps its rays from directly entering the lens of video camera 4 where they might saturate the sensor array of video camera 4 and wash out its image of local communicant 110, and despite the option of using an anti-reflective coating on the rear surface of ~he screen ~5, the incidental backscatter of that light from the rear surface 13~6~5 of screen 15 may still prove troublesome. To overcome this, both the video camera 4 and the light source 7 are here shown provided with optional liquid crystal shutters 8 and 9 respectively. During the image-display mode as shown in FIG. 4, shutter 8 is kept opaque and shutter 9 is kept transparent by control unit 6, through its application of state control voltages to control lines 81 and 91, respectively, o the terminal 300. However, during the di~play vertical-retrace interval (i.e. during the image capture mode), when the~ screens 15 and 10 are made transparent and video camera 4 is permitted its brief glimpse of the local communicant, the states of the shutters 8 and 9 are reversed by control unit 6, video camera 4~s shutter % being switched to transparent and light source 7's shutter 9, being switched to opaque. At the same time, the normally translucent diffuser screen 10 and the display screen 5 are switched to their transparent states under control of the unit 6 via lines 101 and 102.
This prevents any flooding of the camera with interfering light, whether direct or reflected, and permits the use of inexpensive, lon~-lived incandescent, electroluminescent or similar light sources rather than lights that would have to be rapidly switched off during the brief interval when the video camera is switched on to capture its image of the viewer.
Note that the use of the liquid crystal display 15 as a display screen permits the terminal to be smaller and more compact, for any desired image size, and also permits the display of a bright, high-contrast image, viewable in high ambient light, since the separate light source 7 rather than the display device itself, provides the image brightness.
Finally, the above-described embodiments of the invention are intended to be illustrative only. Numerous alternative embodiments may be devised without departing from the spirit and scope of the present invention.