US20050134683A1

Movatterモバイル変換

Info

Publication number: US20050134683A1
Application number: US11/034,943
Authority: US
Inventors: W. Quintana; Michael Pinkham; J. Houston; Mark Norton; Joseph Petruska; F. Mitchell
Original assignee: Bath Iron Works Corp
Current assignee: Bath Iron Works Corp
Priority date: 2000-11-22
Filing date: 2005-01-14
Publication date: 2005-06-23
Also published as: US6956614B1

Abstract

An apparatus and method for using a wearable computer in collaborative applications that uses a general inspection camera, a detailed inspection camera, a display, a computer adapted to use wireless communication and to facilitate collaborative applications, a battery, an audio communication device, and a harness for securing these components to a person's body.

Description

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates generally to wearable computers, and more particularly to a wearable computer for use in collaborative applications.

2. Description of the Related Art

Construction and manufacturing projects require that structures and components be built to exacting specifications and strict time schedules. Manufacturing industries, including, for example, shipbuilding, aircraft manufacturing, and automobile manufacturing, often involve modular construction where individual components of a final product are built simultaneously and at different physical locations. These components must be constructed in a precise manner to ensure that the individual components will fit together properly. When problems arise during the construction of these individual components, the manufacturers must respond quickly to ensure that the problem is properly resolved, design changes are properly recorded, and the project does not fall behind schedule. The same concerns apply to other construction projects where various components of the project are constructed simultaneously and often at separate locations.

The traditional response to a problem that arises during manufacturing or construction is a telephone call from the onsite individual who discovers the problem to an engineer or other individual responsible for resolving the problem. Ideally, the engineer is located near the job site and can travel to the site without undue inconvenience. However, often the engineer is located a great distance from the site of the problem and cannot respond in an expedient manner. Regardless of the engineer's location, the engineer typically must travel to the job site, make notes by hand, and then return to the engineer's office to review plans and other technical information to resolve the problem. The engineer often must make repeated visits to the job site to gather further information regarding the problem before any solution can be formulated. This traditional method of problem resolution often consumes a considerable amount of time, thus wasting precious production time.

Wearable computers are computers that may be physically worn on the body of the person operating the computer. Wearable computers are preferred when there is insufficient space to set up a lap top or desk top computer. Wearable computers have been used for report preparation and other data gathering activities. However, the use of a wearable computer only for data gathering functions does not meet the needs of problem resolution in a manufacturing or construction setting. In addition, even if a wearable computer that had the technical information regarding the structure or project were available on-site, it would be of limited use absent the ability to collaborate with one or more other individuals who could offer expertise and insight into resolving the problem.

Therefore, it would be desirable to provide a person at the location of interest with the ability to use a wearable computer in a real time collaborative manner with one or more off-site individuals who could help to resolve the issue presented or otherwise assist in the task to be performed by the on-site individual.

SUMMARY OF THE INVENTION

The present invention is a method and apparatus for using a wearable computer in collaborative problem resolution and collaborative design applications. In a preferred embodiment, the present invention comprises a general inspection camera; a detailed inspection camera; a display; a device to be used for wireless audio communication; a computer adapted to exchange data using wireless communication and adapted to facilitate collaborative applications between an individual at the location of interest and an individual at a remote location; a battery to supply power to the general inspection camera, the detailed inspection camera, the display, the wireless audio communications device, and the computer; and a harness to support any or all of the foregoing components from the body of a person.

The present invention permits an individual who is on-site at a manufacturing, construction, or inspection project (hereinafter “liaison”) to collect data for use in collaborative problem resolution or collaborative design survey or design audit applications (hereinafter “design audits”), to share this data using wireless communication with an engineer or other individual who will assist in the problem resolution or design audit (hereinafter “remote engineer”), and to collaborate with such individuals, in real time, using the data collected by the liaison to resolve the encountered problem or complete the design audit. The present invention also may be used by multiple liaisons and/or multiple remote engineers to resolve a common problem or complete a common design audit.

While the present invention may be used in a wide range of manufacturing, construction, and inspection applications as well as a wide range of design audit applications, the following description of the use of the present invention in the shipbuilding industry illustrates one use of the present invention. As with other large scale manufacturing and construction operations, the construction of a ship is divided into manageable units. These individual units that are later assembled into the complete ship must be constructed to precise specifications. Whenever any design problems or issues arise during the construction of these units, a designer or other person responsible for quality control (hereinafter “design representative”) generally is contacted to resolve the problem or issue. Traditionally, the design representative typically would be dispatched to the work site to make an initial assessment of the problem. The design representative typically would make a few hand sketches and then return to the office to review the latest drawings and to research a mainframe database for outstanding drawing revision notices that could either resolve or compound the encountered problem. In difficult situations, the design representative may even be forced to make another trip to the problem location to conduct a further review and then return to the engineering offices to review, for example, three dimensional computer aided design (“CAD”) models that often are used in design control. While the design representative endeavors to resolve the problem, which may take several hours or even longer, the production process is interrupted, potentially causing overall production schedule to be delayed.

Using the present invention, the time and effort required to resolve any design or other problems arising during the construction of the above mentioned ship units can be significantly reduced. For example, when a design or other problem is encountered during the construction of a ship unit, an individual (hereinafter “liaison”) using an apparatus according to a preferred embodiment of the present invention can be dispatched to the location of the problem or other issue. The apparatus preferably includes a general inspection camera, a detailed inspection digital camera, a visual display, a wearable computer, a wireless telephone or other device for audio communication, and a harness supporting the general inspection camera, detailed inspection digital camera, display, wearable computer, and wireless telephone or other device for audio communication from the liaison's body. Once the liaison has had a chance to assess the situation, the liaison may use the present invention to access plans and/or specifications or any other information stored either locally or remotely on a database that may offer assistance in resolving the situation. These plans and/or specifications can be stored locally on the wearable computer or at another, remote database. The liaison likewise may use the wireless telephone or other means for wireless audio communication to contact and collaborate with a remote engineer who can assist in the resolution of the issue. The present invention can be used simultaneously by multiple liaisons and/or remote engineers to resolve related issues in real time.

In a typical situation, the liaison would first use the general inspection camera to provide real time video to the remote engineer using wireless communication to give the remote engineer a general understanding of the proximity and nature of the problem. The liaison then can use the detailed inspection camera to take high resolution snap-shots that can be downloaded to the liaison's wearable personal computer. Using a software application that permits real time collaboration, the liaison may then transmit the snapshots to the remote engineer. The liaison may likewise annotate the snapshots, with the collaboration software enabling the remote engineer to view the annotations in real time. The remote engineer may likewise annotate the snapshots, which also may be viewed in real time by the liaison.

Either the remote engineer or liaison may also access plans and specifications for use in resolving the encountered issue. These plans and specifications may likewise be annotated in real time, thus allowing for a collaborative resolution of the issue presented. While the above example is set in the shipbuilding context, the present invention may likewise be used in other fields including, without limitation, aircraft and automobile manufacturing, construction, and inspection applications.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a front view of the present invention as worn on the body of a person;

FIG. 2 is a rear view of the present invention as worn on the body of a person;

FIG. 3 is a schematic diagram of a display unit stored in a housing; and

FIG. 4 is a schematic diagram of an apparatus to support components from the body of a person according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

The present invention is a method and apparatus for using a wearable computer in collaborative applications. For example, the present invention may be used in areas such as ship, aircraft, and automobile manufacturing, construction projects, and inspection, design, audit, and quality assurance projects. The present invention may be used to decrease the response time to production and other problems encountered during manufacturing, construction, and inspection projects. The present invention permits a liaison who is on-site at a manufacturing, construction, inspection site, or other location of interest to collect data for use in problem resolution or other collaborative applications; transmit the collected data using wireless communication means that include, without limitation, wireless local area network (“WLAN”) communication, ad hoc wireless communication, peer to peer wireless communication, and narrow and/or broadband wireless communications, all including both secure and unsecure transmission, to an engineer or other individual at any location who will assist in the problem resolution or collaborative collection of data regarding the location of interest (hereinafter “remote engineer”); and collaborate with the remote engineer to resolve the problem or collect data regarding the location of interest. The present invention also permits the liaison to engage in a collaborative “design audit” or “design survey” with a remote engineer. In this collaborative design audit or design survey, the liaison collaborates with a remote engineer to collect data regarding an existing structure or other object of interest for use in future designs or other planning. The present invention also may be used to permit multiple liaisons and/or multiple remote engineers to collaborate in real time.

Referring toFIG. 1,FIG. 2, andFIG. 4, the present invention preferably comprises ageneral inspection camera1000, adetailed inspection camera2000 preferably stored in a detailed inspectioncamera storage case2200, awireless telephone3000 or other means for wireless audio communication preferably mounted in awireless telephone housing3200, adisplay unit4000 preferably stored in adisplay housing4200, acomputer5000 preferably stored in acomputer housing5200, a battery6000 preferably stored in abattery housing6200, aninterface hub7000 preferably stored in ahub housing7200 and aharness8000 that supports any or all of the foregoing and/or other components from thebody10 of the liaison using the present invention.

1. Cameras

As shown inFIG. 1,general inspection camera1000 preferably is mounted upon aleft shoulder strap8300 ofharness8000. However,general inspection camera1000 may likewise be mounted uponright shoulder strap8400 or at any other location suitable for collecting video data.General inspection camera1000 preferably is secured to acamera mounting pad1200 using elastic straps (not shown), but may also be secured tocamera mounting pad1200 using any other suitable fastening means including hook and piling fastener tape, snaps, buttons, zippers, and clips.Camera mounting pad1200 preferably is secured toshoulder strap8300 using hook and pile fastener tape that is secured to the lower surface ofcamera mounting pad1200 and the outer surface ofshoulder strap8300. However, any suitable fastening means may be used to securecamera mounting pad1200 toshoulder strap8300 including, without limitation, zippers, buttons, snaps, and clips.

Referring toFIG. 2,general inspection camera1000 transmits video data tocomputer5000 usingvideo cable1100. In one embodiment of the present invention,video cable1100 is a USB cable. However,video cable1100 may be any means suitable for transmitting video data including, without limitation, a USB v. 2.0 or “firewire” interface. In a preferred embodiment of the present invention,general inspection camera1000 is a 3Com Home Connect web camera, available from 3Com, Inc., 5400 Bayfront Plaza, Santa Clara, Calif., 95052-8145. The software drivers of this camera fully support Microsoft Windows “plug and play,” which permits the “hot swapping” of USB devices. In addition to the 3Com Home Connect web camera, any camera suitable for collecting and transmitting real time video data may be used asgeneral inspection camera1000. Preferably,general inspection camera1000 is characterized by features including low bandwidth, low light sensitivity, rugged construction, compatibility with existing interface ports, water resistance, thermal resistance to both high and low temperatures, shock resistance, and a low profile. In another embodiment of the present invention,general inspection camera1000 may be a high resolution video camera.

As shown inFIG. 1,detailed inspection camera2000 preferably is used to collect detailed “snapshots” of the problem to be resolved.Detailed inspection camera2000 preferably is stored incamera storage case2200 when not in use.Camera storage case2200 preferably is secured to harness8000, as will be discussed further below.

When detailed imagery snapshots are desired, the liaison preferably removesdetailed inspection camera2000 fromcamera storage case2200, powers upcamera2000 if the power is not already turned on, and takes the desired snapshots. After the desired snapshots are taken, the snapshots are downloaded tocomputer5000 usingvideo cable2100.Camera2000 can have its own power source, or it can be powered by battery6000. Ifcamera2000 uses its own power source,video cable2100 does not need to be connected tocamera2000 while the snapshots are taken. In this embodiment, the snapshots may be reviewed before they are downloaded tocomputer5000 and then transmitted using wireless communication. This embodiment preferably is used to ensure that confidential or otherwise restricted access information is not accidentally downloaded or transmitted. Ifcamera2000 receives its power from battery6000, such power can be provided viavideo cable2100 connectingcamera2000 tocomputer5000, which in turn is connected to battery6000 via cable6100. In this embodiment,camera2000 is connected tocomputer5000 while the snapshots are taken.

Once the desired snapshots are taken, the snapshots can be downloaded tocomputer5000 usingvideo cable2100. Once the snapshots are downloaded tocomputer5000, the liaison may view the snapshots ondisplay unit4000. In a preferred embodiment of the present invention, the liaison can then annotate the snapshots using a touchscreen display unit4000. For example, the snapshots taken withcamera2000 can be annotated using the Netmeeting software application, available from Microsoft, Inc., One Microsoft Way, Redmond, Wash., 98052-6399. Netmeeting is preferred because of its “whiteboarding” feature, which permits individuals using the Netmeeting software to bring up a bitmap image, which is the snapshot taken bycamera2000, and share the ability to mark-up and annotate the image. In the present invention, the use of this “whiteboarding” feature permits live collaboration and allows the liaison and remote engineer to mark-up and annotate the snapshot in real time, thus allowing both the liaison and remote engineer to view the annotations as they are made. For example, the remote engineer could sketch dimensions and highlight areas of concern on the snapshot while the snapshot is being viewed by the liaison. The annotations made to the snapshots may then be stored for future reference. In addition to Netmeeting, any other software application that allows the annotation of images in real time including, without limitation, PlaceWare, available from PlaceWare, Inc., 295 N. Bernardo Ave., Mountain View, Calif., and Microsoft Exchange, may be used in the present invention. Another software application that may be used for live collaboration is Infoworkspace, available from General Dynamics Electronic Systems, 100 Ferguson Drive, P.O. Box 7188, Mountain View, Calif., 94039-7188, which is a java-based software application that allows the use of a “thin-client” so that specialized collaboration software does not have to reside oncomputer5000 and can be installed as needed.

In a preferred embodiment of the present invention, the remote engineer may use a touch sensitive smart board available from SMART Technologies, Inc., Suite 600, 1177-11th Ave. S.W., Calgary, Alberta, Canada, to annotate images.

In a preferred embodiment of the present invention,detailed inspection camera2000 is a 990 Nikon Cool Pix, available from Nikon, Inc., 1300 Walt Whitman Road, Melville, N.Y., 11747-3064. The 990 Nikon Cool Pix preferably is used ascamera2000 because of its sophisticated auto-flash capability, battery life, 3.3 Megapixel resolution, and USB output. However, any digital camera that is capable of taking high resolution still and video imagery, has low light sensitivity, has a long battery life, is rugged and water resistant, and preferably capable of sharing the power source ofcomputer5000 may be used ascamera2000.Video cable2100 preferably is a USB cable, but also may be any other suitable medium for transmitting video data.

In another embodiment of the present invention, a single camera (not shown) can be used in place of

individual camera

1000 and2000. This single camera (not shown) would be capable of transmitting both real time video and high resolution video images. In addition, this camera (not shown) would preferably have low light sensitivity, be able to share a power source withcomputer5000, have a long battery life, and be rugged and waterproof.

In another embodiment of the present invention, a single camera used in place ofcamera1000 andcamera2000 can be integrated intodisplay unit4000.

2. Audio Communications

As shown inFIG. 1, awireless telephone3000 that preferably is mounted intelephone housing3200 preferably is used in the present invention to allow audio communication between the liaison and remote engineer. In addition to a wireless telephone, any other means for wireless audio communication, including, without limitation, a two-way radio and cellular telephone, may be used in place ofwireless telephone3000. Aheadset3300 comprising anearphone3320 and microphone3310 preferably is plugged intowireless telephone3000 usingaudio cable3100 to permit hands-free audio communication between the liaison and remote engineer. In a preferred embodiment of the present invention,headset3300 is an Andrea Electronics Corp. headset, model no. ANC100, available from Andrea Electronics Corp., 45 Melville Park Road, Melville, N.Y., 11747, used with a stereo-to-mono audio adapter.

In one embodiment of the present invention,wireless telephone3000 preferably is incorporated into a cascading call-forwarding protocol system. In this embodiment, the liaison initially places a telephone call to an assigned remote engineer for assistance in the problem resolution. If this remote engineer is unable to answer the call, the call is automatically forwarded to a back-up remote engineer who will assist the liaison. If the back-up remote engineer is unable to answer the call, the call will continue to be forwarded up the chain-of-command until it is answered and a support team can be put in place. The use of this cascading call-forwarding system ensures that there will always be a remote engineer available to offer immediate assistance to the liaison. In a preferred embodiment of the present invention,wireless telephone3000 preferably is provided by Spectralink, Inc., 5755 Central Avenue, Boulder, Colo., 80301-2848.

As shown inFIG. 1,wireless telephone housing3200 preferably is used to supportwireless telephone3000 fromharness8000. As shown inFIG. 1,telephone housing3200 preferably is configured to permittelephone3000 to be extended from the body of the liaison and to be stored in an upright position (not shown) when not in use and after communications have been established. In a preferred embodiment of the present invention, the angle at whichtelephone3000 extends from the liaison's body when in use may be adjusted through the use of asupport cord3235 and barrel stops3230 and3238. Using barrel stops3230 and3238, the length ofsupport cord3235 may be adjusted, thereby controlling the angle at whichtelephone3000 extends from the body of the liaison.

Although not shown inFIG. 1,telephone3000 may be stored upright against the body of the liaison by folding asupport flap3210 inwards toward the body of the liaison.Telephone3000 is preferably stored in this upright position whentelephone3000 is not in use and whentelephone3000 is in use after communication has been established with the remote engineer. Hook and pile fastener tape preferably is mounted upon the outer surface of atelephone mounting strap3215 and mountingstrip3220. In addition to hook and pile fastener tape, any suitable fastening means may be used to securetelephone mounting strap3215 to mountingstrip3220 including, without limitation, zippers, buttons, snaps and clips.

In another embodiment of the present invention, audio communications between the liaison and remote engineer preferably are made using WLAN integrated Voice Over Internet Protocol (“VoIP”) technology. The use of WLAN integrated VoIP technology would eliminate the need to usewireless telephone3000 in the present invention. In this embodiment,headset3300 preferably would be modified to be USB compatible andaudio cable3100 preferably would be a USB cable. In this embodiment,headset3300 would be connected tocomputer5000 usingaudio cable3100.

The following is a detailed discussion regarding the use of VoIP technology according to the present invention. The present invention preferably would employ key enabling technology achieve the current wireless connectivity is the IEEE 802.11b Standard for Wireless Local Area Networks. IEEE 802.11b is a national standard for wireless data transmission broadcasting over the 2.43 Ghz radio frequency. The IEEE standard has been adopted by companies such as CISCO, Harris, Symbol and others to allow mobile PC's to connect to standard IEEE 802.3 Ethernet LANs. The basic system architecture of 802.11b starts with a wireless hub, called an Access Point (“AP”) that plugs into a standard Ethernet port via an RJ-45 cable connection. The Access Point allows a mobile computer equipped with a PCMCIA client card, called a Mobile User (“MU”), to send and receive data to a conventional Ethernet network via a properly configured AP. The 802.11b standard allows wireless data throughput up to 11 Mbs, dividing the available bandwidth among all MU's associated with a particular AP. Association to a particular AP is established through a unique software setting called an SSID. Only MU's and AP's with the same SSID can exchange information. There are various schemes that can be employed using SSID's, channel designations, and the physical placement of AP's to extend the range and signal density of a wireless network. All of these factors are taken into account when designing a wireless network. A Wireless Bridge can be used to relay data between wireless networks. Wireless Bridges (WB's) also have a unique ability to be configured either for wireless relay or to operate as autonomous Access Point. This operation can be accomplished remotely through a web based interface (each AP and WB has it's own IP address) or locally through an RS232 serial connection. This application can also be used to monitor the identity and number of users on the system to insure system security and quality of service. Most commercially available bridges are designed for indoor/outdoor use and can withstand cold temperatures. 802.11b is considered to be a leading wireless networking technology for use in harsh industrial and marine environments. The following components preferably are used with the present invention:

- 1) CISCO 340 Series PCMCIA Client Card, 100 Mw, available from Cisco Systems, 170 West Tasman Dr., San Jose, Calif., 95134, and
- 2) CISCO 340 Series Wireless Bridge, 100 Mw.
  Access Points and Wireless Brides preferably can be configured to encrypt data through either software or hardware based security schemes. In another embodiment of the present invention,headset3300 may be incorporated into a hearing protection headset, hardhat, or other head and hearing protection system.

3. Display Unit

As shown inFIG. 3,display unit4000 is used to provide data to the liaison wearing the present invention and to exchange data between the liaison and remote engineer.Display screen4010 ofdisplay unit4000 preferably utilizes a thin film transistor (“TFT”) touch sensitive display surface, thus combining both video and “mouse” functions intodisplay unit4000. The liaison using the present invention preferably interfaces withdisplay unit4000 using apen stylus4020 ondisplay screen4010. As shown inFIG. 3,display unit4000 preferably is stored indisplay housing4200.Display unit4000 is connected tocomputer5000 usingdisplay cable4100.

Display unit

4000 is used to provide data to the liaison and to exchange data between the liaison and the remote engineer. For example, after the liaison has taken snapshots of a problem usingdetailed inspection camera2000 and downloaded the snapshots tocomputer5000,display unit4000 may be used to view the snapshots before they are transmitted to the remote engineer. Whendisplay screen4010 uses a TFT touch sensitive display surface, the liaison may use the “whiteboarding” feature of Microsoft Netmeeting to make annotations usingpen stylus4020 on the snapshot that can be viewed by the remote engineer in real time. When exchanging data with the remote engineer, the liaison preferably may use a software application such as Netmeeting to view plan changes made by the remote engineer to address the problem to be resolved through the real time collaboration. The data from the real time collaboration also may be stored for future reference.

In a preferred embodiment of the present invention,display unit4000 is a ViA II PC Pen Tablet with an Indoor Readable display, available from ViA, Inc., 12550 West Frontage Road, Ste. 201, Burnsville, Minn. 55337. The Indoor Readable display is preferred because of its backlight feature. A Sunlight Readable display, also available from ViA, Inc., may be used asdisplay4000 in situations where the present invention is being used outdoors where sunlight may interfere with the ability of the liaison to viewdisplay screen4010. In another embodiment of the present invention, a transflective screen, available from ViA, Inc., or a Hewlett Packard No Power display, available from Hewlett Packard, 3000 Hanover Street, Palo Alto, Calif. 94304-1185, may be used asdisplay unit4000.

As shown inFIG. 1 andFIG. 3,display unit4000 preferably is stored indisplay housing4200 to supportdisplay unit4000 fromharness8000. As shown inFIG. 1,display housing4200 preferably is configured to permitdisplay unit4000 to be extended from thebody10 of the liaison when in use for hands-free operation and to permitdisplay unit4000 to be stored in a position flat against thebody10 of the liaison when not in use (not shown). In a preferred embodiment of the present invention as shown inFIG. 3, the angle at whichdisplay unit4000 extends from thebody10 of the liaison, and the angle at whichdisplay unit4000 may be viewed when in use, may be adjusted through the use of asupport cord4235 and barrel stops4230 and4238. Using barrel stops4320 and4238, the length ofsupport cord4235 may be adjusted, thereby controlling the angle at whichdisplay unit4000 extends from the body of the liaison.

Also as shown inFIG. 3, display is fastened to display housing usingfastening straps4240. Fasteningstraps4240 preferably are permanently secured to displayhousing4200 at one end and removably fastened to displayhousing4200 at the other end using hook and pile fastener tape or any other suitable fastening means including, without limitation, snaps, buttons, and clips. In another embodiment of the present invention,display4000 may be removed fromdisplay housing4200 for use in displaying information to others by either unfasteningfastening straps4240 or sliding the display in a lateral direction when fastening straps4240 are loosened.

Although not shown inFIG. 1 orFIG. 3, whendisplay unit4000 is not in use, display unit may be stored in a flat position against thebody10 of the liaison by folding asupport flap4210 inwards towards thebody10 of the liaison. A mounting strip preferably made of hook and pile fastener tape preferably is mounted upon the outer surface of astorage flap4125 and mountingstrip4220. In addition to hook and piling fastener tape, any suitable fastening means may be used to securestorage flap4125 to mountingstrip4220 including, without limitation, zippers, buttons, and snaps.

In another preferred embodiment of the present invention, a head mounteddisplay3330 may be used in lieu ofdisplay4000. As shown inFIG. 1, head mounteddisplay3330 may be mounted on anarm3335 extending fromheadset3300. In addition, head mounteddisplay3330 may be incorporated into a pair of safety glasses. The use of head mounteddisplay3330 would enable the liaison to use “augmented reality” software applications. As an example, the liaison would be able to upload three-dimensional computer aided design (“CAD”) models and overlay them over the scene that the liaison is viewing to assist in the resolution of engineering problems. In a preferred embodiment of the present invention, a Liteye300, available from Liteye Microdisplay Systems, LLC, 12415 Dumont Way, Unit #103, Littleton, Colo. 80125, may be used as head mounteddisplay3330. The head mounted display used in this embodiment of the present invention may use technology including, but not limited to, curvilinear prism technology, liquid crystal display technology, or retinal scan display technology.

The present invention likewise may incorporate a wrist mounted keyboard (not shown), a wrist mounted finger mouse (not shown), or any other ergonomically adapted keyboard or mouse (not shown).

4. Computer

As shown inFIG. 2,computer5000 is used in the present invention to provide information to the liaison wearing the present invention and to facilitate the exchange of information between the liaison and the remote engineer or to permit the liaison to continue working independent of the remote computer network as required.Computer5000 preferably is a wearable computer. As shown inFIG. 2,computer5000 preferably is stored incomputer housing5200 to supportcomputer5000 fromharness8000.

While numerous wearable computers capable of wireless communications may be used ascomputer5000,computer5000 preferably is a ViA IIB or ViA IIC (Transmeta processor) wearable personal computer, available from ViA, Inc., 12550 West Frontage Road, Ste. 201, Burnsville, Minn. 55337, or a ViA IIR wearable personal computer, available from General Dynamics Information Systems, 8800 Queen Avenue South, Bloomington, Minn., 55431. The ViA IIR is a ruggedized modified version of the ViA IIB.

The ViA IIB is preferable ascomputer5000 because it uses a Cyrix processor, which generally consumes less power and generally has a cooler operating temperature than processors available from Intel and AMD. The ViA IIB preferably is used forcomputer5000 because it possesses the following capabilities. The ViA IIB is Microsoft Windows 9X compatible and currently uses Windows 98 as its operating system. The ViA IIB has two internal PCMCIA slots to accommodate a 100 mW wireless LAN card. Using, for example, an Aironet wireless communication system, available from Cisco Systems, Inc., 170 West Tasman Drive, San Jose, Calif., 95134,computer5000 is able to transmit and receive data over a WLAN connection using the IEEE 802.11(x) protocol.

In another preferred embodiment of the present invention,computer5000 may be the ViA IIC, which incorporates a Transmeta Crusoe processor. Like the ViA IIB, the ViA IIC has two PCMIA slots to accommodate WLAN communication. The ViA IIC is preferable because it uses a faster processor, produces less heat, and is capable of using a variety of operating systems including Windows 95, Windows 98,Windows 2000, Windows NT 4.0, and Sun, Hewlett-Packard, Apple Macintosh, and IBM operating systems.

A ViA IIR preferably may be used ascomputer5000 because it is “ruggedized” to withstand a greater shock than a conventional wearable personal computer can be expected to withstand. The ViA IIR takes the basic core unit of a commercial ViA IIB and consolidates it into a 3.8″×5.9″×1.6″ box machined from a solid block of aluminum that is sealed to be water tight and able to withstand shock. A hollow cell is machined into the box containing the motherboard, processor, chipset, RAM and all other associated electronic components. This cell is waterproof and the motherboard is designed to use the thermal mass of its container as a heat sink.

To further enhance high heat performance, a cooling tunnel, located adjacent to the processor cell, is incorporated into the design of the ViA IIR. The tunnel contains a large aluminum heat sink and a compact cooling fan generating a steady air stream over its fins. In order to facilitate air exchange, the cooling tunnel is not sealed. The cooling fan is rugged enough to withstand repeated exposures to water and can be easily replaced if it is damaged. Preferably, a cooling fan providing greater airflow than the fan used in a standard ViA IIB is used to provide increased cooling capacity, thus allowing the ViA IIR to operate in a high temperature environment. A Cyrix or Transmeta processor preferably is used in the ViA IIR because of their low power draw resulting in longer battery life and cooler running temperatures. This makes the ViA IIR preferable over other conventional wearable personal computers that use Intel and AMD processors that generally consume more power than the Cyrix processor.

The ViA IIR preferably may be used forcomputer5000 because it is possesses the following capabilities. The ViA IIR is Microsoft Windows 9X compatible, and currently uses Windows 98 as its operating system. In addition, the ViA IIR is also capable of using Windows NT 4.0 as its operating system. The ViA IIR has an internal PCMCIA slot to accommodate a 100 mW wireless LAN card. Using, for example, an Aironet wireless communication system, available from Cisco Systems, Inc., 170 West Tasman Drive, San Jose, Calif., 95134, computer300 is able to transmit and receive data over a WLAN connection using the IEEE 802.11 protocol.

The present invention preferably uses wireless communication to permit collaborative problem or data gathering resolution between the liaison wearing the present invention and the remote engineer. The following is an example of how the liaison and remote engineer may collaborate to resolve a problem. After identifying a problem on the job site or arriving at the location of interest and contacting the remote engineer usingwireless telephone3000 or other wireless audio communication means such WLAN integrated VoIPcommunication using computer5000, the liaison may first transmit real time video usinggeneral inspection camera1000. The real time video is transmitted using wireless communication fromcomputer5000 to the computer system being used by the remote engineer.Computer5000 may use software such as Netsnap, available from PeleSoft, 2115 Palm Bay Rd., N.E., Palm Bay, Fla. 32905, for the streaming of video using wireless communication.

The liaison may then collect high-resolution imagery snapshots of the problem usingdetailed inspection camera2000 and download the snapshots tocomputer5000. The liaison may then review the downloaded snapshots ondisplay unit4000 and make annotations to the snapshots using the “whiteboarding” feature of Microsoft Netmeeting. The annotations may be viewed by the remote engineer in real time using whiteboarding. The remote engineer likewise may make additional annotations to the snapshots using “whiteboarding” that can be viewed by the liaison in real time. These annotations may then be stored by either the liaison, remote engineer, or both for future reference.

Computer

5000 preferably may also be used to exchange technical information such as project plans and technical specifications between the liaison and design engineer. In one embodiment of the present invention, the liaison could open a CAD application such as Autocad, available from Autodesk, Inc., 111 McInnis Parkway, San Raphael, Calif., and select to share this application while using Netmeeting, causing the AutoCAD application to “pop-up” on the remote engineer's conferencing window. The remote engineer may then take control of the Autocad application that is being hosted oncomputer5000 and make changes to the design plans that could be viewed by the liaison and any other persons participating in the “Netmeeting.” The Netmeeting application also permits instant text messaging, which would enable the liaison to contact and collaborate with the remote engineer online rather than usingwireless telephone3000 or other means of audio communication. Netmeeting also permits files to be transferred betweencomputer5000 and the remote engineer's computer. In addition to AutoCAD, any other suitable software package featuring “application sharing” may be used according to the present invention. One such software package is Visualizer, available from Parametrics Technology Corp., 128 Technology Drive, Waltham, Mass., 02453.

In addition to collaboration through “whiteboarding,” the liaison and remote engineer may also collaborate using a more sophisticated version of “whiteboarding” known as “redlining.” “Redlining” generally allows users to mark up vector based images (and certain bitmap formats such as CALS C4) using software applications such as Autodesk's Volo View, TMS View Director, available from TMSS Headquarters, 206 W. 61 Ave., Stillwater, Okla., 74074, Intergraph's ImageR, available from Integraph, Inc., 8252 Hwy. 20 West, Madison, Ala., and CPC View, available from Cartesian Products, Inc., 30 Wesley Street, Ste. 2, Newton, Mass. 02458. Product View, available from Parametric Technology Corp., may also be used for redlining applications or any other type of application sharing. “Redlining” is usually focused on the mark up of technical drawings because it can facilitate CAD and Computer Aided Engineering (“CAE”) options such as layer assignment, revision history, dimensioning, and dynamic panning and zooming. Layers preferably can be designated so that another designer cannot override the changes made by the liaison or remote engineer. In addition to collaborating with the remote engineer using the above applications, the liaison preferably may likewise independently access these applications before collaborating with the remote engineer. Independently accessing these applications before contacting the remote engineer may allow the liaison to view the latest drawings and revision change notices to discover what may be a “prior fix” to the problem currently being encountered by the liaison.

In another embodiment of the present invention, digital signature verification software, such as Sign-It for Microsoft Word and Adobe Acrobat 4.0, available from Communication Intelligence Corp., 275 Shoreline Drive, Suite 500, Redwood Shores, Calif., 94065-1413, may be used with the present invention.

In situations where wireless communication is unavailable or becomes temporarily disabled, the liaison may collect data for later use, which is commonly referred to as “store and forward.” When wireless communication becomes available, the liaison preferably may retrieve the stored data and collaborate with the remote engineer.

In addition to the above listed applications,computer5000 may use any other software applications that facilitate collaboration between the liaison and remote engineer to resolve an on-site problem. Software applications that may be used with the present invention preferably include some or all of the following features: whiteboard, redlining, video and VoIP technology, information sharing, and peer to peer file transfer. Software such as Microsoft Exchange may be used as the collaborative software according to the present invention.Computer5000 may also be used to store voice and video data for future reference.

At locations where the use of a WLAN is not feasible or available, long range wireless LAN communication, as available from BreezeCom, 5858 Edison Place, Carlsbad, Calif., 92008, for example, may be used to establish wireless communication. If long range wireless LAN communication is not available, satellite based communication, as available from DirecPC, 11717 Exploration Lane, Germantown, Md., 20876, for example, may be used to establish wireless communication. In addition to these examples, any other type of wireless communication may be used with the present invention.

As shown inFIG. 2, battery6000 supplies power tocomputer5000 using power cable6100. Battery6000 is stored inbattery housing6200, which preferably supports battery6000 fromharness7000. In a preferred embodiment of the present invention, battery6000 is two Molicel ME202BB batteries, available from E-One Moli Energy Limited, North American Sales Office and Production Facility, Maple Ridge, BC, Canada, V2X 9E7. The Molicel ME202BB is preferred because of its high energy density characteristics and thermal resistance. The Molicel ME202BB is the battery that is shipped with the ViA IIB computer. The Energy Access SBS series smart battery charger that is also shipped with the ViA IIB computer is likewise preferred because it uses “smart charging technology” that allows the battery to be charged at various levels of discharge with diminished risk of developing battery “memory” or overcharging the battery. This battery supports Microsoft Windows Power Management, which will display the percentage of power remaining in the battery, can be set to send a warning message when the battery charge is reduced to a certain level, and allows the “hot-swapping” of batteries. In addition, this battery includes a touch sensitive film switch on the battery itself with a relative power indicator.

As shown inFIG. 1, the present invention preferably may also include aninterface hub7000 that may be used to add additional peripheral devices to the present invention and/or to simplify the connection of components tocomputer5000. In a preferred embodiment of the present invention,interface hub7000 may be a Targus Multiport 4 Port USB Hub, Model No. PA060U, available from Targus, Inc., 1211 N. Miller St., Anaheim, Calif. 92806. The use of a Targus 4 Port USB Hub provides the ability to add additional USB devices to the present invention.

In another preferred embodiment of the present incentive,hub housing7200, which securesinterface hub7000 to harness8000, may also be used to storegeneral inspection camera1000 whengeneral inspection camera1000 is not in use.

5. Harness

As shown inFIG. 1,FIG. 2, andFIG. 4

harness

8000 preferably is used to supportgeneral inspection camera1000,detailed inspection camera2000,wireless telephone3000,display unit4000,computer5000, battery6000, andinterface hub7000 from thebody10 of the liaison wearing the present invention. Referring toFIG. 4, a preferred embodiment ofharness8000 is a modified “back support belt” commonly worn by warehouse workers to ease the strain of lifting and long hours standing on concrete floors. Aninner belt8100 is a typical adjustable back support belt preferably with an outer hook and pile fastener tape surface. In addition to hook and piling fastener tape, any other method of fastening may be used such as buttons, snaps, and zippers.Inner belt8100 preferably is adjustable to many body types because it is fastened using a hook and piling fastener tape patch (not shown) located on the inside surface of anouter flap8110. An adjustableouter belt8200 preferably constructed from nylon is positioned over innerback support belt8100 and is held in place usingsupport loops8210 that are secured to the outer surface ofinner belt8200.Outer belt8200 preferably is adjustable and may have its ends fastened to one another usingclasp8230 as shown inFIG. 4. The ends ofbelt8200 may also be secured to one another using any other suitable fastening means including, without limitation, buckles, snaps, button, hook and pile fastener tape, and clips.Harness8000 as shown has the added benefit of providing additional lumbar support to the liaison wearing the present invention.

Detailed inspection camera

2000,wireless telephone3000,display unit4000,computer5000, battery6000, andinterface hub7000 may be supported fromouter belt8200 by runningouter belt8100 through support loops (not shown) located on the inside surfaces of detailed inspectioncamera storage case2200,wireless telephone housing3200,display housing4200,computer housing5200,battery housing6200, andhub housing7200. In a preferred embodiment of the present invention, hook and pile fastener tape patches sewn onto the support loops located on the inside surfaces of detailedinspection camera case2200,wireless telephone housing3200,display housing4200,computer housing5200,battery housing6200, andhub housing7200 prevent the various components from sliding aboutinner belt8200 because the hook and pile fastener tape patches on the support loops adhere to the outer hook and pile fastener tape surface of innerback support belt8100. This preferred embodiment has the added benefit of allowing other components such as additional storage pockets to easily be supported fromouter belt8200. In addition, this embodiment allows for the reconfiguration, addition, or deletion of various components depending upon the liaison's needs. In addition to this preferred embodiment, any fastening means including snaps, buttons, zippers and clips may be used to support the components fromharness8000.

As shown inFIG. 4,harness8000 also comprises

adjustable shoulder straps

8300 and8400 that provide additional support for the liaison wearing the present invention.

Shoulder straps

8300 and8400 preferably are adjusted so that innerback support belt8100 is properly positioned on the liaison.

As shown inFIG. 4,

cable conduits

8610 and8620 preferably are incorporated intoharness8000 to prevent the cables used in the present invention from causing inconvenience or snagging. As shown inFIG. 4,cable conduit8610 preferably runs along the upper edge ofinner belt8100 andcable conduit8610 runs along the outside of

shoulder strap

8300 and8400. In addition to this embodiment, cable conduits may be positioned at any other suitable location inharness8000.

Cable conduits

8610 and8620 preferably are constructed from two-sided hook and pile fastening tape. One edge of the tape is secured to harness8000 using stitching or any other suitable fastening means including, without limitation, snaps, buttons, zippers, or clips. The other edge of the tape remains free. The cable to be passed through the conduit preferably is rolled into the tape, enclosing the cable in the conduit. An advantage of using the hook and piling fastening tape in this embodiment is the ability to create an aperture at any point along the conduit to permit the cable to exit the conduit. Corresponding apertures may be made at other location throughout the cable conduits to permit the cables to be appropriately positioned.

In addition to the above example, any other suitable material may be used to construct

cable conduits

8610 and8620, and cable conduit may be positioned at any appropriate location onharness8000.

Harness

8000 as shown inFIG. 1,FIG. 2 andFIG. 4 is a preferred embodiment of the present invention. However, there are numerous other means that may be used to supportgeneral inspection camera1000,detailed inspection camera2000,wireless telephone3000,display unit4000,computer5000, battery6000, andhub housing7200 from the body of the liaison. For example, a harness could be used that incorporates pockets to hold the various components. In addition, a harness could be used that has high-resolution storage case2200,wireless telephone housing3200,display housing4200,computer housing5200,battery housing6200, andhub housing7200 fastened to the outside surface of the harness at suitable locations on thebody10 of the liaison wearing the harness as shown inFIG. 1, andFIG. 2.

Whereas the present invention has been described with respect to specific embodiments thereof, it will be understood that various changes and modifications will be suggested to one skilled in the art and it is intended that the invention encompass such changes and modifications as fall within the scope of the appended claims.