US20190361109A1 - High precision time of flight measurement system for industrial automation - Google Patents

Abstract

A system for tracking position of objects in an industrial environment includes an interrogator, a transponder, and a processor. The interrogator transmits a signal and provides a first reference signal corresponding to the transmitted signal. The transponder provides a response signal. The interrogator receives the response signal and provides a second reference signal corresponding to the response signal. The processor determines a location of either the interrogator or the transponder, relative to the other, based on the two reference signals.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
• This Application is a divisional claiming the benefit under 35 U.S.C. § 120 of U.S. application Ser. No. 15/960,224, filed Apr. 23, 2018, entitled “HIGH PRECISION TIME OF FLIGHT MEASUREMENT SYSTEM FOR INDUSTRIAL AUTOMATION,” which is a continuation claiming the benefit under 35 U.S.C. § 120 of U.S. application Ser. No. 15/181,999, filed Jun. 14, 2016, entitled “HIGH PRECISION TIME OF FLIGHT MEASUREMENT SYSTEM FOR INDUSTRIAL AUTOMATION”, which claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Application Ser. No. 62/175,819, filed Jun. 15, 2015; U.S. Provisional Application Ser. No. 62/198,633, filed Jul. 29, 2015; U.S. Provisional Application Ser. No. 62/243,264, filed Oct. 19, 2015; U.S. Provisional Application Ser. No. 62/253,983, filed Nov. 11, 2015; U.S. Provisional Application Ser. Nos. 62/268,727, 62/268,734, 62/268,736, 62/268,741, and 62/268,745, each filed Dec. 17, 2015; U.S. Provisional Application Ser. No. 62/271,136, filed Dec. 22, 2015; U.S. Provisional Application Ser. No. 62/275,400, filed Jan. 6, 2016; and U.S. Provisional Application Ser. Nos. 62/306,469, 62/306,478, and 62/306,483, each filed Mar. 10, 2016, each of which is herein incorporated by reference in its entirety for all purposes.
BACKGROUND1. Field of the Disclosure
• The present disclosure generally relates to tracking objects in an industrial automation environment, and more particularly to tracking motion of industrial equipment or employees.
2. Discussion of Related Art
• Industrial environments, such as manufacturing facilities, warehouses, fulfillment centers, etc., typically have a mix of personnel, machinery, and equipment working among and in combination with each other. Automated equipment and machinery, human-controlled equipment and machinery, and human personnel may all move about independently of each other and may pose risks to each other or may not perform their functions in an efficient or coordinated manner. Traditional systems to optimize operations and/or detect danger typically involve independent sensors on machinery and rules or operating procedures imposed upon humans, all of which are subject to malfunction, error, or actions out of the ordinary. There exists a need, therefore, for a set of components, a system, and a method to increase automation and precision tracking of operations and movement within industrial environments.
SUMMARY
• Aspects and embodiments relate to tracking objects in an industrial automation environment, and more particularly to tracking motion of industrial equipment or employees.
• According to one aspect, a system for tracking position of objects includes at least one interrogator which transmits a first electromagnetic signal and provides a first reference signal corresponding to the transmitted signal; at least one transponder which receives the first electromagnetic signal and provides a response signal; the at least one interrogator including a receiver which receives the response signal and provides a second reference signal corresponding to the response signal; and a processor which in response to the first reference signal and the second reference signal determines a precise location of at least one of the at least one interrogator or the at least one transponder; wherein the objects to be tracked includes at least one of a part of one of a human, a piece of equipment, and an item; wherein the system is configured to determine a precise position and location of the human's body movement in cooperation with the piece of equipment or item; and wherein one of the at least one interrogator and the at least one transponder is configured to be mounted to the object.
• In some embodiments the at least one interrogator includes a plurality of interrogators in fixed positions. In some embodiments the at least one transponder includes a plurality of transponders in fixed positions. In some embodiments one of the at least one interrogator and the at least one transponder is integrated into a wristband. In some embodiments the at least one interrogator and the at least one transponder is integrated into a personal digital device. In some embodiments one of the at least one interrogator and the at least one transponder is configured with a feedback mechanism. In some embodiments the feedback mechanism includes one of a colored LED, a speaker, a microphone, a wireless beacon, an accelerometer, a gyroscope, and a haptic device. In some embodiments the system is configured to signal the feedback mechanism to give the human real time feedback regarding task performance. In some embodiments the feedback mechanism is configured to provide at least one indication of critical feedback and at least one other indication of routine feedback. In some embodiments the system is configured to provide the human with real time instructions. In some embodiments the system is configured to monitor and store work patterns of a limb of the human for one of analytics, performance monitoring, and training. In some embodiments the system is configured to track the piece of equipment or item for performance monitoring in a work environment. In some embodiments the work environment is one of a pick and pack environment, a warehouse environment, and an assembly environment. In some embodiments the limb is a person's hand and the system is configured for tracking the person's hand and the item to the selection of items from bins to provide real time feedback in a pick and pack environment. In some embodiments the system is configured for precisely tracking one or more human limbs in relation to the piece of equipment. In some embodiments the system is configured for actuating the industrial equipment to perform an action based on and in cooperation with the recognized movement the one or more limbs. In some embodiments the system is configured to detect a pending collision between the limb and piece of equipment, and in response to cause the industrial equipment to halt or to move out of the way of the collision. In some embodiments the system is configured for interpreting the movement of the human body part as a performable action. In some embodiments the system is configured to predict movement of the human limb. In some embodiments the system is configured for enabling setup or modifications of robotic lines to eliminate interference and optimize movement paths of robots operating in an industrial environment. In some embodiments the system is configured for automatic switching between modes of control for the piece of equipment based on the determined location of the piece of equipment. In some embodiments the system is configured for precise assembly or setup within tolerances of large scale machinery that has multiple subcomponents.
• Still other aspects, embodiments, and advantages of these exemplary aspects and embodiments are discussed in detail below. Embodiments disclosed herein may be combined with other embodiments in any manner consistent with at least one of the principles disclosed herein, and references to “an embodiment,” “some embodiments,” “an alternate embodiment,” “various embodiments,” “one embodiment” or the like are not necessarily mutually exclusive and are intended to indicate that a particular feature, structure, or characteristic described may be included in at least on embodiment. The appearances of such terms herein are not necessarily all referring to the same embodiment.
BRIEF DESCRIPTION OF THE DRAWINGS
• Various aspects of at least one embodiment are discussed below with reference to the accompanying figures, which are not intended to be drawn to scale. The figures are included to provide illustration and a further understanding of the various aspects and embodiments, and are incorporated in and constitute a part of this specification, but are not intended as a definition of the limits of the invention. In the figures, each identical or nearly identical component that is illustrated in various figures is represented by a like numeral. For purposes of clarity, not every component may be labeled in every figure.
• In the Figures:
• FIG. 1 illustrates one embodiment of a system for measuring distance with precision based on a bi-static ranging system configuration for measuring a direct time-of-flight (TOF);
• FIG. 2 illustrates one embodiment of a system for measuring distance with precision based on frequency modulated continuous wave (FMCW) TOF signals;
• FIG. 3 illustrates one embodiment of a system for measuring distance with precision based on direct sequence spread spectrum (DSSS) TOF signals;
• FIG. 4 illustrates one embodiment of a system for measuring distance with precision based on wide-band, ultra-wide-band pulsed signals, or any pulse compressed waveform;
• FIG. 5 illustrates one embodiment of a system for measuring distance with precision based on DSSS or frequency hopping spread spectrum (FHSS) FMCW ranging techniques;
• FIG. 6 illustrates one embodiment of a system for measuring distance with precision with TOF signals having multiple transmitters, multiple transceivers, or a hybrid combination of transmitter and transceivers;
• FIG. 7 illustrates one embodiment of a system for measuring distance with precision with TOF signals having multiple receivers, multiple transponders, or a hybrid combination of receivers and transponders;
• FIG. 8 illustrates one embodiment of a system for measuring distance with precision with TOF signals having multiple transmitters, multiple transceivers, or a hybrid combination of transmitter and transceivers and well as multiple receivers, multiple transponders, or a hybrid combination of receivers and transponders;
• FIG. 9 illustrates one embodiment of a system for measuring location with precision with modulated TOF signals;
• FIG. 10 illustrates another embodiment of a system for measuring location with precision with modulated TOF signals;
• FIG. 11 illustrates a block diagram of an interrogator for linear FMCW two-way TOF ranging;
• FIG. 12 illustrates another embodiment of a block diagram of an interrogator for linear FMCW two-way TOF ranging;
• FIG. 13 illustrates one embodiment of a system for measuring distance with precision with TOF signals for detecting movement of a user and/or industrial equipment; and
• FIG. 14 illustrates another embodiment of a system for measuring distance with precision with TOF signals for detecting movement of a user and/or industrial equipment.
DETAILED DESCRIPTION
• It is to be appreciated that embodiments of the methods and apparatuses discussed herein are not limited in application to the details of construction and the arrangement of components set forth in the following description or illustrated in the accompanying drawings. The methods and apparatuses are capable of implementation in other embodiments and of being practiced or of being carried out in various ways. Examples of specific implementations are provided herein for illustrative purposes only and are not intended to be limiting. Also, the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use herein of “including,” “comprising,” “having,” “containing,” “involving,” and variations thereof is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. References to “or” may be construed as inclusive so that any terms described using “or” may indicate any of a single, more than one, and all of the described terms. Any references to front and back, left and right, top and bottom, upper and lower, and vertical and horizontal are intended for convenience of description, not to limit the present systems and methods or their components to any one positional or spatial orientation.
Definitions:
• A transceiver is a device comprising both a transmitter (an electronic device that, with the aid of an antenna, produces electromagnetic signals) and a receiver (an electronic device that, with the aid of an antenna, receives electromagnetic signals and converts the information carried by them to a usable form) that share common circuitry.
• A transmitter-receiver is a device comprising both a transmitter and a receiver that are combined but do not share common circuitry.
• A transmitter is a transmit-only device, but may refer to transmit components of a transmitter-receiver, a transceiver, or a transponder.
• A receiver is a receive-only device, but may refer to receive components of a transmitter-receiver, a transceiver, or a transponder.
• A transponder is a device that emits a signal in response to receiving an interrogating signal identifying the transponder and received from a transmitter.
• Radar (for Radio Detection and Ranging) is an object-detection system that uses electromagnetic signals to determine the range, altitude, direction, or speed of objects. For purposes of this disclosure, “radar” refers to primary or “classical” radar, where a transmitter emits radiofrequency signals in a predetermined direction or directions, and a receiver listens for signals, or echoes, that are reflected back from an object.
• Radio frequency signal or “RF signal” refers to electromagnetic signals in the RF signal spectrum that can be CW or pulsed or any form.
• Pulse Compression or pulse compressed signal refers to any coded, arbitrary, or otherwise time-varying waveform to be used for Time-of-Flight (TOF) measurements, including but not limited to FMCW, Linear FM, pulsed CW, Impulse, Barker codes, and any other coded waveform.
• Wired refers to a network of transmitters, transceivers, receivers, transponders, or any combination thereof, that are connected by a physical waveguide such as a cable to a central processor.
• Wireless refers to a network of transmitters, transceivers, receivers, transponders, or any combination thereof that are connected only by electromagnetic signals transmitted and received wirelessly, not by physical waveguide.
• Calibrating the network refers to measuring distances between a transmitters, transceivers, receivers, transponders, or any combination thereof.
• High precision ranging refers to the use electromagnetic signals to measure distances millimeter or sub-millimeter precision.
• One-way travel time or TOF refers to the time it takes an electromagnetic signal to travel from a transmitter or transceiver to a receiver or transponder.
• Two-way travel time or TOF refers to the time it takes an electromagnetic signal to travel from a transmitter or transceiver to a transponder plus the time it takes for the signal, or response, to return to the transceiver or a receiver.
• Referring toFIG. 1, aspects and embodiments of one embodiment of a system for measuring distance with precision of the present invention are based on a bi-static ranging system configuration, which measures a direct time of flight (TOF) of a transmitted signal between at least onetransmitter10 and at least onereceiver12. This embodiment of a ranging system of the invention can be characterized as an apparatus for measuring TOF of anelectromagnetic signal14. This embodiment of an apparatus is comprised of at least onetransmitter10, which transmits anelectromagnetic signal14 to at least onereceiver12, which receives the transmittedsignal14 and determines a time of flight of the received signal. A time of flight of theelectromagnetic signal14 between the transmission time of thesignal14 transmitted from thetransmitter10 to the time the signal is received by thereceiver12 is measured to determine the TOF of thesignal14 between the transmitter and the receiver. A signal processor within one of thetransmitter10 and thereceiver12 analyzes the received and sampled signal to determine the TOF. The TOF of thesignal14 is indicative of the distance between thetransmitter10 and thereceiver12, and can be used for many purposes, some examples of which are described herein.
• A preferred embodiment of the ranging system of the present invention is illustrated and described with reference toFIG. 2. In particular, one embodiment of a ranging system according to the present invention includes atransmitter10 which can, for example, be mounted on an object for which a position and/or range is to be sensed. Thetransmitter10 transmits a frequency modulated continuous wave (FMCW) signal14′. At least onereceiver12 is coupled to thetransmitter10 by acable16. Thecable16 returns the received transmitted signal received by the at least one receiver back to thetransmitter10. In thetransmitter10, the transmittedsignal14′ is split by asplitter17 prior to being fed to and transmitted by anantenna18. A portion of the transmittedsignal14′ that has been split by thesplitter16 is fed to a first port of amixer20 and is used as local oscillator (LO) signal input signal for the mixer. The transmittedsignal14′ is received by anantenna22 at thereceiver12 and is output by the at least onereceiver12 to acombiner24, which combines the received signals from the at least onereceiver12 and forwards the combined received signals with thecable16 to a second port of themixer20. Anoutput signal21 from the mixer has a beat frequency that corresponds to a time difference between the transmitted signal from thetransmitter10 to the received signal by thereceiver12. Thus, the beat frequency of theoutput signal21 of the mixer is representative of the distance between the transmitter and the receiver. Theoutput signal21 of themixer20 is supplied to an input of an Analog toDigital converter26 to provide a sampledoutput signal29. The sampledsignal29 can be provided to aprocessor28 configured to determine the beat frequency to indicate a TOF, which is indicative of the distance between the transmitter and receiver.
• This embodiment of the ranging system is based on the transmission and reception of an FMCW transmitted signal and determining a beat frequency difference between the transmitted and received signals. The beat frequency signal is proportional to the TOF distance between the transmitter and the receiver. By way of example, the sampled signal from the A/D converter26 is fed to the Fast Fourier Transform (FFT)device30 to transform the sampled time signal into the frequency domain x(t)⇒X(k). It will be understood that other transforms or algorithms may be used, such as multiple signal classifiers (MUSIC), estimation of signal parameters via rotational invariance techniques (ESPRIT), discrete Fourier transforms (DFT), and inverse Fourier transforms (IFT), for example. From the FFT, the TOF of thesignal14′ can be determined. In particular, the data output from the A/D converter26 is a filtered set of amplitudes, with some low frequency noise. According to aspects of this embodiment a minimum amplitude threshold for object detection to occur can be set so that detection is triggered by an amplitude above the minimum threshold. If an amplitude of the sampled signal at a given frequency does not reach the threshold, it may be ignored.
• In the system illustrated inFIG. 2, any number ofadditional receivers12 can be included in the system. The output signals from theadditional receivers12 are selected by aswitch24 and fed back to thetransmitter10 by thecable16 to provide selected received signals at the additional receivers for additional time of flight measured signals atadditional receivers12. In an alternate embodiment, themixer20 and the A/D converter26 can be included in each receiver to output a digital signal from each receiver. In this embodiment, the digital signal can be selected and fed back to the transmitter for further processing. It is appreciated that for this embodiment, the FFT processing can be done either in each receiver or at the transmitter. The TOF measured signals resulting from theadditional receivers12 can be processed to indicate the position of the object to which thetransmitter10 is mounted with a number of degrees of freedom and with excellent resolution according to the present invention. Also as is illustrated with reference toFIG. 8, according to aspects and embodiments of this disclosure, it is appreciated that multiple transmitters can be coupled to multiple receivers to produce a sophisticated position-detecting system.
• In the ranging system ofFIG. 2, at least onetransmitter10 can be mounted on an object to be tracked in distance and position. The receivers each generate a signal for determining a TOF measurement for thesignal14′ transmitted by the transmitter. Thereceivers12 are coupled to theprocessor28 to produce data indicating the TOF from the transmitter to each of the three receivers, which can be used for precise position detection of thetransmitter10 coupled to the object. It is appreciated that various arrangements of transmitters and receivers may be used to triangulate the position of the object to which the transmitter is attached, providing information such as x, y, z position as well as translation and3 axes of rotation of thetransmitter10.
• It is appreciated that for any of the embodiments and aspects disclosed herein, there can be coordinated timing between the transmitter and receivers to achieve the precise distance measurements. It is also appreciated that the disclosed embodiments of the system are capable of measuring distance by TOP on the order of about a millimeter or sub-millimeter scale in precision, at 1 Hz or less in frequency over a total range of hundreds of meters. It is anticipated that embodiments of the system can be implemented with very low-cost components for less $100.
Modulation Ranging Systems.
• Referring toFIG. 3, there is illustrated another embodiment of a rangingsystem300 implemented according to the present invention. It is appreciated that various form of modulation such as harmonic modulation, Doppler modulation, amplitude modulation, phase modulation, frequency modulation, signal encoding, and combinations thereof can be used to provide precision navigation and localization. One such example is illustrated inFIG. 3, which illustrates a use of pulsed direct sequence spread spectrum (DSSS) signals32 to determine range or distance. In direct sequence spread spectrum ranging systems, code modulation of the transmittedsignal32 and demodulation of a received andre-transmitted signal36 can be done by phase shift modulating a carrier signal. A transmitter portion of atransceiver38 transmits via an antenna40 a pseudo-noise code-modulatedsignal32 having a frequency F1. It is to be appreciated that in a duplex ranging system, thetransceiver38 and atransponder42 can operate simultaneously.
• As shown inFIG. 3, thetransponder42 receives the transmittedsignal32 having frequency F1, which is fed to and translated by atranslator34 to a different frequency F2, which can be for example 2×F1 and is retransmitted by thetransponder42 as code-modulatedsignal36 having frequency F2. A receiver subsystem of thetransceiver38, which is co-located with the transmitter portion of thetransceiver38 receives the retransmittedsignal36 and synchronizes to the return signal. In particular, by measuring the time delay between the transmittedsignal32 being transmitted and receivedsignal36, the system can determine the range from itself to the transponder. In this embodiment, the time delay corresponds to the two-way propagation delay of the transmitted32 and retransmitted signals36.
• According to aspects of this embodiment, the system can include two separatePN code generators44,46 for the transmitter and receiver subsystems of thetransceiver38, so that the code at the receiver portion of the transceiver can be out of phase with the transmitted code or so that the codes can be different.
• The transmitter portion of thetransceiver38 for measuring TOF distance of an electromagnetic signal comprises a 1stpseudo noise generator44 for generating a first phase shift signal, afirst mixer48 which receives acarrier signal50, which modulates the carrier signal with a firstphase shift signal52 to provide a pseudo-noise code-modulatedsignal32 having a center frequency F1 that is transmitted by thetransceiver38. Thetransponder apparatus42 comprises thetranslator34 which receives the pseudo-noise code-modulatedsignal32 having center frequency F1 and translates the pseudo-noise code-modulated signal of frequency F1 to provide a translated pseudo-noise code-modulated signal having a center frequency F2 or that provides a different coded signal centered at the center frequency F1, and that is transmitted by the transponder back to thetransceiver38. Thetransceiver apparatus38 further comprises a secondpseudo noise generator46 for generating a secondphase shift signal56, and asecond mixer54 which receives the secondphase shift signal56 from thepseudo-noise generator46, which receives the translated pseudo-noise code-modulatedsignal36 at frequency F2 and modulates the pseudo-correlated code-modulatedsignal36 having center frequency F2 with the secondphase shift signal56 to provide areturn signal60. The apparatus further comprises adetector62 which detects thereturn signal60, and a ranging device/counter64 that measures the time delay between the transmittedsignal32 and the receivedsignal36 to determine the round trip range from thetransceiver38 to thetransponder42 and back to thetransceiver38 so as to determine the two-way propagation delay. According to aspects of some embodiments, thefirst PN generator44 and thesecond PN generator46 can be two separate PN code generators.
• It is appreciated that the preciseness of this embodiment of the system depends on the signal-to-noise ratio (SNR) of the signal, the bandwidth, and the sampling rate of the sampled signals. It is also appreciated that this embodiment of the system can use any pulse compressed signal.
• FIG. 9 illustrates another embodiment of amodulation ranging system301. This embodiment can be used to provide a transmitted signal at frequency F1 frominterrogator380, which is received and harmonically modulated bytransponder420 to provide aharmonic return signal360 at F2, which can be for example 2×F1, that is transmitted by thetransponder420 back to theinterrogator380 to determine precise location of the transponder. With the harmonic ranging system, the doubling of the transmittedsignal320 by the transponder can be used to differentiate the retransmitted transponder signal from a signal reflected for example by scene clutter.
• As illustrated byFIGS. 3 and 9-10 along with the discussion above, atransponder42,420,421,423 may translate a received frequency F1 to a response frequency F2 and the response frequency F2 may be harmonically related to F1. A simple harmonic transponder device capable of doing so may include a single diode used as a frequency doubler, or multiplier, coupled to one or more antennas.FIG. 9 illustrates a simpleharmonic transponder423 that includes a receive antenna RX, amultiplier422 that can simply be a diode, anoptional battery425, and an optionalauxiliary receiver427.FIG. 3 shows atransponder42 having a single antenna for both receiving and transmitting signals to and from thetransponder42, whileFIG. 9 shows separate antennas (labelled RX,TX) for both receiving and transmitting signals to and from thetransponders420,423. It is appreciated that embodiments of anytransponder42,420,421, and423 as disclosed herein, may have may have one shared antenna, may have multiple antennas such as a TX and an RX antenna, and may include different antenna arrangements.
• An embodiment oftransponder42,420,421,423 can include afrequency multiplying element422, such as but not limited to a diode, integrated into an antenna structure. For example, a diode may be placed upon and coupled to a conducting structure, such as a patch antenna or microstrip antenna structure, and placed in a configuration so as to match impedance of a received and/or transmitted signal so as to be capable of exciting antenna modes at each of the receive and response frequencies.
• An embodiment of a passiveharmonic transponder423 includes a low power source such as a battery425 (for example a watch battery), which can be used to reverse bias thediode multiplier422 to normally be off, and the low power source can be turned off to turn the harmonic transponder to an on state (a wake up state) to multiply or otherwise harmonically shift a frequency of a received signal. The low power source can be used to reverse bias themultiplier422 to turn on and off the transponder, for example in applications like those discussed herein. According to an embodiment of the transponder, thepower source425 can also be configured to forward bias the multiplexer (diode)422 to increase the sensitivity and increase the range of the transponder to kilometer range up from for example, a 10-100 meter range. In still another embodiment, amplification (LNA, LNA2, LNA3, LNA4) either solely or in combination with forward biasing of themultiplier diode422, may also or alternatively be used to increase sensitivity of the transponder. It is appreciated that in general, amplification may be employed with any transponder to increase the sensitivity of any of the embodiments of a transponder of any of the ranging systems as disclosed herein.
• According to aspects and embodiments, the diode-basedtransponder423 can be a passive transponder that is configured to use very little power and may be powered via button-type or watch battery, and/or may be powered by energy harvesting techniques. This embodiment of the transponder is configured to consume low amounts of energy with the transponder in the powered off mode most of the time, and occasionally being switched to a wake up state. It is appreciated that the reverse biasing of the diode and the switching on and off of the diode bias takes little power. This would allow passive embodiments of thetransponder423 to run off of watch batteries or other low power sources, or to even be battery-less by using power harvesting techniques, for example from the TOF electromagnetic signals, or from motion, such as a piezoelectric source, a solenoid, or an inertial generator, or from a light source, e.g., solar. With such an arrangement, theinterrogator38,380,381 can include anauxiliary wireless transmitter429 and thetransponder42,420,421, and423 can include anauxiliary wireless receiver427 as discussed herein, particularly with respect toFIGS. 3, 9-10, that is used to address each transponder to tell each transponder when to wake up. The auxiliary signal transmitted byauxiliary wireless transmitter429 and received byauxiliary wireless receiver427 is used to address each transponder to tell each transponder when to turn on and turn off. One advantage of providing the interrogator with theauxiliary wireless transmitter429 and each transponder with an auxiliarywireless signal receiver427 is that it provides for the TOF signal channel to be unburdened by unwanted signal noise such as, for example, communication signals from transponders that are not being used. With that said, it is also appreciated that another embodiment of the TOF system could in fact use the TOF signal channel to send and receive radio/control messages to and from the transponders to tell transponders to turn on and off, etc. With such an arrangement, theauxiliary wireless receiver427 is optional.
• It is appreciated that embodiments of the passiveharmonic transponder423 do not require a battery source that needs to be changed every day/few days. The passiveharmonic transponder423 can either have a long-life battery or for shorter range applications may be wirelessly powered by the main channel signal or by an auxiliary channel signal for longer range (e.g. the interrogator and transponder can operate over the 3-10 GHz range, while power harvesting can occur using either or both of the main signal range and a lower frequency range such as, for example, 900 MHz or 13 MHz. In contrast, classic harmonic radar tags simply respond as a chopper to an incoming signal, such that useful tag output power levels require very strong incoming signals such as >−30 dBm at the tag from a transmitter. It is appreciated that the passiveharmonic transponder423 provides a compact, long/unlimited lifetime long-range transponder by storing energy to bias the diode, drastically increasing the diode sensitivity and range of the transponder to, for example, 1 km scales.
• One aspect of the embodiment shown inFIG. 9 of a modulation ranging system, or any of the embodiments of a ranging system as disclosed herein, is that eachtransponder420 can be configured with anauxiliary wireless receiver427 to be uniquely addressable by anauxiliary wireless signal401 from theauxiliary wireless transmitter429, such as for example a blue tooth signal, a Wi-Fi signal, a cellular signal, a Zigbee signal and the like, which can be transmitted by theinterrogator380. Thus, theinterrogator380 can be configured with anauxiliary wireless transmitter429 to transmit anauxiliary wireless signal401 to identify and turn on aparticular transponder420. For example, theauxiliary wireless signal401 could be configured to turn on each transponder based on each transponder's serial number. With this arrangement, each transponder could be uniquely addressed by an auxiliary wireless signal provided by the interrogator. Alternately, an auxiliary signal to address and enable individual or groups of transponders may be an embedded control message in the transmitted interrogation signal, which may take the form of command protocols or unique codes. In other embodiments the auxiliary signal to enable a transponder may take various other forms.
• As shown inFIG. 9, a transmitter portion of aninterrogator380 transmits via an antenna400 asignal320 having a frequency F1. The transponder can be prompted to wake up byauxiliary wireless transmitter429 transmitting an auxiliary wireless signal and the transponder receiving with anauxiliary wireless receiver427 theauxiliary wireless signal401, such that thetransponder420 receives the transmittedsignal320 having frequency F1, which is doubled in frequency by the transponder to frequency F2 (=2×F1) and is retransmitted by thetransponder420 assignal360 having frequency F2. A receiver subsystem of theinterrogator380, which is co-located with the transmitter portion of theinterrogator380 receives the retransmittedsignal360 and synchronizes the return signal to measure the precise distance and location between theinterrogator380 and thetransponder420. In particular, by measuring the time delay between the transmittedsignal320 being transmitted and the receivedsignal360, the system can determine the range from the interrogator to the transponder. In this embodiment, the time delay corresponds to the two-way propagation delay of the transmitted320 and retransmitted signals360.
• For example, the transmitter portion of theinterrogator380 for measuring precise location of atransponder420 comprises anoscillator382 that provides afirst signal320 having a center frequency F1 that is transmitted by theinterrogator380. Thetransponder apparatus420 comprises a frequencyharmonic translator422 which receives thefirst signal320 having center frequency F1 and translates the signal of frequency F1 to provide a harmonic of the signal F1 having a center frequency F2, for example 2×F1 that is transmitted by thetransponder420 back to theinterrogator380. Theinterrogator380 as shown further comprises four receivechannels390,392,394,396 for receiving the signal F2. Each receive channel comprises amixer391,393,395,397 which receives thesecond signal360 at frequency F2 and down converts thereturn signal360. The interrogator apparatus further comprises a detector which detects the return signal, an analog-to-digital converter and a processor to determine a precise measurement of the time delay between the transmittedsignal320 and the receivedsignal360 to determine the round trip range from theinterrogator380 to thetransponder420 and back to theinterrogator380 so as to determine the two-way propagation delay.
• According to aspects of this embodiment, the interrogator can include four separate receivechannels390,392,394,396 to receive the harmonic return frequencies of the retransmittedsignal401 in a spatially diverse array for the purpose of navigation. It is appreciated that thefirst signal320 having a center frequency F1 can be varied in frequency according to any of the modulation schemes that have been discussed herein, such as, for example FMCW, and that the modulation could also be any of CW pulsed, pulsed, impulse, or any other waveform. It is to be appreciated that any number of channels can be used. It is also to be appreciated that in the four receive channels of the interrogator can either be multiplexed to receive thesignal360 at different times or can be configured to operate simultaneously. It is further appreciated that, at least in part because modulation is being used, theinterrogator380 and thetransponder420 can be configured to operate simultaneously.
• It is to be appreciated that according to aspects and embodiments disclosed herein, the modulator can use different forms of modulation. For example, as noted above direct sequence spread spectrum (DSSS) modulation can be used. In addition, other forms of modulation such as Doppler modulation, amplitude modulation, phase modulation, coded modulation such as CDMA, or other known forms of modulation can be used either in combination with a frequency or harmonic translation or instead of a harmonic or frequency translation. In particular, theinterrogator signal320 and thetransponder signal360 can either be at the same frequency, i.e. F1, and a modulation of the interrogator signal by thetransponder420 can be done to provide thesignal360 at the same frequency F1, or the interrogator can also frequency translate thesignal320 to provide thesignal360 at a second frequency F2, which may be at a harmonic of F1, in addition to modulate the signal F1, or the interrogator can only frequency translate thesignal320 to provide thesignal360. As noted above, any of the noted modulation techniques provide the advantage of distinguishing thetransponder signal360 from background clutter reflectedsignal320. It is to be appreciated that with some forms of modulation, the transponders can be uniquely identified by the modulation, such as coded modulation, to respond to the interrogation signal so thatmultiple transponders420 can be operated simultaneously. In addition, as been noted herein, by using a coded waveform, there need not be a translation of frequency of the retransmittedsignal360, which has the advantage of providing a less expensive solution since no frequency translation is necessary.
• It is to be appreciated that according to aspects and embodiments of any of the ranging system as disclosed herein, multiple channels may be used by various of the interrogator and transponder devices, for example, multiple frequency channels, quadrature phase channels, or code channels may be incorporated in either or both of interrogation or response signals. In other embodiments, additional channel schemes may be used. For example, one embodiment of atransponder42,420,421,423 can have both in phase and 90° out of phase (quadrature) channels with two different diodes where the diodes are modulated in quadrature by reverse biasing of the diodes. With such an arrangement, the interrogator could be configured to send coded waveform signals to different transponders simultaneously. In addition, other methods as discussed herein, such as polarization diversity, time sharing, a code-multiplexed scheme where each transponder has a unique pseudo-random code to make each transponder uniquely addressable, and the like provide for allow increased numbers of transponders to be continuously monitored at full energy sensitivity.
• FIG. 10 illustrates another embodiment of amodulation ranging system310. This embodiment can be used to provide a transmitted signal at frequency F1 frominterrogator381, which is received bytransponder421 and frequency translated bytransponder421 to provide a frequency shiftedreturn signal361 at F2, which can be arbitrarily related in frequency to F1 of the interrogator signal (it doesn't have to be a harmonic signal), that is transmitted by thetransponder421 back to theinterrogator381 to determine precise location of thetransponder421. With this arrangement illustrated inFIG. 10, for example thesignal321 at F1 can be at the 5.8 GHz Industrial Scientific and Medical band, and thereturn signal361 at F2 can be in the 24 GHz ISM band. It is to be appreciated also that with this arrangement of a modulation system, the frequency shifting of the transmittedsignal321 by thetransponder421 can be used to differentiate the retransmittedtransponder signal361 from a signal reflected for example by background clutter.
• One aspect of thisembodiment310 of a modulation ranging system or any of the embodiments of a ranging system as disclosed herein is that eachtransponder42,420,421,423 can be configured to be uniquely addressable to wake up each transponder by receiving with anauxiliary wireless receiver427 anauxiliary wireless signal401 from anauxiliary wireless transmitter429, such as for example a blue tooth signal, a Wi-Fi signal, a cellular signal, a Zigbee signal, and the like, which auxiliary wireless signal can be transmitted by theinterrogator381. Thus, theinterrogator381 can be configured with anauxiliary signal transmitter429 to transmit anauxiliary wireless signal401 to identify and turn on aparticular transponder42,420,421,423. For example, the auxiliary wireless signal could be configured to turn on each transponder based on each transponder's serial number. With this arrangement, each transponder could be uniquely addressed by an auxiliary wireless signal provided by the interrogator or another source.
• With respect toFIG. 10, it is appreciated that an oscillator such as OSC3 will have finite frequency error that manifests itself as finite estimated position error. One possible mitigation with a low cost TCXO (temperature controlled crystal oscillator) used for OSC3 is to have a user periodically touch their transponder to a calibration target. This calibration target is equipped with magnetic, optical, radar, or other suitable close range high precision sensors to effectively null out the position error caused by any long-term or short-term drift of the TCXO or other suitable low cost high stability oscillator. The nulling out is retained in the radar and/or transponder as a set of calibration constants that may persist for minutes, hours, or days depending on the users position accuracy needs.
• According to aspects and embodiments the interrogator and each transponder of the system can be configured to use a single antenna (same antenna) to both transmit and receive a signal. For example, theinterrogator38,380,381 can be configured with oneantenna40,400, to transmit theinterrogator signal32,320,321 and receive theresponse signal36,360,361. Similarly, the transponder can be configured with one antenna to receive theinterrogator signal32,320,321 and transmit theresponse signal36,360,361. This can be accomplished, for example, if coded waveforms are used for the signals. Alternatively, where the signals are frequency translated but are close in frequency, such as for example 4.9 GHz and 5.8 GHz, the same antenna can be used. Alternatively or in addition, it may be possible to provide theinterrogator signal32,320,321 at a first polarization, such as Left Hand Circular Polarization (LHCP), Right Hand Circular Polarization (RHCP), vertical polarization, horizontal polarization, and to provide theinterrogator signal36,360,361 at a second polarization. It is appreciated that providing the signals with different polarizations can also enable a system with the interrogator and the transponder each using a single antenna, thereby reducing costs. It is further appreciated that using circular polarization techniques mitigates the reflections from background clutter thereby reducing the effects of multi-path return signals, because when using circular polarization, the reflected signal is flipped in polarization, and so the multipath return signals could be attenuated by using linear polarizations and/or polarization filters.
• According to aspects and embodiments of any of the systems disclosed herein, it is further appreciated that there can be selective pinging of eachtransponder42,420,421,423 to wake up each transponder by receiving with anauxiliary wireless receiver427 anauxiliary wireless signal401, such as for example a blue tooth signal, a Wi-Fi signal, a cellular signal, a Zigbee signal and the like, which can be transmitted by theinterrogator380 to provide for scene data compression. In particular, there can be some latency when using an auxiliary wireless signal to identify and interrogate eachtransponder42,420,421,423. As the number of transponders increases, this can result in slowing down of interrogation of all the transponders. However, some transponders may not need to be interrogated as often as other transponders. For example, in an environment where some transponders may be moving and others may be stationary, the stationary transponders need not be interrogated as often as the transponders that are actively moving. Still others may not be moving as fast as other transponders. Thus, by dynamically assessing and pinging more frequently the transponders that are moving or that are moving faster than other transponders, there can be a compression of the transponder signals, which can be analogized for example to MPEG4 compression where only pixels that are changing are sampled.
• According to aspects and embodiments disclosed herein, the interrogators and transponders can be configured with their own proprietary micro-location frequency allocation protocol so that the transponders and interrogators can operate at unused frequency bands that exist amongst existing allocated frequency bands. In addition, the interrogators and transponders can be configured so as to inform users of legacy systems at other frequencies for situational awareness, e.g. to use existing frequency allocations in situations that warrant using existing frequency band allocations. Some advantages of these aspects and embodiments are that it enables a control for all modes of travel (foot, car, aerial, boat, etc.) over existing wired and wireless backhaul networks, with the interrogators and the transponders inter-operating with existing smart vehicle and smart phone technologies such as Dedicated Short Range Communications (DSRC) and Bluetooth Low Energy (BLE) radio.
• In particular, aspects and embodiments are directed to high power interrogators in license-free bands e.g. 5.8 GHz under U-NII and frequency sharing schemes via dynamic frequency selection and intra-pulse sharing wherein the system detects other loading issues such as system timing and load factor, and the system allocates pulses in between shared system usage. One example of such an arrangement is dynamic intra pulse spectrum notching on the fly. Another aspect of embodiments disclosed herein is dynamic allocation of response frequencies by a lower power transponder at license-free frequency bands (lower power enables wider selection of transponder response frequencies).
• Another aspect of embodiments of interrogators and transponders disclosed herein is an area that has been configured with a plurality of interrogators (a localization enabled area) can have each of the transponders enabled with BLE signal emitting beacons (no connection needed), as has been noted herein. With this arrangement, when a user having a transponder, such as a wearable transponder, enters into the localization area, the transponder “wakes up” to listen for the BLE interrogation signal and replies as needed. It is also appreciated that the transponder can be configured to request an update on what's going on, either over the BLE channel or another frequency channel, such as a dynamically allocated channel.
• Some examples of applications where this system arrangement can be used are for example as a human or robot walks, drives, or pilots a vehicle or unmanned vehicle through any of for example a dense urban area, a wooded area, or a deep valley area where direct line of sight is problematic and multipath reflections cause GNSS navigation solutions to be highly inaccurate or fail to converge altogether. The human or robot or vehicle or unmanned vehicle can be equipped with such configured with transponders and interrogators can be configured to update the transponders with their current state vector as well as broadcast awareness of their state vector over preselected or dynamically selected frequency using wireless protocols, Bluetooth Low Energy, DSRC, and other appropriate mechanisms for legal traceability (accident insurance claims, legal compliance).
• One implementation can be for example with UDP multicasting, wherein the transponders are configured to communicate all known state vectors of target transponders with UDP multicast signals. The UDP multicast encrypted signals can be also be configured to be cybersecurity protected against spoofing, denial of service and the like. One practical realization of the network infrastructure may include: Amazon AWS IoT service, 512 byte packet increments, TCP Port 443, MQTT protocol, designed to be tolerant of intermittent links, late to arrive units, and brokers and logs data for traceability, and machine learning.
Wide-Band or Ultra-Wide-Band Ranging Systems.
• FIG. 4 illustrates an embodiment of a wide-band or ultra-wide-bandimpulse ranging system800. The system includes an impulse radio transmitter900. The transmitter900 comprises atime base904 that generates aperiodic timing signal908. Thetime base904 comprises a voltage controlled oscillator, or the like, which is typically locked to a crystal reference, having a high timing accuracy. Theperiodic timing signal908 is supplied to acode source912 and acode time modulator916.
• Thecode source912 comprises a storage device such as a random access memory (RAM), read only memory (ROM), or the like, for storing codes and outputting the codes ascode signal920. For example, orthogonal PN codes are stored in thecode source912. Thecode source912 monitors theperiodic timing signal908 to permit the code signal to be synchronized to thecode time modulator916. Thecode time modulator916 uses thecode signal920 to modulate theperiodic timing signal908 for channelization and smoothing of the final emitted signal. The output of thecode time modulator916 is a codedtiming signal924.
• The codedtiming signal924 is provided to anoutput stage928 that uses the coded timing signal as a trigger to generate electromagnetic pulses. The electromagnetic pulses are sent to a transmitantenna932 via atransmission line936. The electromagnetic pulses are converted into propagatingelectromagnetic waves940 by the transmitantenna932. The electromagnetic waves propagate to an impulse radio receiver through a propagation medium, such as air.
• FIG. 4 further illustrates animpulse radio receiver1000. Theimpulse radio receiver1000 comprises a receiveantenna1004 for receiving a propagatingelectromagnetic wave940 and converting it to an electrical receivedsignal1008. The received signal is provided to acorrelator1016 via a transmission line coupled to the receiveantenna1004. Thereceiver1000 comprises adecode source1020 and anadjustable time base1024.
• Thedecode source1020 generates adecode signal1028 corresponding to the code used by the associated transmitter900 that transmitted thesignal940. Theadjustable time base1024 generates aperiodic timing signal1032 that comprises a train of template signal pulses having waveforms substantially equivalent to each pulse of the receivedsignal1008.
• Thedecode signal1028 and theperiodic timing signal1032 are received by thedecode timing modulator1036. Thedecode timing modulator1036 uses thedecode signal1028 to position in time theperiodic timing signal1032 to generate adecode control signal1040. Thedecode control signal1040 is thus matched in time to the known code of the transmitter900 so that the receivedsignal1008 can be detected in thecorrelator1016.
• Anoutput1044 of thecorrelator1016 results from the multiplication of theinput pulse1008 and thesignal1040 and integration of the resulting signal. This is the correlation process. Thesignal1044 is filtered by alow pass filter1048 and asignal1052 is generated at the output of thelow pass filter1048. Thesignal1052 is used to control theadjustable time base1024 to lock onto the received signal. Thesignal1052 corresponds to the average value of the correlator output, and is the lock loop error signal that is used to control theadjustable time base1024 to maintain a stable lock on the signal. If the received pulse train is slightly early, the output of thelow pass filter1048 will be slightly high and generate a time base correction to shift the adjustable time base slightly earlier to match the incoming pulse train. In this way, the receiver is held in stable relationship with the incoming pulse train.
• It is appreciated that this embodiment of the system can use any pulse compressed signal. It is also appreciated that the transmitter900 and thereceiver1000 can be incorporated into a single transceiver device. First and second transceiver devices according to this embodiment can be used to determine the distance d to and the position of an object. Further reference to functionalities of both a transmitter and a receiver are disclosed in U.S. Pat. No. 6,297,773 System and Method for Position Determination by Impulse Radio, which is herein incorporated by reference.
Linear FM and FHSS FMCW Ranging Systems.
• Referring toFIG. 5, there is illustrated another embodiment of a rangingsystem400 implemented according to the present invention that can use either linear FMCW ranging or frequency hopping spread spectrum (FHSS) FMCW ranging signals and techniques.
• According to one embodiment implementing linear FMCW ranging, a transmittedsignal74 is swept through a linear range of frequencies and transmitted as transmittedsignal74. For one way linear TOF FMCW ranging, at aseparate receiver80, a linear decoding of the receivedsignal74 and a split version of the linear swept transmitted signal are mixed together at amixer82 to provide a coherent received signal corresponding to the TOF of the transmitted signal. Because this is done at aseparate receiver80, it yields a one-way TOF ranging.
• FIG. 11 illustrates a block diagram of an embodiment of an interrogator for linear FMCW two-way TOF ranging. In the Embodiment ofFIG. 11, an interrogator transmits via antenna1 (ANT1) a linear FM modulated chirp signal74 (or FMCW) towards a transponder (not illustrated) as shown for example inFIG. 5. The transponder can for example frequency shift the linear FM modulatedchirp signal74 and re-transmit a frequency shiftedsignal75 at different frequency as discussed herein for aspects of various embodiments of a transponder. For example, as discussed herein, a transponder tag is tracked by receiving, amplifying, then frequency mixing the linear FM modulated interrogation signal and re-transmitting it out at a different frequency. This allows the tag to be easily discernable from clutter, or in other words, so it can be detected among other radar reflecting surfaces. The frequency offsetreturn signal75 and any scatteredreturn signal74 are collected by receiver antenna2 (ANT2), antenna3 (ANT3) and antenna4 (ANT4), amplified by a low noise amplifier LNA1 and an Amplifier AMP1, and multiplied by the original chirp signal supplied via the circulator CIRC2 in the mixer MXR1. In the illustrated embodiment the antennas are multiplexed by a single-pole multi-throw switch SW1. The product is amplified via a video amplifier fed out to a digitizer where ranging information can be computed. It is appreciated that although linear FM is discussed in this example any arbitrary waveform can be used including but not limited to impulse, barker codes, or any pulse or phase coded waveforms of any kind. The interrogator and the transponder can work with any arbitrary waveforms including but not limited to linear FM (or FMCW), impulse, pulsed CW, barker codes, or any other modulation techniques that fits within the bandwidth of its signal chain.
• FIG. 12 illustrates another embodiment of a block diagram of an interrogator for linear FMCW two-way TOF ranging. This embodiment differs from the embodiment ofFIG. 11, primarily in that the interrogator has three transmit antennas to allow for three dimensional ranging of the interrogator and four receive channels for receiving the re-transmitted signal. This embodiment was prototyped and tested. The transmitted signal was transmitted with a Linear FM modulation, 10 mS chirp over a 4 GHz bandwidth from 8.5 GHz to 12.5 GHz. The transmitted output power was +14 dBm. With this arrangement, precision localization was measured and achieved to an accuracy of 27 um in Channel 0, 45 um inChannel 1, 32 um inChannel 2 and 59 um in Channel 3.
• With FHSS FMCW ranging, the transmitted signal is not linearly swept through a linear range of frequencies as is done with linear FMCW ranging, instead the transmitted signal is frequency modulated with a series of individual frequencies that are varied and transmitted sequentially in some pseudo-random order according to a specific PN code. It might also exclude particular frequency bands, for example, for purposes of regulatory compliance. For FHSS FMCW ranging at aseparate receiver80 for one way TOF ranging, a decoding of the receivedsignal74 and a split version of the individual frequencies that are varied and transmitted sequentially according to a specific PN code are mixed together at amixer82 to provide a coherent received signal corresponding to the TOF of the transmitted signal. For FHSS FMCW, this is done at aseparate receiver80 for one-way TOF ranging.
• More specifically, this embodiment of anapparatus400 for measuring TOF distance via a linear FHSS FMCW electromagnetic signal comprises atransmitter70 comprising alocal oscillator72 for generating asignal74 and alinear ramp generator76 coupled to the local oscillator that sweeps the local oscillator signal to provide a linear modulated transmittedsignal74 for linear modulation. According to the FHSS FMCW embodiment, instead of a linear ramp generator, the signal provided to modulate the local oscillator signal is broken up into discrete frequency signals78 that modulate the local oscillator signal to provide a series of individual frequencies according to a specific PN code for modulating the local oscillator signal. The modulated transmittedsignal74 modulated with the series of individual frequencies are transmitted sequentially in some pseudo-random order, according to a specific PN code, as the transmitted signal. For one-way TOF measurements, a split off version of the transmitted signal is also fed via acable88 to areceiver80. Thereceiver80 receives the transmitted signal at anantenna90 and forwards the received signal to afirst port91 of the mixer. The mixer also receives the signal oncable88 at asecond port92 and mixes the signal with the receivedsignal74, to provide at anoutput94 of the mixer a signal corresponding to the time of flight distance between thetransmitter70 and thereceiver80 of the transmittedsignal74 that is either linear modulated (for linear FMCW) or modulated with the PN codes of individual frequencies (for FHSS FMCW). The apparatus further comprises an analog todigital converter84 coupled to anoutput94 of themixer82 that receives that signal output from the mixer and provides a sampledoutput signal85. The sampledoutput signal85 is fed to aprocessor86 that performs a FFT on the sampled signal. According to aspects of this embodiment, the ranging apparatus further comprises a frequency generator configured to provide signals at a plurality of discrete frequencies and processor to provide a randomized sequence of the individual frequency signals.
• It is appreciated that this embodiment of the system can use any pulse compressed signal.
• It is desirable to make the interrogators and the transponders as have been discussed herein as small as possible and as cheap as possible, so that the interrogators and transponders can be used anywhere and for anything. This it is desirable to implement as much of the interrogator structure and functionality and as much of the transponder structure and functionality as can be done on a chip. It is appreciated that one of the most inexpensive forms of manufacturing electronic devices is as a CMOS implementation. Accordingly, aspects and embodiments of the interrogators and transponders as described herein are to be implemented as CMOS.
• Multiple Transmitter and/or Transceivers
• Referring toFIG. 6, it is to be appreciated that various embodiments of a rangingsystem500 according to the invention can comprisemultiple transmitters96,multiple transceivers98, or a combination of both transmitter and transceivers that transmit a transmittedsignal106 that can be any of the signals according to any of the embodiments described herein. Such embodiments include at least one receiver102 that either receives the transmittedsignal106 from each transmitter and/or at least onetransponder104 that receives the transmitted signal and re-transmits asignal108 that is a re-transmitted version of the transmittedsignal106 back to a plurality oftransceivers98, according to any of ranging signals and systems described herein.
• One example of a system according to this embodiment includes one transceiver98 (interrogator) that transmits afirst interrogation signal106 to at least onetransponder104, which transponder can be attached to an object being tracked. The at least one transponder retransmits a secondre-transmitted signal108 that is received by, for example second, third, andfourth transceivers98 to determine a position and a range of the transponder and the object being tracked. For example two transceivers can be grouped in pairs to do hyperbolic positioning and three transceivers can be grouped to do triangulation position to the transponder/object. It is appreciated that any of thetransceivers98 can be varied to be the interrogator that sends the first transmit interrogation signal to thetransponder104 and that any of thetransceivers98 can be varied to receive the re-transmitted signal from the responder. It is appreciated that where ranging to the transponder is being determined at the transceivers, the range and position determination is a time of flight measurement between the signals transmitted by thetransponder104 and received by at least two of thetransceivers98.
• Another example of a system according to this embodiment includes at least onetransponder104, which can be attached to an object being tracked. The at least onetransponder104 receives asignal106 that is transmitted by any of at least first, second, third, and fourth transceivers98 (interrogators). The signal can be coded to ping at least one of the transponders. It is appreciated that more than onetransponder104 can be provided. It is appreciated that each transponder can be coded to respond to a different ping of the transmittedsignal106. It is appreciated that multiple transponders can be coded to respond to a same ping of the transmittedsignal106. Thus, it is appreciated that one transponder or any of a plurality of transponders or a plurality of the transponders can be pinged by thesignal106 transmitted by at least one of thetransceivers98. It is appreciated that multiple transceivers can be configured to send asignal106 having a same code/ping. It is also appreciated that each transceiver can be configured to send a transmitted signal having a different code/ping. It is further appreciated that pairs or more of transceivers can be configured to send a signal having the same code/ping. It is also appreciated that pairs or more of the transponders can be configured to respond to a signal having the same code/ping. It is appreciated that where the range to the transponder is being determined at the transponder (the device being tracked), the range determination is a time difference of arrival measurement between the signal transmitted by at least two of thetransceivers98. For example, where the transponder is pinged by two of the transceivers98 a hyperbolic positioning of the transponder (object) can be determined. Where the transponder is pinged by three of thetransceivers98, triangulation positioning of the transponder (object) can be determined.
• Alternatively, instead of coding each signal with a ping, it is appreciated that according to some embodiments a precise time delay can be introduced between signals transmitted by the transmitters and/or transceivers. Alternatively, a precise time delay can be introduced between signals re-transmitted by the at least one transponder in response to receipt of the transmitted signal. With this arrangement pairs of transceivers can be used to accomplish 3D or hyperbolic positioning or at least three transceivers can be used to perform triangular positioning according to any of the signals described herein.
• Another example of a system according to this embodiment includes onetransmitter96 that is a reference transmitter that provides a waveform by which the receivers102 and/ortransponders104 correlate against to measure a delta in time of the time difference of arrival (TDOA) signal relative to thereference transmitter96. It is also appreciated that this embodiment of the system can use any pulse compressed signal.
• Multiple Receivers and/or Transponders
• Various embodiments of a system according to the invention can comprise at least onetransmitter96 ortransceiver98 that transmits a transmitted106 signal and a plurality of receivers102 ortransponders104 that receive the transmitted signal from each transmitter or transceiver, according to any of ranging systems and signals described herein. Such embodiments include at least onetransmitter96 ortransceiver98 that transmits the transmittedsignal106 and a plurality of receivers102 ortransponders104 that either receive the transmittedsignal106 or receive and re-transmit asignal108 that is a re-transmitted version of the transmittedsignal106 back to the at least onetransceivers98, according to any of ranging signals and systems described herein.
• It is appreciated that according to aspects of this embodiment atransmitter96 can be attached to an object being tracked and can transmit afirst signal106 to a plurality of receivers102 to perform time of flight positioning and ranging from the transmitter to the receiver. For example, where two receivers receive the transmitted signal, hyperbolic positioning of the transmitter/object can be achieved. Alternatively or in addition, where at least three receivers receive the transmittedsignal106, triangulation positioning to thetransmitter96 and object can be achieved.
• According to aspects of another embodiment, at least onetransceiver98 can be attached to an object being tracked and can transmit afirst signal106 to a plurality oftransponders104 to perform positioning and ranging from the transmitter to the receiver. For example, where two transponders receive and re-transmit the transmittedsignal106, hyperbolic positioning of the transmitter/object can be achieved. Alternatively or in addition, where at least threetransponders104 receive and re-transmit the transmittedsignal106, triangulation positioning to thetransceiver98 and object can be achieved.
• It is appreciated that any of the transponders can be varied to respond to theinterrogator98 that sends the first transmit interrogation signal to thetransponder104. It is appreciated that the at least onetransponder104 receives asignal106 that is transmitted by the transceivers98 (interrogators). The signal can be coded to ping at least one of the transponders. It is appreciated that each transponder can be coded to respond to a different ping of the transmittedsignal106. It is appreciated that multiple transponders can be coded to respond to a same ping of the transmittedsignal106. It is appreciated that one transponder or any of a plurality of transponders or a plurality of the transponders can be pinged by thesignal106 transmitted by at least onetransceivers98. It is also appreciated that pairs or more of the transponders can be configured to respond to a signal having the same code/ping.
• Alternatively, instead of coding each signal with a ping, it is appreciated that according to some embodiments a precise time delay can be introduced between signals re-transmitted by thetransponders104 in response to receipt of the transmitted signal. With this arrangement pairs of transponders can be used to accomplish hyperbolic positioning of the at least one transceiver or at least three transponders can be used to perform triangular positioning according to any of the signals described herein. It is also appreciated that this embodiment of the system can use any pulse compressed signal.
Hybrid Ranging Systems
• Referring toFIG. 8, various embodiments of a system according to the invention can comprise a plurality of transmitters that transmit a transmitted signal and a plurality of receivers that receive a transmitted signal according to any of the signals and systems disclosed herein. Various embodiments of a system according to the invention can comprise a plurality oftransceivers98 that transmit a transmitted signal and a plurality oftransponders104 that receive the transmittedsignal106 and re-transmit the transmittedsignal108, according to any of ranging signals and ranging systems described herein. It is further appreciated that the plurality of thetransmitters96 ortransceiver98 can be coupled together either by a cable or a plurality of cables e.g. to create a wired mesh of transmitters or transceivers, or coupled together wirelessly to create a wireless mesh of transmitters or transceivers. It is also appreciated that the plurality of the receivers102 ortransponders104 can be coupled together either by a cable or a plurality of cables e.g. to create a wired mesh of receivers or transponders, or coupled together wirelessly to create a wireless mesh of receivers or transponders. Still further it is appreciated that the system can comprise a mixture of plurality of transmitters and transceivers and/or a mixture of a plurality of receivers or transponders. It is appreciated that the mixture of the plurality of transmitters and transceivers and/or the mixture of a plurality of receivers or transponders can be coupled together either by one or more cables or wirelessly or a combination of one or more cables and wirelessly. Such embodiments can be configured to determine range and positioning to at least one object according to any of the signals and systems that have been described herein.
• According to the disclosure above regarding any of the TOF ranging systems disclosed, it will be apparent that a TOF ranging system may be comprised of devices, any of which may transmit, receive, respond, or process signals associated with any of the foregoing TOF ranging systems. In aspects and embodiments, any transceiver, interrogator, transponder, or receiver may determine TOF information in one or more of the manners discussed above in accordance with any of the TOF ranging systems disclosed. Any transmitter, transceiver, interrogator, or transponder may be the source of a signal necessary for determining the TOF information in one or more of the manners discussed above in accordance with any of the TOF ranging systems disclosed.
• It is appreciated that in embodiments, the exact position of signal generating and signal processing components may not be significant, but the position of an antenna is germane to precise ranging, namely the position and the location from which an electromagnetic signal is transmitted or received. Accordingly, the TOF ranging systems locations disclosed herein are typically configured to determine by the TOF ranging to antenna positions and locations. For example, the exemplary embodiments discussed above with respect toFIG. 2 andFIGS. 9 to 12 have multi-antenna components, and it is also appreciated that any of the embodiments of interrogators and transponders as disclosed inFIGS. 1-12 can have multiple antennas. In such example embodiments, and others like them, various components may be shared among more than one antenna and TOF ranging can be done to the multiple antenna components. For example, a single oscillator, modulator, combiner, correlator, amplifier, digitizer, or other component may provide functionality to more than one antenna. In such cases, each of the multiple antennas may be considered an individual TOF transmitter, receiver, interrogator, or transponder, to the extent that associated location information may be determined for such antenna.
• In aspects and embodiments, multiple antennas may be provided in a single device to take advantage of spatial diversity. For example, an object with any of the TOF ranging components embedded may have multiple antennas to ensure that at least one antenna may be unobstructed at any given time, for example as the orientation of the object changes. In one embodiment, a wristband may have multiple antennas spaced at intervals around a circumference to ensure that one antenna may always receive without being obstructed by a wearer's wrist.
• In aspects and embodiments, signal or other processing, such as calculations, for example, to determine distances based on TOF information, and positions of TOF devices, may be performed on a TOF device or may be performed at other suitable locations or by other suitable devices, such as, but not limited to, a central processing unit or a remote or networked computing device.
OTHER EXAMPLES
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can be used to accomplish precise distance measurements, to accomplish multiple distance measurements for multilateration, to accomplish highly precise absolute TOF measurements, to accomplish precision localization of a plurality of transponders, transceivers, or receivers, or to accomplish ranging with a hyperbolic time difference of arrival methodology, or any other ranging or localization capability for which TOF measurements may be used.
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can use any pulse compressed signal.
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, each transponder can be configured to detect a signal of a unique code and respond only to that unique code.
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, a plurality of transmitters or transceivers can be networked together and configured to transmit at regular, precisely timed intervals, and a plurality of transponders or receivers can be configured to receive the transmissions and localize themselves via a hyperbolic time difference of arrival methodology.
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, at least one transceiver is carried on a vehicle.
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, at least one transceiver may be fixed to a person or animal, or to clothing, or embedded in clothing, a watch, or wristband, or embedded in a cellular or smart phone or other personal electronic device, or a case for a cellular or smart phone or other personal electronic device.
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, transceivers can discover each other and make an alert regarding the presence of other transceivers. Such discovery and/or alerts may be triggered by responses to interrogation signals or may be triggered by enabling transceivers via an auxiliary wireless signal as discussed. For example, vehicles could broadcast a BLE signal that activates any TOF transceiver in its path and thereby discover humans, animals, vehicles, or other objects in its path. Similarly, a human, animal, or vehicle in the path may be alerted to the approaching vehicle. In another scenario, people with transceivers on their person may be alerted to other people's presence, e.g., when joining a group or entering a room or otherwise coming in to proximity. In such a scenario, distance and location information may be provided to one or more of the people.
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can comprise a wireless network of wireless transponders in fixed locations, and wherein the element to be tracked includes at least one transceiver that pings the wireless transponders with coded pulses so that the transponders only respond and reply with precisely coded pulses.
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system further comprises a wireless network of wireless transceivers or transponders in fixed locations that transmit or interrogate, and reply to each other, for purposes of measuring a baseline between the transceivers or transponders for calibrating the network.
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, an object to be tracked includes at least one transceiver that is configured to transmit the first signal to interrogate one of a plurality of transponders in the network, and wherein at least one transponder is configured to respond to the first signal and to transmit a signal to interrogate one or more other transponders in the network, and wherein the one or more other transponders emit a second signal that is received by the original interrogator-transceiver for purposes of calibration.
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system comprises at least one transponder that is programmed to send a burst of data and its timing transmission and including data for purposes of revealing any of temperature, battery life, other sensor data, and other characteristics of the transponder.
• According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can include wireless transponders configured to send ranging signals between each of the transponders for measuring distances between transponders.
Pick and Pack Application of Various Embodiments of Ranging Systems
• Referring toFIG. 13, in accordance with various aspects and/or embodiments of the subject disclosure, there is illustrated an example of asystem710 and method for detecting a user's body movement in cooperation with an industrial automation environment. It is also to be appreciated that the system can be used in a variety of environments to interface withindustrial machinery112 or without industrial machinery such as for example for pick and pack work in fulfillment centers and warehouses or combinations thereof. The system and method includes employing a plurality ofTOF transmitters96 or transceivers/interrogators98 (depicted by an antenna) as have been described herein that transmit and/or receive asignal110 that detects movement of atransponder114 mounted to a body part of a user. Any of various embodiments of an interrogator, transponder, transmitter, and transceivers that have been described herein may be used. The transponders hereinafter also referred to as TOF sensors, can be mounted to a body part for any of or any combination of: detecting movement of a body part of the user, ascertaining whether or not the movement of the body part conforms to a recognized movement of the body part, interpreting the recognized movement of the body part as a performable action, actuating industrial machinery to perform a performable action based on and in cooperation with the recognized movement of the body part and/or giving the worker real time feedback on their task performance.
• The system includes a plurality ofTOF transmitters96 or transceivers/interrogators98 (depicted by an antenna) as has been described herein that transmit and/or transmit and receive asignal110 for measuring movement of atransponder114 mounted to a body part of a user. The system can be used to measure a position of the user in a pick and pack environment, or a position of a user such as a user's arm proximate to and in cooperation withindustrial machinery112, such as a robotic arm, and proximate to theTOF sensors96/98. The system may further include at least onetransponder118 mounted to theindustrial machinery112, such as a robotic arm, and proximate to theTOF sensors96/98. According to aspects of this embodiment, a controller can be configured to receive measurements of movement of the receivers ortransponders114,118 as measured by the transmitters or transceivers/interrogators96/98, to determine any or all of whether or not the movement of the body part conforms with a recognized movement of the body part, to determine a precise position and location of the receivers ortransponders114,118, to predict movement of the human limb, to monitor movement and performance of a user such as in a pick and pack environment and provide feedback to the user, and to control industrial machinery such as therobotic arm112 to perform an action based at least in part on instructions received from the industrial controller and a position of the receivers ortransponders114,118 attached to the user, to control the robotic arm to perform an action based at least in part on any of instructions received from the industrial controller and a position of the receivers ortransponders114,118 so that the human and the robotic arm can work in cooperation and without risk or danger of harm to the human. It is also appreciated that the system can be configured to have a transmitter or transceiver/interrogator on the robotic arm and a transponder or transceiver/interrogator on the limb or appendage of a human so as to have direct time of flight ranging between the robotic arm and the human arm or limb.
• According to aspects and embodiments, workers can for example be outfitted with a small wristband or other personal digital device that is configured as atransponder114. The transponder device can be configured with feedback mechanisms such as colored LEDs, a simple microphone, a wireless beacon and/or a haptic feedback system (e.g. gyroscope) to provide feedback to the user. For example, the device could give the worker real time feedback on their task performance in contemporary pick and pack systems. The pick and pack systems could be configured with a variety of communication mechanisms such as for example a laser pointer that directs the worker to the bin that the worker should place to or pick from. The system could be configured for example such that as the worker moves towards a correct or incorrect movement, the wristband (or other device) could signal this to the user via any of the feedback mechanisms (e.g., a flashing green/red light and slow-weak/fast-intense pulses of the gyroscope). It is appreciated that some signals could be reserved for critical feedback (e.g., unsafe conditions) and other feedback signals could be used for routine task feedback (e.g., correct/incorrect placement). It is also appreciated that the system could be so configured such that if despite feedback from the system the user still engages in some form of incorrect or unsafe behavior, the system can also interact with the equipment involved (e.g., stopping it, moving it out of the user's space, etc.). It is also appreciated that the system and the transponder device can be configured such that users may be able to customize their preferred feedback patterns to a certain extent (as determined by the system operator). It is further appreciated that the system can be used to monitor and catalogue a user's performance for any of a variety of purposes such as analytics, training, and the like.
• Referring toFIG. 14, in accordance with various aspects and/or embodiments of the subject disclosure, there is illustrated a further example of an environment for determining the motion of industrial equipment and/or a user's body. The example environment ofFIG. 14 is particularly directed to pick and pack work in fulfillment centers, warehouses, etc. The system and method includes employing a plurality ofTOF transmitters96 or transceivers/interrogators98 (depicted by an antenna) as have been described herein that transmit and/or receive signals to detect movement of atransponder114 affixed to parts of a user orindustrial machinery112.
• In the example ofFIG. 14, the work to be tracked is the selection (picking) of items frombins120 and placing the items in boxes (packing). The user's body motions andindustrial machines112 motions may be tracked and analyzed to determine from whichbin120 an item has been taken and thereby identify the item picked by reference to a database of what items are stored in whichbins120.Further transponders114 may be affixed to notches on a conveyor belt and thereby the system may determine where the item was placed, and therefore in which box it was placed. Further, with the knowledge of which items were placed in which boxes, the system, with the aid of back-end databases and order processing information, may determine which order is in which box and may thereby further automate the process by, for example, affixing the proper shipping labels to the boxes.
• It is appreciated that numerous variations on this example environment are contemplated. With knowledge of the movement of items, users, and machinery, the system could monitor for safety, accuracy, efficiency, etc.Transponders114 could be affixed to individual boxes in addition to or instead of the conveyor belt, or the system could track conveyor belt motion in an alternate manner. While tracking items out of bins, the system could also track items placed into bins and/or manage inventory.Transponders114 could be affixed to individual items, which could further allow identification of the contents of a box even after it is sealed closed.
• While this particular example is for picking and packing, it is appreciated that the work to be tracked could include any environment or application. For example, the work monitored could be an assembly line function. The system could monitor the regular operation of the assembly line for safety, accuracy, efficiency, and could also control or monitor for options installed or incorporated into particular product builds, etc.
• In accordance with yet further aspects or embodiments, the system includes time of flight transmitters and/or transceivers/interrogators and time of flight receivers or transponders (time of flight sensors) in any of the combinations and using any of the signals disclosed herein for constantly monitoring the movement performed by the user, for detecting an appropriate movement performed by the user, for predicting movement of the human limb, for monitoring movement and performance of a user such as in a pick and pack environment and to provide feedback to the user, for controlling industrial machinery in combination with movement of a user for demarcating a safety zone around the industrial equipment for appropriate movement performed by the user and for cooperating with the industrial equipment, and for controlling and actuating the industrial equipment to stay clear of the safety zone and/or to cooperate with and interact with movement of the user.
• It is appreciated that in accordance with aspects or embodiments, the TOF systems as have been discussed herein can be used to provide for initial and ongoing engineering of robotic lines to eliminate interference and optimize movement paths of industrial-scale robots operating in an industrial environment. The TOF systems would provide an improvement over systems that require large industrial robots on an assembly line to have to be placed precisely, which requires a great deal of integration effort and time ensuring that the robots don't clash in operation and that their paths have been optimized to maximize production capacity. The TOF systems would provide an improvement over systems that require the precise location of the robots to be checked and fixed on a regular basis, where even small changes to the line can require near-complete reengineering of the entire solution. With the TOF systems as have been discussed herein, interrogator and transponders can be integrated at several points (i.e. on an end effector, one or more joints) which will vary by application on each multi-axis robot. Data from these sensors can be fed to an optimization and machine learning software suite, which can provide one or more sets of interference resolutions that optimize work flow for the line. A User Interface and state machine could be provided that would allow users to plan and execute this process in contextually-appropriate ways. The system could be configured based on the TOF measurements to resolve interferences and optimize itself, and could also be configured to allow users to control the process. The system can also be configured to dynamically optimize itself as ongoing changes to line configurations and robotic technology are required, the system could dynamically optimize for these changes with reduced integration and setup efforts.
• It is appreciated that in accordance with aspects or embodiments, the TOF systems as have been discussed herein can be used to provide for location awareness in an automated industrial environment. With the TOF systems as have been discussed herein, a baseline TOF interrogator infrastructure could be installed near important work areas, and transponders can be integrated into various devices (e.g. a drill, a powered exoskeleton, a transport vehicle). Software could be provided for automatic switching between modes of control for the device depending on the location of that tool. For example, a drill might become inactive if taken more than two meters away from a workstation, a vehicle might switch to different speed limits depending on its proximity to certain areas in an automated production facility, and a powered exoskeleton might allow for different modes of activity depending on proximity of certain workstations. Software could further allow users to tailor this mode switching to certain degrees as set by those granted authority in the system (e.g., managers), and the system could also collect users' tailoring/feedback on the current control schemes for representation to those granted authority in the system. An analytics engine could produce reports and visualizations for users to make more informed decisions about control mode switching, error states and optimization opportunities.
• It is appreciated that in accordance with aspects or embodiments, the TOF systems as have been discussed herein can be used to provide for a system that provides for precise assembly of large Machinery that has multiple subcomponents (e.g., a 100 meter long molding and assembly machine). Some advantages are that such a system could provide for assembly of such machines within millimeter scale tolerances and allow users to manage the assembly process intuitively and smoothly. Organizations could use TOF systems as disclosed herein to assemble large (100 m+) machinery to tolerance and specification before and after it's taken apart for delivery to a facility. Such an arrangement could provide ease of assembly advantages as compared to processes that involve weeks of intensive, expensive effort on site when the equipment arrives.
• Each subcomponent of the machinery could be instrumented with interrogators and/or transponders that would measure precise ranges between these subcomponents at key points. Software could analyze and present the precise range data to users guide assembly processes in real time, to make assessments on assembly quality, to make informed decisions about assembly processes, and to store data for each subcomponent of the machinery to reassemble to tolerance based on micro-location information and analytics.
• According to aspects of one embodiment, the time of flight sensors as have been disclosed herein can be used in industrial automation environments of large scale or where, due to distance and/or overwhelming ambient noise, voice commands are futile, it is not uncommon for body movements (e.g., hand gestures, arm motion, or the like) to be employed to direct persons in control of industrial equipment to perform tasks, such as directing a fork lift operator to load a pallet of goods onto a storage shelf, or to inform an overhead gantry operator to raise or lower, move to the right or left, backward or forward, an oversized or heavy component portion (e.g., wing spar or engine) for attachment to the fuselage of an aircraft. These human hand, arm, body gestures, and/or finger gesticulations can have universal meaning to human observers, and/or if they are not immediately understood, they typically are sufficiently intuitive that they can easily be learned without a great investment in training, and moreover they can be repeated, by most, with a great deal of uniformity and/or precision. In the same manner that a human observer can understand consistently repeatable body motion or movement to convey secondary meaning, asystem710 can also utilize human body movement, body gestures, and/or finger gesticulations to have conveyed meaningful information in the form of commands, and can therefore perform subsequent actions based at least in part on the interpreted body movement and the underlying command.
• In accordance with one embodiment, TOF sensors can monitor or detect motion associated with the torso of the user located proximate the TOF sensor. In accordance with another embodiment, TOF sensors can detect or monitor motion associated with the hands and/or arms of the user situated within the TOF sensors line of sight. In accordance with another embodiment, TOF sensors can detect or monitor movement associated with the hand and/or digits (e.g., fingers) of the user positioned proximate to automated machinery.
• It is understood that TOF sensors in conjunction or cooperation with other components (e.g., a controller and a logic component) can perceive motion of an object in at least three-dimensions. In accordance with embodiments, a TOF sensor can perceive lateral body movement (e.g., movement in the x-y plane) taking place within its line of sight, and also discern body movement in the z-axis as well.
• Additionally it is appreciated, in cooperation with further components such as controller and/or associated logic component, a TOF sensor as disclosed herein can gauge the velocity with which a body movement, gesticulation, or gesture is performed. For example, where the user is configured with one or more TOF sensors and is moving their hands with vigor or velocity, the time of flight sensors in conjunction with a controller and/or logic component, can comprehend the velocity and/or vigor with which the user is moving their hands to connote urgency or aggressiveness. Accordingly, in one embodiment, TOF sensors can perceive the vigor and/or velocity of the body movement. For instance, in an industrial automated environment, where a forklift operator is receiving directions from a colleague, the colleague can have initially commenced his/her directions by gently waving his/her arm back and forth (indicating to the operator of the forklift that he/she is clear to move the forklift in reverse). The colleague on perceiving that the forklift operator is reversing too rapidly and/or that there is a possibility of a collision with on-coming traffic can either start waving his/her arm back and forth with great velocity (e.g., informing the forklift operator to hurry up) or hold up their arm with great emphasis (e.g., informing the forklift operator to come to an abrupt halt) in order to avoid the impending collision. According to aspects of embodiments of this disclosure, the systems disclosed herein can be used to interpret such hand commands and transmit instructions for example to a fork lift operator, where the fork lift operator may not be able to see or hear instructions from the human providing the instructions.
• It is also appreciated that according to aspects of such embodiment, the TOF sensors in conjunction with a controller and/or logic component, can detect the sluggishness or cautiousness with which the user is moving their hands. Such time-of-flight measurements of sluggishness, cautiousness, or lack of emphasis can be interpreted by the controller and/or logic component to convey uncertainty, warning, or caution, and once again can provide instructions for previously perceived body movements or future body movements. Thus, continuing with the foregoing forklift operator example, the colleague can, after having waved his/her arm back and forth with great velocity, vigor, and/or emphasis can now commence moving his/her arm in a much more languid or tentative manner, indicating to the forklift operator that caution should be used to reverse the forklift.
• It is appreciated without limitation or loss of generality that TOF sensors, controller (and associated logic component), andindustrial machinery112 can be located in disparate locations within an automated industrial environment. For instance, in accordance with an embodiment, TOF sensors andindustrial machinery112 can be situated in close proximity to one another, while controller and associated logic component can be located in an environmentally controlled (e.g., air-conditioned, dust free, etc.) environment. In accordance with a further embodiment, time of flight sensors, a controller and logic components can be located in an environmentally controlled safe environment (e.g., a safety control room) while industrial machinery can be positioned in an environmentally hazardous environment.
• It can be appreciated from the foregoing, the sequences and/or series of body/movements, signals, gestures, or gesticulations utilized by the subject application can be limitless, and as such a complex command structure or set of commands can be developed for use in a warehouse and/or industrial environment. Moreover, one need only contemplate established human sign language (e.g. American Sign Language) to realize that a great deal of complex information can be conveyed merely through use of hand movements. Accordingly, as will have been observed in connection with the foregoing, in particular contexts, certain gestures, movements, motions, etc. in a sequence or set of commands can act as modifiers to previous or prospective gestures, movements, motions, gesticulations, etc.
• According to aspects of certain embodiments, a controller and/or logic component can further be configured to distinguish valid body movement (or patterns of body movement) intended to convey meaning from invalid body movement (or patterns of body movement) not intended to communicate information, parse and/or interpret recognized and/or valid body movement (or patterns of body movement), and translate recognized and/or valid body movement (or patterns of body movement) into a command or sequence of commands or instructions necessary to actuate or effectuate industrial machinery to perform tasks. For example, to aid a controller and/or associated logic component in differentiating valid body movement from invalid or unrecognized body movement, a controller and/or logic component can consult a persisted library or dictionary of pre-established or recognized body movements (e.g., individual hand gestures, finger movement sequences, etc.) in order to ascertain or correlate the body movement supplied by, and received from, TOF sensors with recognized body movement, and thereafter to utilize the recognized body movement to interpret whether or not the recognized body movement is capable of one or more performable action a warehouse environment and/or in cooperation withindustrial machinery112.
• It should be noted without limitation or loss of generality that a library or dictionary of pre-established or recognized body movements and translations or correlations thereof to commands or sequences of commands can be persisted to a memory or storage media. While storage devices (e.g., memory, storage media, and the like) are not depicted, typical examples of these devices include computer readable media including, but not limited to, an ASIC (application specific integrated circuit), CD (compact disc), DVD (digital video disk), read only memory (ROM), random access memory (RAM), programmable ROM (PROM), floppy disk, hard disk, EEPROM (electrically erasable programmable read only memory), memory stick, and the like.
• In order to facilitate communication between the various and disparately located component parts of any of the herein disclosed systems, a network topology or network infrastructure can be utilized. Typically the network topology and/or network infrastructure can include any viable communication and/or broadcast technology, for example, wired and/or wireless modalities and/or technologies can be utilized to effectuate the subject application. Moreover, the network topology and/or network infrastructure can include utilization of Personal Area Networks (PANs), Local Area Networks (LANs), Campus Area Networks (CANs), Metropolitan Area Networks (MANs), extranets, intranets, the Internet, Wide Area Networks (WANs)—both centralized and/or distributed—and/or any combination, permutation, and/or aggregation thereof.
• Having described above several aspects of at least one embodiment, it is to be appreciated various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure and are intended to be within the scope of the invention. Accordingly, the foregoing description and drawings are by way of example only, and the scope of the invention should be determined from proper construction of the appended claims, and their equivalents.

Claims (20)

What is claimed is:

1. A system comprising:

at least one first radio frequency transceiver configured to be mounted to a body part of a user;

at least one second radio frequency transceiver mounted to a portion of a robot;

a plurality of interrogators configured to determine a position of the at least one first radio frequency transceiver and configured to determine a position of the at least one second radio frequency transceiver; and

at least one controller configured to track, using the determined position of the at least one first radio frequency transceiver, movement of the body part of the user, and configured to track, using the determined position of the at least one second radio frequency transceiver, movement of the portion of the robot relative to the movement of the body part of the user.

2. The system ofclaim 1, further comprising at least one feedback mechanism to provide feedback to the user about the position of the body part relative to the position of the portion of the robot.

3. The system ofclaim 2, wherein the at least one feedback mechanism comprises haptic feedback.

4. The system ofclaim 2, wherein the at least one feedback mechanism comprises at least one light emitting diode.

5. The system ofclaim 1, wherein the at least one controller is configured to stop movement of the portion of the robot based on the determined position of the body part of the user relative to the determined position of the portion of the robot.

6. The system ofclaim 1, wherein the at least one controller is configured to move the portion of the robot away from the body part of the user based on the determined position of the body part of the user relative to the determined position of the portion of the robot.

7. The system ofclaim 1, wherein the at least one first radio frequency transceiver is affixed to a wristband configured to be worn by the user.

8. The system ofclaim 1, wherein the at least one controller is configured to track, using the determined position of the at least one first radio frequency transceiver, movement of the body part of the user while picking items from, and/or placing items into, a plurality of bins.

9. The system ofclaim 8, further comprising at least one feedback mechanism to provide feedback to the user in picking items from and/or placing items into the plurality of bins.

10. The system ofclaim 9, wherein the at least one feedback mechanism is configured to signal to the user a correct one of the plurality of bins to pick an item from and/or to place an item into.

11. The system ofclaim 9, wherein the at least one feedback mechanism is configured to signal to the user that an item has been correctly placed and/or correctly picked.

12. The system ofclaim 9, wherein the at least one feedback mechanism is configured to signal to the user that an item has been incorrectly placed and/or incorrectly picked.

13. The system ofclaim 9, wherein the at least one feedback mechanism provides an indication of an unsafe condition.

14. A method comprising:

determining a position of at least one first radio frequency transceiver mounted to a body part of a user using a plurality of interrogators;

determining a position of at least one second radio frequency transceiver mounted to a portion of a robot using the plurality of interrogators;

tracking, using the determined position of the at least one first radio frequency transceiver, movement of the body part of the user; and

tracking, using the determined position of the at least one second radio frequency transceiver, movement of the portion of the robot relative to the movement of the body part of the user.

15. The method ofclaim 14, further comprising providing feedback to the user about the position of the body part relative to the position of the portion of the robot using at least one feedback mechanism.

16. The method ofclaim 14, further comprising stopping movement of the portion of the robot based on the determined position of the body part of the user relative to the determined position of the portion of the robot.

17. The method ofclaim 14, further comprising moving the portion of the robot away from the body part of the user based on the determined position of the body part of the user relative to the determined position of the portion of the robot.

18. The method ofclaim 14, further comprising tracking, using the determined position of the at least one first radio frequency transceiver, movement of the body part of the user while picking items from, and/or placing items into, a plurality of bins.

19. The method ofclaim 18, further comprising providing feedback to the user in picking items from and/or placing items into the plurality of bins using at least one feedback mechanism.

20. The method ofclaim 19, further comprising signaling to the user a correct one of the plurality of bins to pick an item from and/or to place an item into using the at least one feedback mechanism.

Images