US20070078466A1 - Methods for harvesting follicular units using an automated system - Google Patents

Abstract

A method for harvesting follicular units from a body surface, includes acquiring and processing images of a body surface to identify a follicular unit on the body surface and to determine a relative position and orientation of the identified folliculat unit; using an automated system including a moveable arm to position a harvesting tool mounted on the moveable arm adjacent the identified follicular unit, based at least in part on processed image data, such that a longitudinal axis of the harvesting tool is aligned with a longitudinal axis of the follicular unit; and harvesting the follicular unit by movement of the harvesting tool relative to the body surface, wherein the images are acquired from one or more cameras mounted on the moveable arm.

Description

RELATED APPLICATION DATA
• The present application claims the benefit under 35 U.S.C. § 119 to U.S provisional patent application Ser. Nos. 60/722,521, filed Sep. 30, 2005, 60/753,602, filed Dec. 22, 2005, and 60/764,173, filed Jan. 31, 2006. The foregoing applications are all hereby incorporated by reference into the present application in their entirety.
FIELD OF INVENTION
• This invention relates generally to an image-guided robotics system for performing precision diagnostic and therapeutic medical procedures.
BACKGROUND
• U.S. Pat. No. 6,585,746 discloses a hair transplantation system utilizing a robot, including a robotic arm and a hair follicle introducer associated with the robotic arm. A video system is used to produce a three-dimensional virtual image of the patient's scalp, which is used to plan the scalp locations that are to receive hair grafts implanted by the follicle introducer under the control of the robotic arm. The entire disclosure of U.S. Pat. No. 6,585,746 is incorporated herein by reference.
SUMMARY
• In accordance with a general aspect of the inventions disclosed herein, an automated system, such as an image-guided robotics system, is employed for performing precisely controlled diagnostic and therapeutic medical procedures, such as (by way of non-limiting examples) hair removal and/or transplantation, repetitive needle injections (e.g., for delivery of collagen filers, melanocyte, tattoo ink), tattoo or mole removal, application of laser or radio frequency (RF) energy, cryogenic therapy (e.g., for mole or wart removal), patterned micro-tissue removal (e.g., as an alternative to a conventional “face lift” procedure), and any other procedure currently performed using human-controlled devices.
• According to according to some embodiments, an automated system may also be employed for performing diagnostic evaluations, such as, e.g., obtaining precision image data for skin cancer screening, and performing ultrasound diagnostics. In various embodiments, the robotics system generally includes a robotic arm controlled by a system controller, an end-effecter assembly coupled to a distal (tool) end of the robotic arm, and an image acquisition system, including one or more high speed cameras coupled to the end-effecter assembly for acquiring images that are processed for providing control signals for movement of the robotic arm using a “visual-servoing” process.
• In accordance with some embodiments, methods for harvesting follicular units from a body surface include (i) acquiring images of a body surface; (ii) processing the acquired images to identify a follicular unit on the body surface and to determine a relative position and orientation of the identified follicular unit; (iii) using an automated system including a moveable arm to position a harvesting tool mounted on the moveable arm adjacent the identified follicular unit, based at least in part on processed image data, such that a longitudinal axis of the harvesting tool is aligned with a longitudinal axis of the follicular unit; and (iv) harvesting the follicular unit by movement of the harvesting tool relative to the body surface, wherein the images are acquired from one or more cameras mounted on the moveable arm.
• By way of example, the automated system may be a robotic system, wherein the moveable arm is a robotic arm. In one such embodiment, the images are acquired from a single camera mounted to the robotic arm, the method further comprising registering a reference coordinate system of the camera with a tool frame reference coordinate system of the robotic arm. For example, the camera reference coordinate system may be registered with the robotic arm tool frame reference coordinate system based on images of a fixed calibration target acquired as the robotic arm is moved along one or more axes of the robotic arm tool frame reference coordinate system.
• In another such embodiment, the images may be acquired from a pair of cameras mounted to the robotic arm, the method further comprising registering respective reference coordinate systems of the cameras with each other and with a tool frame reference coordinate system of the robotic arm. In still another such embodiment, the images may be acquired using respective first and second pairs of cameras mounted to the robotic arm, the first pair focused to acquire image data of a first field of view, and the second pair focused to acquire image data of a second field of view substantially narrower than the first field of view. In yet further such embodiments, the method may further comprise identifying the approximate physical boundaries of the identified follicular unit, including identifying a subcutaneous base region embedded in the body surface and a distal tip region extending away from the body surface. Furthermore, the images may include subcutaneous images.
• In accordance with yet other embodiments, methods for harvesting follicular units from a body surface include (i) acquiring images of a body surface; (ii) processing the acquired images to identify a follicular unit on the body surface and to determine a relative position and orientation of the identified follicular unit; (iii) using an automated system including a moveable arm to position a harvesting tool mounted on the moveable arm adjacent the identified foilicular unit, based at least in part on the processed images, such that a longitudinal axis of the harvesting tool is aligned with a longitudinal axis of the follicular unit; and (iv) harvesting the follicular unit by movement of the harvesting tool relative to the body surface, wherein the images are acquired using a pair of cameras, and further comprising registering respective reference coordinate systems of the cameras with each other.
• In accordance with still further embodiments, methods for harvesting follicular units from a body surface include (i) acquiring images of a body surface; (ii) processing the acquired images to identify a follicular unit on the body surface and to determine a relative position and orientation of the identified follicular unit; (iii) using an automated system including a moveable arm to position a harvesting tool mounted on the moveable arm adjacent the identified follicular unit, based at least in part on the processed images, such that a longitudinal axis of the harvesting tool is aligned with a longitudinal axis of the follicular unit; and (iv) harvesting the follicular unit by movement of the harvesting tool relative to the body surface, wherein the images are acquired using respective first and second pairs of cameras, the first pair focused to acquire images of a first field of view, and the second pair focused to acquire images of a second field of view substantially narrower than the first field of view.
• Other and further objects and advantages of the invention will become apparent from the following detailed description when read in view of the accompanying figures.
BRIEF DESCRIPTION OF THE DRAWINGS
• The invention is illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements, and in which:
• FIG. 1 is a photograph of an embodiment of an image-guided robotics system, including a robotic arm for positioning and orienting an end-effecter tool at targeted locations on the skin surface of a patient.
• FIG. 2 is a photograph showing first and second stereo camera pairs secured to the robotic arm ofFIG. 1, and used to capture image data from multiple fields-of-view for guiding movement of the robotic arm and an attached end-effecter tool assembly.
• FIG. 3 is a close-up photograph of the system ofFIG. 2, more clearly showing the end-effecter tool.
• FIG. 4 is a flow diagram of a procedure for calibrating an optical axis and associated camera reference frame of a single camera with a tool frame established at the distal (working) end of the robotic arm to which the camera is attached.
• FIG. 5 is a flow diagram of an iterative procedure for aligning (both position and orientation) an elongate end-effecter tool used for harvesting and/or implanting hair follicles with a selected hair follicular unit.
• FIG. 6 depicts a camera image of hair follicular units in a region of interest on a human scalp.
• FIG. 7 illustrates exemplary position and orientation, i.e. defined by x,y offsets and in-plane and out-of-plane angles, of a hair follicular unit relative to the camera reference frame.
• FIG. 8 is a flow diagram of an automated procedure for identifying a position and orientation of each of a multiplicity of follicular units in a region of interest on a human scalp, and then harvesting some or all of the identified follicular units.
• FIG. 9 is a flow diagram of an algorithm that uses images acquired from a stereo pair of cameras for identifying follicular units in a region of interest, and then computes the respective locations and orientations of the identified follicular units.
• FIG. 10 is a three-part tool for follicular unit harvesting recipient site incision, and graft placement, according to one embodiment of the invention.
• FIG. 11 is an end-effecter apparatus used for driving the respective three parts of the three-part tool ofFIG. 10.
• FIG. 12 is a photograph of a semi-circular cylinder used as a rotational cutter for harvesting hair follicles, according to one embodiment of the invention.
• FIG. 13 is a flow diagram of an algorithm using control points to design a natural looking (implanted) hairline.
• FIG. 14 is a flow diagram of an algorithm using control points to provide natural-looking randomness to implanted hair graft locations.
• FIG. 15 is a flow diagram illustrating an automatic guidance feature of an image-guided robotics system.
• FIG. 16 is a flow diagram of an algorithm using stereovision for accurately controlling the depth of a hair follicle implant.
• FIG. 17 is a flow diagram of a procedure for harvesting hair follicles.
• FIG. 18 is a flow diagram of a procedure for implanting hair follicles.
• FIG. 19 illustrates an end-effector tool having a positioning assembly in accordance with some embodiments.
• FIG. 20 illustrates a holding unit located within the positioning assembly ofFIG. 19 in accordance with some embodiments.
• FIG. 21A illustrates a needle assembly in accordance with some embodiments.
• FIGS. 21B-21D illustrate variations of a distal end of the needle assembly ofFIG. 21A in accordance with different embodiments.
• FIG. 22 illustrates the needle assembly ofFIG. 21A being engaged with the holding unit ofFIG. 20.
• FIG. 23 illustrates a follicular unit being harvested by a coring needle in accordance with some embodiments.
• FIGS. 24A-24D illustrates a process for implanting a follicular unit in accordance with some embodiments.
• FIG. 25 illustrates a force diagram representing a force experienced by a coring needle in accordance with some embodiments.
• FIG. 26 illustrates a cartridge for holding a plurality of coring needles in accordance with some embodiments.
• FIG. 27 illustrates a puncture needle holder in accordance with some embodiments.
• FIG. 28 illustrates a positioning assembly in accordance with other embodiments.
• FIGS. 29A-29B illustrate a process of harvesting and implanting a follicular unit using the positioning assembly ofFIG. 28, the cartridge ofFIG. 26, and the puncture needle holder ofFIG. 27 in accordance with some embodiments.
• FIG. 30 illustrates a skin tensioner that can be used with embodiments described herein.
• FIG. 31 illustrates a needle assembly in accordance with still other embodiments.
• FIGS. 32A-32C illustrate an exemplary method of using the needle assembly ofFIG. 31 in accordance with some embodiments.
DETAILED DESCRIPTION OF THE ILLUSTRATED EMBODIMENTS
• FIG. 1 depicts an image-guidedrobotics system25, including a programmablerobotic arm27 of a type manufactured and distributed by Adept Technology, Inc. (www.adept.com). Another source of robotic arm assemblies suitable for embodiments of the invention are manufactured and distributed by Kuka Robot Group (www.kuka.com). Therobotic arm27 provides precisely controlled movement of a distal end plate (not seen inFIG. 1) in six degrees of freedom (x, y, z, ω, ρ, r), as is well-known in the art. Such movement of the distal plate is provided with a high degree of repeatability and accuracy (e.g., to 20 microns) by respective motors and encoders located inrespective arm joints34 of therobotic arm27.
• A variety of different end effecter tools and/or assemblies may be attached to the distal end plate on therobotic arm27 for performing various procedures on a human or animal patient. By way of example, the end-effecter assembly30 shown inFIGS. 1-3 is designed for the harvesting and implantation of hair follicles from/in a human scalp. It will be appreciated that embodiments of the invention will employ many different types of end-effecter tools and assemblies for performing diagnostic and therapeutic medical procedures that take advantage of the ability of therobotic arm27 to rapidly and precisely position the respective tool (e.g., needle) or assembly at desired locations at the skin surface of a patient. It will be appreciated that the end-effecter assemblies may themselves include moving, controllable parts. By way of example, one end-effecter assembly comprises a reciprocating needle used for delivering precisely targeted, repetitive injections through the dermis.
• As described in greater detail herein, movement of therobotic arm27 is governed by a system controller (not shown), in response to control signals derived from image data acquired by a pair of “stereo”cameras28 attached to the distal end of the robotic arm (proximate the end-effecter assembly30). in alternate embodiments, only a single camera need be used for image acquisition. Also, as depicted inFIG. 2 (and also as described in greater detail herein), multiple pairs ofstereo cameras28A and28B may be used in order to capture differing (i.e., broader and narrower) fields-of-view. In still further embodiments, a single camera may be used to capture a first (i.e., broad) field-of-view, and a second camera may be used to capture a second (i.e., narrow) field-of-view. Other camera configurations are also possible.
• Image data acquired by the camera(s)28 is processed in a computer (not shown inFIG. 1) associated with therobotics system25, which provides control signals to the system controller for directing movement of therobotic arm27. In particular, images are acquired from each camera of thepair28 at a desired magnification (e.g., in a range of 6× to 10× in one embodiment) and duty cycle (e.g., 30 hertz in one embodiment). The acquired images are digitized using known image segmentation techniques implemented in software on the computer in order to identify the position(s) and orientation(s) of objects of interest. In the case of procedures involving the removal or implantation of hair follicles, it may be desirable to die the hair follicles of interest with a dark color prior to a procedure, in order to increase the effectiveness of the image processing techniques. It may also be desirable to cut the hair follicles in the region(s) of interest to a substantially uniform length prior to the procedure.
• As will be appreciated by those skilled in the art, one can visualize below the skin surface by adjusting the lighting, filters on the cameras, and various image processing techniques. This is because the reflection and absorption of light by the skin surface will change based on the wavelength of light used. Further, the depth of penetration of the light itself into the skin also varies based on the wavelength. Understanding these basic properties of light, images of the subcutaneous portions of the follicular units (hair follicles) may be obtained using appropriate respective wavelengths of light, including both visible light spectrum and infrared, capturing the different wavelengths of light using different imaging filters, and subtracting and/or combining images during image processing. This approach enables one to visualize the hair shaft of the follicular unit, both outside the skin, as well as under the skin surface, including all the way down to the bulb.
• More particularly, therobotics system25 is able to precisely track movement of the distal end plate (and end-effecter tool or assembly) in each of the six degrees of freedom (x, y, z, ω, ρ, r) relative to three different reference frames. A “world frame” has its x,y,z coordinate origin at a center point of thebase32 of therobotic arm27, with the x-y coordinates extending along a plane in a surface of a table36 on which thebase32 of therobotic arm27 is attached. The z-axis of the world frame extends orthogonally to the table surface through a first section of therobotic arm27. A “tool frame” has its x,y,z coordinate origin established at the distal end tool plate. Lastly, a “base frame” may be registered relative to the world and tool frames. Each camera also has a (two-dimensional) camera coordinate system (“camera frame”), in which the optical axis of the camera (“camera axis”) passes through the origin of the x,y coordinates. By aligning the respective world frame, tool frame, base frame and camera frames, the system controller can precisely position and orient an object secured to the tool plate (e.g., a needle) relative to another object, such as a hair follicular unit extending out of a patient's skin surface.
• In order to physically align the camera axis with an axis of an end-effecter tool (e.g., an elongate needle cannula) fixed to the distal tool plate of therobotic arm25, it is of practical importance to be able to calibrate, and thereby have the information to compensate for, the positional and rotational offsets between the end effecter “tool axis” and the camera axis, as well as the deviation from parallel of these respective axes. An exemplary calibration procedure is illustrated inFIG. 4. As an initial matter, the proximal base of therobotic arm27 is mounted to thetable surface36, so that thetable surface36 is aligned with the x-y coordinate plane of the world frame of the robotic system. Thus, a point lying anywhere on the table surface has a x-y coordinate location in the world frame, which can be identified in terms of x and y offset values (e.g., measured in mm) from the origin of the world frame located at a center point of the robotic arm proximal base interface with thetable surface36, with the z coordinate location of the point in the world frame equal to zero.
• Atstep60, the camera axis of a single camera fixed to the distal end tool plate of therobot arm27 is aligned with a fixed “calibration point” located on thetable surface36. The base frame of the robotic system is then initiated, meaning that the origin of the base frame is set at the “calibration point” and the camera axis is aligned with the calibration point on the table surface. This initial position is called “home” position and orientation, and therobot arm27 always starts from this position, even in the absence of the calibration point.
• Atstep62, a scaling and orientation of the camera image relative to the base frame is then determined by first moving the robotic arm27 (and, thus, the camera) a fixed distance (e.g., 5 mm) along the x axis of the base frame, so that the calibration point is still captured in the resulting image, but is no longer aligned with the camera axis. Because the camera frame x-y axes are not aligned with the base frame x-y axes, movement along the x axis of the base frame results in movement in both the x and y directions in the camera frame, and the new location of the calibration point is measured in the camera frame as a number of image pixels in each of the x and y directions between the pixel containing the relocated camera axis and the pixel containing the calibration point.
• This process is repeated by moving the robotic arm27 (and camera) a fixed distance (e.g., 5 mm) along the y axis of the base frame, and again measuring the x,y offsets in the camera frame of the new location of the calibration point. As will be appreciated by those skilled in the art, these measurements allow for scaling the physical movement of the robot/camera (in mm) to movement of an object in the camera image (in pixels), as well as the in-plane orientation of the x-y axes of the camera frame relative to the x-y axes of the base frame. It will further be appreciated that the scaling and orientation process ofsteps60 and62 are repeated for each camera in a multiple camera system, whereby variances in image movement between respective cameras may also be determined and calibrated.
• Atstep64, once the camera frame is calibrated with respect to the base frame, the camera axis is again aligned with a fixed calibration point lying on the surface of table36, wherein the base frame is returned to is “home” position and orientation (0,0,0,0,0,0). Therobotic arm27 is then moved in one or more of the six degrees of freedom (x, y, z, ω, ρ, r), so that an end effecter tool (e.g., needle tip) attached to the tool plate contacts the calibration point. By precisely tracking the movement of therobotic arm27 from the initial home position/orientation of the tool frame to its position/orientation when the tool tip is contacting the calibration point, the system controller calculates the translational and rotational offsets between the initial home position and the camera axis. Because the camera is fixed to the tool plate, the measured offsets will be constant, and are used throughout the procedure for alignment of the tool frame with the camera frame (and, by extension, the base frame).
• As will be described in greater detail herein, when using a stereo pair of cameras, e.g.,camera pair28 inFIG. 1, the respective optical axes (and camera frames) of the cameras are typically not installed or maintained in parallel, but are slightly verged, e.g., about 10 degrees, which may be compensated for through known image processing techniques. In particular, the respective camera frames are aligned to have a common x (horizontal) axis, whereby a position and orientation (including in-plane depth) of objects captured in the parallel images may be aligned using image-processing techniques. One advantage of using astereo camera pair28 is that a “depth” in the camera frame of an identified object may be calculated based on the differences of the x,y position offsets of the object in the respective (left v. right) camera frames. In particular, the depth of implantation of a hair follicular unit (“graft”) is important to the aesthetic result and is a challenge to achieve manually, particularly with the operator fatigue that results when a large number of grafts are implanted. If the graft is implanted too deep, a divot-like appearance results; if implanted too shallow, a bump results or the graft may not stay in position.
• In order to calculate a depth of a selected object, such as a hair follicular unit, the left and right images obtained from the stereo camera pair must first be aligned. Because the respective camera images are aligned horizontally, the same objects will appear in the same horizontal scan lines of the two images. And, because the depth of an object being imaged relative to the camera lenses is within a known range (e.g., established by the focal lengths of the respective cameras), a selected object in a first image (e.g., a hair follicular unit) can be matched to itself in the second image (to thereby align the images with each other) by calculating an effective depth of the object when paired with the possible candidate objects in the second image (i.e., in the same scan line) to determine which “pair” has a calculated depth in the possible range.
• Another advantage of using astereo camera pair28 is the ability to obtain image data regarding the position and orientation of an end-effecter tool (e.g., a hair follicularunit harvesting tool40 shown inFIGS. 2 and 3) in a same reference frame that image data is obtained regarding the position and orientation of objects of interest (e.g., hair follicles, wrinkle lines, tattoos, moles, etc.) on the skin surface. The respective left and right camera frames are calibrated with the tool frame in the same manner as described above for a single camera frame. Once these offsets are established, the relative positions and orientations of the end-effecter tool and objects on the skin surface (e.g., hair follicular units) may be determined and tracked in the tool frame.
• FIG. 5 is a simplified flow diagram of a procedure according to one embodiment of the invention for aligning the position and orientation of an elongate axis of the follicularunit harvesting tool40 with an elongate shaft axis of a hair follicular unit extending from the scalp, using only a single camera for image acquisition. Briefly, theharvesting tool40 generally comprises a hollow, tubular cannula having a sharpened distal end for puncturing the epidermis and dermis immediately around an outer circumference of a follicular unit in order to envelop, capture and remove the entire follicular unit from the fatty subcutaneous tissues underlying the dermis, e.g., by rotating the cannula in a drill-like motion, or by a quick reciprocating thrust along its longitudinal axis. Theharvesting tool40 may be advanced and withdrawn by its own longitudinal motion (i.e., relative to the tool plate to which it is attached), or by longitudinal motion of therobotic arm27, or by a combination of both, in order to core and remove the respective follicular units, e.g., by friction and/or with the aid of a weak vacuum. For example, the end-effecter may have its own controller and actuation system that is separate from therobotics system25.
• A more detailed description of exemplary follicular harvesting tools and assemblies is provided below in conjunction withFIGS. 10-12. It should also be appreciated that the positioning and orientation process used for aligning the elongate axis of theharvesting tool40 with the elongate axis of a hair follicular unit will have much broader applicability than just for hair removal and/or implantation procedures. By way of non-limiting examples, substantially similar positioning and orientation procedures may be used for aligning a laser, or an injection needle, with desired physical features and/or locations on a patient's skin surface in a timely and precise manner.
• After therobotics system25 has been initiated and calibrated so that the camera frame is aligned with the tool frame (described above in conjunction withFIG. 4), image data is acquired and processed by the system computer to identify objects of interest in the camera frame. By way of example,FIG. 6 depicts, a camera image of hair follicular units in a region ofinterest50 on a human scalp. From images of this region ofinterest50, image segmentation and screening software residing in the computer identifies and selects one or more particular follicular units of interest for harvesting from the scalp. With reference toFIG. 7, a position of a selected hairfollicular unit52 is identified in terms of its x,y offset coordinates in the camera frame (the z axis being the camera optical axis which is preferably aligned substantially orthogonal to the surface of the scalp at the region50).
• Unless the camera axis happens to be exactly aligned with the longitudinal axis of the follicular unit52 (in which case the follicular unit will appear as a circular point representing an end view of the hair shaft), the image of follicular unit will be in the form of an elongate line having an “apparent” length that will depend on the angle of the camera frame relative to the follicular unit. Because of physical attributes of a hair follicular unit, its base (i.e., the end emerging from the dermis) can be readily distinguished from its tip as part of the image segmentation process. For example, the base portion has a different profile and is generally thicker than the distal tip portion. Also, a shadow of the follicular unit can typically be identified which, by definition, is “attached” at the base.
• The x,y locations of the follicular unit base in the camera frame are then calculated and represent the position offsets of the hair base. Orientation offsets of thefollicular unit52 are also calculated in terns of (i) an in-plane angle α formed by the identified follicular unit shaft relative to, and in the same plane as, the x (or y) axis of the camera frame; and (ii) an out-of-plane angle δ that is an “apparent” angle formed between the follicular unit shaft and the scalp, i.e., between the follicular unit and the plane of the x,y axes of the camera frame. As noted above, the hair shaft is preferably trimmed prior to the procedure to a substantially known length, e.g., 2 mm, so the out-of-plane angle δ may be calculated based on a ratio of a measured apparent length of the image of the follicular unit to its presumed actual length, which ratio is equal to the cosine of the out-of-plane angle δ.
• Returning toFIG. 5, atstep42, the x,y position and orientation offsets are identified for a selected hair follicular unit, as described above. The computer then calculates the necessary movements of therobotic arm27 to cause the camera axis to be aligned in the same position and orientation of the calculated offsets. The base frame and tool frame are also “moved” by the same x,y and rotational offsets (i.e., until angles α and δ are both equal to 0), so that the camera, base and tool frames remain aligned at the new position and orientation of the camera axis. Because of the inherent possible variances and errors in the system and in the assumptions (e.g., regarding the hair follicular unit length) the actual position and orientation of the hair follicular unit may not match the calculated values. Thus, once the robotic arm27 (and camera axis) is moved by the calculated positional and rotational offsets, the follicular unit is again imaged and (at step46) a determination is made as to whether the camera axis is aligned with the position and orientation of the follicular unit within acceptable tolerances. If the camera axis is adequately aligned with the follicular unit, therobotic arm27 is moved a last time (at step48) in order to align theharvesting tool40 in the “confirmed” position of the camera axis (i.e., based on the offsets obtained in the above-described calibration process). However, if the (in step46) the camera axis is not adequately aligned with the hair follicular unit, the procedures in steps42-46 are repeated, starting from the new camera axis location.
• As will be appreciated by those skilled in the art, in embodiments of the invention, the duty cycle of the image acquisition and processing is substantially faster than the movement of therobotic arm27, and the process of identifying and calculating position and orientation offsets of selected hair follicular units relative to the camera axis can effectively be done “on-the-fly,” as the robotic arm is moving. Thus, the end destination (i.e., position and orientation) of the robotic arm27 (and harvesting tool40) may (optionally) be constantly adjusted (i.e., fine tuned) as theharvesting tool40 is moved into alignment with the follicular unit. Because such adjustments begin immediately, movement of therobotic arm27 is more fluid and less jerky. This iterative feedback process, referred to as “visual-servoing,” continually calculates and refines the desired position and orientation of theharvesting tool40, in order to minimize the image of the hair follicular unit, i.e., until the image transforms from a line to a point.
• Thus, in embodiments of the invention, the image-guidedrobotics system25 may be used to perform automated or semi-automated procedures for identifying position and orientation of a large number of hair follicular units in a region of interest on a patients scalp, and then accurately harvest some or all of the follicular units. One or more cameras attached to the working distal end of the robotic arm capture images at a desired magnification of a selected area of the patient's scalp. A computer system processes the images and identifies (through known thresholding and segmentation techniques) the individual hair follicular units, as well as their respective positions and orientations relative to the camera frame. Through a user-interface (e.g., a display and a standard computer mouse), an attending surgeon may define a region on the scalp from which hair follicular units are to be harvested and defines a harvesting pattern, such as, e.g., taking every other hair follicular unit in the region, leaving a defined number of follicular units between harvested follicular units, taking a certain percentage of follicular units, leaving behind an aesthetically acceptable pattern, etc.
• For example, images obtained from a wide field-of-view pair of stereo cameras may be used by the attending physician to locate generally a region of interest, while images obtained from a narrow field-of-view pair of stereo cameras are used to accurately guide the harvesting tool with the individual selected follicular units. Once the hair follicular units to be harvested have been identified, the robotics system systematically aligns a harvesting tool (e.g., harvesting tool40) with each hair to be harvested; the respective hair follicles are harvested, and the process is repeated for all of the selected follicular units in the defined harvest region. It will be appreciated that in some cases, the individual hair follicular units being harvested are then implanted in another portion of the patient's scalp, whereas in other instances the harvested hair follicular units are discarded. It will also be appreciated that, rather than a coring harvesting tool, such astool40, another type of hair removal end-effecter tool may be employed, such as, e.g., a laser. It will be still further appreciated that the above-described techniques for aligning the camera frame with the robot tool frame for precisely aligning an end-effecter tool may be equally applicable to other types of end-effecter tools, such as an injection needle (or a plurality of injection needles) used for injecting ink for forming tattoos on a skin surface of a patient.
• FIG. 8 is a flow diagram of an automated (or semi-automated) procedure for identifying a position and orientation of all follicular units in a region of interest on a patient's scalp, and then accurately harvesting some or all of the identified follicular units.
• FIG. 9 is a flow diagram of a procedure using a stereo pair of cameras to identify individual follicular units in a region of interest on a patient's scalp, and then compute a location and orientation of each in the respective camera frames and robot tool frame. The procedure starts by calibrating the stereo pair of cameras to identify both intrinsic and extrinsic parameters, in accordance with well known techniques. Intrinsic parameters are intrinsic to the individual camera, such as internal optics, distortion, scaling, and the like. Extrinsic parameters relate to characteristics between the two cameras, e.g., differences in the alignment of their respective optical axes (which are ideally parallel to one another, but as since this is unlikely as a practical matter, mathematical compensation is required). Calibration of intrinsic and extrinsic parameters are known in the field of stereo imaging and will not be explained in detail herein. As discussed above, the locations of the centers of the hair follicles are identified and matched in both the left and right rectified images. The head and tail of each hair follicle is then identified in both the left and right images, wherein the three dimensional coordinates of the head and tail of the hair follicle may be calculated. Finally, the relative offset of the location and orientation of the hair follicle and the cannula are determined by employing the images of the cameras which see both the cannula and the hair follicle, in accordance with well known stereo imaging techniques.
• The aesthetic result of a hair transplant procedure depends in part on implanting the grafts in natural-looking patterns. The computer can efficiently “amplify” the surgeon's skill by “filling in the blanks” among a small fraction of the implant sites for which the surgeon determines graft location and orientation. Achieving a natural-looking hairline is particularly important for a good aesthetic result. Instead of painstakingly making incisions for all of the near-hairline implant sites, the surgeon indicates a few hairline implant locations and orientations and the computer fills in the rest by interpolating among the designated sites, using the imaging system to identify and avoid existing follicular units.
• FIG. 13 illustrates an algorithm using control points to design natural looking hairline. A curve is designed using control points based on, for example, b-spline cubic polynomials. The control points are specified by the operator. The orientation of the hair at each of the control points is specified. Points along the curve are identified at a given spacing, for instance, by interpolation. The locations of the points along the curve may be randomized to make a natural looking hair line. The amount of randomization may be user-specified or computer-generated. It is preferable that the follicular unit orientations are not randomized but are interpolated, for example, the same way a cubic spline is generated. Randomization of the location and interpolation of the orientation create more natural looking implants.
• Natural looking randomness is important in both the critical hairline region and in the balance of the recipient sites. This can be achieved using the procedure illustrated in FIG.14, wherein a surface is designed using control points based on, for example, b-spline cubic surfaces. Again, the orientation of the hair at each of the control points is specified. Implant points along the surface are identified at a given spacing. The locations of the points along the surface may be randomized to make a natural looking hair distribution. The amount of randomization may be user-specified or computer-generated. Again, the orientation of the respective follicular units is preferably not randomized, but interpolated the same way a cubic spline surface is generated. Randomization and interpolation schemes are known in the art, and can be adapted for this method.
• It is often desirable to leave the existing hair in the recipient region at its natural length, which can interfere with the vision system's access to individual recipient sites. This can be overcome by a gentle air jet directed at the recipient site, causing the hair in that region to be directed away from the target site. If necessary, the hair can be dampened to facilitate this step. The air jet also can disperse blood that emerges from the incised recipient site, thus maintaining visual access during graft implantation. Such an air jet can be part of a more complex end-effecter assembly attached to the robotic arm tool plate, and which may also include one or more hair follicle harvesting and/or implantation needles.
• Therobotics system25 uses real-time information from the vision system to monitor the position of the patient (typically using fiducial markers in the recipient region of the scalp), of the implanting tool, and of existing follicular units to guide the implanting tool into place for incising the recipient site and implanting the graft.FIG. 15 shows an example of the automatic guidance feature of the robotic system, including the step of planning implant locations and orientations with respect to global landmarks (e.g., existing hairs, tattoos, or other distinguishing features). The robot is then moved to register landmarks on the patient. The register information can be stored in memory for reference. The robot can make use of the registered landmarks as reference points for recognizing its position relative to the working surface. The robot is moved to each of the implant location and orientation with respect to the global landmarks. The global landmarks provide a global reference for global movements. The location and orientation are fine-tuned based on the nearby landmarks such as neighboring preexisting hairs or newly implanted hairs. The nearby landmarks provide a local reference for local movements.
• Hair transplantation generally includes three steps: follicular unit harvesting, recipient site incision, and graft placement. The efficiency of the surgery can be enhanced if these functions are accomplished with a single tool.FIG. 10 shows an embodiment of a three-part tool for accomplishing the three functions. The three coaxial elements are an outer cannula (“puncture needle”) with a sharp bevel cut that is used for making the recipient-site incision, a second cannula (“coring needle”), that slides inside the outer needle and is used for cutting around the donor graft, and an obdurator that slides inside the second cannula and is used for positioning the graft at the appropriate depth in the recipient site. For harvesting the second cannula cuts the tissue (by rotating or by a quick thrust) while being advanced to the desired depth for separating the follicular unit from the skin down to the level of fatty tissue. The graft is then captured within this cannula by advancing the cannula into the fatty tissue surrounding the follicular unit bulb without a cutting motion. The cannula then extracts the graft using friction between the graft and the inside of the cannula or a combination of such friction and vacuum. For recipient site incision, the outer cannula is advanced beyond the harvesting cannula and is use to make an incision at the desired location with the desired orientation and depth. The obdurator then holds the graft at the desired depth while the two cannulae are retracted.
• In the three-part tool ofFIG. 10, it is necessary to move each of the three elements independently of the other two. And, if the harvesting cannula cuts by rotation rather than a linear quick thrust, there is a mechanism for rotating that cannula.FIG. 11 shows an embodiment of an apparatus for producing the required motions of the tool elements, including rotation and advancement of the harvesting cannula, advancement and retraction of the implant cannula, and advancement and retraction of the obdurator. A translation mechanism or linear motor provides advancement and retraction of the implant cannula. A rotation and advancement motor or mechanism provides both translational and rotational movement of the harvesting cannula. Another translation mechanism or linear motor provides advancement and retraction of the obdurator. The mechanisms and motors typically employ a combination of motors, cams, and springs, but any suitable mechanism can be used to provide translational and rotational movement of the tool parts.
• FIG. 17 depicts a general sequence of actions for harvesting hair follicles using a system according to embodiments of the invention, Initially, the robot is moved so that the harvesting needle is aligned with the hair follicle, both in location and orientation. The harvesting needle is then advanced so that the needle cannulates the hair follicle. The needle is advanced into the patient to cut the skin at a predetermined speed in step (e.g., to produce a quick jab or thrust). The needle is advanced into the patient's scalp to cut through the fatty layer underneath the skin. The needle is retrieved out of the patient and stops turning. Sometimes, the hair follicle will be lifted by the harvesting needle, as the harvesting needle is retrieved. Alternatively, an extraction mechanism, such as a vacuum, can be provided to extract or harvest the hair follicle. The vacuum is coupled via a suction tube to the harvesting needle to provide suction to harvest the hair follicle.
• FIG. 18 depicts a general sequence of actions for implanting hair follicles using a system according to embodiments of the invention, Initially, the robot is moved so that the three part tool is aligned with the implant location and orientation. The implant needle is then advanced so that it is in front of the harvesting needle. The needle assembly or tool is advanced so that the implant needle parts the skin at the implant location. The obdurator is then advanced to push the graft into the precise depth in the parted skin. Holding the obdurator in place, the implant needle is then retracted out of the patient. The obdurator is then retrieved to its standby position.FIG. 16 is a flow diagram of a sequence of actions for accurately controlling the depth of the implant.
• Another feature of the invention relates to the automatic loading and unloading of multiple needles and multiple-needle cassettes. In the typical procedure, the patient is prone or semi-prone during the harvesting of grafts from a donor region in the back of the head and is sitting erect during implantation of grafts in a recipient region at the front hairline or top of the head. While it is possible to harvest a single foIlicular unit from the donor site and then implant it immediately in the recipient site by suitably moving the robotic arm and/or the patient, it is faster to keep the patient in the prone or near-prone position while harvesting a number of grafts (hundreds, at least), then move the patient to the upright position for implanting all those grafts. This can be accomplished using cassettes that hold a number of tools, typically in the range of fifty to one hundred. The cassettes may be in the form of revolving cylinders with multiple chambers, one for each tool, or may have a rectilinear array of chambers. The individual tools are indexed into place for use in harvesting and implanting. Multiple cassettes may be sequentially loaded onto the robotic arm (an operation that can be either manual or automated using standard robot-loading procedures) to harvest and implant large numbers of grafts without changing the patient's position; for example, ten cassettes of one hundred chambers each would be used for one thousand grafts. It is possible to have just harvesting cannulae in the cassettes, using a single implanting cannula and obdurator for a number of harvesting cannulae by appropriately indexing the cassettes during the implanting stage of the transplant procedure.
• For example, a cassette may have a plurality of chambers, and multiple cassettes can be provided in the robotic arm. While a circular cylindrical cylinder with a sharp cutting edge (which may be serrated to facilitate cutting) is an obvious configuration because of its similarity to dermatological biopsy punches, other shapes also work. For example, a semi-circular cylinder (as shown inFIG. 12) is an effective rotational cutter. If it is close to 360 degrees, it can capture the graft for extraction. If it is significantly less than 360 degrees, an additional cannula (which may be the implanting cannula) will be advanced to capture the graft. Similarly, an array of pins can be used for rotational cutting. Furthermore, shapes other than circular or semi-circular can be used for quick-thrust cutting.
• In accordance with another aspect of the inventions disclosed herein, therobotic system25 may be employed to perform procedures that involve the patterned removal of tissue. In particular, persons seek a “face lift” procedure because their skin has lost its elasticity and texture, and has stretched out. The surgeon's objective in performing a face lift is to restore texture and consistency, and to remove excess tissue. An undesirable side effect is that, when the surgeon pulls the tissue to tighten it, an unnatural rearrangement of anatomical features can result. For example, one well known technique is for the surgeon to remove an entire section of scalp, and pull the remaining scalp together to tighten the tissue. As an alternative to such wholesale tissue removal, it may be desirable to perform multiple (e.g., hundreds, even thousands) of “punch-biopsy” type micro-tissue removals in a predetermined pattern across a patient's scalp using an appropriately sized coring needle, and depend on the skin's natural ability to heal the micro-incisions, as it does following a hair transplantation procedure. An appropriate end-effecter needle would be used similar to the one used for harvesting hair follicles, but with a smaller coring diameter. Rather than targeting hair follicles, the same image processing techniques described above can be used to avoid harm to existing hair follicles, while removing bits of tissue throughout a targeted region of the scalp. By employing a relatively small needle, the wound healing process can occur without a resulting scar from an incision, and without the unnatural realignment of anatomical features. Use of the robotically controlled system for needle location, alignment and depth control allows for such a procedure within a relatively reasonable amount of time, and without the necessary complications and risks due to physician fatigue caused by repetitive manual tissue punches.
• In accordance with yet another aspect of the inventions disclosed herein, the above-described image processing techniques and embodiments may be employed for diagnostic procedures with or without the robotic system. For example, therobotic arm27 may be used to maneuver one ormore cameras28 fixed to the distal tool plate, but without any further end-effecter assembly. In the alternative, the one or more cameras may be mounted to a non robotic assembly, whether positionable or rigid, and whether stationary or movable. Or the one or more cameras may be hand held. By way of non-limiting examples, such procedures may include: (i) examination of a patient's skin surface, or below the skin surface; (ii) detection and/or monitoring and/or tracking changes in skin conditions over time; and (iii) for image data acquisition for supporting medical therapies such as the use of lasers, drug delivery devices, etc. Image data acquired by the imaging system can be stored as part of a patient's medical history. Also, image data acquired by the imaging system can be stored, later processed, and/or enhanced for use in a telemedicine system.
• FIG. 19 illustrates a distal portion of therobotics system25 in accordance with some embodiments. Therobotics system25 includes aforce sensor100 secured to anarm104, aplate102 mounted to theforce sensor100, and apositioning assembly106 secured to theplate102. Alternatively, theplate102 could be secured directly to thearm104, in which cases, theforce sensor100 may be secured between thepositioning assembly106 and theplate102. In further embodiments, theforce sensor100 may be located within thepositioning assembly106.
• Theforce sensor100 is configured to sense three forces Fx, Fy, Fz in three different orthorgonal directions X, Y, Z, and three onhorgonal moments Mx, My, Mz. In other embodiments, theforce sensor100 may be configured to sense one or two of the forces Fx, Fy, Fz, and/or one or two of the moments Mx, My, Mz. As shown in the figure, theforce sensor100 is coupled to acomputer120, which receives data from theforce sensor100 representing the sensed force(s) and/or moment(s). In other embodiments, the force sensor data may go directly to the robot.
• In the illustrated embodiments, thepositioning assembly106 includes a holdingunit109 for engagement with aneedle assembly110, and a plurality for positioners107a-107c. The holdingunit109 is configured to engage with different parts of theneedle assembly110 so that theneedle assembly110, as a whole, can be positioned by thepositioning assembly106. The holdingunit109 also allows different components of theneedle assembly110 to be controlled after theneedle assembly110 is engaged with the holdingunit109. The positioners107a-107care configured for moving different components of theneedle assembly110 after it has been engaged with the holding unit. Although three positioners107a-107care shown, in other embodiments, thepositioning assembly106 may include more or less than three positioners107. In some embodiments, thepositioning assembly106 includes the device ofFIG. 11, which includes three motors (positioners) for moving different components of theneedle assembly110.
• FIG. 20 illustrates the holdingunit109 in accordance with some embodiments. The holdingunit109 includes afirst engagement portion122 for engaging a first portion of theneedle assembly110, asecond engagement portion124 for engaging a second portion of theneedle assembly110, and athird engagement portion126 for engaging a third portion of theneedle assembly110.
• FIG. 21A illustrates theneedle assembly110 in accordance with some embodiments. Theneedle assembly110 has a similar configuration as that shown inFIG. 10. Theneedle assembly110 includes acoring needle200, apuncture needle202, and a plunger (obdurator)204. Thecoring needle200 has aproximal end212, adistal end214, abody215 extending between the proximal anddistal ends212,214, and alumen217 defined at least partially by thebody215. In the illustrated embodiments, thelumen217 has a cross sectional dimension that is between 0.5 millimeter and 1.5 millimeters, and more preferably, approximately 1 millimeter. Theneedle assembly110 further includes ashaft216 having aproximal end218, adistal end220, and alumen222 extending between the proximal anddistal ends218,220. Theproximal end212 of thecoring needle200 is secured to thedistal end220 of theshaft216. Thepuncture needle202 has aproximal end232, adistal end234, abody230 extending between the proximal anddistal ends232,234, and alumen236 within thebody230. Thelumen236 has a cross sectional dimension sized for accommodating at least a portion of thecoring needle200, and for allowing thecoring needle200 to slide relative to thepuncture needle202. Thedistal end234 of thepuncture needle202 has asharp tip250 for piercing tissue.
• In the illustrated embodiments, thedistal end214 of thecoring needle200 has a tubular configuration (FIG. 21B). In such cases, theedge252 of thecoring needle200 may have a sharp configuration for allowing thecoring needle200 to penetrate tissue. In other embodiments, thedistal end214 of thecoring needle200 may have an arc configuration (FIG. 21C). In such cases, theends254 of the arc portion may have a sharp configuration for allowing thecoring needle200 to cut tissue as thecoring needle200 is rotated about its axis. In further embodiments, thedistal end214 of thecoring needle200 can include a plurality of cuttingportions256, with each cuttingportion256 having asharp edge258 for cutting tissue (FIG. 21D). It should be noted that thedistal end214 of thecoring needle200 is not limited to the examples described previously, and that thedistal end214 can have other configurations in other embodiments, as long as it can core tissue.
• Theneedle assembly110 further includes afirst engagement portion238 and asecond engagement portion240. Thefirst engagement portion238 has a tubular configuration, and is secured to theshaft216. The second engagement portion also has a tubular configuration, and is secured to theproximal end232 of thepuncture needle202,proximal end232 of thepuncture needle202. The first and thesecond engagement portions238,240 are sized and shaped to engage with corresponding components of the holdingunit109. It should be noted that the first andsecond engagement portions238,240 are not limited to the example of the configuration illustrated, and that theengagement portions238,240 can have other configurations in other embodiments. For example, in alternative embodiments, theengagement portion238 does not have a tubular configuration. In such cases, theengagement portion238 can be a structure that is secured to, or extends from, a surface of theshaft216. Similarly, in other embodiments, theengagement portion240 can be a structure that is secured to, or extends from, a surface of thepuncture needle202, and needs not have a tubular configuration. As shown in the figure, theneedle assembly110 also includes aconnector248 secured to theshaft216. Theconnector248 has a shape that resembles a sphere, but may have other shapes in other embodiments.
• Theplunger204 has aproximal end242 and adistal end244. Theplunger204 is at least partially located within thelumen217 of thecoring needle200, and is slidable relative to thecoring needle200. Theneedle assembly110 further includes aspring246 coupled to theplunger204 for biasing theplunger204 in a proximal direction relative to thecoring needle200. In the illustrated embodiments, theplunger204 is described as a component of theneedle assembly110. In other embodiments, theplunger204 is not a part of theneedle assembly110. For example, theplunger204 may be a component of thepositioning assembly106.
• FIG. 22 illustrates theneedle assembly110 that has been engaged with thepositioning assembly106. When theneedle assembly110 is snapped onto thepositioning assembly106, thefirst engagement portion122 of the holdingunit109 is engaged with theconnector248, thesecond engagement portion124 is engaged with thefirst engagement portion238 of theneedle assembly110, and thethird engagement portion126 is engaged with thesecond engagement portion240 of the needle assembly. Theconnector248 allows theneedle assembly110 to be detachably secured to thepositioning assembly106. Thefirst engagement portion122 of the holdingunit109 is coupled to thefirst positioner107a. In some embodiments, thecoring needle200 is not translatable. In alternative embodiments, thefirst positioner107ais configured to translate (e.g., advance or retract) thecoring needle200. Thesecond engagement portion124 of the holdingunit109 is coupled to thesecond positioner107b, which is configured to rotate thecoring needle200 about its axis. Thethird engagement portion126 of the holdingunit109 is coupled to thethird positioner107c, which is configured to translate (e.g., advance or retract) thepuncture needle202. In other embodiments, thesecond engagement portion124 of the holdingunit109 may be coupled to both thefirst positioner107aand thesecond positioner107b. In such cases, thefirst positioner107ais configured to translate theengagement portion124 to thereby advance or retract thecoring needle200, and thesecond positioner107bis configured to rotate theengagement portion124 to thereby turn thecoring needle200 about its axis. In further embodiments, thesecond positioner107bis not needed, and theneedle assembly110 does not include theengagement portion238. In such cases, thepositioning assembly106 is not configured to rotate thecoring needle200, but to advance and retract thecoring needle200 in a back and forth trusting motion. In still further embodiments, thethird positioner107cis not needed, and thethird engagement portion126 is fixedly secured to the holdingunit109. In such cases, thepuncture needle202 may be positioned by therobotic arm27, and thecoring needle200 may be positioned relative to thepuncture needle202 using thefirst positioner107a.
• When using theneedle assembly110 to harvest a follicular unit, theneedle assembly110 is first coupled to thepositioning assembly106. Such may be accomplished manually by snapping theneedle assembly110 onto thepositioning assembly106. Alternatively, theneedle assembly110 may be held upright by a stand (not shown). In such cases, therobotic arm27 may be used to move thepositioning assembly106 to “grab” theneedle assembly110 from the stand. The camera(s)28 may be used to provide information regarding a position of theneedle assembly110 to theprocessor120, which controls therobotic arm27 based on the information, thereby placing the positioning assembly in engagement position relative to theneedle assembly110.
• Next, a treatment plan is inputted into thecomputer120. In some embodiments, the treatment plan is a prescribed plan designed to transplant hair follicles from a first region (harvest region) to a target region (implant region). In such cases, the treatment plan may include one or more parameters, such as a number of hair follicles to be removed/implanted, location of harvest region, location of implant region, a degree of randomness associated with targeted implant locations, spacing between adjacent targeted implant locations, depth of follicle, depth of implant, patient identification, geometric profile of harvest region, geometric profile of implant region, marker location(s), and density of targeted implant locations. Various techniques may be used to input the treatment plan into thecomputer120. In the illustrated embodiments, the treatment plan may be inputted using a user interface that includes amonitor122 and akeyboard124. Alternatively, the treatment plan may be inputted using a storage device, such as a diskette or a compact disk. In other embodiments, the treatment plan may be downloaded from a remote server. In further embodiments, the treatment plan may be inputted using a combination of the above techniques. For example, some parameters may be inputted into thecomputer120 using a diskette, while other parameters may be inputted using the user interface. In some embodiments, one or more parameters of the treatment plan may be determined in real time (e.g., during a treatment session).
• After the treatment plan has been inputted into thecomputer120, thecomputer120 then registers the treatment plan with a patient. In some embodiments, such may be accomplished by using the camera(s)28 to identify one or more markers on the patient. The marker may be a reflector that is secured to the patient an ink mark drawn on the patient, or an anatomy of the patient. The identified marker(s) may be used to determine a position and/or orientation of a target region on the patient.
• In the illustrated embodiments, the treatment plan includes a position of the harvest region. Using input from the camera(s)28, thecomputer120 identifies the location of the harvest region on the patient, and a target follicular unit in the harvest region. Thecomputer120 then operates therobotic arm27 to place thedistal end214 of thecoring needle200 next to the target follicular unit. In some embodiments, thecoring needle200 is positioned coaxial to the target follicular unit. Next, thecoring needle200 is used to harvest the target follicular unit302 (FIG. 23). In some embodiments, such may be accomplished by activating a positioner within thepositioning assembly106 to rotate thecoring needle200. As thecoring needle200 is rotated, thecoring needle200 may be advanced distally (e.g., by activating another positioner within thepositioning assembly106, or by moving thepositioning assembly106 using the robotic arm27). In other embodiments, the harvesting of thetarget follicle302 unit may be accomplished by thrusting thecoring needle200 forward and backward. While thecoring needle200 is used to core out thefollicular unit302, thepuncture needle202 is located proximally away from thedistal end214 of thecoring needle200 to thereby prevent interference with the coring procedure. Such may be accomplished by advancing thecoring needle200 distally relative to thepuncture needle202, or alternatively, by retracting thepuncture needle202 proximally relative to the coring needle200 (if thepuncture needle202 can be positioned).
• When thedistal end214 of thecoring needle200 has been advanced within aprescribed depth300, e.g. 5 millimeter, below a skin surface306 (FIG. 23), thecoring needle200 is then retracted proximally to remove thecoring needle200 from the patient. In the illustrated embodiments, the camera(s)28 may be used to monitor the coring process to thereby determine an amount ofcoring needle200 that has been advanced below theskin surface306. In some embodiments, the exterior of thecoring needle200 may include marker lines to thereby allow the camera(s)28 or a physician to “see” how much of thecoring needle200 has been advanced into the patient. In some embodiments, surface friction at the interface between thefollicular unit302 and theinterior surface304 within thelumen217 will hold thefollicular unit302 as thecoring needle200 is removed from the patient, thereby harvesting thefollicular unit302. In other embodiments, theinterior surface304 can be texturized (e.g., having one or more indents or protrusions) to thereby allow thedistal end214 to more easily hold onto thefollicular unit302 as thecoring needle200 is removed from the patient. In further embodiments, a proximal end of theneedle assembly110 may be coupled to a vacuum unit (not shown) located within thepositioning assembly106. In such cases, the vacuum unit creates a suction within thelumen217 of thecoring needle200, to thereby pull the targetfollicular unit302 away from its underlying tissue as thecoring needle200 is removed from the patient.
• After thefollicular unit302 has been harvested, thepositioning assembly106 then retracts thecoring needle200 proximally until thedistal end214 is proximal to thedistal end234 of thepuncture needle202. Alternatively, if thepuncture needle202 is positionable, thepuncture needle202 may be advanced distally until thedistal end234 is distal to thedistal end214 of thecoring needle200. Next, thecomputer120 operates therobotic arm27 to place thedistal end234 of thepuncture needle202 adjacent to a target location within an implant region of the patient as prescribed by the treatment plan. Thepuncture needle202 is then advanced (e.g., by activating a positioner within thepositioning assembly106, or by moving thepositioning assembly106 distally towards the target location) to pierce through theskin310 at the implant region (FIG. 24A). Thepuncture needle202 is advanced until the penetrateddepth312 is at least equal to thecoring depth300. In some embodiments, the camera(s)28 and thecomputer120 may be used to determine an amount of thepuncture needle202 that has been advanced into the patient. For example, thepuncture needle202 may include a plurality of marker lines for allowing the camera(s)28 or a physician to “see” how much of thepuncture needle202 has been inserted into the patient. As shown in the figure, thepuncture needle202 creates anopening314 below the patient'sskin314, in which thefollicular unit302 may be placed.
• Next, thecoring needle200, which contains the harvestedfollicular unit302, is advanced within thelumen236 of thepuncture needle202, until a top surface320 of thefollicular unit302 is at or below theskin310 at the implant region (FIG. 24B).
• Next, theplunger204 may be advanced distally (e.g., by using another positioner within the positioning assembly106) until itsdistal end244 engages with thefollicular unit302 located within the coring needle200 (FIG. 24C). Thepuncture needle202 and thecoring needle200 are then retracted proximally relative to theplunger204, thereby leaving thefollicular unit302 implanted at the target location in the implant region (FIG. 24D). In other embodiments, theneedle assembly110 does not include theplunger204. In such cases, a pressure generator (not shown) located within thepositioning assembly106 may be used to create a pressure within thelumen217 of thecoring needle200, thereby pushing thefollicular unit302 towards the patient as thepuncture needle202 and thecoring needle200 is retracted. Such technique will cause thefollicular unit302 to dislodge from thecoring needle200 while thecoring needle200 is being removed from the patient.
• After the firstfollicular unit302 has been implanted in the implant region, thecoring needle200 is advanced distally until itsdistal end214 is distal to thedistal end234 of thepuncture needle202. Thecomputer120 then operates therobotic arm27 again to place thecoring needle200 next to another targetfollicular unit302 to be harvested. The above described process is then repeated to harvest the nextfollicular unit302, and to implant thefollicular unit302. The selection of thefollicular unit302 may be determined by thecomputer120. For example, in some embodiments, based on a location and geometry of the prescribed harvest region, thecomputer120 selects afollicular unit302 only if it is within the prescribed harvest region. In some embodiments, the above process is repeated until a prescribed number offollicular units302 have been implanted in the implant region, until a density of the implantedfollicle units302 reaches a prescribed density, or until there is no more availablefollicular unit302 in the harvest region.
• During the above harvesting and implanting process, theforce sensor100 monitors one or more force/moment component transmitted from thepositioning assembly106. For example, theforce sensor100 may monitor a force Fz, which has a directional vector that is approximately parallel to an axis of thecoring needle200. The sensed force Fz is transmitted to thecomputer120, which determines whether a magnitude of the sensed force Fz is within an acceptable limit. In some embodiments, thecomputer120 is configured (e.g., programmed) to stop a harvest process or an implant process if the sensed force Fz exceeds a prescribed limit, which may indicate that thecoring needle200 or thepuncture needle202 is pressing against the skull, for example. As such, theforce sensor100 provides a safety feature that prevents thecoring needle200 and thepuncture needle202 from injuring a patient in an unintended way.
• In other embodiments, instead of, or in addition to, using theforce sensor100 as a safety feature, theforce sensor100 may also be used to control a positioning of thecoring needle200 and/or thepuncture needle202. As thecoring needle200 is being advanced through the skin and into tissue underneath the skin, thecoring needle200 experiences a force Fz, which represents a resistance encountered by thecoring needle200.FIG. 25 illustrates a force diagram that represents a force resistance Fz sensed by thecoring needle200 as the coring needle is advanced through the skin and into tissue. Such force Fz is transmitted by the various components within thepositioning assembly106 to theforce sensor100, which measures such force Fz and transmits the force data to thecomputer120. Because the skin surface is relatively tough, initially, as thecoring needle200 pushes against skin, it will not immediately penetrates the skin, and will experience a force resistance Fz provided by the skin surface. The force resistance Fz increases from zero to a value Fp, at which point, thecoring needle200 penetrates through the skin. Because the tissue underneath the skin is relatively softer than the skin, the force resistance Fz experienced by thecoring needle200 will be less than Fp after thecoring needle200 penetrates the skin. As shown inFIG. 25, after the value Fp is reached, the force curve falls back to a second value Fs, which represents the force resistance sensed by thecoring needle200 after it has penetrated the skin surface. The force Fz will continue to increase from that point as thecoring needle200 continues to be advanced into the tissue. This is because as more portion of thecoring needle200 is advanced into the tissue thecoring needle200 will contact more tissue that is underneath the skin, thereby increasing an amount of surface friction between thecoring needle200 and the tissue. In some cases, if thecoring needle200 hits a bone, the force diagram will result in a spike (shown in dotted line in the figure).
• Thecomputer120 may be programmed to monitor the force curve being generated as thecoring needle200 is being advanced during the harvest process, and controls thecoring needle200 based on the force curve. For example, in some embodiments, thecomputer120 activates a positioner in thepositioning assembly106 to advance thecoring needle200 at a first rate until a dip in the force curve is observed, indicating that thecoring needle200 has penetrated the skin. After that, thecomputer120 then activates the positioner to advance thecoring needle200 at a second rate until a desired penetration depth is accomplished. In some embodiments, the first rate may be faster than the second rate.
• In the above embodiments, thesame coring needle200 is used to harvest and implant multiplefollicular units302. In other embodiments, multiple coring needles may be provided, wherein each of the coring needles may be used to harvest and implant one or morefollicular units302.FIG. 26 illustrates aneedle cartridge400 in accordance with some embodiments. Thecartridge400 has a plurality of slots oropenings402, each of which sized to accommodate acoring needle404. Each of the coring needles404 has aproximal end406, adistal end408, and alumen410 extending between the proximal and the distal ends406,408. Thecoring needle404 has a similar configuration as thecoring needle200 described with reference toFIG. 21A. Theslots402 are located circumferentially near a periphery of thecartridge400. Alternatively, theslots402 may be arranged in a different configuration. For example, in other embodiments, theslots402 may be arranged in a form of a matrix having N number of rows by M number of columns. In the illustrated embodiments, thecartridge400 further has a bottom420, which may be adapted or placement on a surface (e.g., thesurface36 shown inFIG. 1). Thecartridge400 also includes anengagement portion422 configured (e.g., sized and shaped) for detachably securing to a component of thepositioning assembly106. Theengagement portion422 may be a slot/opening, a surface having a protrusion, or a connector device.
• FIG. 27 illustrates apuncture needle holder450 for holding apuncture needle assembly453 in accordance with some embodiments. Thepuncture needle holder450 may be used with thecartridge400. Thepuncture needle holder450 includes abody451 having anopening452 for accommodating thepuncture needle assembly453. Thepuncture needle assembly453 may be fixedly secured to thepuncture needle holder450, or alternatively, be slidably coupled to thepuncture needle holder450. Thepuncture needle assembly453 includes apuncture needle454 having aproximal end456, adistal end458, and alumen460 extending between the proximal anddistal ends456,458. Thepuncture needle assembly453 also includes an engagement portion462 secured to theproximal end456 of thepuncture needle454. Thepuncture needle454 has a similar configuration as thepuncture needle202 described with reference toFIG. 21A. As shown inFIG. 27, astand470 may be provided to support thepuncture needle holder450.
• FIG. 28 illustrates apositioning assembly106 in accordance with other embodiments. Thepositioning assembly106 includes acartridge holer500, apositioner502 for positioning thecartridge holder500, acoring needle holder504, and apositioner506 for positioning thecoring needle holder504. In other embodiments, thepositioning assembly106 does not include thepositioner502, in which case, thecartridge holder500 does not move relative to thepositioning assembly106 after thecartridge holder500 is detachably coupled to thecartridge holder500.
• FIGS. 29A-29D illustrate a method of using thepositioning assembly106 ofFIG. 28, thecartridge400 ofFIG. 26, and thepuncture needle holder250 ofFIG. 27 to harvest and implant a follicular unit in accordance with some embodiments. First, thecartridge400, with a plurality of coringneedles404 loaded therein, is placed on thesupport surface36 next to thepositioning assembly106. The camera(s)28 is then used to view thecartridge400 and transmit image data to thecomputer120 for processing. Thecomputer120 processes the image data to determine a position of the cartridge40O, and activates therobotic arm27 to pick up thecartridge400 based on the processing of the image data (FIG. 29A). In some embodiments, thecomputer120 is configured to recognize a feature associated with thecartridge400. For example, thecartridge400 may have a marker attached thereto, in which case, thecomputer120 is configured to determine the marker location. Various techniques may be employed to allow therobotic arm27 to pick up thecartridge400. In the illustrated embodiments, thecartridge holder500 of theholder assembly106 is shaped and sized to detachably mate with theengagement portion422 of thecartridge400. For example, if theengagement portion422 comprises a slot, thecartridge holder500 may be implemented as a snap-on extension that is configured to be inserted into the slot. In other embodiments, thecartridge holder500 may include an electromagnetic device that generates a magnetic field using a current. In such cases, theengagement portion422 of thecartridge400 includes a magnet that can be coupled to thecartridge holder500.
• Next, thepositioner506 is activated to move thecoring needle holder504 so that thecoring needle holder504 engages with one of the coring needles404. Thecoring needle holder504 picks up thecoring needle404, and is moved to an operative position in thepositioning assembly106 at which thecoring needle404 may be positioned (e.g., rotated and/or advanced) for coring a follicular unit (FIG. 29B). Therobotic arm27 is then activated to movepositioning assembly106 such that thecoring needle404 at the operative position is adjacent to a target follicular unit, and thecoring needle404 is used to core the target follicular unit (e.g., by rotating thecoring needle404 using a motor (not shown), or by advancing and retracting thecoring needle404 in a thrusting action). The technique for coring the follicular unit is similar to that discussed previously. After a first follicular unit has been cored, thepositioner506 is activated to move thecoring needle holder504 to place thecoring needle404 back to theslot402 of thecartridge400. Thepositioner506 then moves thecoring needle holder504 to pick up anotherempty coring needle404 from anotherslot402, and the process is repeated until all of the coring needles404 have been used to harvest respective follicular units, or until a desired number of follicular units have been obtained.
• In some embodiments, if thecartridge holder500 is rotatable about its axis, thecartridge holder500 may be rotated to place acoring needle404 at a location from which thecoring needle holder504 may pick up and place back thecoring needle404.
• When a desired number of follicular units have been obtained, therobotic arm27 is positioned to pick up the puncture needle holder450 (FIG. 29C). In the illustrated embodiments, thepuncture needle holder450 is supported on thestand470, which is placed on thesupport surface36. Similar technique for picking up thecartridge400 may be employed to pick up thepuncture needle holder450. For example, the camera(s)28 and thecomputer120 may be used to determine a position of thepuncture needle holder450, and thepuncture needle holder450 may be have an engagement portion (not shown) configured for detachably coupled to a component (not shown) of thepositioning assembly106.
• After thepuncture needle holder450 has been picked up by thepositioning assembly106, therobotic arm27 is activated to move thepositioning assembly106 such that thecoring needle454 is adjacent to a target implant location. Thepositioner506 then moves thecoring needle holder504 to pick up one of the coring needles404 (which contains a harvested follicular unit), and moves thecoring needle404 such that it is at least partially within thelumen460 of the puncture needle454 (FIG. 29D). Thecoring needle404 and thepuncture needle454 are then used to implant the follicular unit in thecoring needle404 using similar technique as that described previously. After the follicular unit has been implanted, thepositioner506 moves thecoring needle holder504 to place theempty coring needle404 back to thecartridge400, and thecoring needle holder504 picks up anothercoring needle404 that has a harvested follicular unit. The above process is repeated to implant one or more additional follicular unit(s) at the implant region.
• When all of the follicular units in the loaded coring needles404 have been implanted in the implant region, if additional implanting is desired, thepositioning assembly106 places thepuncture needle holder450 back to its original location (e.g., on the stand470), and decouples thepuncture needle holder450 from thepositioning assembly106. Thecartridge400 and the coring needles404 are then used again to harvest additional follicular unit(s) from the harvest region, using the same process as that described.
• FIG. 30 illustrates askin tensioner500 that may be used with embodiments described herein. Theskin tensioner500 includes ashaft501, ahorizontal support502, and twoside tines503. Eachtine503 includes adistal portion504 for pressing against a skin surface, Theproximal end506 of theshaft501 is configured (e.g., sized and shaped) to engage with an end-effector of the robotic hair transplant system. Thehorizontal support502 includes a spring-loaded mechanism (not shown) that exerts a force along the x-axis, thereby causing thetines503 to spread apart from each other. During use, thedistal portions504 of thetines503 are positioned next to a follicular unit, with the follicular unit being between the twodistal portions504. The spring-loaded mechanism then spreads thetines503 apart to thereby tension the skin. As a result the hair shaft associated with the follicular unit may stand more erect relative to the scalp surface. In some cases, the skin tension may also serve to temporarily occlude vessels (e.g., capillaries) surrounding the follicular unit, thereby reducing bleeding during the harvesting of the follicular unit. The puncture needle and coring needle described herein would act between thedistal portions504 of thetines503.
• In embodiments of the invention, the attending physician or operator can specify where a follicular unit needs to be implanted and at what angle, i.e., its relative location (or “implantation site”), orientation, and depth. This specification of the location, orientation and/or depth of a hair follicle to be implanted may be carried out by a treatment planning system. Alternatively, during the implanting mode, when the camera(s) are viewing the recipient area of the scalp, the attending operator may use a user interface (e.g., a conventional computer mouse) to specify the implant location and/or position and/or orientation and/or implant depth. Alternatively, the operator can point to location on the scalp by placing a temporary fiducial, such as an ink mark or a pointer that can be visualized, identified, and measured by the image processing system. Further, orientation can be specified directly on the computer monitor as a combination of two angles, such as rotation about x-axis and a rotation about y-axis (assuming that z-axis is along the needle), or by placing an elongated pointer on the scalp, which the image processing system can visualize and measure the angles.
• In any case, the control of the robotic arm now becomes two steps. First, based on the specification of the location and orientation of the implant location, the computer processor directs the robot to move the implant needle to the desired location and orientation. Second, the actual implantation takes place, either solely by actuating the mechanism, or by a combination of robotic movement and/or mechanism actuation, in which the desired implant depth is achieved. Another way of specifying the orientation of the implanted follicular unit is to have the system match to the orientation of the existing hairs in the area of the implant. The system, after moving the implantation needle to the implant location, visualizes and measures the orientation of the hair follicles in the neighborhood of the implant location, and uses that orientation as the specification for the implant. In the case of neighboring hairs having different orientations, the system may, for example, obtain a weighted average of the various orientations for implanting the follicular unit.
• FIG. 31 illustrates animplant needle550 in accordance with yet another embodiment, and which also may be used with other embodiments described herein. Theimplant needle550 is configured to harvest and divide a follicular unit into a plurality of follicular sections (i.e., slices). It is believed that each of the follicular sections obtained from the single follicular unit using theneedle500 has the ability to regenerate into a new follicular unit when replanted in the patient's scalp, so long as the respective follicular section contains a sufficient quantity of follicular epithelial stem cells and the structural matrix of the collagenous sheath. For more information, reference is made to Jung-Chul Kim and Yung-Chul Choi, “Hair Survival of Partial Follicles: Implications for Pluripotent Stem Cells and Melanocyte Reservoir,” which is published as Chapter 9C in the textbook “Hair Transplantion, Fourth Edition, Revised and Exped by Walter P. Unger and Ronald Shapiro (Marcel Dekker, Inc. 2004) and which is fully incorporated herein by reference.
• Theimplant needle550 includes alumen554 and three slots552a-552ctransverse to an axis of theimplant needle550. The proximal end (not shown) of theimplant needle550 may be coupled to a needle assembly or a positioner, as described herein. During use, theimplant needle550 is used to core and harvest a follicular unit560 (FIG. 32A). After thefollicular unit560 has been harvested, cutting elements564a-564care then inserted into respective slots552a-552c, thereby cutting thefollicular unit560 into a plurality of sections562a-562d(FIG. 32B). Notably, slots552a-552dare located so that the cuts are made at mid-section of the follicular unit, where the follicular epithelial stem cells are concentrated. Each cutting element564a-cmay be a plate having a sharp edge, or may have another configuration. In the illustrated embodiments, each cutting element564a-cmay include achannel566 for delivering a fluid (e.g., culture nutrient) between the follicular sections562.
• After the follicular sections562 have been created the cutting elements564 are then retracted. As the cutting elements564 are being retracted, fluid containing culture nutrient may be delivered throughchannels566 of respective cutting elements564. After the cutting elements564 have been completely removed from thelumen554 of theimplant needle550, atube570 may be placed around theimplant needle550 to thereby prevent the fluid between the follicular sections562 from escaping through the slots552 (FIG. 32C). In some embodiments, the fluid may be a quick setting material, such as paraffin or a gel, which acts to encapsulate (i.e., protect) and stabilize the follicular sections, and helps ensure they are implanted in the scalp in the same orientation as in the donor follicle.
• In some embodiments, the insertion of the cutting elements564 into thelumen554 may be performed simultaneously. In other embodiments, thebottom-most cutting element564cmay be inserted first, thereby pushing the remainingfollicular unit560 upward. Then the nextbottom-most cutting element564bis inserted, thereby pushing the remainingfollicular unit560 upward. Thelast cutting element564ais then inserted. In other embodiments, instead of having three slots552a-552c, theimplant needle550 may have more or less then three slots552. In such cases, the number of cutting elements564 would correspond with the number of slots552 on the implant needle.
• In some embodiments, a plunger (e.g., plunger204) may be used to implant the follicular sections562 at different target locations. For example, theplunger204 may be advanced to push the follicular sections562a-562ddistally until the distal mostfollicular section562dis outside thelumen554 of theimplant needle550. Theimplant needle550 is then moved to a different target location, and theplunger204 is further advanced to push the nextfollicular section562cout of thelumen554. The process is repeated until all of the follicular sections562a-562dhave been implanted. In other embodiments, the distal mostfollicular section562d(the follicular base) is discarded and is not used. In further embodiments, the proximal mostfollicular section562a(the follicular top) is discarded and is not used.
• The forgoing illustrated and described embodiments of the invention are susceptible to various modifications and alternative forms, and it should be understood that the invention generally, as well as the specific embodiments described herein, are not limited to the particular forms or methods disclosed, but to the contrary cover all modifications, equivalents and alternatives falling within the scope of the appended claims. By way of non-limiting example, it will be appreciated by those skilled in the art that the invention is not limited to the use of a robotic system, including a robotic arm, and that other automated and semi-automated systems that have a moveable arm assembly may be used for carrying and precisely positioning the respective camera(s) and harvesting/implanting needle assemblies adjacent the body surface.

Claims (26)

1. A method for harvesting follicular units from a body surface, comprising:

acquiring images of a body surface;

processing the acquired images to identify a follicular unit on the body surface and to determine a relative position and orientation of the identified follicular unit;

using an automated system including a moveable arm to position a harvesting tool mounted on the moveable arm adjacent the identified follicular unit, based at least in part on processed image data, such that a longitudinal axis of the harvesting tool is aligned with a longitudinal axis of the follicular unit; and

harvesting the follicular unit by movement of the harvesting tool relative to the body surface,

wherein the images are acquired from one or more cameras mounted on the moveable arm.

2. The method ofclaim 1, wherein the automated system is a robotic system, and the moveable arm is a robotic arm.

3. The method ofclaim 2, wherein the images are acquired from a single camera mounted to the robotic arm, and further comprising registering a reference coordinate system of the camera with a tool frame reference coordinate system of the robotic arm.

4. The method ofclaim 3, wherein the camera reference coordinate system is registered with the robotic arm tool frame reference coordinate system based on images of a fixed calibration target acquired as the robotic arm is moved along one or more axes of the robotic arm tool frame reference coordinate system.

5. The method ofclaim 2, wherein the images are acquired from a pair of cameras mounted to the robotic arm, and further comprising registering respective reference coordinate systems of the cameras with each other and with a tool frame reference coordinate system of the robotic arm.

6. The method ofclaim 5, wherein the camera reference coordinate systems are registered with the robotic arm tool frame reference coordinate system based on images of a fixed calibration target acquired as the robotic arm is moved along one or more axes of the robotic arm tool frame reference coordinate system.

7. The method ofclaim 2, wherein the images are acquired using respective first and second pairs of cameras mounted to the robotic arm, the first pair focused to acquire image data of a first field of view, and the second pair focused to acquire image data of a second field of view substantially narrower than the first field of view.

8. The method ofclaim 7, further comprising registering respective reference coordinate systems of the first and second pairs of cameras with each other and with a tool frame reference coordinate system of the robotic arm.

9. The method ofclaim 8, wherein the camera reference coordinate systems are registered with the robotic arm tool frame reference coordinate system based on images of a fixed calibration target acquired as the robotic arm is moved along one or more axes of the robotic arm tool frame reference coordinate system.

10. The method ofclaim 2, wherein the harvesting tool is positioned by visual servoing of the robotic arm.

11. The method ofclaim 1, farther comprising identifying the approximate physical boundaries of the identified follicular unit, including identifying a subcutaneous base region embedded in the body surface and a distal tip region extending away from the body surface.

12. The method ofclaim 1, wherein the images include subcutaneous images.

13. A method for harvesting follicular units from a body surface, comprising:

acquiring images of a body surfaces;

processing the acquired images to identify a follicular unit on the body surface and to determine a relative position and orientation of the identified follicular unit;

using an automated system including a moveable arm to position a harvesting tool mounted on the moveable arm adjacent the identified follicular unit, based at least in part on the processed images, such that a longitudinal axis of the harvesting tool is aligned with a longitudinal axis of the follicular unit; and

harvesting the follicular unit by movement of the harvesting tool relative to the body surface,

wherein the images are acquired using a pair of cameras, and further comprising registering respective reference coordinate systems of the cameras with each other.

14. The method ofclaim 13, wherein the automated system is a robotic system, and the moveable arm is a robotic arm.

15. The method ofclaim 14, further comprising registering the respective camera reference coordinate systems with a tool frame reference coordinate system of the robotic arm.

16. The method ofclaim 15, wherein the respective camera reference coordinate systems are registered with the robotics arm tool frame reference coordinate system based on images of a fixed calibration target acquired as the robotic arm is moved along one or more axes of the robotic arm tool frame reference coordinate system.

17. The method ofclaim 13, wherein identifying a relative position and orientation of an identified follicular unit comprises identifying its approximate physical boundaries, including identifying a subcutaneous base region embedded in the body surface and a distal tip region extending away from the body surface.

18. The method ofclaim 13, wherein the images include subcutaneous images.

19. The method ofclaim 14, wherein the harvesting tool is positioned by visual servoing of the robotic arm.

20. A method for harvesting follicular units from a body surface, comprising:

acquiring images of a body surface;

processing the acquired images to identify a follicular unit on the body surface and to determine a relative position and orientation of the identified follicular unit;

using an automated system including a moveable arm to position a harvesting tool mounted on the moveable arm adjacent the identified follicular unit, based at least in part on the processed images, such that a longitudinal axis of the harvesting tool is aligned with a longitudinal axis of the follicular unit; and

harvesting the follicular unit by movement of the harvesting tool relative to the body surface,

wherein the images are acquired using respective first and second pairs of cameras, the first pair focused to acquire images of a first field of view, and the second pair focused to acquire images of a second field of view substantially narrower than the first field of view.

21. The method ofclaim 20, further comprising registering respective reference coordinate systems of each of the first and second pairs of cameras with each other.

22. The method ofclaim 20, wherein the automated system is a robotic system, and the moveable arm is a robotic arm.

23. The method ofclaim 22, further comprising registering the respective camera reference coordinate systems with a tool frame reference coordinate system of the robotic arm.

24. The method ofclaim 20, wherein identifying a relative position and orientation of an identified follicular unit comprises identifying its approximate physical boundaries, including identifying a subcutaneous base region embedded in the body surface and a distal tip region extending away from the body surface.

25. The method ofclaim 20, wherein the images include subcutaneous images.

26. The method ofclaim 22, wherein the harvesting tool is positioned by visual servoing of the robotic arm.

Images