Movatterモバイル変換


[0]ホーム

URL:


ORGANIZATIONAL
Sign in with credentials provided by your organization.
INSTITUTIONAL
Select your institution to access the SPIE Digital Library.
SELECT YOUR INSTITUTION
PERSONAL
Sign in with your personal SPIE Account.
PERSONAL SIGN IN
No SPIE Account?Create one
;
SPIE digital library
CONFERENCE PROCEEDINGS
Advanced Search
Home> Journals> J. Biomed. Opt.> Volume 17> Issue 5>Article
Open Access
7 May 2012Simultaneous imaging of multiple focal planes for three-dimensional microscopy using ultra-high-speed adaptive optics
Author Affiliations +
Martí Duocastellahttps://orcid.org/0000-0003-4687-8233,1 Bo Sun,1 Craig B. Arnold1

1Princeton Univ. (United States)
ORGANIZATIONAL
Sign in with credentials provided by your organization.
INSTITUTIONAL
Select your institution to access the SPIE Digital Library.
PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
No SPIE Account?Create one
;
PURCHASE THIS CONTENT
SUBSCRIBE TO DIGITAL LIBRARY
50 downloads per 1-year subscription
Members: $195
Non-members: $335ADD TO CART
25 downloads per 1-year subscription
Members: $145
Non-members: $250ADD TO CART
PURCHASE SINGLE ARTICLE
Includes PDF, HTML & Video, when available
Members:
Non-members:ADD TO CART
This will count as one of your downloads.
You will have access to both the presentation and article (if available).
This content is available for download via your institution's subscription. To access this item, please sign in to your personal account.
Forgot your username?
No SPIE account?Create an account
My Library
You currently do not have any folders to save your paper to! Create a new folder below.
Abstract
Traditional white-light and fluorescent imaging techniques provide powerful methods to extract high-resolution information from two-dimensional (2-D) sections, but to retrieve information from a three-dimensional (3-D) volume they require relatively slow scanning methods that result in increased acquisition time. Using an ultra-high speed liquid lens, we circumvent this problem by simultaneously acquiring images from multiple focal planes. We demonstrate this method by imaging microparticles and cells flowing in 3-D microfluidic channels.

One of the key frontiers in modern imaging is to extract real-time three-dimensional (3-D) images from a living biological system or fast moving industrial process.1 A promising way to achieve this is to acquire information from multiple locations in a sample as quickly as possible, ideally simultaneously. Previous approaches based on this concept include spatiotemporal multiplexing in two-photon microscopy,24 remote focusing in confocal microscopy,5 or modifying the detection pathway of a conventional microscope to send information from two different depths into two separate cameras.6,7 However, requirements for mechanical scanning limit the acquisition speed in the first two classes of techniques, whereas the latter techniques lack flexibility in selecting the image plane locations due to the fixed position of the cameras and optics.

Here, we propose a novel method for simultaneously acquiring multiple and selectable focal planes without mechanically moving parts. Our approach is based on an acoustically driven liquid lens which is used to scan through different axial planes at frequencies as high as 1 MHz. Such high speed, in combination with synchronized pulsed illumination, enables one to select any desired focal plane within the lens scanning range. We use multiple light sources at different wavelengths, each distinctly synchronized with the lens to record information corresponding to different locations within the volume in a single exposure of a standard color charge-coupled device (CCD) microscope camera. Although the composite color image merges the different planes, simply by separating the color channels of the image, we can recover each individual focal plane without loss of in-plane lateral resolution. We demonstrate our method by imaging polystyrene microparticles and living cells flowing through 3-D channels from a microfluidic chip.

The unique imaging capabilities of our method are enabled by the use of a tunable acoustic gradient index (TAG) lens.8 This device consists of a fluid-filled cylindrical cavity which is radially excited with acoustic energy causing a periodic standing wave modulation in the fluid, and consequently, the index of refraction.9 As such, the lens is continuously varying its focal length and therefore, by defining a time delay between the acoustic field and the incident light any specific focal length can be selected with submicrosecond temporal resolution [Fig. 1(b)]. The feasibility of the TAG as a varifocal device has been previously demonstrated,8,10 but the high-speed focusing capabilities have never been used to simultaneously acquire multiple images from different focal planes. In this particular experiment, we drive a TAG lens made of a cylindrical piezoelectric, inner diameter of 32 mm and length of 40 mm, with a USB function generator (Syscomp, WGM-201) at a frequency of 72 kHz. We set up the TAG lens on top of the objective revolver of a transmission bright field microscope (Olympus BX 60), as ray tracing simulations show that this location is optimal for achieving the highest scanning range as well as maximizing the exit pupil. We employ two color pulsed illumination to select two focal planes for simultaneous imaging, and we acquire images using a CCD color camera (Lumenera, Infinity 1) located after the microscope tube lens [Fig. 1(a)].

Fig. 1

TAG-enabled microscope setup and characterization. (a) Schematic representation of the setup used in the experiments. (b) Temporal evolution of the TAG optical power when driven at a frequency of 72 kHz. The TAG is in a continuous state of changing focus. (c) Images of a tilted ruler acquired using pulsed light synchronized with the TAG at different delay times (α,β,γ) and the corresponding ruler profile at the bottom. Scale bar, 100 μm. (d) Scanning range of the microscope versus different objective magnifications: 5x (N.A. 0.13), 10x (N.A. 0.25), 20x (N.A. 0.40), and 50x (N.A. 0.50). The dot points correspond to the experimental values range of the microscope scales linearly with the voltage amplitude of the signal that measured, and the solid line to the predictions of a model based on geometrical optics. (e) The scanning drives the TAG lens. This is due to the linear dependence between TAG optical power and driving amplitude.8 The dot points correspond to experimental measurements and the solid lines to the predictions based on a geometrical optics model.

JBO_17_5_050505_f001.png

We first determine the scanning capabilities and resolution of the TAG-enabled transmission microscope. In this case, we use a pulsed white LED to illuminate a calibration sample which consists of a tilted ruler. Varying the time delay between light pulses and the TAG with a pulsed delay generator (Stanford Research System DG535) allows the user to select an arbitrary focal plane within the sample. This can be observed inFig. 1(c), where different parts of the ruler appear in focus at different delay times (α,β,γ) with the corresponding height profile of this sample displayed at the bottom ofFig. 1(c). In this particular experiment, the scanning range (Δz) of the TAG-enabled microscope for a10× objective (N.A. 0.25) is about 300 μm, but this range depends on the objective magnification. We modelΔz for different infinity-corrected objectives using geometrical optics and thin lens approximation. Accordingly, we consider all the elements in the microscope, including objective, TAG and tube lens, as thin lenses with a known optical powerδ and location. The thin lens equations for this system can be written as:

Eq. (1)

1/s+1/s=δobjective

Eq. (2)

1/(ds)+1/s2=±δTAG,
wheres is the distance between the object and the objective,s is the distance between the image after the object and the objective,s2 is the distance between the image after the TAG lens and the TAG lens, andd is the separation between the objective and the TAG lens. Since the camera is located at the focus of the tube lens,s2=. The microscope scanning range is then determined by the solution of the previous equations over the change in focal power of the TAG fromδTAG toδTAG:

Eq. (3)

Δz=|s(δTAG)s(δTAG)|=2ftube2δTAGM2δTAG2(Mdftube)2,
whereδobjective=M/ftube has been considered,M being the objective magnification andftube the focal length of the tube lens. This model is in good agreement with experimental results [Fig. 1(d)]. Notably,Δz can be easily controlled by its linear relationship to the amplitude of the driving signal [Fig. 1(e)]. In this way, it is possible to achieve aΔz in all cases that is superior to the objective depth of field (DOF) by more than an order of magnitude. In addition, and given the analog nature of the TAG, it is possible to continuously select between the different focal positions within that range.

The use of TAG-enabled microscopy for simultaneous imaging of multiple focal planes is presented inFig. 2 for a PDMS microfluidic chip containing polystyrene microbeads. In this case, we use a red and blue pulsed LED to illuminate the beads flowing through two microchannels located 1 mm apart from each other in thez direction [Fig. 2(b)]. A pulse delay generator drives each light-emitting diode (LED) (light pulse duration of 600 ns) synchronously with the TAG, but each with a different delay time in order to select the desired focal plane and we capture both pulses within a single exposure of a color CCD camera [Fig. 2(c)]. By separating the colors of the image from the CCD output, we recover information of the entire field of view of each individual plane. Furthermore, the separated image does not show color leakage due to the monochromacity of the LED sources. This process can be scaled up with additional illumination colors.

Fig. 2

Simultaneous imaging of multiple focal planes by a TAG-enabled microscope. (a) Scheme of the operation principle of the microscope, in which light pulses of different colors corresponding to different focal planes when synchronized with the TAG, are simultaneously acquired in a single CCD camera exposure. (b) Representation of the microfluidic device consisting of two microchannels separated by 1 mm through which polystyrene microspheres (diameter of 15 μm) flow. (c) On the left, composite color CCD image with the spheres corresponding to each microchannel merged. On the right, color separation of the image allows recovering information of the spheres in each individual microchannel without loss of in-plane lateral resolution (Video 1, MOV, 3 MB). Scale bars, 100 μm. [URL:http://dx.doi.org/10.1117/1.JBO.17.5.050505.1]

JBO_17_5_050505_f002.png

We also evaluate real-time imaging of simultaneous multiple planes with the TAG-enabled microscope. In this case, we show a video of microspheres flowing through the two channels of the microchip inFig. 2(b) at 8 frames per second (fps) (Video 1). The video shows how the microspheres move at different speeds and directions as we manually vary the flux in each individual channel. In this case, the limitation to the acquisition time is the frame rate of the camera itself. However, given a bright illumination source, the theoretical temporal resolution of the TAG-enabled microscope is given by the time required to scan overΔz, which in this case is 14 μs or equivalently 72,000 fps. This value is orders of magnitude higher than the maximum speed that can be obtained by mechanical scanning systems which are subject to settling times and have to overcome inertial effects.

Finally, we explore the potential of the TAG-enabled microscope for imaging biological systems (Fig. 3). In this case, murine fibroblast cells flowing through two perpendicular microchannels separated by 300 μm are imaged in a single exposure of a color CCD camera, applying the same method described above [Fig. 3(a)]. The color separation of the CCD image allows recovering information of the cells in each individual microchannel without loss of in-plane information [Fig. 3(b) and3(c)]. In addition, by using focus stacking algorithms11 we are able to generate a two-dimensional image of the cells flowing in each microchannel where out of focus information has been eliminated [Fig. 3(d)].

Fig. 3

Simultaneous imaging of murine fibroblast cells flowing through two perperndicular microchannels separated by 300 μm. (a) Composite color CCD image acquired in a single exposure. (b,c) Color separation of the image in (a) provides information of the cells flowing in each individual microchannel. (d) Focus stacking of the images from (a) into a single image where out of focus information can now be removed. Scale bars, 100 μm.

JBO_17_5_050505_f003.png

The possibility of simultaneously imaging multiple focal planes demonstrated in this manuscript for optical microscopy is a first step toward real-time 3-D microscopy. Our method does not require mechanically moving parts and it can be scaled up by using multiple colors, which opens the door to record multiple focal planes at speeds as high as 72,000 fps. In the future, the implementation of imaging processing algorithms will make it possible to retrieve the phase information of the images which can enable the reconstruction of the 3-D space between the corresponding focal planes.12 In addition, applying our method in combination with other imaging techniques based on optical sectioning such as two-photon microscopy,13 confocal microscopy,14 or structured illumination methods,15 can result in a significant reduction of the acquisition times allowing researchers to explore new fundamental processes in living systems.

Acknowledgments

The authors acknowledge financial support from AFOSR and NSF. In addition, we acknowledge Prof. Howard A. Stone for useful discussion and access to facilities for fabricating microfluidic devices and cell preparation, Yunlai Zha for help with fabricating the calibration standard, and Christian Theriault (TAG Optics Inc.) for support on use and integration of the TAG lens.

References

1. 

T. A. Planchonet al., “Rapid three-dimensional isotropic imaging of living cells using Bessel beam plane illumination,” Nat. Methods, 8 (5), 417 –423 (2011).http://dx.doi.org/10.1038/nmeth.1586 1548-7091Google Scholar

2. 

W. Amiret al., “Simultaneous imaging of multiple focal planes using a two-photon scanning microscope,” Opt. Lett., 32 (12), 1731 –1733 (2007).http://dx.doi.org/10.1364/OL.32.001731 OPLEDP 0146-9592Google Scholar

3. 

R. Carrileset al., “Simultaneous multifocal, multiphoton, photon counting microscopy,” Opt. Express, 16 (14), 10364 –10371 (2008).http://dx.doi.org/10.1364/OE.16.010364 OPEXFF 1094-4087Google Scholar

4. 

A. Chenget al., “Simultaneous two-photon calcium imaging at different depths with spatiotemporal multiplexing,” Nat. Methods, 8 (2), 139 –142 (2011).http://dx.doi.org/10.1038/nmeth.1552 1548-7091Google Scholar

5. 

E. J. Botcherbyet al., “Real-time extended depth of field microscopy,” Opt. Express, 16 (26), 21843 –21848 (2008).http://dx.doi.org/10.1364/OE.16.021843 OPEXFF 1094-4087Google Scholar

6. 

P. Prabhatet al., “Elucidation of intracellular recycling pathways leading to exocytosis of the Fc receptor, FcRn, by using multifocal plane microscopy,” Proc. Natl. Acad. Sci. USA, 104 (14), 5889 –5894 (2007).http://dx.doi.org/10.1073/pnas.0700337104 1091-6490Google Scholar

7. 

S. Ramet al., “High accuracy 3D quantum dot tracking with multifocal plane microscopy for the study of fast intracellular dynamics in live cells,” Biophys. J., 95 (12), 6025 –6043 (2008).http://dx.doi.org/10.1529/biophysj.108.140392 BIOJAU 0006-3495Google Scholar

8. 

A. Mermillod-BlondinE. McLeodC. B. Arnold, “High-speed varifocal imaging with a tunable acoustic gradient index of refraction lens,” Opt. Lett., 33 (18), 2146 –2148 (2008).http://dx.doi.org/10.1364/OL.33.002146 OPLEDP 0146-9592Google Scholar

9. 

E. McLeodA. B. HopkinsC. B. Arnold, “Multiscale Bessel beams generated by a tunable acoustic gradient index of refraction lens,” Opt. Lett., 31 (21), 3155 –3157 (2006).http://dx.doi.org/10.1364/OL.31.003155 OPLEDP 0146-9592Google Scholar

10. 

N. Olivieret al., “Two-photon microscopy with simultaneous standard and extended depth of field using a tunable acoustic gradient-index lens,” Opt. Lett., 34 (11), 1684 –1686 (2009).http://dx.doi.org/10.1364/OL.34.001684 OPLEDP 0146-9592Google Scholar

11. 

B. Forsteret al., “Complex wavelets for extended depth-of-field: a new method for the fusion of multichannel microscopy images,” Microsc. Res. Tech., 65 (1–2), 33 –42 (2004).http://dx.doi.org/10.1002/(ISSN)1097-0029 MRTEEO 1059-910XGoogle Scholar

12. 

A. MigukinV. KatkovnikJ. Astola, “Wave field reconstruction from multiple plane intensity-only data: augmented Lagrangian algorithm,” J. Opt. Soc. Am. A, 28 (6), 993 –1002 (2011).http://dx.doi.org/10.1364/JOSAA.28.000993 JOAOD6 0740-3232Google Scholar

13. 

F. HelmchenW. Denk, “Deep tissue two-photon microscopy,” Nat. Methods, 2 (12), 932 –940 (2005).http://dx.doi.org/10.1038/nmeth818 1548-7091Google Scholar

14. 

J.-A. ConchelloJ. W. Lichtman, “Optical sectioning microscopy,” Nat. Methods, 2 (12), 920 –931 (2005).http://dx.doi.org/10.1038/nmeth815 1548-7091Google Scholar

15. 

J. Mertz, “Optical sectioning microscopy with planar or structured illumination,” Nat. Methods, 8 (10), 811 –819 (2011).http://dx.doi.org/10.1038/nmeth.1709 1548-7091Google Scholar
© 2012 Society of Photo-Optical Instrumentation Engineers (SPIE) 0091-3286/2012/$25.00 © 2012 SPIE
Martí Duocastella,Bo Sun, andCraig B. Arnold"Simultaneous imaging of multiple focal planes for three-dimensional microscopy using ultra-high-speed adaptive optics," Journal of Biomedical Optics 17(5), 050505 (7 May 2012).https://doi.org/10.1117/1.JBO.17.5.050505
Published: 7 May 2012
Lens.org Logo
CITATIONS
Cited by 59 scholarly publications and 8 patents.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission Get copyright permission on Copyright Marketplace
KEYWORDS
3D image processing

Microscopes

Objectives

Microfluidics

3D acquisition

Microscopy

Adaptive optics

Cameras

CCD cameras

Imaging systems

Erratum Email Alerts notify you when an article has been updated or the paper is withdrawn.
VisitMy Account to manage your email alerts.
The alert successfully saved.
VisitMy Account to manage your email alerts.
The alert did not successfully save. Please try again later.
Martí Duocastella, Bo Sun, Craig B. Arnold, "Simultaneous imaging of multiple focal planes for three-dimensional microscopy using ultra-high-speed adaptive optics," J. Biomed. Opt. 17(5) 050505 (7 May 2012) https://doi.org/10.1117/1.JBO.17.5.050505
Include:
Format:
Back to Top

Keywords/Phrases

Keywords
in
Remove
in
Remove
in
Remove
+ Add another field

Search In:























Publication Years

Range
Single Year

Clear Form

[8]ページ先頭

©2009-2025 Movatter.jp