Image formation in structured illumination wide-field fluorescence microscopy
Introduction
The confocal microscope possesses a number of advantages over the conventional optical microscope, and the optical sectioning is arguably the most important one (Wilson and Sheppard, 1984, Wilson, 1990, Pawley, 1995). The traditional construction of a confocal microscope employs a point light source together with a point pinhole detector. It is the presence of the pinhole aperture which is responsible for the optical sectioning since it physically blocks light from out-of-focus planes from reaching the photodetector and hence precludes this light (information) from contributing to the final image. A complete image of the object is built up by scanning. These systems, which are usually built as an ‘add-on’ to a conventional microscope, are very powerful and have found great application is a wide number of fields. They normally require laser light sources since standard microscope illumination systems are usually insufficiently bright. In order to overcome these problems a number of approaches have been taken. Among those there are two developed at the University of Oxford. The first one has concentrated on improving the design of traditional pinhole-based systems (Juškaitis et al., 1996, Wilson et al., 1996), whereas the second has attempted to modify the conventional optical microscope in such a way as to introduce optical sectioning (Neil et al., 1997). If we define optical sectioning as the requirement that all spatial frequencies within the transfer function attenuate with defocus then it is clear that the conventional microscope does not possess this property. However, if we consider for example the conventional fluorescence case then we find that it is only the zero spatial frequency which does not attenuate with defocus; all the other frequencies are imaged less strongly with increasing defocus. This suggests that if we modify the illumination system in a conventional microscope, so as to project a single spatial frequency fringe pattern onto the object, the microscope will image those parts of the fringe pattern efficiently whose projection onto the object lies within the focal region. We thus obtain an image of the object in which the focal optical section is labelled by a sharply focused grid of lines. Simple processing of three images, taken at three relative spatial positions of the fringe pattern, permits both an optically sectioned and a conventional image to be extracted in real-time. The approach has been demonstrated in both brightfield reflected light imaging (Neil et al., 1997, Wilson et al., 1996) as well as fluorescence (Neil et al., 1998, Neil et al., 2000, Lanni and Wilson, 2000). In this article we theoretically describe the fluorescence case using two methods of obtaining structured illumination: fringe projection and grid projection. In the fringe projection case the structured pattern is formed by the interference of two coherent illumination beams, so as to create the appropriate pattern on the specimen. In the grid projection approach the structured pattern is formed by imaging a physical grid object on the specimen.
There have been numerous attempts to exploit structured illumination in microscopy to achieve different goals. Notably, Gustafsson has shown that using basically the same principle as described in this paper it is possible theoretically to improve the lateral resolution of the optical microscope by a factor of two (Gustafsson, 2000). Further, exploiting the nonlinearity properties of fluorophore saturation theoretically an unlimited improvement is possible (Gustafsson, 2005). However, in the reality the improvement is limited by the signal-to-noise ratio and the photobleaching of imaged fluorophores. Bailey et al. (1993) introduce standing wave excitation in the fluorescence microscopy, by which they achieve improved axial resolution. Failla et al. (2003) name this type of microscopy spatially modulated illumination microscopy and claim it can be used for the measurement of the structures with accuracy close to 1 nm. This approach also uses structured illumination, but unlike of the approach described in the paper, its sinusoidal pattern is laid along the illumination axis, which complicates the system setup, and limits its potential applications.
The analysis in this article emphasises the optical sectioning side of the approach, and presents experimental results which confirm that the optically sectioned images of high quality can be achieved by this method.
Section snippets
Fringe projection—imaging theory
Let us assume the fluorescence specimen, characterised by a spatial distribution of fluorescence , Fig. 1, is illuminated with a one-dimensional interference intensity pattern of the formwhere μ denotes the modulation depth, ν the spatial frequency and ϕ a spatial phase. We have elected to work in optical co-ordinates which are related to real co-ordinates (x, y) via where n sin α is the numerical aperture of the objective
Theoretical considerations
Let us now turn to the case when a physical grid is used together with an optical system to project an image of the grid onto the specimen (Neil et al., 1997, Wilson et al., 1998, Lanni and Wilson, 2000). In this case, Fig. 6, the intensity of illumination, which illuminates the specimen is given bywhere we have assumed incoherent illumination of the grid, and the transmissivity of the grid is S(t0).
If the transmissivity of the grid is written as S(t0) = 1 +
Discussion
We have shown that the use of structured illumination in a conventional fluorescence microscope results in a raw image consisting of a combination of three partial images. The first, I0, represents a conventional image whereas the other two sideband images explore regions of Fourier space bounded by two offset circles (m ± ν)2 + n2 = 4. The offset, ±ν, caused by the presence of the structured illumination leads to these sideband images exhibiting optical sectioning in the way usually understood in
Conclusion
We have discussed two approaches which permit optically sectioning images to be obtained using conventional fluorescence microscopes employing structured illumination. Both are capable of producing images with optical sectioning strengths comparable to that obtained with true confocal instruments. The grid projection technique also exhibits a decrease in integrated intensity whereas the fringe projection technique does not. The spatial frequency bandwidth is increased in both cases and it was
References (18)
- et al.
Real time 3D fluorescence microscopy by two beam interference illumination
Opt. Commun.
(1998) - et al.
Enhancement of axial resolution in fluorescence microscopy by standing wave excitation
Nature
(1993) - et al.
Lateral resolution enhancement with standing evanescent waves
Opt. Lett.
(2000) - et al.
ComPlexUs
(2003) Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy
J. Microsc.
(2000)Nonlinear structured-illumination microscopy: wide-field fluorescence imaging with theoretically unlimited resolution
Proc. Natl. Acad. Sci.
(2005)- et al.
Laterally modulated excitation microscopy: improvement of resolution by using a diffraction grating
Proc. SPIE
(1999) - et al.
Efficient real-time confocal microscopy with white light sources
Nature
(1996) - Karadaglić, D., 2004. Wide-field optical sectioning microscopy using structured illumination. DPhil Thesis, University...
Cited by (111)
Adaptive structured illumination optical-sectioning microscopy based on the prior knowledge of sample structure
2024, Optics and Lasers in EngineeringParallel multi-slit modulation and decoding technique for high-resolution surface measurement in structured illumination microscopy
2023, Optics and Lasers in EngineeringFourier ptychographic rapid superresolution imaging via line-scanning microscopy with virtual structural- modulated
2021, Optics and Lasers in EngineeringCitation Excerpt :Different from the super-resolution techniques which focus on modulation in the spatial domain, such as FED, STED, STORM, SIM is a revolutionary imaging system because it brings super-resolution from the perspective of frequency domain [11]. SIM employs a sinusoidal-patterned illumination to surpass the diffraction limit by shifting some high-frequency information into the passing band of the imaging system and, thus, expand the effective passband of the optical system [1,3,12]. A series of deriving techniques have been developed to further enhance resolution, such as saturated structured illumination microscopy (SSIM) [13], SIM with speckle pattern (blind-SIM) [14], image scanning microscopy (ISM) [15], and other approaches.