Open Access
1 May 2009 Three-dimensional surface profile intensity correction for spatially modulated imaging
Author Affiliations +
Abstract
We describe a noncontact profile correction technique for quantitative, wide-field optical measurement of tissue absorption (μa) and reduced scattering (μs) coefficients, based on geometric correction of the sample's Lambertian (diffuse) reflectance intensity. Because the projection of structured light onto an object is the basis for both phase-shifting profilometry and modulated imaging, we were able to develop a single instrument capable of performing both techniques. In so doing, the surface of the three-dimensional object could be acquired and used to extract the object's optical properties. The optical properties of flat polydimethylsiloxane (silicone) phantoms with homogenous tissue-like optical properties were extracted, with and without profilometry correction, after vertical translation and tilting of the phantoms at various angles. Objects having a complex shape, including a hemispheric silicone phantom and human fingers, were acquired and similarly processed, with vascular constriction of a finger being readily detectable through changes in its optical properties. Using profilometry correction, the accuracy of extracted absorption and reduced scattering coefficients improved from two- to ten-fold for surfaces having height variations as much as 3 cm and tilt angles as high as 40 deg. These data lay the foundation for employing structured light for quantitative imaging during surgery.

1.

Introduction

Over the past decade, significant progress has been made in the development of noncontact wide-field technologies for quantitative, subsurface functional imaging. For example, fluorescence imaging can now provide surgeons with real-time guidance during surgical procedures1, 2, 3, 4, 5 and has successfully been translated to human trials for breast-cancer sentinel lymph-node mapping,6 (Troyan, manuscript in review). Frequency-domain photon migration (FDPM) and fluorescence lifetime imaging have been applied to large fields of view [(FOV), typically > 5cm ]7, 8, 9 for normal versus tumor cell delineation through natural chromophore contrast,10, 11 or for improved exogenous and endogenous fluorescence signal detection through lifetime contrast.12, 13, 14 Recently, spatially modulated light [also known as patterned illumination, structured illumination, modulated imaging (MI)] has been shown to provide depth-resolved maps of optical properties15 and biochemical components, such as oxyhemoglobin and deoxyhemoglobin, in turbid media.16, 17

Translating such technologies into clinically relevant tools, though, is a significant challenge, particularly when quantitation is required. Most of these technologies require multiple images to be acquired with a varying parameter (e.g., time or spatial intensity, wavelength), and images must be registered to the same position in space over the period of data acquisition. Consequently, problems arise when dealing with samples that have different surface profiles or varying surface profiles over time (i.e., motion). Image acquisition gating and synchronization using physiological signals (such as an electrocardiogram) can be employed to overcome image motion over time in the context of in vivo optical imaging.18 However, image gating does not correct for surface height variations when they are independent of time. This is the case, for example, with calibrated intensity measurements when the calibration and the sample have different surface profiles. Previous studies have utilized sample surface profile information to correct for color rendering,19 to optimize venous imaging,20 or to simulate the diffuse reflectance of biological tissues,21 but none thus far use this information for quantitative optical imaging.

In this study, we demonstrate that phase profilometry can be incorporated into an MI imaging system in such a way that quantitative, wide-field optical imaging of tissue absorption (μa) and reduced scattering (μs) coefficient is possible. By generating an accurate surface map of an object, phase profilometry permits the correction of surface reflectance intensity variations that occur as a consequence of sample geometrical parameters, such as height and surface contour (i.e., variation in angle with respect to collection plane). This, in turn, improves the extraction of optical properties from random-shaped objects over large FOVs.

2.

Materials and Methods

2.1.

Instrumentation

We used the MI instrument platform first developed by Cuccia, described in detail in Refs. 15, 16, 17, 22, 23 and shown in Fig. 1a . The system consists of an intensity-stabilized 250-W quartz-tungsten-halogen lamp (Newport, Irvine, California) focused on a spatial light modulator (DMD Discovery 1100, Vialux, Chemnitz, Sachsen, Germany), which is then projected through an objective lens (Thorlabs, Newton, New Jersey) whose magnification and focal length ensure complete illumination of the target by spatially modulated light. A Nuance multispectral imaging system (CRI Inc., Woburn, Massachusetts), composed of a liquid-crystal tunable filter ( λ=6501100nm , Δλ=10nm ) and a 12-bit CCD camera, was used to acquire reflected images. Projection and collection are cross-polarized to reduce the contribution of specularly reflected light and to isolate diffuse reflectance.24 We placed the samples on a custom-made, z -translation, x - and y -rotation stage that allows positioning at a range of heights from 0to5cm and tilt angles from 40to+40deg . MI data acquisition was performed using code written in LabVIEW (National Instruments, Austin, Texas), and image processing was performed using code written in MATLAB (MathWorks, Natick, Massachusetts).

Fig. 1

Instrumentation schematics: Intensity sine waves (grayscale stripes) are projected at a 20-deg angle onto a sample using a spatial light modulator, and collected with a 12-bit CCD camera. Collection is cross-polarized with respect to projection, and wavelengths are filtered using the tunable filter on the camera. Orientation of the sine waves is shown for optical properties measurement (a) and profilometry measurement (b).

034045_1_054903jbo1.jpg

2.2.

Tissue-like Phantoms

Tissue-simulating phantoms with known optical properties were used to assess the qualitative and quantitative performance of the imaging technique. These phantoms, 96×96×10mm , are made of polydimethylsiloxane and incorporate homogeneously distributed India ink as an absorber, and TiO2 as a scattering agent.25 Spectral absorption and reduced scattering coefficients of the calibration phantom were verified using a two-distance, multifrequency FDPM measurement, which is a self-calibrating measurement.26

2.3.

Phase Profilometry

Phase profilometry is a well-known measurement technique that is used for surface profile characterization.27, 28, 29 As shown in Fig. 1b, a spatially modulated intensity sine wave is projected onto the sample while the camera acquires at a fixed angle with respect to the projection axis. Maximum sensitivity to surface variations is obtained when the fringes of the intensity sine wave are orthogonal to the plane formed by the camera and projector optical axes. In Fig. 1b, the optical axes of the camera and projector are lying within the x-z plane while the fringes are aligned along the y vector. The observed fringe phase will then be dependent on the geometry of the optical system and the sample surface height. Consequently, the sample height can be extracted from measurement of the fringes’ phase and either knowledge of the optical system geometry or calibration of the phase-height relationship. We chose to extract the fringes’ phase using a profilometry method that consists of projecting an intensity sine wave with three different phase shifts.29 The fringe phase at each pixel is extracted from the three sine waves and unwrapped. Another alternative would be to perform a discrete Fourier transform (DFT) using a single intensity sine wave,28 but in our case, the trade-off between phase resolution and spatial resolution renders the DFT approach inadequate. As the optical system geometry may vary in time, we chose to perform a multiple-height calibration scheme that allows the extraction of a linear relationship between the inverse of sample height variation and the inverse of phase variation.30 This technique consists of vertically translating a horizontal flat surface and acquiring, for known heights, the phase at each pixel location.

It is important to note that the choice of spatial frequency used when performing phase profilometry is a trade-off between sensitivity to large changes of height, which is highest at low spatial frequencies, and height resolution, which is highest at high spatial frequencies. When measuring relatively smooth surfaces that do not present sudden height changes, such as flat or hemispheric surfaces, we performed phase unwrapping (i.e., phase was no longer constrained to 0180deg ). This permitted use of relatively high frequencies (> 0.1mm1) to minimize phase noise, while maintaining sensitivity to large height changes. Of course, this approach assumes that the phase does not vary by > 180deg from one pixel to another, which is the case for smooth surfaces.

2.4.

Modulated Imaging

The spatial dependence of light reflectance from turbid media has been characterized extensively.31 Two general approaches can be used to quantify turbid media optical properties using continuous (i.e., time-independent) light sources. The first “real domain” method measures the spatial point-spread function of a point source incident on the sample and is generally well suited for local, millimeter-scale interrogation using contact fiber probes.24, 32 This approach can be extended to noncontact geometries and large areas by raster scanning the point illumination source across the region of interest. In the “spatial frequency domain,” the reflectance modulation transfer function of the sample is evaluated in a wide-field imaging geometry.33 MI, developed by Cuccia and described in detail in Refs. 15, 16, 17, 22, 23, is a spatial frequency domain technique that relies on the analysis of reflectance from a spatially modulated sinusoidal light source. Because the analysis is performed within the spatial frequency domain, fast acquisition of large FOVs (typically, 5cm or greater) is possible. MI is a calibration-dependent, model-based method that allows the extraction of absorption and reduced scattering coefficients ( μa and μs ; i.e., optical properties) from a turbid medium at any wavelength.

The theory and methods of MI are described extensively in Refs. 16, 17. To place the present study in context, we provide the following brief overview of the method and its fundamental principles. The ac component, Iac , of an intensity sine wave of spatial frequency fx and phase α , measured at a single wavelength and at the location (x,y) on the sample has the following form:

Eq. 1

Iac(x,y,fx,α)=Mac(x,y,fx)cos(2πfxx+α).
The modulation amplitude, Mac , can be extracted by varying the phase α of the intensity sine wave, taking, in our case, three values: α1=0 , α2=2π3 , and α3=4π3 . At each location (x,y) ,

Eq. 2

Mac(fx)=23[Iac(fx,α1)Iac(fx,α2)]2+[Iac(fx,α2)Iac(fx,α3)]2+[Iac(fx,α3)Iac(fx,α1)]2.
Finally, Mac can be related to the source intensity I0 , the modulation transfer function of the optical system MTFsys , and the diffuse reflectance of the sample, Rd , at each location (x,y) ,

Eq. 3

Mac(fx)=I0[MTFsys(fx)][Rd(fx)].
As shown in Refs. 16, 17, the instrument-dependent contributions to the measured Mac , namely, the frequency response (MTFsys) of the collection optics and the incident intensity (I0) at each location (x,y) , need to be separated from the contribution of the light-tissue interaction [i.e., the diffuse reflectance of the sample (Rd)] .

During a typical measurement, the modulation amplitude (Mac,ref) of a calibration phantom with known optical properties is measured at multiple illumination spatial frequencies (fx) , and the calibration phantom diffuse reflectance (Rd,ref) is predicted from the known optical properties using a forward light propagation model (which is analytical when using the diffusion approximation to the transport equation17, 34 or statistical when using Monte Carlo computations35). Next, the Mac of the unknown sample is measured and its diffuse reflectance extracted using the reference values ( Mac,ref and Rd,ref ) from the calibration phantom, at each location (x,y)

Eq. 4

Rd(fx)=Mac(fx)Mac,ref(fx)Rd,ref(fx).
As shown in Eq. 4, instrument-dependent contributions (product of I0 and MTFsys ) can be removed from the frequency-domain tissue data with a simple division. Finally, as the sample diffuse reflectances, Rd(fx) , are directly dependent on the sample optical properties (μa,μs) , diffuse reflectances acquired at two or more spatial frequencies are used to fit for optical properties by solving the inverse problem using a light propagation model at each location (x,y) (described in detail in Refs. 16, 17).

Cuccia16 and Cuccia 17 showed that, by properly choosing the spatial frequencies, optical properties can be extracted using a quick, two-dimensional lookup table generated from either “white” Monte Carlo simulations or the diffusion approximation, and calibrated using a phantom with well-known optical properties. The premise of that technique is that dc, continuous wave illumination, is sensitive to both absorption and scattering whereas a certain range of higher spatial frequencies (typically > 0.1mm1 in the case of tissues) is primarily sensitive to scattering. This permits separation of the optical properties (i.e., absorption and reduced scattering) of an object. In the work presented here, we used the diffusion approximation to the transport equation as our forward light propagation model and optical properties were extracted using the rapid two-dimensional lookup table generated from the diffusion approximation to the transport equation. During our experiments, the desired high spatial frequency for optical properties measurement using the two-dimensional lookup table was in the range of 0.10.2mm1 . Because accurate knowledge of this spatial frequency is necessary for the light propagation model, a postacquisition calibration of the exact high-frequency value is measured using a ruler.

As shown in Fig. 1a, when measuring optical properties of phantoms, we purposely chose to project fringes that were not sensitive to the sample surface variations. This was simply achieved by orienting the fringes parallel to the plane formed by the camera-projector optical axes (see Sec. 2.3). Typically, MI is performed by first acquiring data from a single reference calibration phantom with well-known optical properties at a single specific height. Problems arise when the reference and the sample are not at the same height, which occurs commonly during in vivo measurements. In this case, the sample and the reference do not share the same incident light intensities [ I0 in Eq. 3], and direct comparison of modulation amplitudes is no longer appropriate for accurate diffuse reflectance extraction and subsequent optical properties determination. The previous MI measurement protocol, without profile intensity correction, requires that the sample and reference heights be as close as possible to minimize errors.

Additionally, we developed a new, multiple spatial frequency processing algorithm for MI. The commonly employed algorithm assumes that there is only one single spatial frequency of interaction between the light and the sample. Because of surface profile variations, though, this intensity sine wave gets projected onto locally angled surfaces, and multiple frequencies of interaction are present. We overcame this problem by measuring the calibration phantom at multiple single frequencies, extracting the sample optical properties for all those frequencies, and interpolating the sample optical properties according to the measured local spatial frequency (obtained using the surface profile data).

2.5.

Profile-Based Correction Method

Because light intensity locally reemitted from a diffusive surface can be described using a Lambertian model varying in cos(θ)r2 , where r is the distance from the sample to the camera and θ the angle between the normal of the surface and the collection optical axis, we developed a surface profile correction method that consists of these two correction components. The first part addresses the intensity variation associated with surface height changes while the second part addresses the intensity variation due to surface angle. These corrections were applied to MI data. In order to validate this approach, we first assessed its performance in correcting height-dependent intensity variations only. This was made possible by vertically translating a horizontal flat tissue-simulating phantom perpendicular to the collection optical axis. In doing so, there were no angle-dependent contributions to the sample intensity variation. With the knowledge that the height-dependent intensity variations were corrected, we then tilted a flat tissue-simulating phantom, from 40to+40deg in both axes of rotation and studied the combination of both height- and angle-dependent corrections, because, when the sample is angled, contributions from height and angle cannot be studied independently.

2.5.1.

Height-dependent intensity correction

There are two possible approaches to correct for the effect of height variations in measured intensity: (i) model-based correction or (ii) calibration-based correction. Although the measured sample intensity followed the inverse square law model, which is valid for Lambertian reflectance, we chose to implement a more convenient approach, based on calibration, which can be easily adapted to different system geometries. The phase profilometry calibration method uses flat phantoms acquired at various heights. For each calibrated height, we performed a profilometry measurement and an optical property measurement (as described above). The profilometry measurement yielded phase variation versus height variation for each pixel in the image while the optical property measurement provided the intensity variation versus height variation for each pixel in the image. We decided to calibrate the reference amplitude modulation, Mac,ref , directly proportional to the reference intensity. The formula used for computing Mac is shown in Eq. 2. We subsequently extracted a matrix describing the modulation amplitude of the reference phantom versus height for each pixel in the image, a quantity that is directly proportional to the reference intensity versus height. At each location (x,y) , the modulation amplitude of the reference phantom, Mac,ref , can be described as a function the profilometry phase of the reference phantom, Pref , acquired at n discrete heights:

Eq. 5

Mac,ref,k(fx)=f(Pref,k),k=[0,n].

After performing this calibration, the sample surface profile is acquired and the profile-corrected reference modulation amplitude is obtained by interpolating the sample profilometry phase, pixel by pixel, using Eq. 5. For each location (x,y) ,

Eq. 6

Mac,ref,heighṯcorrected(fx)=f(Psample).

Finally, the diffuse reflectance of the sample is extracted using the height-corrected reference modulation amplitude in Eq. 4

Eq. 7

Rd,sample(fx)=Mac,sample(fx)Mac,ref,heighṯcorrected(fx)Rd,ref(fx).

To assess this correction performance, we acquired data from two tissue-like phantoms with homogeneous optical properties. One phantom was used for calibration purposes, and the other was treated as an unknown sample. In both cases, data were acquired every 1cm from 0to3cm , while keeping the phantoms horizontal. The spatial frequency used for profilometry was 0.1mm1 and frequencies used for optical property measurements were dc (0mm1) and 0.2mm1 . The FOV was 3×4cm . Data were acquired at 650nm , processed with and without height correction, and compared to expected theoretical values.

2.5.2.

Angle-dependent intensity correction

There are also two possible approaches for correcting reference intensity dependence with surface angle: (i) model-based correction or (ii) calibration-based correction. Because calibrations acquired on flat horizontal phantoms (i.e., with no surface angle variations) integrate flawlessly into the method workflow, we chose to employ a model-based Lambertian reflectance approach. From the profile acquired using phase profilometry, we extracted the surface normal vectors and computed the cosine of the angle θ between these vectors and the optical axis of the camera. The cosine gave a correction factor that we applied to the height-corrected reference modulation amplitude to obtain the fully profile-corrected reference modulation amplitude for each pixel location (x,y) ,

Eq. 8

Mac,ref,profile̱corrected(fx)=Mac,ref,heighṯcorrected(fx)cos(θ).
We implemented both a collimated collection approach and a divergent collection approach. The collimated collection approach assumes that the optical axis of collection is independent of the position on the sample, and the divergent collection approach assumes it is dependent. We noted very little difference (<1%) in the correction factors when implementing the two approaches due to the low angle of divergence of our system (1.8deg) . We thus chose the less computationally intensive, collimated collection approach.

To assess the performance of this method of correction, we acquired data from two flat tissue-like phantoms with homogeneous optical properties. One phantom was used for calibration purposes, measured horizontally every centimeter, from 0to3cm . The other phantom was treated as an unknown sample and measured at various angles from 40to+40deg in both axes of rotation (side and front tilts, see Fig. 1). The spatial frequency used for profilometry was 0.1mm1 and spatial frequencies used for optical properties were dc (0mm1) and 0.2mm1 . FOV was 3×4cm . Data were acquired at 650nm , and the sample surface smoothed using a Wiener filter ( 10×10pixel window size) to reduce the influence of surface angle errors originating from noise in the profilometry data. Data were processed with and without height and angle corrections, and compared to expected theoretical values.

2.6.

In Vitro Hemispheric Phantom Measurements

In addition to flat phantoms, we acquired data from a complex-shaped phantom that consisted of a flat homogenous phantom having on its surface a 2-cm radius hemisphere of the same optical properties. One flat phantom with known optical properties was measured at five different heights, from 0to4cm , every centimeter, for calibration purposes. The sample phantom data were measured at a height of 1cm . Both sets of phantom data were processed for phase profilometry and optical properties as described above. The spatial frequency used for profilometry was 0.17mm1 and spatial frequencies used for optical property determination were dc (0mm1) and 0.12mm1 . FOV was 4×5cm . Data were acquired at 670nm and processed for height and optical property reconstructions, with and without profilometry correction (for height and angle). The first phantom served as the calibration reference for both height and optical properties.

2.7.

In Vivo Measurements

We acquired data from a human right hand, with the index finger having a rubber band-induced constriction of blood flow. One flat phantom with known optical properties was measured at six different heights, from 0to5cm , every centimeter, for calibration purposes. The spatial frequency used for profilometry was 0.08mm1 and spatial frequencies used for optical properties were dc (0mm1) and 0.13mm1 . FOV was 7×9cm . Data were acquired at 670nm , and the sample surface smoothed using a Wiener filter ( 10×10pixel window size) to reduce the influence of surface angle errors originating from noise in the profilometry data. Data were processed for height and optical property extractions, with and without profilometry correction (for height and angle), and using the flat phantom as the calibration reference. Finally, optical property maps were smoothed using a Gaussian filter having a FWHM of 4pixels .

3.

Results

3.1.

Phase Profilometry

A flat phantom with homogenous, tissue-like optical properties was translated vertically (Figure 2a ), front tilted [Fig. 2b] and side tilted [Fig. 2c], and its surface reconstructed. Over 3cm of vertical translation, measured height was always reconstructed within 1mm or less of its theoretical height [Fig. 2d]. Over ±20deg of side tilt or front tilt, the surface of the phantom was reconstructed within 0.7deg or less of its theoretical angle [Fig. 2e]. However, for front-tilt angles from ±20to±40deg , there was proportionally increasing deviation due to systematic errors associated with phase extraction [Fig. 2e]. For front tilts, the phase of the sine wave is the result of a phase addition process along the x vector, causing errors to accumulate during phase extraction. This does not occur during side-tilts, where phase is constant along the x vector.

Fig. 2

Profilometry measurements: (a) Surface maps of flat phantoms translated vertically, b) surface maps of flat phantoms rotated along the y -axis (i.e., front tilt), (c) surface maps of flat phantoms rotated along the x -axis (i.e., side tilt), (d) measured surface heights (squares) as a function of the expected theoretical surface heights (dashed line), and (e) measured surface angles for front tilt (squares) and side tilt (circles) as a function of the expected theoretical angles (dashed line).

034045_1_054903jbo2.jpg

3.2.

Optical Property Measurements of Flat Tissue-like Phantoms

Extraction of absorption and reduced scattering coefficients was impacted significantly by profilometry correction on a flat phantom with homogenous, tissue-like optical properties (Fig. 3 ). As described in Sec. 2, results from uncorrected data were processed using a calibration phantom measured at a single 0-cm reference height and 0deg in both axes of rotation. Results from corrected data have been processed using a calibration phantom measured at various heights and 0deg in both axes of rotation.

Fig. 3

Optical property measurements of tissue-like phantoms: Recovered absorption coefficients [(a–c), mean±standard deviation] and reduced scattering coefficients [(d–f), mean±standard deviation] at 650nm of (a,d) vertically translated phantoms, (b,e) front-tilted phantoms, (c,f) side-tilted phantoms having homogeneous optical properties. Profilometry-corrected data (squares) and uncorrected data (circles) are shown along with the expected theoretical values (dashed lines).

034045_1_054903jbo3.jpg

For vertical translation [Figs. 3a and 3d], the correction algorithm uses only height-dependent intensity correction. Profilometry-based correction reduced absorption coefficient error from 10% per centimeter to <1% over the entire range from 0to3cm . Similarly, reduced scattering coefficient error was reduced from 10% to <1% at every surface height. For both absorption and reduced scattering coefficients, the standard deviation of all pixels in an image was reduced from 7% to 3% of the mean pixel value.

For tilted phantoms [Figs. 3b, 3e, 3c, 3f], the correction algorithm uses a combination of height- and angle-dependent intensity correction. For angles within ±40deg , the correction reduced absorption coefficient error from 86% to 7% of the expected pixel value, and reduced scattering coefficient error from 10% to 4% of the expected pixel value. For absorption coefficients, the standard deviation of all pixels in an image was reduced from 13% to 6% of the mean pixel value, whereas for reduced scattering coefficients, standard deviation was reduced from 6% to 2% of the mean pixel value. It should be noted that the camera optical axis was not normal to the 0deg horizontal phantom surface, but was angularly displaced ( 20deg front, 0deg side). Consequently, measured values found their local extrema at this angle [see, for example, Fig. 3b and 3e]. We also note a tendency for overcorrection of tilted phantoms on the reduced-scattering maps (see Sec. 4).

3.3.

Optical Property Measurements of Hemispheric Tissue-like Phantoms

Although appearing to work well with flat surfaces, we next explored the use of profilometry-based correction on complex surfaces. Shown in Fig. 4 is a hemispheric phantom having homogeneous, tissue-like optical properties. Figure 4a shows optical properties maps (absorption and reduced scattered coefficients at 670nm ) plotted on the sample surface, with and without correction. Figure 4b shows cross-sectional plots from Figure 4a made through the center of the hemisphere. Profilometry-corrected data (solid curve) and uncorrected data (thin dashed curve) are shown along with the expected theoretical values (thick dashed curves). In the absence of profilometry-based correction, reconstruction of absorption and reduced scattering coefficients results in large errors (28% of the pixels on average are within 10% of their expected values). These errors are most significant at points presenting a high surface angle, with deviations of > 100% at angles of > 40deg for absorption coefficients. However, when corrected for surface height and angle, the accuracy of optical property measurements is improved both qualitatively [Fig. 4a] and quantitatively {50% of the pixels on average are within 10% of their expected values [Fig. 4b]}.

Fig. 4

Optical property measurements of a hemispheric, tissue-like phantom having homogeneous optical properties: (a) Recovered absorption coefficients (top) and reduced scattering coefficients (bottom) at 670nm either without (left), or with (right), profilometry-based correction for height and angle. Arrows indicate the expected theoretical value. (b) Cross-sectional plots from (a), through the center of the hemisphere, of recovered absorption coefficients (left) and reduced scattering coefficients (right) at 670nm . Profilometry-corrected data (solid curve) and uncorrected data (thin dashed curve) are shown along with the expected theoretical values (thick dashed curves).

034045_1_054903jbo4.jpg

When reconstructing only those pixels that fall within the range of the calibration phantom ( 03cm in vertical translation and ±40deg in front tilt and side tilt), deviation of the recovered absorption coefficient from the expected value was reduced from 65% to 9% with profilometry-based correction. Deviation of the recovered reduced scattering coefficient from the expected value was actually slightly degraded after correction, increasing from 1.5% to 3% over the entire hemispheric surface. There was also a trend toward overcorrection with increasing surface angle [Fig. 4b]. The standard deviation of measurements at any given pixel was reduced from 51% to 25% of the mean pixel value for absorption coefficient, and from 20% to 7% of the mean pixel value for reduced scattering coefficient, with the incorporation of surface height maps.

When the entire hemispheric surface is analyzed, without restricting reconstruction to ±40deg [Fig. 4b], absorption maps are still improved by a similar factor but corrected reduced scattering results are slightly degraded, increasing to 8.4% average deviation from expected and showing no improvement in standard deviation over the uncorrected case. This is thought to be due to very steep angles at the junction of the sphere and the flat phantom, resulting in both insensitivity to optical properties and inappropriate Lambertian reflectance correction (see Sec. 4).

Note is made of a tiny dark spot at the top center of the hemisphere, seen in both the absorption and reduced scattering coefficient maps [Fig. 4a], which is caused by excessive specular reflection. A second tiny dark spot in the reduced scattering coefficient maps is due to a small speck of nondissolved TiO2 , visible to the naked eye, which arose during the phantom-making process. Note is also made of an area at the back of the hemisphere where the profile cannot be reconstructed due the low intensity of the illumination. This phenomenon is typical when performing phase profilometry using single-angled illumination.36 We also note a tendency for overcorrection of both scattering and absorption maps, increasing with surface angle (see Sec. 4).

3.4.

In Vivo Optical Property Measurements

The optical properties of an even more complex object, a human hand with the index finger constricted with a rubber band, were reconstructed with and without phase profilometry-based correction. A reflectance image of the hand and its surface map is shown in Fig. 5a . Recovered absorption and reduced scattering coefficients, with and without surface map correction, are shown in Fig. 5b. Consistent with in vitro results, the standard deviation of measurements made on the constricted finger section was reduced from 44% to 30% of the mean pixel value for absorption coefficient, and from 29% to 23% of the mean pixel value for reduced scattering coefficient. Artifacts due to movement of the hand during data acquisition were visible, especially in scattering maps (see Sec. 4). Additionally, noise originating from phase profilometry acquired at low spatial frequency is clearly visible and degrades the results obtained from angle-dependent correction (see Sec. 4). Most important, profilometry-based correction greatly improved the uniformity of in vivo optical property measurements, as shown in the cross-sectional plot, along the y -axis of the constricted finger, of the absorption data [Fig. 5c].

Fig. 5

In vivo imaging of a human hand: (a) Reflectance image of a right hand having an index finger constriction (rubber band), taken at 670nm (left), and the 3-D plot of the hand obtained using phase profilometry (right). Dashed box indicates the region of interest for cross-sectional quantitative analysis. (b) Recovered absorption coefficients (top) and reduced scattering coefficients (bottom) at 670nm either without (left), or with (right), profilometry-based correction for height and angle. Note increased absorption at 670nm on the constricted finger due to an increase in deoxyhemoglobin and total hemoglobin. (c) Cross section along the Y -axis through the constricted finger [ X=average of pixels 275 to 300; see dashed box in (a)] of the hand shown in (b). Corrected (solid curve) and uncorrected (dashed curve) absorption coefficients are plotted.

034045_1_054903jbo5.jpg

4.

Discussion

In this study, we present a technique for improving the reconstruction of optical properties from objects having complex surface geometries. By exploiting patterned illumination for both phase profilometry and optical properties measurements, we were able to achieve large FOV imaging, fast data acquisition, and rapid reconstruction, all with the same instrument. The results are applicable to image-guided surgery, where there is currently no quantitative optical imaging technique used routinely. One application of particular interest is the monitoring of tissue oxygenation status. One could envision extracting optical properties at several wavelengths in order to quantify oxyhemoglobin and deoxyhemoglobin concentration using a modified Beer’s law. This particular application would provide surgeons with the ability to interrogate tissue oxygenation in near real-time.

As briefly stated in Sec. 1, coregistration of the acquired images is key in adapting quantitative techniques to relevant in vivo situations. The two major contributors to coregistration problems are time and space related. Time-related contributions can be further subdivided into voluntary motions, cyclic involuntary motions due to normal physiological activity (such as heartbeat and respiration), and noncyclic involuntary motions (due to fatigue, for example). Image acquisition gating, as described previously, can help overcome cyclic involuntary motions.18 Large voluntary and involuntary motions can be overcome using motion sensors for preventing acquisition during motion. The present study addresses space-related coregistration, independent of time, and can be coupled with image acquisition gating in the future for overcoming both time- and space-related coregistration problems.

In all cases, though, both the number of required images and camera integration time need to be minimized in order to reduce the influence of time-related motions. Our current system, not optimized for fast data acquisition, caused small artifacts due to hand motion. These movements are particularly pronounced in the reduced scattering coefficient maps [Fig. 5b], due precisely to the increased ac sensitivity to motion compared to the dc, continuous-wave measurements. One of the major potential advantages of the profilometry-based technique we describe is the speed of data acquisition. After initial calibration, only three additional images (i.e., three phases at a single spatial frequency) are required, which depending on fluence rate, camera sensitivity, and camera frame rate, would add only hundreds of milliseconds to data acquisition. Using a multiple cameras imaging system,37 (Troyan, manuscript in review), it should be possible to perform profilometry and optical properties measurements simultaneously, at two different wavelengths, which in turn would improve coregistration even further. Although technically challenging, one might also consider profile-sensitive orientation of the patterned illumination during optical properties measurements, which might reduce the acquisition time by half.

However, our technique is not without limitations and room for improvement. We limited calibration and reconstruction to surface height variations of 03cm and tilt angles from ±40deg . Indeed, at more extreme angles, the spatial frequency of the projected fringes would decrease dramatically, thus preventing separation of absorption and reduced scattering coefficients during image reconstruction. This is because good separation of the dc and ac measurements is necessary, and the ac frequency is typically > 0.1mm1 for recovery of optical properties. We also noted a tendency for overcorrection in reduced scattering and/or absorption coefficients. The origin of this tendency is not yet clear and presently attributed to many factors. For the angle-dependent correction method, we used a simple cosine to express its Lambertian nature. Other types of dependencies have been reported in the literature,38 and errors are generated if the model used is not accurate. The spatial frequency broadening due to the projection of a sine wave on an angled surface, while accounted for in our processing by interpolating optical properties as a function of the local spatial frequency, could be more accurately corrected if included directly in the model.

Furthermore, the major source of error in the correction technique we developed lies in the quality of the phase profilometry data. Small errors in reconstructing surface heights from phase profilometry lead to large angle variations around the true angle value. This was particularly significant in the implementation of the Lambertian reflectance correction. The magnitude of this effect increases dramatically with the magnitude of the true angle value due to the cosine nature of Lambertian reflectance. This results in an increased standard deviation in both absorption and reduced scattering coefficients, as seen with the in vivo hand data [Figs. 5b and 5c]. Several possible solutions to this problem exist. First, phase profilometry acquisition could be improved by including additional higher spatial frequencies, which would increase sensitivity to small height changes and reduce random variations of measured surface heights. Second, one could employ a commercially available profilometry analysis package (e.g., from Breuckmann, 3D Digital Corporation, Steinbichler, InSpeck) to acquire the object surface, although these packages tend to be expensive and difficult to integrate into custom instrumentation. Finally, one could perform either time or spatial filtering to reduce noise in the data, although filtering can result in longer acquisition times and/or reduced image quality.

5.

Conclusion

We have designed and validated a new technique for correcting surface height and surface angle variations for wide-field intensity-based optical imaging. Our approach is based on surface profile acquisition, calibration of the light source intensity with height, and a Lambertian reflectance model-based correction. We have applied this method to spatial frequency-domain optical imaging based on structured illumination and evaluated performance at various sample heights and angles. By implementing the correction, optical property calculations of phantoms are dramatically improved in both accuracy and standard deviation. Finally, we successfully applied this technique to complex-shaped turbid media, such as a hemispheric phantom with homogeneous optical properties and a human hand. These studies provide a practical framework for noncontact quantitative imaging of optical and physiological properties in humans and small animals, where spatially varying surface topographies are commonly encountered.

Acknowledgments

The authors thank Valerie Croft, Midge Garisson, Lori Moffitt, and Eugenia Trabucchi for administrative assistance and Barbara L. Clough for editing. The authors thank the following individuals for their contributions to this project: from Boston University, Irving Bigio and Jerome Mertz; from Politecnico di Milano, Italy, Andrea Bassi; and from the Beckman Laser Institute, University of California at Irvine, Jae Kim, Fred Ayers, and Jessie Weber. This study was funded by National Institutes of Health/NCI Grant No. R21-CA-129758. Additional support has been provided by National Institutes of Health/NCRR under Grant No. P41-RR01192 (Laser Microbeam and Medical Program: LAMMP), U.S. Air Force Office of Scientific Research, Medical Free-Electron Laser Program (Grants No. F49620-00-2-0371 and No. FA9550-04-1-0101), and the Beckman Foundation.

References

1. 

E. M. Sevick-Muraca, J. P. Houston, and M. Gurfinkel, “Fluorescence-enhanced, near infrared diagnostic imaging with contrast agents,” Curr. Opin. Chem. Biol., 6 642 –650 (2002). https://doi.org/10.1016/S1367-5931(02)00356-3 1367-5931 Google Scholar

2. 

R. E. Lenkinski, M. Ahmed, A. Zaheer, J. V. Frangioni, and S. N. Goldberg, “Near-infrared fluorescence imaging of microcalcification in an animal model of breast cancer,” Acad. Radiol., 10 1159 –1164 (2003). https://doi.org/10.1016/S1076-6332(03)00253-8 1076-6332 Google Scholar

3. 

E. Tanaka, H. S. Choi, H. Fujii, M. G. Bawendi, and J. V. Frangioni, “Image-guided oncologic surgery using invisible light: completed pre-clinical development for sentinel lymph node mapping,” Ann. Surg. Oncol., 13 1671 –1681 (2006). https://doi.org/10.1245/s10434-006-9194-6 1068-9265 Google Scholar

4. 

R. Flaumenhaft, E. Tanaka, G. J. Graham, A. M. De Grand, R. G. Laurence, K. Hoshino, R. J. Hajjar, and J. V. Frangioni, “Localization and quantification of platelet-rich thrombi in large blood vessels with near-infrared fluorescence imaging,” Circulation, 115 84 –93 (2007). https://doi.org/10.1161/CIRCULATIONAHA.106.643908 0009-7322 Google Scholar

5. 

R. Sharma, W. Wang, J. C. Rasmussen, A. Joshi, J. P. Houston, K. E. Adams, A. Cameron, S. Ke, S. Kwon, M. E. Mawad, and E. M. Sevick-Muraca, “Quantitative imaging of lymph function,” Am. J. Physiol. Heart Circ. Physiol., 292 H3109 –3118 (2007). https://doi.org/10.1152/ajpheart.01223.2006 0363-6135 Google Scholar

6. 

J. V. Frangioni, “Translating in vivo diagnostics into clinical reality,” Nat. Biotechnol., 24 909 –913 (2006). https://doi.org/10.1038/nbt0806-909 1087-0156 Google Scholar

7. 

J. R. Lakowicz and K. W. Berndt, “Lifetime-selective fluorescence imaging using an rf phase-sensitive camera,” Rev. Sci. Instrum., 62 1727 –1734 (1991). https://doi.org/10.1063/1.1142413 0034-6748 Google Scholar

8. 

M. A. O’Leary, D. A. Boas, X. D. Li, B. Chance, and A. G. Yodh, “Fluorescence lifetime imaging in turbid media,” Opt. Lett., 21 158 –160 (1996). https://doi.org/10.1364/OL.21.000158 0146-9592 Google Scholar

9. 

J. S. Reynolds, T. L. Troy, R. H. Mayer, A. B. Thompson, D. J. Waters, K. K. Cornell, P. W. Snyder, and E. M. Sevick-Muraca, “Imaging of spontaneous canine mammary tumors using fluorescent contrast agents,” Photochem. Photobiol., 70 87 –94 (1999). https://doi.org/10.1111/j.1751-1097.1999.tb01953.x 0031-8655 Google Scholar

10. 

J. B. Fishkin, O. Coquoz, E. R. Anderson, M. Brenner, and B. J. Tromberg, “Frequency-domain photon migration measurements of normal and malignant tissue optical properties in a human subject,” Appl. Opt., 36 10 –20 (1997). https://doi.org/10.1364/AO.36.000010 0003-6935 Google Scholar

11. 

A. Cerussi, N. Shah, D. Hsiang, A. Durkin, J. Butler, and B. J. Tromberg, “In vivo absorption, scattering, and physiologic properties of 58 malignant breast tumors determined by broadband diffuse optical spectroscopy,” J. Biomed. Opt., 11 044005 (2006). https://doi.org/10.1117/1.2337546 1083-3668 Google Scholar

12. 

I. Munro, J. McGinty, N. Galletly, J. Requejo-Isidro, P. M. Lanigan, D. S. Elson, C. Dunsby, M. A. Neil, M. J. Lever, G. W. Stamp, and P. M. French, “Toward the clinical application of time-domain fluorescence lifetime imaging,” J. Biomed. Opt., 10 051403 (2005). https://doi.org/10.1117/1.2102807 1083-3668 Google Scholar

13. 

M. Y. Berezin, H. Lee, W. Akers, and S. Achilefu, “Near infrared dyes as lifetime solvatochromic probes for micropolarity measurements of biological systems,” Biophys. J., 93 2892 –2899 (2007). https://doi.org/10.1529/biophysj.107.111609 0006-3495 Google Scholar

14. 

W. J. Akers, M. Y. Berezin, H. Lee, and S. Achilefu, “Predicting in vivo fluorescence lifetime behavior of near-infrared fluorescent contrast agents using in vitro measurements,” J. Biomed. Opt., 13 054042 (2008). https://doi.org/10.1117/1.2982535 1083-3668 Google Scholar

15. 

D. J. Cuccia, F. Bevilacqua, A. J. Durkin, and B. J. Tromberg, “Modulated imaging: quantitative analysis and tomography of turbid media in the spatial-frequency domain,” Opt. Lett., 30 1354 –1356 (2005). https://doi.org/10.1364/OL.30.001354 0146-9592 Google Scholar

16. 

D. J. Cuccia, “Modulated imaging: a spatial frequency domain imaging method for wide-field spectroscopy and tomography of turbid media,” (2006). Google Scholar

17. 

D. J. Cuccia, F. Bevilacqua, A. J. Durkin, F. Ayers, and B. J. Tromberg, “Quantitation and mapping of tissue optical properties using modulated imaging,” J. Biomed. Opt., 14 024012 (2009). https://doi.org/10.1117/1.3088140 1083-3668 Google Scholar

18. 

S. Gioux and J. V. Frangioni, “A low-cost universal cumulative gating circuit for small and large animal clinical imaging,” Proc. SPIE, 6848 684807 (2008). https://doi.org/10.1117/12.779196 0277-786X Google Scholar

19. 

M. Westhauser, G. Bischoff, Z. Borocz, J. Kleinheinz, G. von Bally, and D. Dirksen, “Optimizing color reproduction of a topometric measurement system for medical applications,” Med. Eng. Phys., 30 1065 –1070 (2008). https://doi.org/10.1016/j.medengphy.2007.12.014 1350-4533 Google Scholar

20. 

V. Paquit, J. R. Price, F. Mériaudeau, K. W. Tobin, and T. L. Ferrell, “Combining near-infrared illuminants to optimize venous imaging,” Proc. SPIE, 6509 65090H (2007). https://doi.org/10.1117/12.712576 0277-786X Google Scholar

21. 

V. C. Paquit, F. Meriaudeau, J. R. Price, and K. W. Tobin, “Simulation of skin reflectance images using 3D tissue modeling and multispectral Monte Carlo light propagation,” 447 –450 (2008). Google Scholar

22. 

A. Bassi, D. J. Cuccia, A. J. Durkin, and B. J. Tromberg, “Spatial shift of spatially modulated light projected on turbid media,” J. Opt. Soc. Am. A, 25 2833 –2839 (2008). https://doi.org/10.1364/JOSAA.25.002833 0740-3232 Google Scholar

23. 

J. R. Weber, D. J. Cuccia, and B. J. Tromberg, “Modulated imaging in layered media,” Conf. Proc. IEEE Eng. Med. Biol. Soc., 6674 –6676 (2006) Google Scholar

24. 

A. Kienle, L. Lothar, M. S. Patterson, H. Raimund, R. Steiner, and B. Wilson, “Spatially resolved absolute diffuse reflectance measurements for noninvasive determination of the optical scattering and absorption coefficients of biological tissues,” Appl. Opt., 35 2304 –2314 (1996). https://doi.org/10.1364/AO.35.002304 0003-6935 Google Scholar

25. 

F. Ayers, A. Grant, D. Kuo, D. J. Cuccia, and A. J. Durkin, “Fabrication and characterization of silicone-based tissue phantoms with tunable optical properties in the visible and near infrared domain,” Proc. SPIE, 6870 687007 (2008). https://doi.org/10.1117/12.764969 0277-786X Google Scholar

26. 

F. Bevilacqua, A. J. Berger, A. E. Cerussi, D. Jakubowski, and B. J. Tromberg, “Broadband absorption spectroscopy in turbid media by combined frequency-domain and steady-state methods,” Appl. Opt., 39 6498 –6507 (2000). https://doi.org/10.1364/AO.39.006498 0003-6935 Google Scholar

27. 

G. Indebetouw, “Profile measurement using projection of running fringes,” Appl. Opt., 17 2930 –2933 (1978). https://doi.org/10.1364/AO.17.002930 0003-6935 Google Scholar

28. 

M. Takeda and K. Mutoh, “Fourier transform profilometry for the automatic measurement of 3-D object shapes,” Appl. Opt., 22 3977 –3982 (1983). https://doi.org/10.1364/AO.22.003977 0003-6935 Google Scholar

29. 

V. Srinivasan, H. C. Liu, and M. Halioua, “Automated phase-measuring profilometry of 3-D diffuse objects,” Appl. Opt., 23 3105 –3108 (1984). https://doi.org/10.1364/AO.23.003105 0003-6935 Google Scholar

30. 

W.-S. Zhou, and X.-Y. Su, “A direct mapping algorithm for phase-measuring profilometry,” J. Mod. Opt., 41 89 –94 (1994). https://doi.org/10.1080/09500349414550101 0950-0340 Google Scholar

31. 

T. J. Farrell, M. S. Patterson, and B. Wilson, “A diffusion theory model of spatially resolved, steady-state diffuse reflectance for the noninvasive determination of tissue optical properties in vivo,” Med. Phys., 19 879 –888 (1992). https://doi.org/10.1118/1.596777 0094-2405 Google Scholar

32. 

M. Pilz, S. Honold, and A. Kienle, “Determination of the optical properties of turbid media by measurements of the spatially resolved reflectance considering the point-spread function of the camera system,” J. Biomed. Opt., 13 054047 (2008). https://doi.org/10.1117/1.2983675 1083-3668 Google Scholar

33. 

N. Dognitz and G. Wagnieres, “Determination of tissue optical properties by steady-state spatial frequency-domain reflectometry,” Lasers Med. Sci., 13 55 –65 (1998). https://doi.org/10.1007/BF00592960 0268-8921 Google Scholar

34. 

L. O. Svaasand, T. Spott, J. B. Fishkin, T. Pham, B. J. Tromberg, and M. W. Berns, “Reflectance measurements of layered media with diffuse photon-density waves: a potential tool for evaluating deep burns and subcutaneous lesions,” Phys. Med. Biol., 44 801 –813 (1999). https://doi.org/10.1088/0031-9155/44/3/020 0031-9155 Google Scholar

35. 

A. Kienle and M. S. Patterson, “Determination of the optical properties of turbid media from a single Monte Carlo simulation,” Phys. Med. Biol., 41 2221 –2227 (1996). https://doi.org/10.1088/0031-9155/41/10/026 0031-9155 Google Scholar

36. 

O. A. Skydan, M. J. Lalor, and D. R. Burton, “Technique for phase measurement and surface reconstruction by use of colored structured light,” Appl. Opt., 41 6104 –6117 (2002). https://doi.org/10.1364/AO.41.006104 0003-6935 Google Scholar

37. 

S. Gioux, V. Kianzad, R. Ciocan, S. Gupta, R. Oketokoun, and J. V. Frangioni, “High power, computer-controlled, LED-based light sources for fluorescence imaging and image-guided surgery,” Mol. Imaging, (1535-3508) Google Scholar

38. 

R. Basri and D. W. Jacobs, “Lambertian reflectance and linear subspaces,” IEEE Trans. Pattern Anal. Mach. Intell., 25 218 –233 (2003). https://doi.org/10.1109/TPAMI.2003.1177153 0162-8828 Google Scholar
©(2009) Society of Photo-Optical Instrumentation Engineers (SPIE)
Sylvain Gioux, Amaan Mazhar, David J. Cuccia, Anthony Joseph Durkin, Bruce Jason Tromberg, and John V. Frangioni M.D. "Three-dimensional surface profile intensity correction for spatially modulated imaging," Journal of Biomedical Optics 14(3), 034045 (1 May 2009). https://doi.org/10.1117/1.3156840
Published: 1 May 2009
Lens.org Logo
CITATIONS
Cited by 136 scholarly publications and 5 patents.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Optical properties

Absorption

Scattering

Calibration

Spatial frequencies

Modulation

Optical testing

RELATED CONTENT


Back to Top