Preliminary use of a double‑echo pulse sequence with 3D ultrashort echo time in the MRI of bones and joints

  • Authors:
    • Liheng Ma
    • Quanfei Meng
    • Yingming Chen
    • Zhaohui Zhang
    • Haixing Sun
    • Demao Deng
  • View Affiliations

  • Published online on: March 7, 2013     https://doi.org/10.3892/etm.2013.993
  • Pages: 1471-1475
Metrics: Total Views: 0 (Spandidos Publications: | PMC Statistics: )
Total PDF Downloads: 0 (Spandidos Publications: | PMC Statistics: )


Abstract

The aim of the present study was to investigate the application of a double‑echo pulse sequence with 3D ultrashort echo time (UTE) in the magnetic resonance imaging (MRI) of bones and joints. In total, 7 healthy volunteers and 1 volunteer with a suspected tear of the lateral meniscus of the left knee joint underwent MRI with a double‑echo pulse sequence and 3D UTE. The imaging was performed on the tibial diaphysis, knee joint and ankle of the volunteers and on a segment of porcine fibula in vitro. The echo time of echo 1 (TE1) of the UTE images for the achilles tendon of the ankle joint were set as 0.08, 0.16, 0.24 and 0.35 msec. The maximum intensity projection (MIP) of the difference images created from the primary double‑echo images with a TE1 of 0.08 msec were performed on the tendons of the ankle to display their 3D structure. The data were analyzed with a one‑way ANOVA and paired‑sample t‑test. The 3D distribution of the tendons was displayed through MIPs of the difference images created from the primary double‑echo images. The cortical bones, periosteum, tendons and menisci of the 8 volunteers appeared as high signal intensities in the UTE pulse sequence. Multiplanar reconstruction followed by subtraction of the primary double‑echo images raised the image signal‑to‑noise (S/N) ratio from 2.80±0.75 to 3.76±0.88 (t=‑4.851, P<0.01). The artifacts appeared more marked as the TE1 was prolonged. A double pulse sequence MRI with 3D UTE may display the short T2 components which are not displayed with a conventional clinical MRI sequence, therefore creating a basis for the further quantification of these tissues.

Introduction

The most commonly used method for diagnosising parenchymal disease with traditional clinical magnetic resonance imaging (MRI) is the detection of the long-transverse relaxation time (T2) signal in normal or diseased tissues. The T2 in certain tissues of the human body is very short, which would lead to the extremely quick decay of MR signals derived from these short-T2 tissues in conventional MR sequence imaging. The MR signals would decay to 0 or near 0 prior to the clinical MRI system entering the signal receiving mode. Therefore, these organs would show low or no signal in conventional MRI (1). A low or absent signal creates a difficulty in making an image appear using various pulse sequences or contrast agents, making quantitative determination impossible.

Several methods have been developed for the imaging of short-T2 components (24). With the breakthrough in imaging methods, the following possibilities have been raised with regard to the clinical applications of MRI: i) if the acquisition time window was shortened, which would involve lowering the imaging T2 window level and zooming out the displaying-window width towards the imaging of the short-T2 components or tissues, then the signals of the short-T2 components may be collected and varying short-T2 tissues may be distinguished even by MRI; ii) further development of the application horizontally to enable expansion of the clinical window range; and iii) by collecting the signals of the short-T2 components, further quantitative studies of these tissues and organs may be performed.

Based on these issues, the present study used a double-echo pulse sequence with 3D ultrashort echo time (UTE) for the imaging of short-T2 components and a series of research procedures. Double pulse sequence MRI with 3D UTE was performed on the tibial diaphysis, knee and ankle of a group of normal individuals and on 1 case of a suspected tear of the left knee meniscus to investigate the application of an imaging sequence in the bones and joints.

Materials and methods

General information

In total, 7 healthy volunteers and 1 with a suspected tear of the lateral meniscus of the left knee joint were included in the present study. Their ages ranged between 31 and 46 years old, with a median age of 38 years old. Of these patients, 6 were male aged between 31 and 46 years old (median, 37 years) and 2 were female aged 38 and 39 years old. The present study was conducted in accordance with the Declaration of Helsinki and with approval from the Ethics Committee of the First Affiliated Hospital of Sun Yat-Sen University (Guangzhou, China). Written informed consent was obtained from all participants. A double-echo pulse sequence MRI with 3D UTE was performed on the tibial diaphysis, knee joint and ankle.

In addition, the same MRI was performed on a segment of non-muscle-stripped porcine fibula in vitro.

Imaging equipment and the pulse sequence

A 1.5-T MR imaging system (Intera Achieva, Philips Healthcare, Guangzhou, China) and Flex-M surface coil were used in the imaging process. The pulse sequence was a dual-echo pulse sequence with 3D UTE. Following a block hard pulse (a type of radio frequency pulse; <100 μsec) and a delay time, the 1st ultrashort echo (echo 1), which was generated by the free induction decay signal of the tissue during gradient slope-rising and plateau phase, was recorded. Subsequently, the 2nd echo signal (echo 2) was generated with a reversed phase (the sequence design is shown in Fig. 1). The fill of the k-space was created by the 3D isotropic radial trajectory starting from the k-space center. The switching time of the coil was used to determine the shortest echo time of echo 1 (TE1), which may be <100 μsec. The switching time of the Flex-M surface coil was <30 μsec. Combined with other acquisition parameters, the shortest TE1 used was 80 μsec and the TE of echo 2 (TE2) was 4.6 msec (the inphase time of water and fat under 1.5 T).

Scan program and parameters

A 3D UTE double-echo pulse sequence MRI was performed to gain the 3 sagital, coronal and axial planar images of the volunteers’ tibial diaphysis, knee and ankle and of the non-muscle-stripped porcine fibula in vitro. To investigate the influence of TE1 on the image quality, 3D UTE double-echo pulse sequence imaging with TE1s of 0.08, 0.16, 0.24 and 0.35 msec were performed on the ankles and achilles tendons of the volunteers. Following the 1st imaging of the non-muscle-stripped porcine fibula, the partial muscles were detached bluntly, the periosteum was stipped partially while still connected with the non-stripped periosteum, then the free periosteal edge was curled outwardly (Fig. 2) and the MR double-echo pulse sequence imaging with 3D UTE was performed again.

The imaging parameters were as follows: TR, 7.9–9.3 msec; TE1, 0.08–0.35 msec; TE2, 2.3–4.6 msec; field of view (FOV), 70×70×70–140×140×140 mm; matrix, 88×88–124×124mm; acquisition voxel, 0.8×0.8×0.8–1.21×1.21×1.21 mm; reconstruction voxel, 0.63×0.63×0.63 mm; density of angle, 75%; flip angle, 8 and 12°; and a trajectory delay time of 1 and 2 μsec .

Post-processing of the images

To highlight the short T2 components in the tissues, the 2nd echo sequence images were subtracted from the 1st echo sequence images to remove or reduce the signals from the long-T2 components in the tissues and the difference images mainly containing short-T2 components were obtained. In addition, multiplanar reconstructions (reconstruction thickness, 2 mm) of the 3D imaging data of every echo were performed, then the 2nd echo multiplanar reconstruction images were subtracted from the 1st echo multiplanar reconstruction images and the difference images with a short-T2 component signal were obtained. For the ankle tendon imaging, subsequent to subtracting the primary 2nd echo sequence images from the primary 1st echo sequence images, 3D images of the ankle tendon were obtained when the 3D reconstructions (reconstruction thickness, 2 mm) were performed on the difference images with the maximum intensity projection (MIP) method.

To investigate the impact of various TE1s on image quality, the images were compared and analyzed (mainly with regard to the quantity of the artifacts). A rectangular region of interest was used to measure the signal intensity of the achilles tendon and bone marrow and background signal intensity of the anterior distal tibial diaphysis in the 4 TE1s of the primary echo difference images of the ankle. The contrast-to-noise ratio was also calculated using the signal intensity (SI) using the formula SItendon - SImarrow cavity / SIbackground. The size of the region of interest was 10 mm2 for the achilles tendon, 100 mm2 for the bone marrow and 200 mm2 for the background. At the same time, the rectangular region of interest was used to measure the SI of the achilles tendon and the anterior background SI of the distal tibial diaphysis in the TE1 0.08 msec primary echo difference and multiplanar reconstruction difference images for the calculation of the signal-to-noise ratio (SNR).

Statistical analysis

SPSS 13.0 statistical software was used for the statistical analysis of the differences in the contrast-to-noise ratio of the achilles tendon and bone marrow in the primary echo difference images of the various TE1s, as well as for the signal-to-noise (S/N) ratio of TE1 0.08 msec primary echo and multiplanar reconstruction difference images. The statistical methods used were a one-way ANOVA (pairwise comparisons using the Student-Newman-Keuls-q test) and paired sample t-test. P<0.05 was considered to indicate a statistically significant result.

Results

Signal characteristics of the cortical bone and periosteum in the UTE imaging sequence

The tibial cortical bone of the 8 subjects was exhibited as a slight hyperintensity on the 1st echo sequence, while the periosteum was exhibited as a linear hyperintensity around the cortical bone. In the 2nd echo sequence, the cortical bone was exhibited as a low signal intensity, while the periosteum appeared unclear. Following the subtraction of the two echo sequence images, the cortical bone appeared as a significant hyperintensity with a clear outline and the periosteum was exhibited as a partially visible hyperintensity around the cortical bone (Fig. 3A–C). The S/N ratio was higher in the difference images of the multiplanar reconstruction than in the primary echo difference images (Fig. 3C and D).

The periosteum of the non-periosteum-stripped porcine fibula exhibited a linear hyperintensity around the cortical bone in the 1st echo image and an unclear signal in the 2nd echo image, while in the difference images of the 2 echo subtractions, the partial hyperintensity of the periosteum remained observable. The stripped- and freed-partial-periosteum porcine fibula connected with the periosteum which had not been stripped from the cortical bone exhibited a free and outwardly curling linear hyperintensity (Fig. 4).

Meniscal signal characteristics of the knee joint

The meniscus exhibited a hyperintensity in the difference images following echo subtraction (Fig. 5). The torn meniscal fragments were observed as a visible hyperintensity shifting to the femoral intercondylar fossa in the difference images of the volunteer with the clinically suspected lateral meniscus tear (Fig. 5B).

Signal characteristics of the ligament in the UTE pulse sequence

The UTE double-echo imaging of the ankle showed a slightly higher signal for the ligament around the joint in the 1st echo images and a low signal in the 2nd echo images, while a significantly higher signal was observed in the difference images following the subtraction of the two primary echo images. The adjacent long-T2 tissues presented low signals. The 3D information for the ligaments were obtained from the 3D images that resulted from the 3D reconstruction of the difference images using the MIP (Fig. 6).

Effect of TE1 time and post-processing techniques on the images

The image analysis results showed that when comparing the various TE1s, the UTE image quality of 0.08 msec was the best; as the TE1 time was prolonged, the artifacts gradually increased. When the TE1s were 0.08, 0.16, 0.24 and 0.35 msec, the contrast-to-noise ratios were 1.74±0.54, 1.35±0.60, 1.2±0.48 and 0.89±0.24, respectively, with a statistically significant difference (F=3.681, P<0.05). Pairwise comparison results showed that the image contrast-to-noise ratio of a TE1 of 0.08 msec was higher than that of the other 3 TE1 images and exhibited statistically significant differences (q= 2.95, 4.08 and 6.43, respectively; P<0.05) while the other TE1 image contrast-to-noise ratios had no statistically significant differences among them (q=1.13, 2.34 and 3.48, respectively; P>0.05). The paired-sample t-test results demonstrated that the S/N ratio was higher in the difference images of the multiplanar reconstruction (3.76±0.88) than in the primary echo difference images (2.82±0.75) with a statistically significant difference (t=−4.851; P<0.01).

Discussion

The most common approach for the diagnosis of parenchymal disease using MRI is the use of heavily T2-weighted pulse sequences to detect the signal from the long-T2 relaxation components in normal tissues and an increase or decrease in the signal from these components in any abnormal tissues. Even the diagnostic theories of the new pulse sequences, including fast spin-echo, echo-planar imaging and fluid-attenuated-inversion recovery sequences remain unable to detect the long-T2 signals in the normal or diseased tissues.

Henkelman et al(5) regarded tissues with T2 values of <10 msec as short-T2 values (in the light of more recent pulse sequence developments, this threshold requires downward adjustment). The water protons in a number of biological tissues have T2 relaxation times of <1 msec. Such extremely short-T2 values result from the restricted mobility of water when bound to collagen or confined to small spaces (6). The tissues with short-T2 components may be divided into tissues with a minority of short-T2 components and tissues with a majority of short-T2 components. Skeletal muscle is a tissue containing a minority of short-T2 components (7).

A series of extremely short T2 tissue imaging techniques have been reported in the past 20 years, including single point imaging technology, single point slope imaging with enhanced T1, multi-point imaging (2) and water and fat-suppressed MRI (3). It has been confirmed that single point imaging technology and its variants (including multi-point imaging) are particularly effective for displaying extremely short T2 components, while requiring a fast and extremely strong gradient and a scan time that is too long to be suitable for human imaging in vivo. Other technologies for detecting short-T2 components in the developmental and application stages are magnetization transfer imaging, magic angle imaging, short TE imaging and UTE pulse sequence imaging (4). The TE ranges of various pulse sequences are shown in Table I(8).

Table I

TE range of different pulse sequence.

Table I

TE range of different pulse sequence.

TE pulse sequenceTE valueExamples of pulse sequence
Very long≥200 msec2 DFT, HASTE, fast spin echo and EPI; very heavily long T2-weighted
Long20–40 to 200 msec2 DFT, HASTE, FlAIR, fast spin echo, EPI; heavily long T2-weighted
Intermediate5–10 to 20–40 msec2 DFT, T1-weighted or proton density-weighted
Short0.5 to 5–10 msec2 DFT, T1-weighted
Ultrashort0.05–0.50 msecHalf rf pulse with radial center out sampling or radial sampling; short T2-weighted

[i] TE, echo time; DFT, discrete Fourier transform; HASTE, half-Fourier acquisition single-short turbo spin-echo; EPI, echo planar imaging; T2, transverse relaxation time; F1AIRE, fluid attenuated inversion recovery; rf, radio frequency; T1, longitudinal relaxation time.

A UTE pulse sequence is designed to solve the difficulty in exciting the short-T2 components and rapidly collecting signals prior to signal decay. Bergin et al(9,10) first used the semi-radio frequency (RF) pulse and radial sampling pulse sequence clinically in lung imaging in 1991 and 1992. The sequence was then used for imaging other areas and its application in the musculoskeletal system began in 1995 (1119). Since then, the UTE sequence has been more widely applied to the musculoskeletal system (2024). The acronyms used to describe the UTE sequences are shown in Table II(25).

Table II

Ultrashort echo time pulse sequence.

Table II

Ultrashort echo time pulse sequence.

Sequence TypeAcronym
Ultrashort TEUTE
Conventional ultrashort TECUTE
Fat suppressed ultrashort TEFUTE
Long T2 suppressed ultrashort TELUTE
Fat and long T2 suppressed ultrashort TEEFLUTE
Short TI inversion time ultrashort TESTUTE

[i] T2, transverse relaxation time; TI, inversion time..

In the present study, a double-echo pulse sequence MRI with 3D UTE was used. In order to emphasize the short-T2 components, difference images were obtained by subtracting the 2nd echo images from the 1st echo images to remove or reduce the signal of the long-T2 components. Thus, the images that contained short-T2 components were displayed. The 3D UTE imaging was performed on the partially-freed-periosteum porcine fibula in vitro to confirm that the 3D UTE pulse sequence was able to define the periosteum which is not observable in conventional MRI. The cortical bone, menisci and ankle ligaments were shown as hyperintensities by the UTE sequence, making detection of these tissues containing the majority of the short-T2 components available using 2 types of methods, namely those of high and low signals, and increasing the information available for clinical diagnostic work.

Using 3D acquisition through the MIP, 3D UTE imaging may provide 3D information on tendons for clinics and new anatomical reference information for the clinical diagnosis and treatment of tendon injuries. In the present study, a 2-mm thick reconstruction of the two primary echo images was performed using a multiplanar reconstruction technique and the post-reconstruction difference images were obtained by echo subtraction to markedly improve the the S/N ratio of the images. For the achilles tendon imaging, the best image quality was obtained in a TE1 of 0.08 msec following a comparison of 4 TE times. Free induction decay signals were collected in the present study and the signal attenuation was fast, therefore a short TE1 time should be used in future imaging whenever possible.

In conclusion, a double pulse sequence MRI with 3D UTE may display the short-T2 components which are not displayed in conventional clinical MRI sequences. The sequence lowers and zooms out the T2 window of the tissues that may be displayed in MRI. The visualization of the tissues by MRI is extended, founding a basis for further quantification of these tissues.

Considering that the resolution of the 3D UTE double-echo sequence imaging is not high enough, small ligament (e.g., elbow ligament) imaging was not attempted to explore its diagnostic value. Based on the present study and associated literature, the following future research directions are planned: Further adjustment of the parameters; the performance of 3D UTE double-echo sequence imaging on the elbows of a group of volunteers; investigation into the values for observing small ligaments (as elbow ligament injury is not uncommon clinically); the performance of UTE imaging on a group of patients with early stage osteosarcoma, observing the changes to the cortical bone and periosteum in the early stages; and carrying out a quantitative study with regard to the knee meniscus and its short-T2 components, including dynamic enhancement and T2-mapping with a UTE sequence.

References

1. 

Du J, Bydder M, Takahashi AM and Chung CB: Two-dimensional ultrashort echo time imaging using a spiral trajectory. Magn Reson Imaging. 26:304–312. 2008. View Article : Google Scholar : PubMed/NCBI

2. 

Fernández-Seara MA, Wehrli SL and Wehrli FW: Multipoint mapping of semi-solid materials. J Magn Reson. 160:144–150. 2003.

3. 

Wu Y, Ackerman JL, Chesler DA, Graham L, Wang Y and Glimcher MJ: Density of organic matrix of native mineralized bone measured by water- and fat-suppressed proton projection MRI. Magn Reson Med. 50:59–68. 2003. View Article : Google Scholar : PubMed/NCBI

4. 

Gatehouse PD and Bydder GM: Magnetic resonance imaging of short T2 components in tissue. Clin Radiol. 58:1–19. 2003. View Article : Google Scholar : PubMed/NCBI

5. 

Henkelman RM, Stanisz GJ and Graham SJ: Magnetization transfer in MRI: a review. NMR Biomed. 14:57–64. 2001. View Article : Google Scholar : PubMed/NCBI

6. 

Robson MD, Gatehouse PD, Bydder M and Bydder GM: Magnetic resonance: an introduction to ultrashort TE (UTE) imaging. J Comput Assist Tomogr. 27:825–846. 2003. View Article : Google Scholar : PubMed/NCBI

7. 

Fenrich FR, Beaulieu C and Allen PS: Relaxation times and microstructures. NMR Biomed. 14:133–139. 2001. View Article : Google Scholar : PubMed/NCBI

8. 

Robson MD and Bydder GM: Clinical ultrashort echo time imaging of bone and other connective tissues. NMR Biomed. 19:765–780. 2006. View Article : Google Scholar : PubMed/NCBI

9. 

Bergin CJ, Pauly JM and Macovski A: Lung parenchyma: projection reconstruction MR imaging. Radiology. 179:771–781. 1991. View Article : Google Scholar : PubMed/NCBI

10. 

Bergin CJ, Noll DC, Pauly JM, Glover GH and Macovski A: MR imaging of lung parenchyma: a solution to susceptibility. Radiology. 183:673–676. 1992. View Article : Google Scholar : PubMed/NCBI

11. 

Gold GE, Pauly JM, Macovski A and Herfkens RJ: MR spectroscopic imaging of collagen: tendons and knee menisci. Magn Reson Med. 34:647–654. 1995. View Article : Google Scholar : PubMed/NCBI

12. 

Nielsen HT, Gold GE, Olcott EW, Pauly JM and Nishimura DG: Ultra-short echo-time 2D time-of-flight MR angiography using a half-pulse excitation. Magn Reson Med. 41:591–599. 1999. View Article : Google Scholar : PubMed/NCBI

13. 

Waldman A, Rees JH, Brock CS, Robson MD, Gatehouse PD and Bydder GM: MRI of the brain with ultra-short echo-time pulse sequences. Neuroradiology. 45:887–892. 2003. View Article : Google Scholar : PubMed/NCBI

14. 

Gatehouse PD, He T, Puri BK, Thomas RD, Resnick D and Bydder GM: Contrast-enhanced MRI of the menisci of the knee using ultrashort echo time (UTE) pulse sequences: imaging of the red and white zones. Br J Radiol. 77:641–647. 2004. View Article : Google Scholar : PubMed/NCBI

15. 

Brittain JH, Shankaranarayanan A, Ramanan V, et al: Ultra-Short TE imaging with single-digit (8 microsecond) TE. In: Proceedings of the 12th Annual Meeting of ISMRM; Kyoto, Japan. pp. 6292004

16. 

Benjamin M, Toumi H, Ralphs JR, Bydder G, Best TM and Milz S: Where tendons and ligaments meet bone: attachment sites (‘entheses’) in relation to exercise and/or mechanical load. J Anat. 208:471–490. 2006.PubMed/NCBI

17. 

McGonagle D: Diagnosis and treatment of enthesitis. Rheum Dis Clin North Am. 29:549–560. 2003. View Article : Google Scholar

18. 

McGonagle D, Benjamin M, Marzo-Ortega H and Emery P: Advances in the understanding of entheseal inflammation. Curr Rheumatol Rep. 4:500–506. 2002. View Article : Google Scholar

19. 

Gatehouse PD, Thomas RW, Robson MD, Hamilton G, Herlihy AH and Bydder GM: Magnetic resonance imaging of the knee with ultrashort TE pulse sequences. Magn Reson Imaging. 22:1061–1067. 2004. View Article : Google Scholar : PubMed/NCBI

20. 

Du J, Carl M, Bydder M, Takahashi A, Chung CB and Bydder GM: Qualitative and quantitative ultrashort echo time (UTE) imaging of cortical bone. J Magn Reson. 207:304–311. 2010. View Article : Google Scholar : PubMed/NCBI

21. 

Anumula S, Wehrli SL, Magland J, Wright AC and Wehrli FW: Ultra-short echo-time MRI detects changes in bone mineralization and water content in OVX rat bone in response to alendronate treatment. Bone. 46:1391–1399. 2010. View Article : Google Scholar : PubMed/NCBI

22. 

Williams A, Qian Y, Bear D and Chu CR: Assessing degeneration of human articular cartilage with ultra-short echo time (UTE) T2* mapping. Osteoarthritis Cartilage. 18:539–546. 2010. View Article : Google Scholar : PubMed/NCBI

23. 

Williams A, Qian Y, Chu CR and Bowers M: In vivo MRI UTE-T2* is elevated in both torn and surface intact human menisci of anterior cruciate ligament injured knees. Osteoarthritis Cartilage. 19:S11–S12. 2011.

24. 

Du J, Carl M, Bae WC, et al: Dual inversion recovery ultrashort echo time (DIR-UTE) imaging and quantification of the zone of calcified cartilage (ZCC). Osteoarthritis Cartilage. 21:77–85. 2013. View Article : Google Scholar : PubMed/NCBI

25. 

Holmes JE and Bydder GM: MR imaging with ultrashort TE (UTE) pulse sequences: Basic principles. Radiography. 11:163–174. 2005. View Article : Google Scholar

Related Articles

Journal Cover

May 2013
Volume 5 Issue 5

Print ISSN: 1792-0981
Online ISSN:1792-1015

Sign up for eToc alerts

Recommend to Library

Copy and paste a formatted citation
x
Spandidos Publications style
Ma L, Meng Q, Chen Y, Zhang Z, Sun H and Deng D: Preliminary use of a double‑echo pulse sequence with 3D ultrashort echo time in the MRI of bones and joints. Exp Ther Med 5: 1471-1475, 2013
APA
Ma, L., Meng, Q., Chen, Y., Zhang, Z., Sun, H., & Deng, D. (2013). Preliminary use of a double‑echo pulse sequence with 3D ultrashort echo time in the MRI of bones and joints. Experimental and Therapeutic Medicine, 5, 1471-1475. https://doi.org/10.3892/etm.2013.993
MLA
Ma, L., Meng, Q., Chen, Y., Zhang, Z., Sun, H., Deng, D."Preliminary use of a double‑echo pulse sequence with 3D ultrashort echo time in the MRI of bones and joints". Experimental and Therapeutic Medicine 5.5 (2013): 1471-1475.
Chicago
Ma, L., Meng, Q., Chen, Y., Zhang, Z., Sun, H., Deng, D."Preliminary use of a double‑echo pulse sequence with 3D ultrashort echo time in the MRI of bones and joints". Experimental and Therapeutic Medicine 5, no. 5 (2013): 1471-1475. https://doi.org/10.3892/etm.2013.993