Task Book
navigation2003
  [Home] [Search Instructions]   
Task Last Updated: 02/27/2004 
Division Name: Bioastronautics Research 
Program/Discipline: BIOMEDICAL RESEARCH AND COUNTERMEASURES 
Element/Subdiscipline: Operational and clinical research 
Project Title: Diagnostic Three Dimensional Ultrasonography: Development of Novel Compression, Segmentation and Registration Techniques for Manned Space Flight Applications 
Joint Agency Name:  
PI Name: Thomas, James D  PI Phone: 216-445-6312  
PI Email: thomasj@ccf.org  Fax: 216-445-7306 
PI Organization Type: NON-PROFIT 
Organization Name: Cleveland Clinic Foundation 
PI Address 1: Department of Cardiology, Desk F-15 
PI Address 2: 9500 Euclid Avenue 
City: Cleveland  State: OH  Zip Code: 44195  Congressional District: 11 
Comments:  
Project Type: GROUND  Solicitation: NSBRI 
Start Date: 07/01/2001  End Date: 06/30/2004 
No. of Post Docs: No. of PHD Degree:  
No. of Phd Students: No. of MS Degree:  
No. of MS Students: No. of BS Degree:  
No. of BS Students: Monitoring Center: NSBRI 
Contact Monitor:   Contact Phone:  
Contact Email:   Nag No.: None 
Former PI Name:      
Performance Goal No.:  
Performance Goal Text:

 

Task Description:  The National Space Biomedical Research Institute has identified that the efficient and automated delivery of health care in space is a key research arena for the future. Specifically, they propose to develop a “Smart Medical Care System" that will be able to monitor crew health, identify deviations from ground-based norms, and allow timely intervention by crew members who may have only a moderate amount of training in medicine. Such a Smart Medical Care System will have multiple components, including sensors, data analysis, data integration, and automated effectors that will ultimately deliver care. Although the development of novel sensor technology will undoubtedly be pursued in this program, it is clear that for the foreseeable future, the principal diagnostic imaging modality for crew use in space will be ultrasound. Therefore, a key goal of the Smart Medical Care System should be to optimize the use of diagnostic ultrasound in space and integrate it in an intelligent fashion with decision-making software. For the last three years, the principal investigator and colleagues have worked closely with NASA scientists, flight surgeons, and engineers to optimize research and diagnostic ultrasound aboard the International Space Station (ISS) and thus are well positioned to develop the necessary tools and techniques to integrate ultrasound into the Smart Medical Care System. One of the principal limitations of ultrasound technology is its extreme dependence on the expertise of both the acquiring examiner and the interpreting physician. This is particularly true of two-dimensional ultrasound, where the examiner is required to obtain precisely oriented anatomical sections of the organ of interest. Three-dimensional (3D) ultrasound has the advantage of acquiring a large anatomic volume from a single ultrasonic window and thus may be less dependent upon the expertise of the examiner. Furthermore, this large volume may contain sufficient anatomic landmarks to allow unambiguous registration with previously obtained 3D data from either ultrasound or other modalities such as magnetic resonance imaging (MRI) or computed tomography (CT). One could thus envision a system by which whole organs or even the entire body would be imaged in 3D prior to launch, data which could be used to compare with subsequently obtained 3D datasets using in-flight ultrasonography. The overall purpose of this grant is therefore to perform ground-based research, development, and validation aimed at optimizing diagnostic ultrasound in manned spaceflight, with the following unifying hypothesis: Serial 3D ultrasound examinations will enhance diagnostic capabilities in manned spaceflight. This hypothesis will be pursued with both hardware and software development, along with extensive validation studies. Although many disease models could serve for testing the system, we will choose to study two conditions that are highly relevant to problems associated with long-term spaceflight: nephrolithiasis and ventricular atrophy.

The technical aspects of this program will be pursued with the following specific aims:

1) Optimize acquisition methods for 3D sonography using reconstruction and real-time techniques. 2) Develop techniques for registering anatomical images from 2D and 3D ultrasound with those obtained from prior ultrasound examinations and from magnetic resonance and computed tomographic imaging, considered “gold standards” for non-invasive anatomical imaging. 3) Develop tools for abstracting, in an automated fashion, anatomic changes from serial 3D and 2D ultrasound studies. 4) Develop algorithms for the optimal compression of 3D ultrasound images. 5) Assess the ability of novice examiners to obtain 3D sonographic datasets after minimal training.

These objectives will be pursued using data from a variety of in vitro, animal and clinical models. In particular, we will take advantage of a well-established collaboration with the National Institutes of Health, which permits highly sophisticated chronic animal models to be examined with a minimum of additional resources. Although the tools developed here should be applicable to any organ of the body, we will focus our efforts in two areas that present unique challenges and also are highly relevant to spaceflight. 1) The Kidneys: Bone demineralization during prolonged spaceflight may increase the risk for kidney stones. From a technical perspective, the kidney may be a particularly easy organ to register in three dimensions with prior examinations, being static and having well-defined anatomical landmarks. Using computed tomography as the reference standard, we will examine serially patients with renal and ureteral calculi, paying particular attention to the development and resolution of hydronephrosis and calyceal dilation. 2) The Heart: Manned space flight and prolonged exposure to microgravity may result in significant myocardial atrophy. Furthermore, cardiovascular emergencies such as myocardial infarction and cardiac trauma produce structural changes that are important in guiding therapy. From a technical perspective, the heart is a more difficult organ to register than the kidney, since it is dynamic. The presence of well-defined anatomical landmarks, however, assists in this process. To better understand the process of cardiac remodeling with unloading, we will examine two groups of patients in whom sudden changes in chronic loading conditions are known to produce profound ventricular remodeling: 1) patients with aortic stenosis undergoing aortic valve replacement; 2) patients with chronic severe aortic insufficiency undergoing aortic valve replacement or repair. These patient groups will provide insight into the determinates of ventricular remodeling, while forming an important testbed for the assessment of our registration and comparison algorithms for detecting changes in ventricular morphology over time.

In addition to the practical application to manned spaceflight and the ISS, these systems each represent significant societal problems for which the incidence of disease is common enough to study within the time period of this grant. Furthermore, ultrasound is the standard diagnostic tool used in the management of patients with each of these conditions. At the conclusion of this project, we anticipate delivering to the National Space Biomedical Research Institute and its Smart Medical Care System a set of algorithms and software for the nonrigid morphological registration and comparison of serial two and three dimensional ultrasound datasets and validated algorithms for optimal compression of 3D ultrasound data. In addition to these technical deliverables, our validation work on nephrolithiasis will provide important diagnostic clues for assessing this condition in manned spaceflight. Similarly, the work on cardiac mass regression following unloading will be invaluable to the NASA research and medical operations community in assessing the impact of long-term spaceflight on cardiac atrophy and utility of prophylactic countermeasures.

 

Task Objective:

 

Task Significance:

 

Task Progress: Clinical Significance of 3D Ultrasound Capabilities: To date we have performed over 2500 patient examinations with real-time 3D echocardiography, including exercise and intraoperative (epicardial) examinations, with quantitative validation in aneurysmal ventricles, aortic regurgitation, hypertrophic cardiomyopathy, mitral regurgitation, and dilated cardiomyopathy. We validated 3D color Doppler stroke volume as well as 3D reconstruction using a device identical to the ultrasound system on the ISS. Building on our experience with the Volumetrics RT3DUS, we have begun to use a much improved acquisition device (Sonos 7500) to obtain over 100 RT3D examinations in a wide variety of cardiac pathologies, including 28 acquisitions obtained epicardially in the operating room. Already, six abstract presentations and a journal article have resulted from this work including volume assessment validation, valvular assessment for surgical planning compared to standard 2D imaging, and surgical outcome results of myectomy in patients with hypertrophic cardiomyopathy.

Compression, Visualization, Segmentation, And Registration Techniques For 3D Ultrasound: Despite significant advances in ground-based and satellite data communications, digital transfer of data remains a formidable challenge. Optimistic NASA estimates indicate that the overall Deep Space Network (DSN) bandwidth will not exceed 400 kbps until the year 2004 and transfer rates not exceeding 1 Mbps until the year 2010. Therefore, assuming 100% error-free, 100% efficiency/availability, and complete dedication of the entire DSN bandwidth, transmission of a single cardiac cycle 3D volumetric dataset with an estimated size of 60 MB would take over 15 minutes. Clearly, it is easy to appreciate the need for high degrees of volume compression if diagnostic and potentially therapeutic ultrasound imaging is to be applied to future NASA deep space missions. Even the relatively low resolution Volumetrics device generates up to 60 MB of data per second and has proven cumbersome for visualization and quantification. To make this device applicable to space use, we validated the use of a 3D wavelet packet transform for 100:1 compression of 3D echo. We have shown the ability of maintaining a higher signal-to-noise ratio using a modified set partitioning in hierarchical trees algorithm (MSPIHT) over the conventional technique. Also, we have developed highly compact software for visualization, segmentation, and registration. These now can register pre- and post-exercise images and cross-modality data as described next.

Mutual Information-Based Registration of Ultrasound Volumes: We have shown that both rigid-body and affine misalignments can be recovered between volumetric ultrasound images using mutual information-based registration. In this approach, one of the two images (primary) is kept stationary and the other (secondary) is transformed iteratively until the optimal alignment, corresponding to the maximum of the mutual information (MI) function, is found. MI is an intensity-based measure, which conveys the amount of information that the primary contains about the secondary. MI is more effective than other intensity-based measures such as simple cross-correlation, since it is a statistical measure that works even if voxel intensities in the primary are nonlinearly related to those in the secondary. We search for the maximum of the MI by searching for a set of geometric transformation parameters, which produce a 4 x 4 transformation matrix T. Upon convergence, the MI is maximized between the primary (A) and the transformed secondary (TB). T refers to rigid-body transformation if it incorporates rotation and translation only. The transformation is affine (nonrigid) if it includes scaling and shearing, as well.

Registration of Resting Cardiac Ultrasound and SPECT: We have also performed MI-based registration of gated Sestamibi SPECT and RT3D ultrasound images in a pilot study involving nine subjects. Since ultrasound collects more frames per cardiac cycle, 8 original SPECT frames were interpolated with the aid of associated electrocardiograms to match the available ultrasound frames. The average rating for success made by 5 experts was 3.58, with a 1 meaning poor registration and 5 meaning near perfect spatiotemporal registration. Of note, we detected virtually all clinically relevant abnormalities, such as a perfusion defect in the right coronary artery territory that matched with a wall motion abnormality in the inferior wall by 3DUS. Only 7 of 45 evaluations were scored below 3; these were primarily due to poor endocardial definition in ultrasound images – attributed to the quality of the Volumetrics 3DUS device rather than the registration procedure itself. Recently, the image quality of 3D ultrasound has improved significantly. We will further explore cross registration capabilities in Specific Aim #2.

Teaching Novice Examiners to Obtain 2D and 3D Data With Minimal Training: A major issue with diagnostic imaging in space is the limited training that astronauts are likely to have, given the other demands on their schedule. In an important recent study, 5 novices with only 4 hours of training were able to perform technically adequate 2D echocardiograms with remote coaching from an experienced sonographer. Quantitative parameters (e.g., LV mass, ejection fraction, mitral inflow) agreed with (<±10%) and correlated well with (r>0.85) measurements by an expert. 3D studies of both the heart and kidney are ongoing, but anecdotal observations from this work suggest that 3D imaging is even easier to learn. Precise orientation of the probe is not necessary for 3D acquisitions; however, images obtained that must include the structure of interest and be free of near-field and other artifacts.

Facilitate ISS Ultrasound Use and Optimize Digital Downlink Technology: After 4 years of work with JSC engineers during our first grant (NCC9-60), a Philips HDI-5000 ultrasound system was launched to the International Space Station in March, 2001. Since then we have worked closely with Medical Operations physicians and engineers accomplishing several goals: optimizing the probe availability for this unit, testing digital file transfer from ISS to the ground, and developing live video feed capability for guiding the acquisition and real-time interpretation of data by a ground based expert. Digital echocardiography is now fully feasible on the ground with over 250 studies being stored daily at the Cleveland Clinic (~3 terabytes annually). The American Society of Echocardiography has made all-digital storage and analysis a major policy goal of the organization, and the PI now chairs that effort.

Development of wireless technology to interface with a handheld digital ultrasound system: We continue to work with Kevin Montgomery of the Stanford Biocomputation Center/NASA Ames Research Center. Their approach has been to develop small, wearable sensors that register heart rate, respirations, temperature, etc.; then, digitize these signals, and transmit them using wireless protocols. The goal is to capitalize on the wireless development effort and the infrastructure being developed at Ames and Stanford. This would allow full resolution (640x480x30 Hz) ultrasound to be made available in real-time on a web site with a latency of less than 2 seconds, short enough to allow realistic coaching and guidance of the acquisition by an off-site expert. To accomplish this, a wireless testbed within the Cleveland Clinic echocardiography laboratory is utilized to interface to the portable Sonoheart ultrasound device (Sonosite, Bothell, WA) via a PC with wireless capability using a video capture card. We have investigated echocardiographic exam review using Windows CE devices for their ability to view ultrasound data when connected using the 802.11 protocols.

 

Earth Benefits: • Real-time 3D ultrasound is accurate for cardiac volumes and function • Mitral annular motion useful for assessing LV function • 3D aortic annular motion predictive for global LV function • Wavelet packet compression can be applied to 3D ultrasound at ratios > 100:1 • Multimodality registration successfully accomplished 
NSCORT Background/History:  
Flight Program:  
Flight Assignment:

 

Bibliography Type: Description:  (Last Updated: 02/27/2004)
Articles in Peer-reviewed Journals Thomas JD. " Ultrasound in Space" Medica Mundi. 2002. , Oct-2002
Articles in Peer-reviewed Journals Thomas JD, Greenberg NL, Garcia MJ. "Digital echocardiography 2002: Now is the time" J Am Soc Echocardiogr. 2002;15:831-8. , Oct-2002
Abstracts for Journals and Proceedings Saracino G, Shiota T, Qin JX, Thomas JD. ". A new computerized method to trace mitral anulus in three-dimentional space from three-dimensional echocardiographic (RT3DE) image: an in vitro validation study." J Am Coll Cardiol

2003; 41: 520A , Jan-2003

Abstracts for Journals and Proceedings Saracino G, Shiota T, Qin JX, Greenberg NL, Thomas JD "Determination of mitral annular 3-D geometry from real-time 3-D echocardiography: an in-vitro validation and clinical study." J Am Coll Cardiol

2003; 41: 430A , Jan-2003

Abstracts for Journals and Proceedings Agler D, Qin J, Shiota T, Shin J, Kassimatis C, Nash P, Oryszak S, Pettersson G, Griffin B, Grimm R, Thomas J. "Aortic Abnormalities Determined by Live 3D Echo: Comparison with 2D Echocardiographic " J Am Soc Echocardiogr.

2003;16:501. , Jan-2003

Abstracts for Journals and Proceedings Agler D, Qin J, Shiota T, Shin J, Nash P, Morehead A, Greenberg N, Stewart W, Cosgrove DI, Thomas J. "Initial Experience of Epicardial Live 3D Echo for Determining Mitral Valvular Pathology: Operative Validation" Am Soc Echocardiogr.

2003;16:501. , Jan-2003

Abstracts for Journals and Proceedings Qin J, Shiota T, Shin J-H, Agler D, Borowski A, Grimm R, Wilkoff B, Thomas J. "Tracking Pacemaker Wire and Lead in Patients with Permanent Right Ventricular Pacing by Live 3D Echo: Comparison with 2D Echo." J Am Soc Echocardiogr.

2003;16:551, Jan-2003

Abstracts for Journals and Proceedings Qin J, Shiota T, Shin J-H, Agler D, Drinko J, Nash P, Smedira N, Asher C, Lever H, Thomas J. "Quantification of Left Ventricular Outflow Tract by Live 3D Echo in Patients with Hypertrophic Cardiomyopathy" J Am Soc Echocardiogr.

2003;16:546. , Jan-2003

Abstracts for Journals and Proceedings Shin JH, Shiota T, Qin J, Agler D, Greenberg N, Oryszak S, Martin M, Nash P, Eto Y, Thomas J. "Reproducibility of Live Three-Dimensional Echocardiography in Measurement of Left Ventricular Volumes" Am Soc Echocardiogr.

2003;16:551, Jan-2003

Abstracts for Journals and Proceedings Shin JH, Shiota T, Qin J, Agler D, Greenberg N, Oryszak S, Nash P, Eto Y, Thomas J. "Validation of Live Three-Dimensional Echocardiography for Quantification of Left Ventricular Volume: Comparison with Volumetric Real-Time Three-Dimensional Echocardiography" J Am Soc Echocardiogr.

2003;16:552. , Jan-2003

Abstracts for Journals and Proceedings Qin JX, Shiota T, Agler DA, Kwan J, Shin JH, Saracino G, McCarthy PM, Thomas JD. "Deformation of Mitral Annulus in Patients with Ischemic Mitral Regurgitation: A Real-time 3D Echo Study" J Am Soc Echocardiogr

2003; 16: 546 , Jan-2003

Abstracts for Journals and Proceedings Eto Y, Shiota T, Qin JX, Shin JH, Bauer F, Agler DA, Saracino G, Greenberg NL, Thomas JD. "Assessment of Left Atrial Conduit Volume in Patients with Hypertrophic Cardiomyopathy Using Real-Time Three-Dimensional Echocardiography" J Am Soc Echocardiogr

2003; 16: 517 , Jan-2003

Abstracts for Journals and Proceedings Shin JH, Jones M, Qin JX, Agler DA, Greenberg N, Oryszak S, Saracino G, Eto Y, Shiota T. "Automated Computer Analysis of Left Ventricular Functions Using Real-Time Three-Dimensional Echocardiography: A Chronic Animal Study" Circulation

2003; 108: IV-338. , Jan-2003

Abstracts for Journals and Proceedings Saracino G, Greenberg N, Qin JX, Corsi C, Shin JH, Yoko E, Shiota T "A Novel Semi-Automatic 3D Echo Method for the Assessment of Mitral Annular Geometry in Mitral Valve Prolapse, Ischemic Mitral Regurgitation and Normals." Circulation

2003; 108:IV-554. , Jan-2003

Abstracts for Journals and Proceedings Qin JX, Shiota T, Shin JH, Agler DA, Drinko JK, Nash PJ, Smedira NG, Asher CR, Lever HM. "Intraoperative Real-Time 3D Echocardiography, a New Approach to Evaluate Myectomy in Patients with Hypertrophic Cardiomyopathy" Circulation

2003; 108:IV-595, Jan-2003

Articles in Peer-reviewed Journals Nash PG AD, Shin JH, Qin JX, Smedira NG, Lever HM, Shiota T, Thomas JD. "Epicardial Real Time 3-D Echocardiography During Septal Myectomy for Obstructive Hypertrophic Cardiomyopathy" Circulation. 2003; 108: e54-55. , Jan-2003
Articles in Peer-reviewed Journals Qin JX, Shiota T, McCarthy PM, Asher CR, Hail M, Agler DA, Popovic ZB, Greenberg NL, Smedira NG, Starling RC, Young JB, Thomas JD "Importance of mitral valve repair associated with left ventricular reconstruction for patients with ischemic cardiomyopathy: a real-time three-dimensional echocardiographic study" Circulation. 2003;108 Suppl:II241-6. , Jan-2003
Articles in Peer-reviewed Journals Walimbe V, Zagrodsky V, Raja S, Jaber W, DiFilippo F, Garcia M, Brunken R, Thomas J, Shekhar R. "Mutual information-based multimodality registration of cardiac ultrasound and SPECT images: A preliminary investigation." International Journal of Cardiovascular Imaging. 2003. , Jan-2003
Articles in Peer-reviewed Journals Shiota T, Jones M, Tsujino H, Qin JX, Zetts AD, Greenberg NL, Cardon LA, Panza JA, Thomas JD. "Quantitative analysis of aortic regurgitation: real-time 3-dimensional and 2-dimensional color Doppler echocardiographic method--a clinical and a chronic animal study." J Am Soc Echocardiogr. 2002;15:966-71. , Oct-2002
Articles in Peer-reviewed Journals Qin JX, Shiota T, Lever HM, Rubin DN, Bauer F, Kim YJ, Sitges M, Greenberg NL, Drinko JK, Martin M, Agler DA, Thomas JD. " Impact of left ventricular outflow tract area on systolic outflow velocity in hypertrophic cardiomyopathy: a real-time three-dimensional echocardiographic study." J Am Coll Cardiol. 2002;39:308-14. , Oct-2002
Articles in Peer-reviewed Journals Shekhar R, Zagrodsky V. "Mutual information-based rigid and nonrigid registration of ultrasound volumes" IEEE Trans Med Imaging. 2002:9-22. , Oct-2002
Articles in Peer-reviewed Journals Shekhar R, Zagrodsky V, Garcia M, Thomas J. "3D Stress Echocardiography: A novel application based on registration of real-time 3D ultrasound images" Proceedings of CARS. 2002:873-878. , Jan-2003
Articles in Peer-reviewed Journals Troughton R, Geraci M, Rovner A, Greenberg N, Thomas J. "The Ability of Novice Ultrasonographers with Minimal Training to Acquire Technically Adequate Echocardiographic Images under Real Time Guidance May Make Ultrasound Imaging Feasible in Remote Places Such As in Space. " . J Am Soc Echocardiogr. 2002;15:548. , Oct-2002