Introducing smart-imaging into radiologists’ daily practice.
Author and Curator: Dror Nir, PhD
Radiology congresses are all about imaging in medicine. Interestingly, radiology originates from radiation. It was the discovery of X-ray radiation at the beginning of the 20th century that opened the road to “seeing” the inside of the human body without harming it (at that time that meant cutting into the body).
Radiology meetings are about sharing experience and knowhow on imaging-based management patients. The main topic is always image-interpretation: the bottom line of clinical radiology! This year’s European Congress of Radiology (ECR) dedicated few of its sessions to recent developments in image-interpretation tools. I chose to discuss the one that I consider contributing the most to the future of cancer patients’ management.
In the refresher course dedicated to computer application the discussion was aimed at understanding the question “How do image processing and CAD impact radiological daily practice?” Experts’ reviews gave the audience some background information on the following subjects:
- A. The link between image reconstruction and image analysis.
- B. Semantic web technologies for sharing and reusing imaging-related information
- C. Image processing and CAD: workflow in clinical practice.
I find item A to be a fundamental education item. Not once did I hear a radiologist saying: “I know this is the lesion because it’s different on the image”. Being aware of the computational concepts behind image rendering, even if it is at a very high level and lacking deep understanding of the computational processes, will contribute to more balanced interpretations.
Item B is addressing the dream of investigators worldwide. Imagine that we could perform a web search and find educating, curated materials linking visuals and related clinical information, including standardized pathology reporting. We would only need to remember that search engines used certain search methods and agree, worldwide, on the method and language to be used when describing things. Having such tools is a pre-requisite to successful pharmaceutical and bio-tech development.
I find item C strongly linked to A, as all methods for better image interpretation must fit into a workflow. This is a design goal that is not trivial to achieve. To understand what I mean by that, try to think about how you could integrate the following examples in your daily workflow: i.e. what kind of expertise is needed for execution, how much time it will take, do you have the infrastructure?
In the rest of this post, I would like to highlight, through examples that were discussed during ECR 2012, the aspect of improving cancer patients’ clinical assessment by using information fusion to support better image interpretation.
- Adding up quantitative information from MR spectroscopy (quantifies biochemical property of a target lesion) and Dynamic Contrast Enhanced MR imaging (highlights lesion vasculature).
Image provided by: Dr. Pascal Baltzer, director of mammography at the centre for radiology at Friedrich Schiller University in Jena, Germany
- Registration of images generated by different imaging modalities (Multi-modal imaging registration).
The following examples: Fig 2 demonstrates registration of a mammography image of a breast lesion to an MRI image of this lesion. Fig3 demonstrates registration of an ultrasound image of a breast lesion scanned by an Automatic Breast Ultrasound (ABUS) system and an MRI image of the same lesion.
Images provided by members of the HAMAM project (an EU, FP7 funded research project: Highly Accurate Breast Cancer Diagnosis through Integration of Biological Knowledge, Novel Imaging Modalities, and Modelling): http://www.hamam-project.org
Multi-modality image registration is usually based on the alignment of image-features apparent in the scanned regions. For ABUS-MRI matching these were: the location of the nipple and the breast thickness; the posterior of the nipple in both modalities; the medial-lateral distance of the nipple to the breast edge on ultrasound; and an approximation of the ribcage using a cylinder on the MRI. A mean accuracy of 14mm was achieved.
Also from the HAMAM project, registration of ABUS image to a mammography image:
registration of ABUS image to a mammography image, Image provided by members of the HAMAM project (an EU, FP7 funded research project: Highly Accurate Breast Cancer Diagnosis through Integration of Biological Knowledge, Novel Imaging Modalities, and Modelling): http://www.hamam-project.org
- Automatic segmentation of suspicious regions of interest seen in breast MRI images
Segmentation of suspicious the lesions on the image is the preliminary step in tumor evaluation; e.g. finding its size and location. Since lesions have different signal/image characteristics to the rest of the breast tissue, it gives hope for the development of computerized segmentation techniques. If successful, such techniques bear the promise of enhancing standardization in the reporting of lesions size and location: Very important information for the success of the treatment step.
Roberta Fusco of the National Cancer Institute of Naples Pascal Foundation, Naples/IT suggested the following automatic method for suspicious ROI selection within the breast using dynamic-derived information from DCE-MRI data.
Automatic segmentation of suspicious ROI in breast MRI images, image provided by Roberta Fusco of the National Cancer Institute of Naples Pascal Foundation, Naples/IT
Her algorithm includes three steps (Figure 2): (i) breast mask extraction by means of automatic intensity threshold estimation (Otsu Thresh-holding) on the parametric map obtained through the sum of intensity differences (SOD) calculated pixel by pixel; (ii) hole-filling and leakage repair by means of morphological operators: closing is required to fill the holes on the boundaries of breast mask, filling is required to fill the holes within the breasts, erosion is required to reduce the dilation obtained by the closing operation; (iii) suspicious ROIs extraction: a pixel is assigned to a suspicious ROI if it satisfies two conditions: the maximum of its normalized time-intensity curve should be greater than 0.3 and the maximum signal intensity should be reached before the end of the scan time. The first condition assures that the pixels within the ROI have a significant contrast agent uptake (thus excluding type I and type II curves) and the second condition is required for the time-intensity pattern to be of type IV or V (thus excluding type III curves).
Written by: Dror Nir, PhD
2012pharmaceutical
Amandeep Kaur
Aashir Awan, Phd
Abhisar Anand
Adina Hazan
Alan F. Kaul, PharmD., MS, MBA, FCCP
alexcrystal6
anamikasarkar
apreconasia
aptubman
Arav Gandhi
aviralvatsa
David Orchard-Webb, PhD
danutdaagmailcom
Demet Sag, Ph.D., CRA, GCP
Dror Nir
dsmolyar
Ethan Coomber
evelinacohn
Gail S Thornton
Irina Robu
jayzmit48
jdpmd
jshertok
kellyperlman
Ed Kislauskis
larryhbern
Madison Davis
marzankhan
megbaker58
ofermar2020
Dr. Pati
pkandala
ritusaxena
Rick Mandahl
sjwilliamspa
Srinivas Sriram
stuartlpbi
Dr. Sudipta Saha
tildabarliya
zraviv06
zs22
Dr. Nir,
Thank you for this post. It is always very important to share the latest presentations from Conferences with global readers who have not participated in the Regional conference. In this case in Europe.
I report on Conferences in Cardiology, comments are , I attended, Thais for sharing, or I did not attend, thanks for sharing.
It will be interesting to have in one of your future posts a dedicated post on the following:
1. Like here, Diagnistics on breast CA, a comparison on MRI vs. Ultra sound, let’s have same methods for Brain Tumor, Kidney cancer and Spinal rumors.
2. Another post may cover Invasive Radiology, a classification of procedure performed under Imaging guidance
3. New trends in Using CT for imaging the heart, see program at Beth Israel Deaconess Medical Center in Boston
4. comparison of different algorithms used for imaging same organ, see Brigham and Women Hospital Radiology Research.
I am fascinated by medical imaging, am thrilled to read your posts and have that category of research, on our Scientific web site.
[…] potential role of ABUS in future breast screening in my recent posts: Closing the Mammography gap; Introducing smart-imaging into radiologists’ daily practice. As noted, in recent years, several ABUS systems were developed. An intriguing question is; why […]
[…] potential role of ABUS in future breast screening in my recent posts: Closing the Mammography gap; Introducing smart-imaging into radiologists’ daily practice. As noted, in recent years, several ABUS systems were developed. An intriguing question is; why […]
PUT IT IN CONTEXT OF CANCER CELL MOVEMENT
The contraction of skeletal muscle is triggered by nerve impulses, which stimulate the release of Ca2+ from the sarcoplasmic reticuluma specialized network of internal membranes, similar to the endoplasmic reticulum, that stores high concentrations of Ca2+ ions. The release of Ca2+ from the sarcoplasmic reticulum increases the concentration of Ca2+ in the cytosol from approximately 10-7 to 10-5 M. The increased Ca2+ concentration signals muscle contraction via the action of two accessory proteins bound to the actin filaments: tropomyosin and troponin (Figure 11.25). Tropomyosin is a fibrous protein that binds lengthwise along the groove of actin filaments. In striated muscle, each tropomyosin molecule is bound to troponin, which is a complex of three polypeptides: troponin C (Ca2+-binding), troponin I (inhibitory), and troponin T (tropomyosin-binding). When the concentration of Ca2+ is low, the complex of the troponins with tropomyosin blocks the interaction of actin and myosin, so the muscle does not contract. At high concentrations, Ca2+ binding to troponin C shifts the position of the complex, relieving this inhibition and allowing contraction to proceed.
Figure 11.25
Association of tropomyosin and troponins with actin filaments. (A) Tropomyosin binds lengthwise along actin filaments and, in striated muscle, is associated with a complex of three troponins: troponin I (TnI), troponin C (TnC), and troponin T (TnT). In (more ) Contractile Assemblies of Actin and Myosin in Nonmuscle Cells
Contractile assemblies of actin and myosin, resembling small-scale versions of muscle fibers, are present also in nonmuscle cells. As in muscle, the actin filaments in these contractile assemblies are interdigitated with bipolar filaments of myosin II, consisting of 15 to 20 myosin II molecules, which produce contraction by sliding the actin filaments relative to one another (Figure 11.26). The actin filaments in contractile bundles in nonmuscle cells are also associated with tropomyosin, which facilitates their interaction with myosin II, probably by competing with filamin for binding sites on actin.
Figure 11.26
Contractile assemblies in nonmuscle cells. Bipolar filaments of myosin II produce contraction by sliding actin filaments in opposite directions. Two examples of contractile assemblies in nonmuscle cells, stress fibers and adhesion belts, were discussed earlier with respect to attachment of the actin cytoskeleton to regions of cell-substrate and cell-cell contacts (see Figures 11.13 and 11.14). The contraction of stress fibers produces tension across the cell, allowing the cell to pull on a substrate (e.g., the extracellular matrix) to which it is anchored. The contraction of adhesion belts alters the shape of epithelial cell sheets: a process that is particularly important during embryonic development, when sheets of epithelial cells fold into structures such as tubes.
The most dramatic example of actin-myosin contraction in nonmuscle cells, however, is provided by cytokinesisthe division of a cell into two following mitosis (Figure 11.27). Toward the end of mitosis in animal cells, a contractile ring consisting of actin filaments and myosin II assembles just underneath the plasma membrane. Its contraction pulls the plasma membrane progressively inward, constricting the center of the cell and pinching it in two. Interestingly, the thickness of the contractile ring remains constant as it contracts, implying that actin filaments disassemble as contraction proceeds. The ring then disperses completely following cell division.
Figure 11.27
Cytokinesis. Following completion of mitosis (nuclear division), a contractile ring consisting of actin filaments and myosin II divides the cell in two.
http://www.ncbi.nlm.nih.gov/books/NBK9961/
This is good. I don’t recall seeing it in the original comment. I am very aware of the actin myosin troponin connection in heart and in skeletal muscle, and I did know about the nonmuscle work. I won’t deal with it now, and I have been working with Aviral now online for 2 hours.
I have had a considerable background from way back in atomic orbital theory, physical chemistry, organic chemistry, and the equilibrium necessary for cations and anions. Despite the calcium role in contraction, I would not discount hypomagnesemia in having a disease role because of the intracellular-extracellular connection. The description you pasted reminds me also of a lecture given a few years ago by the Nobel Laureate that year on the mechanism of cell division.
PUT IT IN CONTEXT OF CANCER CELL MOVEMENT
The contraction of skeletal muscle is triggered by nerve impulses, which stimulate the release of Ca2+ from the sarcoplasmic reticuluma specialized network of internal membranes, similar to the endoplasmic reticulum, that stores high concentrations of Ca2+ ions. The release of Ca2+ from the sarcoplasmic reticulum increases the concentration of Ca2+ in the cytosol from approximately 10-7 to 10-5 M. The increased Ca2+ concentration signals muscle contraction via the action of two accessory proteins bound to the actin filaments: tropomyosin and troponin (Figure 11.25). Tropomyosin is a fibrous protein that binds lengthwise along the groove of actin filaments. In striated muscle, each tropomyosin molecule is bound to troponin, which is a complex of three polypeptides: troponin C (Ca2+-binding), troponin I (inhibitory), and troponin T (tropomyosin-binding). When the concentration of Ca2+ is low, the complex of the troponins with tropomyosin blocks the interaction of actin and myosin, so the muscle does not contract. At high concentrations, Ca2+ binding to troponin C shifts the position of the complex, relieving this inhibition and allowing contraction to proceed.
Figure 11.25
Association of tropomyosin and troponins with actin filaments. (A) Tropomyosin binds lengthwise along actin filaments and, in striated muscle, is associated with a complex of three troponins: troponin I (TnI), troponin C (TnC), and troponin T (TnT). In (more ) Contractile Assemblies of Actin and Myosin in Nonmuscle Cells
Contractile assemblies of actin and myosin, resembling small-scale versions of muscle fibers, are present also in nonmuscle cells. As in muscle, the actin filaments in these contractile assemblies are interdigitated with bipolar filaments of myosin II, consisting of 15 to 20 myosin II molecules, which produce contraction by sliding the actin filaments relative to one another (Figure 11.26). The actin filaments in contractile bundles in nonmuscle cells are also associated with tropomyosin, which facilitates their interaction with myosin II, probably by competing with filamin for binding sites on actin.
Figure 11.26
Contractile assemblies in nonmuscle cells. Bipolar filaments of myosin II produce contraction by sliding actin filaments in opposite directions. Two examples of contractile assemblies in nonmuscle cells, stress fibers and adhesion belts, were discussed earlier with respect to attachment of the actin cytoskeleton to regions of cell-substrate and cell-cell contacts (see Figures 11.13 and 11.14). The contraction of stress fibers produces tension across the cell, allowing the cell to pull on a substrate (e.g., the extracellular matrix) to which it is anchored. The contraction of adhesion belts alters the shape of epithelial cell sheets: a process that is particularly important during embryonic development, when sheets of epithelial cells fold into structures such as tubes.
The most dramatic example of actin-myosin contraction in nonmuscle cells, however, is provided by cytokinesisthe division of a cell into two following mitosis (Figure 11.27). Toward the end of mitosis in animal cells, a contractile ring consisting of actin filaments and myosin II assembles just underneath the plasma membrane. Its contraction pulls the plasma membrane progressively inward, constricting the center of the cell and pinching it in two. Interestingly, the thickness of the contractile ring remains constant as it contracts, implying that actin filaments disassemble as contraction proceeds. The ring then disperses completely following cell division.
Figure 11.27
Cytokinesis. Following completion of mitosis (nuclear division), a contractile ring consisting of actin filaments and myosin II divides the cell in two.
http://www.ncbi.nlm.nih.gov/books/NBK9961/
This is good. I don’t recall seeing it in the original comment. I am very aware of the actin myosin troponin connection in heart and in skeletal muscle, and I did know about the nonmuscle work. I won’t deal with it now, and I have been working with Aviral now online for 2 hours.
I have had a considerable background from way back in atomic orbital theory, physical chemistry, organic chemistry, and the equilibrium necessary for cations and anions. Despite the calcium role in contraction, I would not discount hypomagnesemia in having a disease role because of the intracellular-extracellular connection. The description you pasted reminds me also of a lecture given a few years ago by the Nobel Laureate that year on the mechanism of cell division.
I actually consider this amazing blog , âSAME SCIENTIFIC IMPACT: Scientific Publishing –
Open Journals vs. Subscription-based « Pharmaceutical Intelligenceâ, very compelling plus the blog post ended up being a good read.
Many thanks,Annette