kth.sePublications KTH
Operational message
There are currently operational disruptions. Troubleshooting is in progress.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Development and application of rule- and learning-based approaches within the scope of neuroimaging: Tensor voting, tractography and machine learning
KTH, School of Engineering Sciences in Chemistry, Biotechnology and Health (CBH), Biomedical Engineering and Health Systems, Medical Imaging.ORCID iD: 0000-0002-6827-9162
2020 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The opportunity to non-invasively probe the structure and function of different parts of the human body makes medical imaging an indispensable tool in clinical diagnostics and related fields of research. Especially neuroscientists rely on modalities like structural or functional Magnetic Resonance Imaging, Computed Tomography or Positron Emission Tomography to study the human brain in vivo. But also in clinical routine, diagnosis, screening or follow-up of different pathological conditions build upon the use of neuroimaging.

Computational solutions are essential for the analysis of medical images. While in the case of conventional photography the recorded signal comprises the actual image, most medical imaging devices require the reconstruction of an image from the acquired data. However, not only the image formation, but also further processing tasks to assist doctors or researchers in the interpretation of the data and eventually in subsequent decision making, rely more and more on automation. Typical tasks range from locating and measuring objects in a single patient, e.g. a particular organ, a tumour or a specific region in the brain, to comparing such measurements over time between groups consisting of large numbers of subjects. Automated solutions for these scenarios are required to model complex relations of data in the presence of acquisition noise and subject variability while assuring a tractable computational demand.

Traditionally, the development of computational algorithms for medical imaging problems focused on rule-based strategies. Explicitly defined rules that encode the knowledge of the developer are characteristic for such approaches. Within the last decade, this paradigm began to change and learning-based models dramatically gained in popularity. These rely on fitting a complex model to large amounts of data samples, often annotated, which are representative for a particular problem. Instead of manually designing the sought-after solution, it is ‘learned from the data’. While these models have shown enormous potential, they also pose important questions for method developers. How can I get hold of enough data? How much data is enough? How can I obtain proper annotations?

This thesis comprises six studies covering the development and the application of methods along the whole pipeline of medical image analysis. Studies I and II propose different extensions to the method of tensor voting to make it applicable in specific medical imaging problems. Studies III–V address the use of modern machine learning techniques, in particular neural networks, in the field of tractography. Notably, the challenge of obtaining adequately annotated data samples is a topic in Study V. In Study VI, a prospective neuroimaging study of unilateral ear canal atresia in adults is presented, covering the application of methods from data acquisition to group comparison. Overall, the compiled works contributed, in one way or the other, to the non-invasive extraction of knowledge from the human body through automated processing of medical images.

Abstract [sv]

Möjligheten att från utsidan undersöka struktur och funktion hos olika delar av människokroppen har gjort medicinsk avbildning till ett oumbärligt verktyg i klinisk diagnostik och relaterade forskningsområden. Särskilt inom neurovetenskap är forskarna starkt beroende av metoder som strukturell eller funktionell magnetresonanstomografi (MRT), datortomografi (DT) eller positronemissionstomografi (PET) för att studera hjärnan hos den levande människan. Men också i rutinsjukvården bygger diagnostik, hälsokontroll eller uppföljning av olika sjukdomstillstånd på avbildning av hjärnan.

Beräkningsmetoder är oundgängliga för att analysera medicinska bilder. I motsats till konventionell fotografi, där den insamlade signalen innehåller själva bilden, kräver de flesta medicinska avbildningsmetoder att bilden rekonstrueras från insamlade data. Men det är inte bara bildalstringen, utan även den fortsatta behandlingen för att stödja det efterföljande beslutsfattandet, som är mer och mer automatiserade. Typiska uppgifter kan handla om att lokalisera och mäta strukturer i den enskilda patienten – t.ex. ett visst organ, en tumör eller en del av hjärnan – eller att jämföra sådana mätningar över tid mellan grupper bestående av ett stort antal personer. Automatiserade lösningar för dessa uppgifter krävs för att modellera komplexa relationer mellan data som är behäftade med insamlingsbrus och individuell variation utan att beräkningarna blir ohanterligt krävande.

Av tradition har utvecklingen av beräkningslösningar för medicinska avbildningsproblem fokuserat på regelbaserade strategier, ett arbetssätt som kännetecknas av explicit definierade regler som omsätter utvecklarens kunskaper. Under det senaste årtiondet har detta paradigm börjat ändras, och inlärningsbaserade modeller har ökat dramatiskt i popularitet. Dessa bygger på att en komplex modell anpassas till stora datamängder, ofta försedda med något slags anteckningar av erfarna praktiker (annoteringar), som kännetecknar ett specifikt problem. I stället för att manuellt konstruera den eftersökta lösningen, blir den inlärd från data. Samtidigt som dessa modeller har en enorm potential, ställer de utvecklarna inför viktiga frågor: Hur ska jag få tag i tillräckligt mycket data? Hur mycket data är tillräckligt? Hur ska jag få annoteringar av hög kvalitet?

Denna avhandling omfattar sex studier som täcker utveckling och tillämpning av metoder genom hela den medicinska bildbehandlingskedjan. Studie I och II föreslår olika utvidgningar av metoden tensorröstning för att göra den tillämpbar på specifika medicinska avbildningsproblem. Studie III–V behandlar användningen av moderna maskinlärningstekniker, mer specifikt neuronnät, inom området traktografi (avbildning av nervbanor i hjärnan). Utmaningen i att erhålla tillräckliga mängder annoterade data är centralt i Studie V. Studie VI utgör en prospektiv hjärnavbildningsstudie på vuxna med outvecklad inre hörselgång och innefattar tillämpning av metoder från datainsamlingtill gruppjämförelser. Sammantaget har alla de ingående arbetena, på ett eller annat sätt, bidragit till icke-invasiv generering av kunskap om människokroppen genom automatiserad medicinsk bildbehandling.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2020. , p. 71
Series
TRITA-CBH-FOU ; 2020:14
Keywords [en]
tensor voting, tractography, deep learning, tractogram filtering, diffusion magnetic resonance imaging
Keywords [sv]
tensorröstning, traktografi, djupinlärning, traktogramfiltrering, diffusions-MRT
National Category
Medical Imaging
Research subject
Applied Medical Technology
Identifiers
URN: urn:nbn:se:kth:diva-272728ISBN: 978-91-7873-531-0 (print)OAI: oai:DiVA.org:kth-272728DiVA, id: diva2:1426857
Public defence
2020-05-18, https://kth-se.zoom.us/j/66671899677, 09:00 (English)
Opponent
Supervisors
Note

QC 2020-04-27

Available from: 2020-04-27 Created: 2020-04-27 Last updated: 2025-02-09Bibliographically approved
List of papers
1. Steering second-order tensor voting by vote clustering
Open this publication in new window or tab >>Steering second-order tensor voting by vote clustering
2016 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Among the various diffusion MRI techniques, diffusion tensor imaging (DTI) is still most commonly used in clinical practice in order to investigate connectivity and fibre anatomy in the human brain. Besides its apparent advantages of a short acquisition time and noise robustness compared to other techniques, it suffers from its major weakness of assuming a single fibre model in each voxel. This constitutes a problem for DTI fibre tracking algorithms in regions with crossing fibres. Methods approaching this problem in a postprocessing step employ diffusion-like techniques to correct the directional information. We propose an extension of tensor voting in which information from voxels with a single fibre is used to infer orientation distributions in multi fibre voxels. The method is able to resolve multiple fibre orientations by clustering tensor votes instead of adding them up. Moreover, a new vote casting procedure is proposed which is appropriate even for small neighbourhoods. To account for the locality of DTI data, we use a small neighbourhood for distributing information at a time, but apply the algorithm iteratively to close larger gaps. The method shows promising results in both synthetic cases and for processing DTI-data of the human brain.

Place, publisher, year, edition, pages
IEEE Computer Society, 2016
Keywords
Tensor voting, spherical clustering, DTI
National Category
Medical Imaging
Research subject
Medical Technology
Identifiers
urn:nbn:se:kth:diva-190103 (URN)10.1109/ISBI.2016.7493492 (DOI)000386377400294 ()2-s2.0-84978401116 (Scopus ID)978-1-4799-2349-6 (ISBN)
Conference
IEEE 13th International Symposium on Biomedical Imaging (ISBI)
Funder
Swedish Research Council, 2012-3512
Note

QC 20160811

Available from: 2016-08-08 Created: 2016-08-08 Last updated: 2025-02-09Bibliographically approved
2. Towards grey scale-based tensor voting for blood vessel analysis
Open this publication in new window or tab >>Towards grey scale-based tensor voting for blood vessel analysis
2017 (English)In: Modeling, Analysis, and Visualization of Anisotropy, Springer Berlin/Heidelberg, 2017, no 9783319613574, p. 145-173Chapter in book (Refereed)
Abstract [en]

Tensor Voting is a technique that uses perceptual rules to group points in a set of input data. Its main advantage lies in its ability to robustly extract geometrical shapes like curves and surfaces from point clouds even in noisy scenarios. Following the original formulation this is achieved by exploiting the relative positioning of those points with respect to each other. Having this in mind, it is not a straight forward task to apply original tensor voting to greyscale images. Due to the underlying voxel grid, digital images have all data measurements at regularly sampled positions. For that reason, the pure spatial position of data points relative to each other does not provide useful information unless one considers the measured intensity value in addition to that. To account for that, previous approaches of employing tensor voting to scalar images have followed mainly two ideas. One is to define a subset of voxels that are likely to resemble a desired structure like curves or surfaces in the original image in a preprocessing step and to use only those points for initialisation in tensor voting. In other methods, the encoding step is modified e.g. by using estimations of local orientations for initialisation. In contrast to these approaches, another idea is to embed all information given as input, that is position in combination with intensity value, into a 4D space and perform classic tensor voting on that. In doing so, it is neither necessary to rely on a preprocessing step for estimating local orientation features nor is it needed to employ assumptions within the encoding step as all data points are initialised with unit ball tensors. Alternatively, the intensity dimension could be partially included by considering it in the weighting function of tensor voting while still employing 3D tensors for the voting. Considering the advantage of a shorter computation time for the latter approach, it is of interest to investigate the differences between these two approaches. Although different methods have employed an ND implementation of tensor voting before, the actual interpretation of its output, that is the estimation of a local hyper surface at each point, depends on the actual application at hand. As we are especially interested in the analysis of blood vessels in CT angiography data, we study the feasibility of detecting tubular structures and the estimation of their orientation totally within the proposed framework and also compare the two mentioned approaches with a special focus on these aspects. In this chapter we first provide the formulation of both approaches followed by the application-specific interpretations of the shape of 4D output tensors. Based on that, we compare the information inferred by both methods from both synthetic and medical image data focusing on the application of blood vessel analysis.

Place, publisher, year, edition, pages
Springer Berlin/Heidelberg, 2017
Series
Mathematics and Visualization, ISSN 1612-3786
National Category
Medical Imaging
Identifiers
urn:nbn:se:kth:diva-217130 (URN)10.1007/978-3-319-61358-1_7 (DOI)2-s2.0-85031994994 (Scopus ID)
Funder
Swedish Heart Lung Foundation, 2011-0376Swedish Research Council, 2014-6153 and 2012-3512
Note

QC 20241113

Part of ISBN 9783319613574

Available from: 2017-11-01 Created: 2017-11-01 Last updated: 2025-02-09Bibliographically approved
3. Learning a single step of streamline tractography based on neural networks
Open this publication in new window or tab >>Learning a single step of streamline tractography based on neural networks
2018 (English)In: Computational Diffusion MRI: MICCAI Workshop on Computational Diffusion MRI, CDMRI 2017, Quebec, 10 September 2017, Springer Nature , 2018, p. 103-116Chapter in book (Other academic)
Abstract [en]

This paper focuses on predicting a single step of streamline tractography from diffusion magnetic resonance imaging data by using different predictors based on neural networks. We train 18 different classifiers in order to assess the effect of including neighbourhood information in the learning step or as a post processing step. Moreover, the performance using four different post processing approaches as well as the variation of the number of classes resulting in a total of 60 experimental configurations are assessed. Further, a comparison to 12 regression-based networks is performed and the effect of including several streamline steps in the network input is investigated. All networks are trained and tested on the ISMRM 2015 tractography challenge data. Our results do not indicate a clear improvement when using neighbouring data (regardless if it used as an input or as a post processing). Also, the linear interpolation of the diffusion data does not outperform the less expensive nearest neighbour approach. As opposed to that, using a linear model on top of the output of the classifiers is beneficial and—in combination with at least 200 classes—resulted in a similar performance as the regression approach. Finally, providing the networks with additional curvature information led to a clear improvement of prediction performance. Our analysis of accuracy based on average angular errors suggests that also considering spatial location in the learning step might further improve machine learning-based streamline tractography algorithms.

Place, publisher, year, edition, pages
Springer Nature, 2018
Series
Mathematics and Visualization
National Category
Medical Imaging
Identifiers
urn:nbn:se:kth:diva-259767 (URN)10.1007/978-3-319-73839-0_8 (DOI)2-s2.0-85065601284 (Scopus ID)
Note

Part of book: ISBN 978-331973838-3

QC 201909223

Available from: 2019-09-23 Created: 2019-09-23 Last updated: 2025-02-09Bibliographically approved
4. Tractography and machine learning: Current state and open challenges
Open this publication in new window or tab >>Tractography and machine learning: Current state and open challenges
2019 (English)In: Magnetic Resonance Imaging, ISSN 0730-725X, E-ISSN 1873-5894, Vol. 64, p. 37-48Article in journal (Refereed) Published
Abstract [en]

Supervised machine learning (ML) algorithms have recently been proposed as an alternative to traditional tractography methods in order to address some of their weaknesses. They can be path-based and local-model-free, and easily incorporate anatomical priors to make contextual and non-local decisions that should help the tracking process. ML-based techniques have thus shown promising reconstructions of larger spatial extent of existing white matter bundles, promising reconstructions of less false positives, and promising robustness to known position and shape biases of current tractography techniques. But as of today, none of these ML-based methods have shown conclusive performances or have been adopted as a de facto solution to tractography. One reason for this might be the lack of well-defined and extensive frameworks to train, evaluate, and compare these methods. In this paper, we describe several datasets and evaluation tools that contain useful features for ML algorithms, along with the various methods proposed in the recent years. We then discuss the strategies that are used to evaluate and compare those methods, as well as their shortcomings. Finally, we describe the particular needs of ML tractography methods and discuss tangible solutions for future works.

Place, publisher, year, edition, pages
Elsevier, 2019
Keywords
Diffusion MRI, Tractography, Machine learning, Benchmark
National Category
Radiology, Nuclear Medicine and Medical Imaging
Identifiers
urn:nbn:se:kth:diva-266206 (URN)10.1016/j.mri.2019.04.013 (DOI)000502191300006 ()31078615 (PubMedID)2-s2.0-85065601103 (Scopus ID)
Note

QC 20200109

Available from: 2020-01-09 Created: 2020-01-09 Last updated: 2022-06-26Bibliographically approved
5. Merging label sources and multiple modalities in a deep neural network for tractogram filtering
Open this publication in new window or tab >>Merging label sources and multiple modalities in a deep neural network for tractogram filtering
(English)Manuscript (preprint) (Other academic)
Abstract [en]

One of the main issues of current tractography methods is their high false-positive rate. Tractogram filtering is an option for removing false positive streamlines from tractography data in a post-processing step. In this paper, we train a deep neural network for filtering tractography data in which every streamline of a tractogram is classified as plausible, implausible or inconclusive. For this, we use four different tractogram filtering strategies as supervisors, whose outputs are combined to obtain the classification labels for the streamlines. We assessed the importance of different features of the streamlines for performing this classification task, including the coordinates of the streamlines, diffusion data, landmarks, T1-weighted information and a brain parcellation. We found that the streamline coordinates are the most relevant, followed by the diffusion data, in this particular classification task.

Keywords
Tractogram filtering, Deep Learning, Tractography, Diffusion magnetic resonance imaging
National Category
Medical Imaging
Research subject
Technology and Health
Identifiers
urn:nbn:se:kth:diva-272727 (URN)
Note

QC 20200506

Available from: 2020-04-27 Created: 2020-04-27 Last updated: 2025-02-09Bibliographically approved
6. Unilateral Ear Canal Atresia:A Study ofCortical Morphologyand Functional Connectivity
Open this publication in new window or tab >>Unilateral Ear Canal Atresia:A Study ofCortical Morphologyand Functional Connectivity
Show others...
(English)Manuscript (preprint) (Other academic)
Abstract [en]

Objectives

The objective is to investigate if unilateral conductive hearing loss in ear canal atresia without hearing treatment in childhood leads to cortical reorganization in functional connectivity and gray matter morphology.

Design

A prospective study including 18 patients with unilateral congenital ear canal atresia age- and gender-matched with normal hearing controls were examined with audiometry, T1, T2 FLAIR and resting state functional magnetic resonance imaging. The thickness and volume of 68 cortical regions were computed from the anatomical images, and seed-based correlation analysis was performed on the resting state functional data for 6 auditory cortical regions of interest.

Results

No statistically significant differences were seen when applying correction for multiple comparisons. However, trends were observed (uncorrected p<0.05) showing larger cortical volumes of the right precuneus cortex in the atretic group (p=0.014), as well as increased functional connectivity of this region coupled to the planum polare in the right hemisphere (p<0.02). The right side precuneus cortex volume was also the most important variable for distinguishing between patients and controls. Cortical volumes of right primary motor cortex (p=0.034) and right somatosensory cortex (p=0.043) were also larger in the atretic group. No differences were observed in the primary auditory cortices’ volume or thickness.

Conclusion

No differences were found within the primary auditory cortices in cortical thickness or volume, which might reflect childhood plasticity with increased bilateral cortical representation of the normal ear, or cross-modal plasticity with stimuli from other senses. Morphology and functional connectivity pattern indicate increased integration of visual and auditory input in unilateral atresia, although future studies are required to support these findings.

Keywords
Unilateral ear canal atresia, gray matter morphology, functional brain connectivity, MRI
National Category
Neurosciences
Research subject
Technology and Health
Identifiers
urn:nbn:se:kth:diva-272725 (URN)
Note

QC 20200506

Available from: 2020-04-27 Created: 2020-04-27 Last updated: 2022-06-26Bibliographically approved

Open Access in DiVA

phd_thesis_kappa_djoergens(68391 kB)1003 downloads
File information
File name FULLTEXT01.pdfFile size 68391 kBChecksum SHA-512
6b23b4aee2f7b438b68e50169fce0128a3ab42b0ff2ba61d4a163c3081b524dfb8bac0b6a450b1b8f59cb4f468727ea068bbddd5e05036a7268bc8709aa4a5e5
Type fulltextMimetype application/pdf

Authority records

Jörgens, Daniel

Search in DiVA

By author/editor
Jörgens, Daniel
By organisation
Medical Imaging
Medical Imaging

Search outside of DiVA

GoogleGoogle Scholar
Total: 1003 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1342 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf