Change search
Link to record
Permanent link

Direct link
BETA
Publications (10 of 16) Show all publications
Chen, C. & Öktem, O. (2018). Indirect image registration with large diffeomorphic deformations. SIAM Journal on Imaging Sciences, 11(1), 575-617
Open this publication in new window or tab >>Indirect image registration with large diffeomorphic deformations
2018 (English)In: SIAM Journal on Imaging Sciences, ISSN 1936-4954, E-ISSN 1936-4954, Vol. 11, no 1, p. 575-617Article in journal (Refereed) Published
Abstract [en]

This paper adapts the large deformation diffeomorphic metric mapping framework for image registration to the indirect setting, where a template is registered against a target that is given through indirect noisy observations. The registration uses diffeomorphisms that transform the template through a (group) action. These diffeomorphisms are generated by solving a flow equation that is defined by a velocity field with certain regularity. The theoretical analysis includes a proof that indirect image registration has solutions (existence) that are stable and that converge as the data error tends to zero, so it becomes a well-defined regularization method. The paper concludes with examples of indirect image registration in 2D tomography with very sparse and/or highly noisy data. 

Place, publisher, year, edition, pages
Society for Industrial and Applied Mathematics Publications, 2018
Keyword
Diffeomorphisms, Image reconstruction, Indirect image registration, Large deformations, Shape regularization, Shape theory, Tomography, Deformation, Image registration, Velocity, Diffeomorphic deformation, Large deformation diffeomorphic metric mappings, Noisy observations, Regularization methods, Velocity field
National Category
Mathematics
Identifiers
urn:nbn:se:kth:diva-227421 (URN)10.1137/17M1134627 (DOI)000428946200019 ()2-s2.0-85045630390 (Scopus ID)
Note

Export Date: 9 May 2018; Article; Funding details: KTH, Kungliga Tekniska Högskolan; Funding details: 100190, CAS, Chinese Academy of Sciences; Funding details: AM13-0049, SSF, Stiftelsen för Strategisk Forskning; Funding details: 11301520, NSFC, National Natural Science Foundation of China; Funding details: NSFC, National Natural Science Foundation of China; Funding text: ∗Received by the editors June 14, 2017; accepted for publication (in revised form) December 18, 2017; published electronically March 1, 2018. http://www.siam.org/journals/siims/11-1/M113462.html Funding: This work was supported by the Swedish Foundation for Strategic Research grant AM13-0049. The first author was also supported in part by the National Natural Science Foundation of China (NSFC) under grant 11301520. †LSEC, ICMSEC, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190, People’s Republic of China (chench@lsec.cc.ac.cn). ‡Department of Mathematics, KTH–Royal Institute of Technology, 100 44 Stockholm, Sweden (ozan@kth.se). QC 20180529

Available from: 2018-05-29 Created: 2018-05-29 Last updated: 2018-05-29Bibliographically approved
Tavabi, A. H., Beleggia, M., Migunov, V., Savenko, A., Öktem, O., Dunin-Borkowski, R. E. & Pozzi, G. (2018). Tunable Ampere phase plate for low dose imaging of biomolecular complexes. Scientific Reports, 8(1), Article ID 5592.
Open this publication in new window or tab >>Tunable Ampere phase plate for low dose imaging of biomolecular complexes
Show others...
2018 (English)In: Scientific Reports, ISSN 2045-2322, E-ISSN 2045-2322, Vol. 8, no 1, article id 5592Article in journal (Refereed) Published
Abstract [en]

A novel device that can be used as a tunable support-free phase plate for transmission electron microscopy of weakly scattering specimens is described. The device relies on the generation of a controlled phase shift by the magnetic field of a segment of current-carrying wire that is oriented parallel or antiparallel to the electron beam. The validity of the concept is established using both experimental electron holographic measurements and a theoretical model based on Ampere's law. Computer simulations are used to illustrate the resulting contrast enhancement for studies of biological cells and macromolecules.

Place, publisher, year, edition, pages
Nature Publishing Group, 2018
National Category
Other Engineering and Technologies
Identifiers
urn:nbn:se:kth:diva-227500 (URN)10.1038/s41598-018-23100-3 (DOI)000429095600001 ()29618785 (PubMedID)2-s2.0-85044965282 (Scopus ID)
Funder
EU, FP7, Seventh Framework Programme, 320832
Note

QC 20180518

Available from: 2018-05-18 Created: 2018-05-18 Last updated: 2018-05-18Bibliographically approved
Tavabi, A. H., Beleggia, M., Migunov, V., Savenko, A., Öktem, O., Dunin-Borkowski, R. E. & Pozzi, G. (2018). Tunable Ampere phase plate for low dose imaging of biomolecular complexes. Scientific Reports, 8, Article ID 5592.
Open this publication in new window or tab >>Tunable Ampere phase plate for low dose imaging of biomolecular complexes
Show others...
2018 (English)In: Scientific Reports, ISSN 2045-2322, E-ISSN 2045-2322, Vol. 8, article id 5592Article in journal (Refereed) Published
Abstract [en]

A novel device that can be used as a tunable support-free phase plate for transmission electron microscopy of weakly scattering specimens is described. The device relies on the generation of a controlled phase shift by the magnetic field of a segment of current-carrying wire that is oriented parallel or antiparallel to the electron beam. The validity of the concept is established using both experimental electron holographic measurements and a theoretical model based on Ampere's law. Computer simulations are used to illustrate the resulting contrast enhancement for studies of biological cells and macromolecules.

Place, publisher, year, edition, pages
NATURE PUBLISHING GROUP, 2018
National Category
Condensed Matter Physics
Identifiers
urn:nbn:se:kth:diva-228130 (URN)10.1038/s41598-018-23100-3 (DOI)000429095600001 ()29618785 (PubMedID)2-s2.0-85044965282 (Scopus ID)
Note

QC 20180518

Available from: 2018-05-18 Created: 2018-05-18 Last updated: 2018-05-18Bibliographically approved
Adler, J. & Öktem, O. (2017). Solving ill-posed inverse problems using iterative deep neural networks. Inverse Problems, 33(12), Article ID 124007.
Open this publication in new window or tab >>Solving ill-posed inverse problems using iterative deep neural networks
2017 (English)In: Inverse Problems, ISSN 0266-5611, E-ISSN 1361-6420, Vol. 33, no 12, article id 124007Article in journal (Refereed) Published
Abstract [en]

We propose a partially learned approach for the solution of ill-posed inverse problems with not necessarily linear forward operators. The method builds on ideas from classical regularisation theory and recent advances in deep learning to perform learning while making use of prior information about the inverse problem encoded in the forward operator, noise model and a regularising functional. The method results in a gradient-like iterative scheme, where the 'gradient' component is learned using a convolutional network that includes the gradients of the data discrepancy and regulariser as input in each iteration. We present results of such a partially learned gradient scheme on a non-linear tomographic inversion problem with simulated data from both the Sheep-Logan phantom as well as a head CT. The outcome is compared against filtered backprojection and total variation reconstruction and the proposed method provides a 5.4 dB PSNR improvement over the total variation reconstruction while being significantly faster, giving reconstructions of 512 x 512 pixel images in about 0.4 s using a single graphics processing unit (GPU).

Place, publisher, year, edition, pages
Institute of Physics Publishing (IOPP), 2017
Keyword
tomography, deep learning, gradient descent, regularization
National Category
Mathematics
Identifiers
urn:nbn:se:kth:diva-219496 (URN)10.1088/1361-6420/aa9581 (DOI)000416015300001 ()2-s2.0-85038424472 (Scopus ID)
Note

QC 20171207

Available from: 2017-12-07 Created: 2017-12-07 Last updated: 2017-12-07Bibliographically approved
Dong, G., Patrone, A. R., Scherzer, O. & Öktem, O. (2015). Infinite dimensional optimization models and PDEs for dejittering. In: 5th International Conference on Scale Space and Variational Methods in Computer Vision, SSVM 2015: . Paper presented at 31 May 2015 through 4 June 2015 (pp. 678-689). Elsevier, 9087
Open this publication in new window or tab >>Infinite dimensional optimization models and PDEs for dejittering
2015 (English)In: 5th International Conference on Scale Space and Variational Methods in Computer Vision, SSVM 2015, Elsevier, 2015, Vol. 9087, p. 678-689Conference paper, Published paper (Refereed)
Abstract [en]

In this paper we do a systematic investigation of continuous methods for pixel, line pixel and line dejittering. The basis for these investigations are the discrete line dejittering algorithm of Nikolova and the partial differential equation of Lenzen et al for pixel dejittering. To put these two different worlds in perspective we find infinite dimensional optimization algorithms linking to the finite dimensional optimization problems and formal flows associated with the infinite dimensional optimization problems. Two different kinds of optimization problems will be considered: Dejittering algorithms for determining the displacement and displacement error correction formulations, which correct the jittered image, without estimating the jitter. As a by-product we find novel variational methods for displacement error regularization and unify them into one family. The second novelty is a comprehensive comparison of the different models for different types of jitter, in terms of efficiency of reconstruction and numerical complexity.

Place, publisher, year, edition, pages
Elsevier, 2015
Series
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), ISSN 0302-9743
Keyword
Dejittering, Nonlinear evolutionPDEs, Variationalmethods, Algorithms, Computer vision, Differential equations, Error correction, Jitter, Pixels, Comprehensive comparisons, Infinite dimensional, Numerical complexity, Optimization algorithms, Optimization problems, Optimization
National Category
Mathematics
Identifiers
urn:nbn:se:kth:diva-177256 (URN)10.1007/978-3-319-18461-6_54 (DOI)2-s2.0-84931081955 (Scopus ID)9783319184609 (ISBN)
Conference
31 May 2015 through 4 June 2015
Note

QC 20151119

Available from: 2015-11-19 Created: 2015-11-17 Last updated: 2015-11-19Bibliographically approved
Öktem, O. (2015). Mathematics of electron tomography. In: Handbook of Mathematical Methods in Imaging: Volume 1, Second Edition: (pp. 937-1031). Springer
Open this publication in new window or tab >>Mathematics of electron tomography
2015 (English)In: Handbook of Mathematical Methods in Imaging: Volume 1, Second Edition, Springer, 2015, p. 937-1031Chapter in book (Other academic)
Abstract [en]

This survey starts with a brief description of the scientific relevance of electron tomography in life sciences followed by a survey of image formation models. In the latter, the scattering of electrons against a specimen is modeled by the Schrödinger equation, and the image formation model is completed by adding a description of the transmission electron microscope optics and detector. Electron tomography can then be phrased as an inverse scattering problem and attention is now turned to describing mathematical approaches for solving that reconstruction problem. This part starts out by explaining challenges associated with the aforementioned inverse problem, such as the extremely low signalto- noise ratio in the data and the severe ill-posedness due to incomplete data, which naturally brings up the issue of choosing a regularization method for reconstruction. Here, the review surveys both methods that have been developed, as well as pointing to new promising approaches. Some of the regularization methods are also tested on simulated and experimental data. As a final note, this is not a traditional mathematical review in the sense that focus here is on the application to electron tomography rather than on describing mathematical techniques that underly proofs of key theorems.

Place, publisher, year, edition, pages
Springer, 2015
National Category
Mathematics
Identifiers
urn:nbn:se:kth:diva-181248 (URN)10.1007/978-1-4939-0790-8_43 (DOI)2-s2.0-84944626100 (Scopus ID)9781493907908 (ISBN)
Note

QC 20160218

Available from: 2016-02-18 Created: 2016-01-29 Last updated: 2016-02-18Bibliographically approved
Vulovic, M., Ravelli, R. B. G., van Vliet, L. J., Koster, A. J., Lazic, I., Lucken, U., . . . Rieger, B. (2013). Image formation modeling in cryo-electron microscopy. Journal of Structural Biology, 183(1), 19-32
Open this publication in new window or tab >>Image formation modeling in cryo-electron microscopy
Show others...
2013 (English)In: Journal of Structural Biology, ISSN 1047-8477, E-ISSN 1095-8657, Vol. 183, no 1, p. 19-32Article in journal (Refereed) Published
Abstract [en]

Accurate modeling of image formation in cryo-electron microscopy is an important requirement for quantitative image interpretation and optimization of the data acquisition strategy. Here we present a forward model that accounts for the specimen's scattering properties, microscope optics, and detector response. The specimen interaction potential is calculated with the isolated atom superposition approximation (IASA) and extended with the influences of solvent's dielectric and ionic properties as well as the molecular electrostatic distribution. We account for an effective charge redistribution via the Poisson-Boltzmann approach and find that the IASA-based potential forms the dominant part of the interaction potential, as the contribution of the redistribution is less than 10%. The electron wave is propagated through the specimen by a multislice approach and the influence of the optics is included via the contrast transfer function. We incorporate the detective quantum efficiency of the camera due to the difference between signal and noise transfer characteristics, instead of using only the modulation transfer function. The full model was validated against experimental images of 20S proteasome, hemoglobin, and GroEL. The simulations adequately predict the effects of phase contrast, changes due to the integrated electron flux, thickness, inelastic scattering, detective quantum efficiency and acceleration voltage. We suggest that beam-induced specimen movements are relevant in the experiments whereas the influence of the solvent amorphousness can be neglected. All simulation parameters are based on physical principles and, when necessary, experimentally determined.

Keyword
Cryo-electron microscopy, Phase contrast, Amplitude contrast, Image simulation, InSilicoTEM, Interaction potential
National Category
Biochemistry and Molecular Biology Biophysics
Identifiers
urn:nbn:se:kth:diva-126891 (URN)10.1016/j.jsb.2013.05.008 (DOI)000321993700003 ()2-s2.0-84879890758 (Scopus ID)
Note

QC 20130822

Available from: 2013-08-22 Created: 2013-08-22 Last updated: 2017-12-06Bibliographically approved
Gopinath, A., Xu, G., Ress, D., Öktem, O., Subramaniam, S. & Bajaj, C. (2012). Shape-based regularization of electron tomographic reconstruction. IEEE Transactions on Medical Imaging, 31(12), 2241-2252
Open this publication in new window or tab >>Shape-based regularization of electron tomographic reconstruction
Show others...
2012 (English)In: IEEE Transactions on Medical Imaging, ISSN 0278-0062, E-ISSN 1558-254X, Vol. 31, no 12, p. 2241-2252Article in journal (Refereed) Published
Abstract [en]

We introduce a tomographic reconstruction method implemented using a shape-based regularization technique. Spatial models of known features in the structure being reconstructed are integrated into the reconstruction process as regularizers. Our regularization scheme is driven locally through shape information obtained from segmentation and compared with a known spatial model. We demonstrated our method on tomography data from digital phantoms, simulated data, and experimental electron tomography (ET) data of virus complexes. Our reconstruction showed reduced blurring and an improvement in the resolution of the reconstructed volume was also measured. This method also produced improved demarcation of spike boundaries in viral membranes when compared with popular techniques like weighted back projection and the algebraic reconstruction technique. Improved ET reconstructions will provide better structure elucidation and improved feature visualization, which can aid in solving key biological issues. Our method can also be generalized to other tomographic modalities.

Keyword
Bayesian methods, electron microscopy, reconstruction, shape-based regularization, tomography
National Category
Engineering and Technology
Identifiers
urn:nbn:se:kth:diva-111819 (URN)10.1109/TMI.2012.2214229 (DOI)000313690600007 ()2-s2.0-84870490769 (Scopus ID)
Note

QC 20130115

Available from: 2013-01-15 Created: 2013-01-14 Last updated: 2017-12-06Bibliographically approved
Rullgard, H., Ofverstedt, L.-G. -., Masich, S., Daneholt, B. & Öktem, O. (2011). Simulation of transmission electron microscope images of biological specimens. Journal of Microscopy, 243(3), 234-256
Open this publication in new window or tab >>Simulation of transmission electron microscope images of biological specimens
Show others...
2011 (English)In: Journal of Microscopy, ISSN 0022-2720, E-ISSN 1365-2818, Vol. 243, no 3, p. 234-256Article in journal (Refereed) Published
Abstract [en]

We present a new approach to simulate electron cryo-microscope images of biological specimens. The framework for simulation consists of two parts; the first is a phantom generator that generates a model of a specimen suitable for simulation, the second is a transmission electron microscope simulator. The phantom generator calculates the scattering potential of an atomic structure in aqueous buffer and allows the user to define the distribution of molecules in the simulated image. The simulator includes a well defined electron-specimen interaction model based on the scalar Schrodinger equation, the contrast transfer function for optics, and a noise model that includes shot noise as well as detector noise including detector blurring. To enable optimal performance, the simulation framework also includes a calibration protocol for setting simulation parameters. To test the accuracy of the new framework for simulation, we compare simulated images to experimental images recorded of the Tobacco Mosaic Virus (TMV) in vitreous ice. The simulated and experimental images show good agreement with respect to contrast variations depending on dose and defocus. Furthermore, random fluctuations present in experimental and simulated images exhibit similar statistical properties. The simulator has been designed to provide a platform for development of new instrumentation and image processing procedures in single particle electron microscopy, two-dimensional crystallography and electron tomography with well documented protocols and an open source code into which new improvements and extensions are easily incorporated.

Keyword
Absorption potential, coherent imaging, computer modelling, contrast transfer function, electrostatic potential, image simulation, inelastic scattering, modulation transfer function, phantom generator, software package, transmission electron microscopy
National Category
Computational Mathematics
Identifiers
urn:nbn:se:kth:diva-39055 (URN)10.1111/j.1365-2818.2011.03497.x (DOI)000293699000003 ()2-s2.0-80051471655 (Scopus ID)
Funder
Swedish Research CouncilKnut and Alice Wallenberg Foundation
Note
QC 20110907Available from: 2011-09-07 Created: 2011-09-07 Last updated: 2017-12-08Bibliographically approved
Öktem, O., Quinto, E. T. & Skoglund, U. (2009). Electron Lambda-tomography. Proceedings of the National Academy of Sciences of the United States of America, 106(51), 21842-21847
Open this publication in new window or tab >>Electron Lambda-tomography
2009 (English)In: Proceedings of the National Academy of Sciences of the United States of America, ISSN 0027-8424, E-ISSN 1091-6490, Vol. 106, no 51, p. 21842-21847Article in journal (Refereed) Published
Abstract [en]

Filtered back-projection and weighted back-projection have long been the methods of choice within the electron microscopy com- munity for reconstructing the structure of macromolecular assem- blies from electron tomography data. Here, we describe electron lambda-tomography, a reconstruction method that enjoys the ben- efits of the above mentioned methods, namely speed and ease of implementation, but also addresses some of their shortcomings. In particular, compared to these standard methods, electron lambda- tomography is less sensitive to artifacts that come from structures outside the region that is being reconstructed, and it can sharpen boundaries.

Place, publisher, year, edition, pages
National Academy Press, 2009
Keyword
local tomography, limited angle tomography, microlocal analysis, electron tomography
National Category
Mathematical Analysis Structural Biology
Research subject
SRA - E-Science (SeRC); SRA - Molecular Bioscience
Identifiers
urn:nbn:se:kth:diva-71137 (URN)10.1073/pnas.0906391106 (DOI)000272994200069 ()2-s2.0-76049103121 (Scopus ID)
Funder
Swedish e‐Science Research Center
Note
QC 20120131Available from: 2012-01-30 Created: 2012-01-30 Last updated: 2017-12-08Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-1118-6483

Search in DiVA

Show all publications