Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Modeling prediction and pattern recognition in the early visual and olfactory systems
KTH, School of Computer Science and Communication (CSC), Computational Biology, CB. Stockholm Brain Institute, Stockholm, Sweden.ORCID iD: 0000-0002-1213-4239
2015 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Our senses are our mind's window to the outside world and determine how we perceive our environment.Sensory systems are complex multi-level systems that have to solve a multitude of tasks that allow us to understand our surroundings.However, questions on various levels and scales remain to be answered ranging from low-level neural responses to behavioral functions on the highest level.Modeling can connect different scales and contribute towards tackling these questions by giving insights into perceptual processes and interactions between processing stages.In this thesis, numerical simulations of spiking neural networks are used to deal with two essential functions that sensory systems have to solve: pattern recognition and prediction.The focus of this thesis lies on the question as to how neural network connectivity can be used in order to achieve these crucial functions.The guiding ideas of the models presented here are grounded in the probabilistic interpretation of neural signals, Hebbian learning principles and connectionist ideas.The main results are divided into four parts.The first part deals with the problem of pattern recognition in a multi-layer network inspired by the early mammalian olfactory system with biophysically detailed neural components.Learning based on Hebbian-Bayesian principles is used to organize the connectivity between and within areas and is demonstrated in behaviorally relevant tasks.Besides recognition of artificial odor patterns, phenomena like concentration invariance, noise robustness, pattern completion and pattern rivalry are investigated.It is demonstrated that learned recurrent cortical connections play a crucial role in achieving pattern recognition and completion.The second part is concerned with the prediction of moving stimuli in the visual system.The problem of motion-extrapolation is studied using different recurrent connectivity patterns.The main result shows that connectivity patterns taking the tuning properties of cells into account can be advantageous for solving the motion-extrapolation problem.The third part focuses on the predictive or anticipatory response to an approaching stimulus.Inspired by experimental observations, particle filtering and spiking neural network frameworks are used to address the question as to how stimulus information is transported within a motion sensitive network.In particular, the question if speed information is required to build up a trajectory dependent anticipatory response is studied by comparing different network connectivities.Our results suggest that in order to achieve a dependency of the anticipatory response to the trajectory length, a connectivity that uses both position and speed information seems necessary.The fourth part combines the self-organization ideas from the first part with motion perception as studied in the second and third parts.There, the learning principles used in the olfactory system model are applied to the problem of motion anticipation in visual perception.Similarly to the third part, different connectivities are studied with respect to their contribution to anticipate an approaching stimulus.The contribution of this thesis lies in the development and simulation of large-scale computational models of spiking neural networks solving prediction and pattern recognition tasks in biophysically plausible frameworks.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2015. , xiv, 185 p.
Series
TRITA-CSC-A, ISSN 1653-5723 ; 2015:10
Keyword [en]
spiking neural networks, pattern recognition, self-organization, prediction, anticipation, visual system, olfactory system, modeling
National Category
Bioinformatics (Computational Biology)
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:kth:diva-166127ISBN: 978-91-7595-532-2 (print)OAI: oai:DiVA.org:kth-166127DiVA: diva2:809353
Public defence
2015-05-27, F3, Lindstedtsv. 26, KTH, Stockholm, 10:00 (English)
Opponent
Supervisors
Funder
EU, FP7, Seventh Framework Programme
Note

QC 20150504

Available from: 2015-05-04 Created: 2015-05-02 Last updated: 2015-05-04Bibliographically approved
List of papers
1. A spiking neural network model of self-organized pattern recognition in the early mammalian olfactory system
Open this publication in new window or tab >>A spiking neural network model of self-organized pattern recognition in the early mammalian olfactory system
2014 (English)In: Frontiers in Neural Circuits, ISSN 1662-5110, E-ISSN 1662-5110, Vol. 8, no Feb, 5- p.Article in journal (Refereed) Published
Abstract [en]

Olfactory sensory information passes through several processing stages before an odor percept emerges. The question how the olfactory system learns to create odor representations linking those different levels and how it learns to connect and discriminate between them is largely unresolved. We present a large-scale network model with single and multi-compartmental Hodgkin-Huxley type model neurons representing olfactory receptor neurons (ORNs) in the epithelium, periglomerular cells, mitral/tufted cells and granule cells in the olfactory bulb (OB), and three types of cortical cells in the piriform cortex (PC). Odor patterns are calculated based on affinities between ORNs and odor stimuli derived from physico-chemical descriptors of behaviorally relevant real-world odorants. The properties of ORNs were tuned to show saturated response curves with increasing concentration as seen in experiments. On the level of the OB we explored the possibility of using a fuzzy concentration interval code, which was implemented through dendro-dendritic inhibition leading to winner-take-all like dynamics between mitral/tufted cells belonging to the same glomerulus. The connectivity from mitral/tufted cells to PC neurons was self-organized from a mutual information measure and by using a competitive Hebbian-Bayesian learning algorithm based on the response patterns of mitral/tufted cells to different odors yielding a distributed feed-forward projection to the PC. The PC was implemented as a modular attractor network with a recurrent connectivity that was likewise organized through Hebbian-Bayesian learning. We demonstrate the functionality of the model in a one-sniff-learning and recognition task on a set of 50 odorants. Furthermore, we study its robustness against noise on the receptor level and its ability to perform concentration invariant odor recognition. Moreover, we investigate the pattern completion capabilities of the system and rivalry dynamics for odor mixtures.

Keyword
BCPNN, Concentration invariance, Large-scale neuromorphic systems, Olfactory bulb, Pattern recognition, Pattern rivalry, Piriform cortex, Spiking neural network
National Category
Bioinformatics (Computational Biology) Neurology
Identifiers
urn:nbn:se:kth:diva-142800 (URN)10.3389/fncir.2014.00005 (DOI)000332714100001 ()2-s2.0-84893603482 (Scopus ID)
Funder
EU, FP7, Seventh Framework Programme, 237955 FP7-269921 FP7-216916
Note

QC 20140313

Available from: 2014-03-13 Created: 2014-03-12 Last updated: 2017-12-05Bibliographically approved
2. Anisotropic connectivity implements motion-basedprediction in a spiking neural network
Open this publication in new window or tab >>Anisotropic connectivity implements motion-basedprediction in a spiking neural network
2013 (English)In: Frontiers in Computational Neuroscience, ISSN 1662-5188, E-ISSN 1662-5188Article in journal (Refereed) Published
Abstract [en]

Predictive coding hypothesizes that the brain explicitly infers upcoming sensory inputto establish a coherent representation of the world. Although it is becoming generallyaccepted, it is not clear on which level spiking neural networks may implementpredictive coding and what function their connectivity may have. We present a networkmodel of conductance-based integrate-and-fire neurons inspired by the architectureof retinotopic cortical areas that assumes predictive coding is implemented throughnetwork connectivity, namely in the connection delays and in selectiveness for the tuningproperties of source and target cells. We show that the applied connection pattern leadsto motion-based prediction in an experiment tracking a moving dot. In contrast to ourproposed model, a network with random or isotropic connectivity fails to predict the pathwhen the moving dot disappears. Furthermore, we show that a simple linear decodingapproach is sufficient to transform neuronal spiking activity into a probabilistic estimatefor reading out the target trajectory.

Keyword
motion detection, motion extrapolation, probabilistic representation, predictive coding, network of spiking neurons, large-scale neuromorphic systems
National Category
Bioinformatics (Computational Biology) Neurosciences
Identifiers
urn:nbn:se:kth:diva-136251 (URN)10.3389/fncom.2013.00112 (DOI)000324633400001 ()2-s2.0-84884678746 (Scopus ID)
Note

QC 20140121

Available from: 2013-12-04 Created: 2013-12-04 Last updated: 2017-12-06Bibliographically approved
3. Signature of an anticipatory response in area VI as modeled by a probabilistic model and a spiking neural network
Open this publication in new window or tab >>Signature of an anticipatory response in area VI as modeled by a probabilistic model and a spiking neural network
2014 (English)In: 2014 International Joint Conference on Neural Networks (IJCNN), IEEE , 2014, 3205-3212 p.Conference paper, Published paper (Refereed)
Abstract [en]

As it is confronted to inherent neural delays, how does the visual system create a coherent representation of a rapidly changing environment? In this paper, we investigate the role of motion-based prediction in estimating motion trajectories compensating for delayed information sampling. In particular, we investigate how anisotropic diffusion of information may explain the development of anticipatory response as recorded in a neural populations to an approaching stimulus. We validate this using an abstract probabilistic framework and a spiking neural network (SNN) model. Inspired by a mechanism proposed by Nijhawan [1], we first use a Bayesian particle filter framework and introduce a diagonal motion-based prediction model which extrapolates the estimated response to a delayed stimulus in the direction of the trajectory. In the SNN implementation, we have used this pattern of anisotropic, recurrent connections between excitatory cells as mechanism for motion-extrapolation. Consistent with recent experimental data collected in extracellular recordings of macaque primary visual cortex [2], we have simulated different trajectory lengths and have explored how anticipatory responses may be dependent on the information accumulated along the trajectory. We show that both our probabilistic framework and the SNN model can replicate the experimental data qualitatively. Most importantly, we highlight requirements for the development of a trajectory-dependent anticipatory response, and in particular the anisotropic nature of the connectivity pattern which leads to the motion extrapolation mechanism.

Place, publisher, year, edition, pages
IEEE, 2014
National Category
Bioinformatics (Computational Biology)
Identifiers
urn:nbn:se:kth:diva-157983 (URN)10.1109/IJCNN.2014.6889847 (DOI)2-s2.0-84908472205 (Scopus ID)978-147991484-5 (ISBN)
Conference
2014 International Joint Conference on Neural Networks, IJCNN 2014, 6 July 2014 through 11 July 2014, Beijing, China
Note

QC 20141219

Available from: 2014-12-19 Created: 2014-12-18 Last updated: 2015-05-04Bibliographically approved

Open Access in DiVA

Modeling prediction and pattern recognition in the early visual and olfactory systems(8934 kB)6954 downloads
File information
File name FULLTEXT02.pdfFile size 8934 kBChecksum SHA-512
d2bbe33a31d3c1de74f487d9c984747ee51b98991b4e2c2fa3195e4106e553c1e36696d7a4cc3409c3de27023b37cf1748c59da2e831a7b2cf59e7ed9577be43
Type fulltextMimetype application/pdf

Authority records BETA

Kaplan, Bernhard

Search in DiVA

By author/editor
Kaplan, Bernhard
By organisation
Computational Biology, CB
Bioinformatics (Computational Biology)

Search outside of DiVA

GoogleGoogle Scholar
Total: 6954 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 2845 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf