Change search
ReferencesLink to record
Permanent link

Direct link
Projection of a Markov Process with Neural Networks
KTH, School of Computer Science and Communication (CSC), Centres, Centre for Autonomous Systems, CAS. KTH, School of Computer Science and Communication (CSC), Computer Vision and Active Perception, CVAP. (CAS/CVAP/CSC)
2001 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

In this work we have examined an application from the insurance industry. We first reformulate it into a problem of projecting a markov process. We then develop a method of carrying out the projection many steps into the future by using a combination of neural networks trained using a maximum entropy principle. This methodology improves on current industry standard solution in four key areas: variance, bias, confidence level estimation, and the use of inhomogeneous data. The neural network aspects of the methodology include the use of a generalization error estimate that does not rely on a validation set. We also develop our own approximation to the hessian matrix, which seems to be significantly better than assuming it to be diagonal and much faster than calculating it exactly. This hessian is used in the network pruning algorithm. The parameters of a conditional probability distribution were generated by a neural network, which was trained to maximize the log-likelihood plus a regularization term. In preparing the data for training the neural networks we have devised a scheme to decorrelate input dimensions completely, even non-linear correlations, which should be of general interest in its own right. The results we found indicate that the bias inherent in the current industry-standard projection technique is very significant. This work may be the only accurate measurement made of this important source of error.

Place, publisher, year, edition, pages
Keyword [en]
Neural Net
National Category
Computer Science
URN: urn:nbn:se:kth:diva-183498OAI: diva2:911794
Subject / course
Computer Science
Educational program
Master of Science - Computer Science
Available from: 2016-03-14 Created: 2016-03-14 Last updated: 2016-03-14Bibliographically approved

Open Access in DiVA

fulltext(2557 kB)7 downloads
File information
File name FULLTEXT01.pdfFile size 2557 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Folkesson, John
By organisation
Centre for Autonomous Systems, CASComputer Vision and Active Perception, CVAP
Computer Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 7 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 23 hits
ReferencesLink to record
Permanent link

Direct link