Change search
ReferencesLink to record
Permanent link

Direct link
Automatic and unsupervised methods in natural language processing
KTH, School of Information and Communication Technology (ICT), Computer and Systems Sciences, DSV.
2005 (English)Doctoral thesis, monograph (Other scientific)
Abstract [en]

Natural language processing (NLP) means the computer-aided processing of language produced by a human. But human language is inherently irregular and the most reliable results are obtained when a human is involved in at least some part of the processing. However, manual workis time-consuming and expensive. This thesis focuses on what can be accomplished in NLP when manual workis kept to a minimum.

We describe the construction of two tools that greatly simplify the implementation of automatic evaluation. They are used to implement several supervised, semi-supervised and unsupervised evaluations by introducing artificial spelling errors. We also describe the design of a rule-based shallow parser for Swedish called GTA and a detection algorithm for context-sensitive spelling errors based on semi-supervised learning, called ProbCheck.

In the second part of the thesis, we first implement a supervised evaluation scheme that uses an error-free treebankto determine the robustness of a parser when faced with noisy input such as spelling errors. We evaluate the GTA parser and determine the robustness of the individual components of the parser as well as the robustness for different phrase types. Second, we create an unsupervised evaluation procedure for parser robustness. The procedure allows us to evaluate the robustness of parsers using different parser formalisms on the same text and compare their performance. Five parsers and one tagger are evaluated. For four of these, we have access to annotated material and can verify the estimations given by the unsupervised evaluation procedure. The results turned out to be very accurate with few exceptions and thus, we can reliably establish the robustness of an NLP system without any need of manual work.

Third, we implement an unsupervised evaluation scheme for spell checkers. Using this, we perform a very detailed analysis of three spell checkers for Swedish. Last, we evaluate the ProbCheck algorithm. Two methods are included for comparison: a full parser and a method using tagger transition probabilities. The algorithm obtains results superior to the comparison methods. The algorithm is also evaluated on authentic data in combination with a grammar and spell checker.

Place, publisher, year, edition, pages
Stockholm: KTH , 2005. , xi, 120 p.
Trita-NA, ISSN 0348-2952 ; 2005:08
Keyword [en]
Keyword [sv]
National Category
Computer Science
URN: urn:nbn:se:kth:diva-156ISBN: 91-7283-982-1OAI: diva2:7478
Public defence
2005-04-08, Kollegiesalen, KTH, Valhallavägen 79, Stockholm, 14:15
QC 20100901Available from: 2005-04-04 Created: 2005-04-04 Last updated: 2010-09-01Bibliographically approved

Open Access in DiVA

fulltext(611 kB)1425 downloads
File information
File name FULLTEXT01.pdfFile size 611 kBChecksum SHA-1
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Bigert, Johnny
By organisation
Computer and Systems Sciences, DSV
Computer Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 1425 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 943 hits
ReferencesLink to record
Permanent link

Direct link