Different ways of evaluating a Swedish grammar checker
2002 (English)In: Proceedings of the third international conference on language resources and evaluation (LREC), 2002, 262-267 p.Conference paper (Other academic)
Three different ways of evaluating a Swedish grammar checker are presented and discussed in this article. The first evaluationconcerns measuring the program's detection capacity on five text genres. The measures (precision and recall) are often used inevaluating grammar checkers. However, in order to test and improve the usability of grammar checking software, they need to becomplemented with user-oriented methods. Consequently, the second and the third evaluations presented in the article both involveusers. The second evaluation focuses on user reactions to grammar error presentations, especially with regard to false alarms anderroneous error identification. The third and last evaluation focuses on problems in supporting users' cognitive revision processes. Italso examines user motives behind choosing to correct or not to correct problems highlighted by the program. Advantages anddisadvantages of the different evaluation methods are discussed.
Place, publisher, year, edition, pages
2002. 262-267 p.
Computer and Information Science
IdentifiersURN: urn:nbn:se:kth:diva-7275ISBN: 2-9517408-0-8OAI: oai:DiVA.org:kth-7275DiVA: diva2:12235
QC 201111142005-09-292005-09-292011-11-14Bibliographically approved