Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
A Use Case Framework for Information Access Evaluation
KTH, Skolan för datavetenskap och kommunikation (CSC), Teoretisk datalogi, TCS.ORCID-id: 0000-0003-4042-4919
2014 (Engelska)Ingår i: Professional Search in the Modern World: COST Action IC1002 on Multilingual and Multifaceted Interactive Information Access / [ed] Paltoglou, Georgios, Loizides, Fernando, Hansen, Preben, Springer, 2014, 6-22 s.Kapitel i bok, del av antologi (Refereegranskat)
Abstract [en]

Information access is no longer only a question of retrieving topical text documents in a work-task related context. Information search has become one of the most common uses of the personal computers; a daily task for millions of individual users searching for information motivated by information needs they experience for some reason, momentarily or continuously. Instead of professionally edited text documents, multilingual and multimedia content from a variety of sources of varying quality needs to be accessed. Even the scope of the research efforts in the field must therefore be broadened to better capture the mechanisms for the systems’ impact, take-up and success in the marketplace. Much work has been carried out in this direction: graded relevance, and new evaluation metrics, more varied document collections used in evaluation and different search tasks evaluated. The research in the field is however fragmented. Despite that the need for a common evaluation framework is widely acknowledged, such framework is still not in place. IR system evaluation results are not regularly validated in Interactive IR or field studies; the infrastructure for generalizing Interactive IR results over tasks, users and collections is still missing. This chapter presents a use case-based framework for experimental design in the field of interactive information access. Use cases in general connect system design and evaluation to interaction and user goals, and help identifying test cases for different user groups of a system. We suggest that use cases can provide a useful link even between information access system usage and evaluation mechanisms and thus bring together research from the different related research fields. In this chapter we discuss how use cases can guide the developments of rich models of users, domains, environments, and interaction, and make explicit how the models are connected to benchmarking mechanisms. We give examples of the central features of the different models. The framework is highlighted by examples that sketch out how the framework can be productively used in experimental design and reporting with a minimal threshold for adoption.

Ort, förlag, år, upplaga, sidor
Springer, 2014. 6-22 s.
Serie
Lecture Notes in Computer Science, ISSN 0302-9743 ; 8330
Nyckelord [en]
Benchmarking, Evaluation, Interaction, Use cases
Nationell ämneskategori
Människa-datorinteraktion (interaktionsdesign)
Identifikatorer
URN: urn:nbn:se:kth:diva-157333DOI: 10.1007/978-3-319-12511-4_2Scopus ID: 2-s2.0-84921412557ISBN: 978-3-319-12510-7 (tryckt)OAI: oai:DiVA.org:kth-157333DiVA: diva2:769719
Anmärkning

QC 20150331

Tillgänglig från: 2014-12-08 Skapad: 2014-12-08 Senast uppdaterad: 2018-01-11Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas

Övriga länkar

Förlagets fulltextScopus

Personposter BETA

Karlgren, Jussi

Sök vidare i DiVA

Av författaren/redaktören
Karlgren, Jussi
Av organisationen
Teoretisk datalogi, TCS
Människa-datorinteraktion (interaktionsdesign)

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetricpoäng

doi
isbn
urn-nbn
Totalt: 88 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf