kth.sePublikationer KTH
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Supporting human interpretation and analysis of activity captured through overhead video
Georgia Institute of Technology.ORCID-id: 0000-0003-4616-189X
2009 (Engelska)Doktorsavhandling, monografi (Övrigt vetenskapligt)
Abstract [en]

Many disciplines spend considerable resources studying behavior. Tools range from pen-and-paper observation to biometric sensing. A tool's appropriateness depends on the goal and justification of the study, the observable context and feature set of target behaviors, the observers' resources, and the subjects' tolerance to intrusiveness. We present two systems: Viz-A-Vis and Tableau Machine. Viz-A-Vis is an analytical tool appropriate for onsite, continuous, wide-coverage and long-term capture, and for objective, contextual, and detailed analysis of the physical actions of subjects who consent to overhead video observation. Tableau Machine is a creative artifact for the home. It is a long-lasting, continuous, interactive, and abstract Art installation that captures overhead video and visualizes activity to open opportunities for creative interpretation. We focus on overhead video observation because it affords a near one-to-one correspondence between pixels and floor plan locations, naturally framing the activity in its spatial context. Viz-A-Vis is an information visualization interface that renders and manipulates computer vision abstractions. It visualizes the hidden structure of behavior in its spatiotemporal context. We demonstrate the practicality of this approach through two user studies. In the first user study, we show an important search performance boost when compared against standard video playback and against the video cube. Furthermore, we determine a unanimous user choice for overviewing and searching with Viz-A-Vis. In the second study, a domain expert evaluation, we validate a number of real discoveries of insightful environmental behavior patterns by a group of senior architects using Viz-A-Vis. Furthermore, we determine clear influences of Viz-A-Vis over the resulting architectural designs in the study. Tableau Machine is a sensing, interpreting, and painting artificial intelligence. It is an Art installation with a model of perception and personality that continuously and enduringly engages its co-occupants in the home, creating an aura of presence. It perceives the environment through overhead cameras, interprets its perceptions with computational models of behavior, maps its interpretations to generative abstract visual compositions, and renders its compositions through paintings. We validate the goal of opening a space for creative interpretation through a study that included three long-term deployments in real family homes.

Ort, förlag, år, upplaga, sidor
Georgia Institute of Technology , 2009. , s. 235
Nyckelord [en]
Ubiquitous computing, Information visualization, Computer vision, User studies, Human-computer interaction, Interactive art, Performance art
Nationell ämneskategori
Datavetenskap (datalogi)
Forskningsämne
Människa-datorinteraktion
Identifikatorer
URN: urn:nbn:se:kth:diva-166022OAI: oai:DiVA.org:kth-166022DiVA, id: diva2:916466
Disputation
2009-06-24, Atlanta, 22:34 (Engelska)
Handledare
Anmärkning

QC 20160405

Tillgänglig från: 2016-04-05 Skapad: 2015-04-30 Senast uppdaterad: 2022-06-23Bibliografiskt granskad

Open Access i DiVA

fulltext(23639 kB)1243 nedladdningar
Filinformation
Filnamn FULLTEXT01.pdfFilstorlek 23639 kBChecksumma SHA-512
def02f91749a36fae72876fb51dbfdb44f11c79f6021d4302f5f59ea64d527e4885531472b481ae8390398c26ea6a814f866e1025ed5984019a6122fe0eac861
Typ fulltextMimetyp application/pdf

Övriga länkar

http://hdl.handle.net/1853/29771

Person

Romero, Mario

Sök vidare i DiVA

Av författaren/redaktören
Romero, Mario
Datavetenskap (datalogi)

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 1244 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

urn-nbn

Altmetricpoäng

urn-nbn
Totalt: 313 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf