kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Put your heart into it: What biometrics and behaviour can teach us about road users
KTH, School of Industrial Engineering and Management (ITM), Centres, Integrated Transport Research Lab, ITRL. KTH, School of Industrial Engineering and Management (ITM), Engineering Design.ORCID iD: 0000-0003-1558-382x
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Sustainable development
SDG 3: Good Health and Well-Being, SDG 8: Decent work and economic growth, SDG 9: Industry, innovation and infrastructure, SDG 11: Sustainable cities and communities
Abstract [en]

As the world enters the intelligence age, it is no surprise that it is easier than ever to collect a vast variation of data types, whether it be raw data on human behaviour or processed data on travel patterns, that can be analysed with the help of artificial intelligence and prove to be incredibly valuable. In the domain of transport science, there is a constant quest to make the transport sector safer and more efficient without hindering those travelling from getting to where they need to be, when they need to be there, and data is vital in that quest.

The data collection tools that have become available in the fields of human-computer interaction and human-machine interaction over the past couple of years show great potential in uncovering how road users are affected by the surroundings they travel through or operate in. It is not only possible to meticulously collect how a person is interacting with a vehicle, be it a conventional or a remotely controlled vehicle, but it is also possible to collect biometric data to understand the psychological and physiological effects of the surroundings on the person. Such biometric data mostly stem from brain and heart activity, hence the title of this thesis: Put your heart into it.

This thesis explores how biometric and behavioural data can be collected, which methods should be used for analysis, and how experiments should be designed to optimize the potential of the data sets collected. Through three studies, focusing each on pedestrians, electric scooters, and general driver information searching, this thesis is intended as a first step towards a guide for other subdomains within transport, like psychology and engineering, on how to collect and analyse psychological information through physical data, also called psychophysiology.

The first study focuses on longitudinal studies with low-frequency biometric data collected through smartwatches. Providing cruder results in terms of psychological analysis but proving rather non-intrusive since the participants can turn on and turn off the data collection at their own will.

The second study utilises high-frequency biometric data, collected through chest straps and electrode helmets. The results provide more accurate readings, leading to analyses that provide more in-depth information regarding how a person’s cognitive load and risk perception is affected by their surroundings and their own actions.

The last study compares the biometric and behavioural characteristics of searching for information in both static and dynamic scenarios. Using eye-tracking and head-movement, this study uses simple data analyses to show how important eye-tracking can be when the aim is to understand what a road user is looking at when trying to search for information, whether they are static or moving along a road.

In conclusion, these studies and this thesis have not only proven how useful and efficient these data collection methods can be, but also taken early steps to uncover how to create studies that allow for these data collection methods to be trialled with the aim to understand how road users are affected in the current transport environment.

Abstract [sv]

När världen går in intelligensåldern är det ingen överraskning att det är enklare än någonsin att samla in en så stor variation av datatyper, vare sig det är rådata om mänskligt beteende eller om bearbetade data om resmönster, analyserad med hjälp av artificiell intelligens, kan denna data visa sig vara otroligt värdefull.

De datainsamlingsverktyg som har blivit tillgängliga inom områdena människa-datorinteraktion och människa-maskininteraktion under de senaste åren visar stor potential för att avslöja hur trafikanter påverkas av omgivningen de färdas genom eller verkar i. Det är inte bara möjligt att noggrant samla in hur en person interagerar med ett fordon, vare sig det är ett konventionellt eller ett fjärrstyrt fordon, utan det är också möjligt att förstå psykologisk och fysiologisk effekt av fordonets omgivning på personen. Sådana biometriska data härrör mest från hjärn- och hjärtaktivitet, därav titeln på denna avhandling: Put your heart into it.

Denna avhandling utforskar hur biometrisk och beteendedata kan samlas in, vilka metoder som bör användas för analys och hur experiment bör utformas för att optimera potentialen hos den insamlade datan. Genom tre studier, var och en med fokus på fotgängare, elsparkcyklar och allmän informationssökning för förare, är denna avhandling tänkt som ett första steg mot en guide för andra underdomäner inom transport, som psykologi och teknik, om hur man samlar in och analyserar psykologisk information genom fysiska data, även kallad psykofysiologi.

Den första studien fokuserar på longitudinella studier med lågfrekvent biometriska data insamlad genom smartklockor. Ger grövre resultat i termer av psykologisk analys men visar sig vara ganska icke-påträngande eftersom deltagarna kan slå på och stänga av datainsamlingen efter egen vilja.

Den andra studien använder högfrekvent biometriska data, insamlad genom bröstband och elektrodhjälmar. Resultaten ger mer exakta avläsningar, vilket leder till analyser som ger mer djupgående information om hur en persons kognitiva belastning och riskuppfattning påverkas av omgivningen och deras egna handlingar.

Den sista studien jämför de biometriska och beteendemässiga egenskaperna för att söka information i både statiska och dynamiska scenarier. Med hjälp av blickspårning och huvudrörelser, använder denna studie enkla dataanalyser för att visa hur viktigt blickspårning kan vara när syftet är att förstå vad en trafikant tittar på när de försöker söka information, oavsett om de är statiska eller rör sig längs en väg.

Sammanfattningsvis har dessa studier och denna avhandling inte bara bevisat hur användbara och effektiva dessa datainsamlingsmetoder kan vara, utan också tagit tidiga steg för att avslöja vad som fungerar och vad som inte fungerar när man skapar scenarier för studier med syfte att förstå hur trafikanter påverkas i den nuvarande transportmiljön.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2025. , p. 111
Series
TRITA-ITM-AVL ; 2025:13
Keywords [en]
Behavioural data, Biometric data, Sensor fusion, Travel Diaries, Micromobility
Keywords [sv]
Beteende data, Biometrisk data, Sensorfusion, Resedagböcker, Mikromobilitet
National Category
Human Computer Interaction Transport Systems and Logistics Other Engineering and Technologies
Research subject
Machine Design
Identifiers
URN: urn:nbn:se:kth:diva-368105ISBN: 978-91-8106-338-7 (print)OAI: oai:DiVA.org:kth-368105DiVA, id: diva2:1987039
Public defence
2025-08-28, F3/https://kth-se.zoom.us/j/62096219683, Lindstedtsvägen 26-28, Stockholm, 10:00 (English)
Opponent
Supervisors
Projects
MERGEN
Funder
Integrated Transport Research Lab (ITRL), F8907TrenOp, Transport Research Environment with Novel PerspectivesAvailable from: 2025-08-07 Created: 2025-08-04 Last updated: 2025-08-26Bibliographically approved
List of papers
1. Built Environment Characteristics, Daily Travel, and Biometric Readings: Creation of an Experimental Tool Based on a Smartwatch Platform
Open this publication in new window or tab >>Built Environment Characteristics, Daily Travel, and Biometric Readings: Creation of an Experimental Tool Based on a Smartwatch Platform
2021 (English)In: Sustainability, E-ISSN 2071-1050, Vol. 13, no 17, article id 9993Article in journal (Refereed) Published
Abstract [en]

Travel surveys can uncover information regarding travel behaviour, needs, and more. Collected information is utilised to make choices when reorganising or planning built environments. Over the years, methods for conducting travel surveys have changed from interviews and forms to automated travel diaries in order to monitor trips made by travellers. With the fast progression of technological advancements, new possibilities for operationalising such travel diaries can be implemented, changing from utilising mobile to wearable devices. Wearable devices are often equipped with sensors which collect continuous biometric data from sources that are not reachable from standard mobile devices. Data collected through wearable devices range from heart rate and blood pressure to temperature and perspiration. This advancement opens new possible layers of information in the collection of travel data. Such biometric data can be used to derive psychophysiological conditions related to cognitive load, which can uncover in-depth knowledge regarding stress and emotions. This paper aims to explore the possibilities of data analysis on the data collected through a software combining travel survey data, such as position and time, with heartrate, to gain knowledge of the implications of such data. The knowledge about the implications of spatial configurations can be used to create more accessible environments.

Place, publisher, year, edition, pages
Basel, Schweiz: MDPI, 2021
Keywords
built environment, position data, biometric data, automated data collection, urban planning, traveller needs, traveller behaviour
National Category
Transport Systems and Logistics Human Computer Interaction Other Engineering and Technologies
Research subject
Transport Science, Transport Systems; Human-computer Interaction; Machine Design
Identifiers
urn:nbn:se:kth:diva-301790 (URN)10.3390/su13179993 (DOI)000694469300001 ()2-s2.0-85114641387 (Scopus ID)
Funder
EU, Horizon 2020, 769980
Note

QC 20211005

Available from: 2021-09-13 Created: 2021-09-13 Last updated: 2025-08-04Bibliographically approved
2. Towards a better understanding of the health impacts of one’s movement in space and time
Open this publication in new window or tab >>Towards a better understanding of the health impacts of one’s movement in space and time
Show others...
2022 (English)In: Journal of Location Based Services, ISSN 1748-9725, E-ISSN 1748-9733, Vol. 16, no 4, p. 288-311Article in journal (Refereed) Published
Abstract [en]

To better understand the interactions between physical built environment conditions and one’s well-being, we created a passive data collector for travellers and made the first step towards an explanatory model based on psychophysiological relations. By measuring biometric information from select trial participants we showed how different controlled factors are affecting the heart rate of the participants. A regression model with the impact factors such as speed, location, time and activity (accelerometer data) reveals how the factors relate to each other and how they correlate with the recorded individual’s heart rates throughout the observed period. For examples, the results show that the increase in movement speed is not linearly correlated with the heart rate. One’s heart rate would increase significantly when the individual reaches brisk walking and running speed, but not before nor after. Early morning and early evening time slots were the time where the observed individuals have the highest heart rates, which may correlate to individuals’ commute activities. Heart rates at the office would be lower than at home, which might correlate to more physical activities in the household. 

Place, publisher, year, edition, pages
Informa UK Limited, 2022
Keywords
Automated data collection, biometric data, built environment, position data, psychophysiological relations, Biometrics, Data acquisition, Regression analysis, Environment conditions, Health impact, Heart-rate, Psychophysiological relation, Space and time, Well being, Heart
National Category
Bioenergy Environmental Sciences related to Agriculture and Land-use Dentistry
Identifiers
urn:nbn:se:kth:diva-318406 (URN)10.1080/17489725.2021.2009051 (DOI)000738503100001 ()2-s2.0-85122308369 (Scopus ID)
Note

QC 20250512

Available from: 2022-09-21 Created: 2022-09-21 Last updated: 2025-08-04Bibliographically approved
3. Establishing an external validity of virtual environments in a micro-mobility context
Open this publication in new window or tab >>Establishing an external validity of virtual environments in a micro-mobility context
2025 (English)In: Transportation, ISSN 0049-4488, E-ISSN 1572-9435Article in journal (Refereed) Epub ahead of print
Abstract [en]

This study aimed to provide a multiangled comparison of the impact of real and virtual setups on the behaviour and perception of electric scooter (e-scooter) riding to examine the external validity of the virtual environments in the micro-mobility context. For this purpose, a within-subject design experiment was conducted to collect data on the behaviour of e-scooter riders. Furthermore, self-reported data on mental and physical demand as well as physiological data in the form of heart rate measurements and electroencephalography (EEG) were recorded to provide an additional insight into the behavioural results. The analysis was based on the multinomial logit model (MNL) for the behavioural data, ordered logit models for self-reported measures. Parametric and non-parametric tests were performed to capture the differences in physiological data. The results of the behavioural data showed significant differences in braking and acceleration patterns between virtual and real scenarios, which undermined the external validity of virtual environments in the current context. Further, self-reported measures painted a mixed picture when looked at jointly with biometric measures, where the questionnaires indicated that both setups were indifferent with respect to mental demand, while the physiological data suggested that virtual scenarios were more mentally engaging for the e-scooter riders.

Place, publisher, year, edition, pages
Springer Nature, 2025
Keywords
Virtual environments, E-scooter, External validity, EEG, HRV
National Category
Transport Systems and Logistics Human Computer Interaction Other Engineering and Technologies
Research subject
Machine Design; Transport Science
Identifiers
urn:nbn:se:kth:diva-368079 (URN)10.1007/s11116-025-10602-z (DOI)001469008400001 ()2-s2.0-105002781110 (Scopus ID)
Funder
Integrated Transport Research Lab (ITRL), F8907
Note

This work is supported by the Austrian FFG Endowed Professor DAVeMoS project(project number 862678).

QC 20250805

Available from: 2025-08-04 Created: 2025-08-04 Last updated: 2025-08-05Bibliographically approved
4. Recording Cognitive Load – Differences between e-scooter simulator and real world riding
Open this publication in new window or tab >>Recording Cognitive Load – Differences between e-scooter simulator and real world riding
Show others...
(English)Manuscript (preprint) (Other academic)
Abstract [en]

Understanding how built environments affect travellers is crucial when building sustainable cities. Making big changes to the infrastructure requires substantial time and money. By instead performing changes in a virtual environment mimicking the target environment, allows testing scenarios in efficient ways before real-world implementation. In this work, psychophysiological indicators in form of biometric data have been used while e- scooter riders drove in virtual and real-world environments. With the rise of commercially available devices for recording electrocardiography (ECG) and electroencephalography (EEG), it is now possible to compare the built environment’s impacts on the participants with less intrusive measurement methods.

Results show that methods for collecting psychophysiological indicators seem promising. It might still be long until virtual scenarios are comparable with real-world ones. Utilising technologies as proposed in this paper enables mimicking reality by iteratively changing the virtual scenarios through rapid and cost-efficient test procedures, providing planners with powerful tools for understanding impact on travellers when designing environments.

Results also show that ECG seems more versatile than EEG given the scenarios analysed, where participants rode an e-scooter on track in both augmented virtuality (AV) simulator and real-world. Biometric data required less demographic information than subjective survey data, while providing seemingly similar results.

Keywords
Augmented Virtuality, Biometric data, Built environment, Data fusion, Psychophysiology
National Category
Human Computer Interaction Transport Systems and Logistics Other Engineering and Technologies
Research subject
Machine Design; Transport Science
Identifiers
urn:nbn:se:kth:diva-368084 (URN)
Projects
MERGEN
Funder
Integrated Transport Research Lab (ITRL), F8907
Note

This work is supported by the KTH-funded project MERGEN with project number F8907. This work was also supported by the Austrian FFG Endowed Professor DAVeMoS project (project number862678) and Transport Research Environment with Novel Perspectives TRENoP at KTH.

QC 20250804

Available from: 2025-08-04 Created: 2025-08-04 Last updated: 2025-08-04Bibliographically approved
5. An Exploration of the Applicability of Information Processing Theories in Road Hazard Perception Context Using E-Scooter Simulator in Augmented Virtuality Scenarios
Open this publication in new window or tab >>An Exploration of the Applicability of Information Processing Theories in Road Hazard Perception Context Using E-Scooter Simulator in Augmented Virtuality Scenarios
(English)Manuscript (preprint) (Other academic)
Abstract [en]

This paper aims to provide a cognitive perspective on the hazard perception process in the traffic situation based on the two theories of brain information processing, namely, Signal Detection Theory and Predictive Coding Theory. The theories are empirically validated in an augmented virtuality scenario encompassing a simplified traffic situation, where participants are faced with hazard cues characterised by a different degree of predictability. Throughout the experiment, the acceleration and braking behaviour of an e-scooter rider together with the electroencephalography data is collected. The developed experimental setup allows for testing the applicability of brain theories in explaining behaviour and cognitive processing of the perception of potential hazards. Current findings show that produced predictions and the subsequent behaviour are modulated by the degree of ambiguity of hazard cues in line with Signal Detection Theory. Following Predictive Coding Theory, the predictions improve as more external input is gathered and the mental model is updated. Moreover, the alpha wave is used as a neural marker of hazard predictability. The results provide implications for road safety researchers and practitioners to guide the more-informed design of road infrastructure as well as in-vehicle human support systems to be more aligned with the processing mechanisms of human cognition.

Keywords
hazard perception, signal detection theory, predictive coding theory, alpha wave, e-scooter, augmented virtuality
National Category
Human Computer Interaction Transport Systems and Logistics Other Engineering and Technologies
Research subject
Transport Science; Machine Design
Identifiers
urn:nbn:se:kth:diva-368103 (URN)10.2139/ssrn.5177204 (DOI)
Funder
Integrated Transport Research Lab (ITRL), F8907
Note

This work is supported by the Austrian FFG Endowed Professor DAVeMoS project (project number862678). This work was also supported by the KTH-funded project MERGEN with project numberF8907 and Transport Research Environment with Novel Perspectives TRENoP at KTH.

QC 20250812

Available from: 2025-08-04 Created: 2025-08-04 Last updated: 2025-08-12Bibliographically approved
6. Designing and trialling a fully implicit data collector for eye- and head-tracking
Open this publication in new window or tab >>Designing and trialling a fully implicit data collector for eye- and head-tracking
Show others...
(English)Manuscript (preprint) (Other academic)
Abstract [en]

Recent advancements in computer graphics and human-computer interaction have made it possible to create traffic simulatorsthat contain complex environments for the participants to navigate. These can be used to understand how changes to theenvironment affect travellers without having to perform the changes in real life. There have also been improvements in how tocollect information about what the user is experiencing in these simulators. There is a wide range of variables that could be usedto better understand what the user is focusing on, but which of these are giving the most information?This paper aims to compare and uncover what the movements of the head and the eyes can explain regarding where a person isfocusing their attention when searching for information. Using a VR HMD with built-in eye-tracking, participants were asked tosearch for objects in static and dynamic environments. The results showed that eye-tracking had a higher hit rate than the headtracking,as expected. Information from the head-tracking was found in the eye-tracking to a higher degree than the eye-trackingwas found in the head-tracking across all scenarios. In conclusion, eye-tracking shows signs that it is the preferred method forunderstanding information searching among travellers.

Keywords
VR, gaze trace, information searching, head movement, traffic simulator
National Category
Human Computer Interaction Transport Systems and Logistics Other Engineering and Technologies
Research subject
Machine Design; Transport Science
Identifiers
urn:nbn:se:kth:diva-368104 (URN)
Funder
Integrated Transport Research Lab (ITRL), F8907
Note

This work is supported by the Austrian FFG Endowed Professor DAVeMoS project (project number 862678) aswell as by the KTH-funded project MERGEN with project number F8907 and the Swedish government strategicresearch area funding from Transport Research Environment with Novel Perspectives TRENoP.

QC 20250806

Available from: 2025-08-04 Created: 2025-08-04 Last updated: 2025-08-06Bibliographically approved

Open Access in DiVA

Put your heart into it(36560 kB)318 downloads
File information
File name FULLTEXT01.pdfFile size 36560 kBChecksum SHA-512
a4e9023a95a5848f3aa6d56a84991e7b48d35868e7497c5adebd9fb510d94060f1fd6e84590a28a5b911c433733b2b6bd11d537b6871ecbd0cb10c36bb5be77f
Type fulltextMimetype application/pdf

Authority records

Palmberg, Robin C. O.

Search in DiVA

By author/editor
Palmberg, Robin C. O.
By organisation
Integrated Transport Research Lab, ITRLEngineering Design
Human Computer InteractionTransport Systems and LogisticsOther Engineering and Technologies

Search outside of DiVA

GoogleGoogle Scholar
Total: 320 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1491 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf