kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Shared Situational Awareness for Connected and Automated Vehicles in Urban Scenarios
KTH, School of Electrical Engineering and Computer Science (EECS), Decision and Control Systems. Scania/ TRATON.ORCID iD: 0000-0001-6030-2869
2026 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

A major challenge in developing connected and automated vehicles~(CAVs) for urban environments is achieving a comprehensive understanding of the surrounding traffic scene. This relies on situational awareness, defined as the ability to perceive, interpret, and anticipate the behavior of surrounding road-users, which is essential to ensure safety. In particular, unprotected road-users, such as pedestrians and cyclists, are often occluded or located in sensor blind-spots of the CAV, which remains a critical challenge. This thesis aims to improve the situational awareness of the ego-vehicle, the CAV of primary interest, in urban environments by leveraging vehicle-to-everything (V2X) communication to incorporate information from connected road-users. A framework using set-based methods is developed to systematically handle uncertainties in measurements and initial conditions of detected pedestrians.

The objective is to address several key challenges that arise in real-world scenarios, including data inconsistency, data association, pedestrian motion prediction, and efficient reduction of redundant information. The thesis first proposes a shared situational awareness framework for occluded pedestrian-crossing scenario to compute an estimated set for the pedestrian. The framework is extended to handle measurements from V2X units that may be inconsistent with the ground truth of the detected pedestrian. To address scenarios involving multiple occluded pedestrians, a data association method based on intersection-over-union heuristics is introduced. Pedestrian motion prediction is further studied using both a data-driven approach and a bounded velocity–acceleration model applied to the estimated set obtained from the framework. An occlusion-aware extension is also developed to handle situations where occlusions affect both the ego-vehicle and V2X units by exploiting previously observed measurements. Finally, a method for selecting and filtering relevant information from multiple V2X units is proposed to reduce the computational load while maintaining effectiveness. The proposed methods are validated through numerical simulations and real-world experiments using Scania prototype automated vehicles.

Abstract [sv]

En stor utmaning i utvecklingen av uppkopplade och automatiserade fordon (CAV) för stadsmiljöer är att uppnå en omfattande förståelse av den omgivande trafikbilden. Detta bygger på situationsmedvetenhet, definierad som förmågan att uppfatta, tolka och förutse omgivande trafikanters beteende, vilket är avgörande för att säkerställa säkerheten. I synnerhet är oskyddade trafikanter, såsom fotgängare och cyklister, ofta blockerade eller placerade i sensorers blinda vinklar i CAV, vilket fortfarande utgör en kritisk utmaning. Denna avhandling syftar till att förbättra situationsmedvetenheten hos ego-fordonet, CAV:n av primärt intresse, i stadsmiljöer genom att utnyttja fordon-till-allt-kommunikation (V2X) för att inkorporera information från uppkopplade trafikanter. Ett ramverk som använder på mängd-baserade metoder utvecklas för att systematiskt hantera osäkerheter i mätningar och initialvillkor för upptäckta fotgängare. 

Målet är att adressera flera viktiga utmaningar från verkliga scenarier, inklusive datainkonsekvens, dataassociation, förutsägelse av fotgängarrörelser och effektiv minskning av redundant information. Avhandlingen föreslår först ett gemensamt situationsmedvetenhetsramverk för ockluderade övergångsställen för att beräkna en uppskattad mängd för fotgängaren. Ramverket utökas för att hantera mätningar från V2X-enheter som kan vara inkonsekventa med den detekterade fotgängarens verklighet. För att hantera scenarier som involverar flera ockluderade fotgängare introduceras en dataassociationsmetod baserad på snitt-över-union heuristik. Förutsägelse av fotgängarrörelser studeras vidare med hjälp av både en datadriven metod och en begränsad hastighet-accelerations-modell tillämpad på den uppskattade mängden från ramverket. En ocklusionsmedveten utökning utvecklas också för att hantera situationer där ocklusioner påverkar både ego-fordonet och V2X-enheterna genom att utnyttja tidigare mätningar. Slutligen föreslås en metod för att välja och filtrera relevant information från flera V2X-enheter för att minska beräkningsbelastningen samtidigt som effektiviteten bibehålls. Metoderna valideras genom numeriska simuleringar och verkliga experiment med Scanias prototypbaserade automatiserade fordon.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2026. , p. xvi, 135
Series
TRITA-EECS-AVL ; 2026:21
Keywords [en]
Connected and automated vehicles; pedestrian safety; vehicle-to-everything communication; Shared situational awareness
National Category
Robotics and automation
Identifiers
URN: urn:nbn:se:kth:diva-379079ISBN: 978-91-8106-557-2 (print)OAI: oai:DiVA.org:kth-379079DiVA, id: diva2:2051496
Public defence
2026-05-07, https://kth-se.zoom.us/j/63639257006, Kollegiesalen, Brinellvägen 8, Stockholm, 09:00 (English)
Opponent
Supervisors
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)
Note

QC 20260408

Available from: 2026-04-10 Created: 2026-04-08 Last updated: 2026-04-20Bibliographically approved
List of papers
1. Situational awareness using set-based estimation and vehicular communication: An occluded pedestrian-crossing scenario
Open this publication in new window or tab >>Situational awareness using set-based estimation and vehicular communication: An occluded pedestrian-crossing scenario
Show others...
2025 (English)In: Communications in Transportation Research, E-ISSN 2772-4247, Vol. 5, article id 100190Article in journal (Refereed) Published
Abstract [en]

The safety of unprotected road-users is crucial in any urban traffic. Occlusions and blind spots in the field-of-view of a vehicle can lead to unsafe situations. In this work, a specific pedestrian-crossing scenario is considered with an occlusion in the ego-vehicle's field-of-view. A novel framework is presented to enhance situational awareness based on vehicle-to-everything (V2X) communication to share perception data between vehicle and roadside units. It leverages set-based estimation utilizing a computationally efficient algorithm, for which the pedestrian is guaranteed to be located in a constrained zonotope. The proposed method has been validated through both simulation and real experiments. The real experiments are carried out on a test track using Scania autonomous vehicles.

Place, publisher, year, edition, pages
Elsevier BV, 2025
Keywords
Safety guarantees, Set-based estimation, Shared situational awareness, Vehicle-to-everything (V2X) communication
National Category
Control Engineering Vehicle and Aerospace Engineering Communication Systems
Identifiers
urn:nbn:se:kth:diva-366023 (URN)10.1016/j.commtr.2025.100190 (DOI)001510696800001 ()2-s2.0-105007627956 (Scopus ID)
Note

QC 20250703

Available from: 2025-07-03 Created: 2025-07-03 Last updated: 2026-04-08Bibliographically approved
2. Shared Situational Awareness Using Hybrid Zonotopes with Confidence Metric
Open this publication in new window or tab >>Shared Situational Awareness Using Hybrid Zonotopes with Confidence Metric
Show others...
2026 (English)Manuscript (preprint) (Other academic)
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-379123 (URN)
Note

Manuscript in preparation and submitted to the 23rd IFAC World Congress, Busan, Republic of Korea, August 23-28, 2026

QC 20260410

Available from: 2026-04-10 Created: 2026-04-10 Last updated: 2026-04-10Bibliographically approved
3. Set-Based Estimation Using Probabilistic Zonotopes to Ensure the Safety of Occluded Pedestrians
Open this publication in new window or tab >>Set-Based Estimation Using Probabilistic Zonotopes to Ensure the Safety of Occluded Pedestrians
2026 (English)Manuscript (preprint) (Other academic)
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-379127 (URN)
Conference
29th ACM International Conference on Hybrid Systems: Computation and Control, and 17th ACM/IEEE International Conference on Cyber-Physical Systems, Saint Malo, France, May 11-14 2026
Note

Manuscript accepted by HSCC/ICCPS 2026, 29th ACM International Conference on Hybrid Systems: Computation and Control, and 17th ACM/IEEE International Conference on Cyber-Physical Systems, Saint Malo, France, May 11-14 2026

QC 20260410

Available from: 2026-04-10 Created: 2026-04-10 Last updated: 2026-04-10Bibliographically approved
4. Data-Driven Reachability Analysis of Pedestrians Using Behavior Modes
Open this publication in new window or tab >>Data-Driven Reachability Analysis of Pedestrians Using Behavior Modes
Show others...
2023 (English)In: 2023 IEEE 26th International Conference on Intelligent Transportation Systems, ITSC 2023, Institute of Electrical and Electronics Engineers (IEEE) , 2023, p. 4025-4031Conference paper, Published paper (Refereed)
Abstract [en]

In this paper, we present a data-driven approach for safely predicting the future state sets of pedestrians. Previous approaches to predicting the future state sets of pedestrians either do not provide safety guarantees or are overly conservative. Moreover, an additional challenge is the selection or identification of a model that sufficiently captures the motion of pedestrians. To address these issues, this paper introduces the idea of splitting previously collected, historical pedestrian trajectories into different behavior modes for performing data-driven reachability analysis. Through this proposed approach, we are able to use data-driven reachability analysis to capture the future state sets of pedestrians, while being less conservative and still maintaining safety guarantees. Furthermore, this approach is modular and can support different approaches for behavior splitting. To illustrate the efficacy of the approach, we implement our method with a basic behavior-splitting module and evaluate the implementation on an open-source data set of real pedestrian trajectories. In this evaluation, we find that the modal reachable sets are less conservative and more descriptive of the future state sets of the pedestrian.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2023
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:kth:diva-344358 (URN)10.1109/ITSC57777.2023.10422257 (DOI)001178996704008 ()2-s2.0-85186502066 (Scopus ID)
Conference
26th IEEE International Conference on Intelligent Transportation Systems, ITSC 2023, Bilbao, Spain, Sep 24 2023 - Sep 28 2023
Note

Part of ISBN 9798350399462

QC 20240315

Available from: 2024-03-13 Created: 2024-03-13 Last updated: 2026-04-08Bibliographically approved
5. Multi-Pedestrian Tracking in Occluded Environments Using Vehicular Communication and Set-Based Estimation
Open this publication in new window or tab >>Multi-Pedestrian Tracking in Occluded Environments Using Vehicular Communication and Set-Based Estimation
2026 (English)Manuscript (preprint) (Other academic)
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-379129 (URN)
Note

Manuscript in preparation to be submitted to The IEEE International Conference on Intelligent Transportation Systems (ITSC) 2026

QC 20260410

Available from: 2026-04-10 Created: 2026-04-10 Last updated: 2026-04-10Bibliographically approved
6. Share the Unseen: Sequential Reasoning About Occlusions Using Vehicle-to-Everything Technology
Open this publication in new window or tab >>Share the Unseen: Sequential Reasoning About Occlusions Using Vehicle-to-Everything Technology
Show others...
2025 (English)In: IEEE Transactions on Control Systems Technology, ISSN 1063-6536, E-ISSN 1558-0865, p. 1418-1431Article in journal (Refereed) Published
Abstract [en]

Vehicle-to-everything (V2X) communication holds significant promise for augmenting autonomous driving capabilities. Particularly in dense traffic with occluded areas, V2X can be used to share information about the respective observed areas between traffic participants. In turn, reducing uncertainty about unseen areas can lead to less conservative behaviors while maintaining collision avoidance.This paper aims to leverage V2X to improve situation awareness for trajectory planning. We particularly address two challenges: First, the ego vehicle may not always receive up-to-date information. Second, some areas may remain occluded despite receiving information from other participants.In this work, we fuse the received information about the detected free space. We use reachability analysis to compute areas that are guaranteed to be free despite being occluded. This way, we can maintain collision-avoidance guarantees. We demonstrate the benefits of our proposed method both in simulations and physical experiments.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-359348 (URN)10.1109/tcst.2024.3499832 (DOI)001367629700001 ()2-s2.0-85210927559 (Scopus ID)
Funder
Knut and Alice Wallenberg Foundation
Note

QC 20250922

Available from: 2025-01-30 Created: 2025-01-30 Last updated: 2026-04-08Bibliographically approved
7. Information Fusion from Multiple Roadside Units in Occluded Urban Scenarios
Open this publication in new window or tab >>Information Fusion from Multiple Roadside Units in Occluded Urban Scenarios
Show others...
(English)Manuscript (preprint) (Other academic)
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-379132 (URN)
Note

QC 20260410

Available from: 2026-04-10 Created: 2026-04-10 Last updated: 2026-04-10Bibliographically approved

Open Access in DiVA

fulltext(68186 kB)81 downloads
File information
File name FULLTEXT01.pdfFile size 68186 kBChecksum SHA-512
1337033cdb4eaad0e72751cb1e502b18c6c0d47218280128ec3b845b64ad80db681b7dd280dda54b7865b9d0442c4dd3566b8ff2c0f31233c97105f51e762db0
Type fulltextMimetype application/pdf

Authority records

Narri, Vandana

Search in DiVA

By author/editor
Narri, Vandana
By organisation
Decision and Control Systems
Robotics and automation

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 5841 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf