kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Situation Awareness for Autonomous Agents under Limited Sensing
KTH, School of Industrial Engineering and Management (ITM), Engineering Design, Mechatronics and Embedded Control Systems.ORCID iD: 0000-0001-9982-578X
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Autonomous agents, such as robots and automated vehicles, rely on their ability to perceive and interpret their environment to make informed decisions and execute actions that align with their goals. A key aspect of this capability is situation awareness, which involves understanding the current state of the environment and predicting its future evolution. Traditional autonomous systems address perception and prediction as separate tasks within a sequential pipeline, where raw sensor data is processed into increasingly abstract representations. While this structured approach has driven significant advancements, it remains constrained by sensor limitations, including occlusions, measurement uncertainty, and adverse weather conditions.

This thesis investigates how predictions from past observations can enhance perception algorithms, enabling agents to infer missing information, reduce uncertainty, and better anticipate changes. To support this integration, alternative environment representations are explored that allow feedback between prediction and perception while capturing uncertainty. This tighter coupling improves decision-making, particularly in complex and partially observable environments.

The contributions include: (1) a reachability-based reasoning framework for tracking possible hidden obstacles; (2) its extension to handle delayed and partial external data; (3) a probabilistic mapping method, Transitional Grid Maps (TGM), that jointly models static and dynamic occupancy; and (4) an extension of TGM to mitigate weather-induced sensor noise.

The proposed methods are evaluated in simulated and real scenarios where traditional perception pipelines struggle, such as occluded, highly dynamic and noisy environments. By bridging the gap between perception and prediction, this work contributes to the development of more robust and intelligent autonomous systems.

Abstract [sv]

Autonoma agenter, såsom robotar och självkörande fordon, är beroende av sin förmåga att uppfatta och tolka omgivningen för att fatta välgrundade beslut och utföra handlingar i linje med sina mål. En viktig del av denna förmåga är situationsmedvetenhet, som innebär att förstå miljöns nuvarande tillstånd och förutse dess framtida utveckling. Traditionella autonoma system hanterar perception och prediktion som separata steg i en sekventiell kedja, där sensordata bearbetas till alltmer abstrakta representationer. Även om detta strukturerade tillvägagångssätt lett till stora framsteg, begränsas det av sensorbrister, inklusive skymda objekt, mätosäkerhet och ogynnsamt väder.

Denna avhandling undersöker hur prediktioner från tidigare observationer kan förbättra perceptionsalgoritmer, så att agenter kan sluta sig till saknad information, minska osäkerhet och bättre förutse förändringar. För att möjliggöra denna integration utforskas alternativa omgivningsrepresentationer som ger återkoppling mellan prediktion och perception, samtidigt som osäkerheter kan hanteras. Denna tätare koppling förbättrar beslutsfattandet, särskilt i komplexa och delvis observerbara miljöer.

Avhandlingens huvudsakliga bidrag inkluderar: (1) ett reso\-nemangs\-ramverk baserat på nåbarhet för att spåra möjliga dolda hinder; (2) dess utvidgning för att hantera fördröjd och ofullständig extern data; (3) en probabilistisk kartmetod, Transitional Grid Maps (TGM), som gemensamt modellerar statisk och dynamisk ockupation; och, (4) utvidgning av TGM för att förbättrad hantering av väderrelaterat sensorbrus.

Metoderna utvärderas i scenarier där traditionella perceptionskedjor har problem, exempelvis i skymda, mycket dynamiska och brusiga miljöer. Genom att överbrygga klyftan mellan perception och prediktion bidrar detta arbete till utvecklingen av robustare och intelligentare autonoma system.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2025. , p. 71
Series
TRITA-ITM-AVL ; 2025:29
National Category
Robotics and automation
Research subject
Machine Design
Identifiers
URN: urn:nbn:se:kth:diva-363919ISBN: 978-91-8106-330-1 (print)OAI: oai:DiVA.org:kth-363919DiVA, id: diva2:1961610
Public defence
2025-06-18, https://kth-se.zoom.us/j/66710325262, Kollegiesalen, Brinellvägen 8, Stockholm, 10:00 (English)
Opponent
Supervisors
Funder
VinnovaAvailable from: 2025-05-27 Created: 2025-05-27 Last updated: 2025-06-09Bibliographically approved
List of papers
1. Foresee the Unseen: Sequential Reasoning about Hidden Obstacles for Safe Driving
Open this publication in new window or tab >>Foresee the Unseen: Sequential Reasoning about Hidden Obstacles for Safe Driving
Show others...
2022 (English)In: 2022 IEEE Intelligent Vehicles Symposium (IV), Institute of Electrical and Electronics Engineers (IEEE), 2022, p. 255-264Conference paper, Published paper (Refereed)
Abstract [en]

Safe driving requires autonomous vehicles to anticipate potential hidden traffic participants and other unseen objects, such as a cyclist hidden behind a large vehicle, or an object on the road hidden behind a building. Existing methods are usually unable to consider all possible shapes and orientations of such obstacles. They also typically do not reason about observations of hidden obstacles over time, leading to conservative anticipations. We overcome these limitations by (1) modeling possible hidden obstacles as a set of states of a point mass model and (2) sequential reasoning based on reachability analysis and previous observations. Based on (1), our method is safer, since we anticipate obstacles of arbitrary unknown shapes and orientations. In addition, (2) increases the available drivable space when planning trajectories for autonomous vehicles. In our experiments, we demonstrate that our method, at no expense of safety, gives rise to significant reductions in time to traverse various intersection scenarios from the CommonRoad Benchmark Suite.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2022
Series
IEEE Intelligent Vehicles Symposium, ISSN 1931-0587
National Category
Computer graphics and computer vision
Identifiers
urn:nbn:se:kth:diva-320423 (URN)10.1109/IV51971.2022.9827171 (DOI)000854106700037 ()2-s2.0-85135375265 (Scopus ID)
Conference
33rd IEEE Intelligent Vehicles Symposium (IEEE IV), June 5-9, 2022, Aachen, Germany
Note

Part of ISBN 97816654-88211

QC 20250923

Available from: 2022-11-07 Created: 2022-11-07 Last updated: 2025-09-23Bibliographically approved
2. Share the Unseen: Sequential Reasoning About Occlusions Using Vehicle-to-Everything Technology
Open this publication in new window or tab >>Share the Unseen: Sequential Reasoning About Occlusions Using Vehicle-to-Everything Technology
Show others...
2024 (English)In: IEEE Transactions on Control Systems Technology, ISSN 1063-6536, E-ISSN 1558-0865, p. 1-14Article in journal (Refereed) Epub ahead of print
Abstract [en]

Vehicle-to-everything (V2X) communication holds significant promise for augmenting autonomous driving capabilities. Particularly in dense traffic with occluded areas, V2X can be used to share information about the respective observed areas between traffic participants. In turn, reducing uncertainty about unseen areas can lead to less conservative behaviors while maintaining collision avoidance.This paper aims to leverage V2X to improve situation awareness for trajectory planning. We particularly address two challenges: First, the ego vehicle may not always receive up-to-date information. Second, some areas may remain occluded despite receiving information from other participants.In this work, we fuse the received information about the detected free space. We use reachability analysis to compute areas that are guaranteed to be free despite being occluded. This way, we can maintain collision-avoidance guarantees. We demonstrate the benefits of our proposed method both in simulations and physical experiments.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-359348 (URN)10.1109/tcst.2024.3499832 (DOI)001367629700001 ()2-s2.0-85210927559 (Scopus ID)
Funder
Knut and Alice Wallenberg Foundation
Note

QC 20250922

Available from: 2025-01-30 Created: 2025-01-30 Last updated: 2026-01-30Bibliographically approved
3. Transitional Grid Maps: Joint Modeling of Static and Dynamic Occupancy
Open this publication in new window or tab >>Transitional Grid Maps: Joint Modeling of Static and Dynamic Occupancy
Show others...
2025 (English)In: IEEE Open Journal of Intelligent Transportation Systems, E-ISSN 2687-7813, Vol. 6, p. 1-10Article in journal (Refereed) Published
Abstract [en]

Autonomous agents rely on sensor data to construct representations of their environments, essential for predicting future events and planning their actions. However, sensor measurements suffer from limited range, occlusions, and sensor noise. These challenges become more evident in highly dynamic environments. This work proposes a probabilistic framework to jointly infer which parts of an environment are statically and which parts are dynamically occupied. We formulate the problem as a Bayesian network and introduce minimal assumptions that significantly reduce the complexity of the problem. Based on those, we derive Transitional Grid Maps (TGMs), an efficient analytical solution. Using real data, we demonstrate how this approach produces better maps than the state-of-the-art by keeping track of both static and dynamic elements and, as a side effect, can help improve existing SLAM algorithms.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
National Category
Computer Sciences Computer graphics and computer vision
Identifiers
urn:nbn:se:kth:diva-359349 (URN)10.1109/ojits.2024.3521449 (DOI)2-s2.0-85210909052 (Scopus ID)
Note

QC 20250130

Available from: 2025-01-30 Created: 2025-01-30 Last updated: 2025-05-27Bibliographically approved
4. Transitional Grid Maps for Adverse Weather Conditions: Temporal Sparsity-based Filtering on Range Sensors
Open this publication in new window or tab >>Transitional Grid Maps for Adverse Weather Conditions: Temporal Sparsity-based Filtering on Range Sensors
Show others...
(English)Manuscript (preprint) (Other academic)
Abstract [en]

Autonomous agents rely on accurate environment perception for safe and effective navigation. However, adverse weather conditions, such as snow or heavy rain, pose significant challenges to range sensors, leading to false positives and hindered obstacle detection. Previous work has focused on analyzing the sparsity of the measurements and learning from extensive datasets to filter out adverse weather detections. Despite promising results, the small residual unfiltered detections can still severely limit an agent's ability to generate feasible motion plans. In this paper, we introduce Transitional Grid Maps for Adverse Weather (TGMw). A temporal filter designed to distinguish weather-related noise from dynamic and static obstacles. It can either be used to directly filter the raw sensor measurements or to complement existing spatial filters. We demonstrate the benefits of our method in an extensive analysis in combination with multiple existing filters.

National Category
Robotics and automation
Identifiers
urn:nbn:se:kth:diva-363918 (URN)
Funder
Vinnova, 876038
Note

QC 20250527

Available from: 2025-05-27 Created: 2025-05-27 Last updated: 2025-05-27Bibliographically approved

Open Access in DiVA

thesis_gaspar_sanchez(13288 kB)1551 downloads
File information
File name FULLTEXT01.pdfFile size 13288 kBChecksum SHA-512
7773d971f9d04d58381ba7a0ed06228b7ce482753225520c59caed36e9df05c58fb68289c0216ea109047f616c024b3604252c71537070c7bdcc457d7227ef5a
Type fulltextMimetype application/pdf

Authority records

Gaspar Sánchez, José Manuel

Search in DiVA

By author/editor
Gaspar Sánchez, José Manuel
By organisation
Mechatronics and Embedded Control Systems
Robotics and automation

Search outside of DiVA

GoogleGoogle Scholar
Total: 1551 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 911 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf