kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Uncertainty Aware Data Driven Precautionary Safety for Automated Driving Systems Considering Perception Failures and Event Exposure
KTH, School of Industrial Engineering and Management (ITM), Machine Design (Dept.), Mechatronics. Zenseact.ORCID iD: 0000-0001-9020-6501
Zenseact.
Zenseact.
KTH, School of Industrial Engineering and Management (ITM), Machine Design (Dept.), Mechatronics.ORCID iD: 0000-0002-4300-885X
Show others and affiliations
2022 (English)In: Proceedings of IEEE Symposium on Intelligent Vehicle, Aachen, Germany, 2022Conference paper, Published paper (Refereed)
Abstract [en]

Ensuring safety is arguably one of the largest remaining challenges before wide-spread market adoption of Automated Driving Systems (ADSs). One central aspect is how to provide evidence for the fulfilment of the safety claims and, in particular, how to produce a predictive and reliable safety case considering both the absence and the presence of faults in the system. In order to provide such evidence, there is a need for describing and modelling the different elements of the ADS and its operational context: models of event exposure, sensing and perception models, as well as actuation and closed-loop behaviour representations. This paper explores how estimates from such statistical models can impact the performance and operation of an ADS and, in particular, how such models can be continuously improved by incorporating more field data retrieved during the operation of (previous versions of) the ADS. Focusing on the safe driving velocity,  this results in the ability to update the driving policy so to maximise the allowed safe velocity, for which the safety claim still holds. For illustration purposes, an example considering statistical models of the exposure to an adverse event, as well as failures related to the system's perception system, is analysed. Estimations from these models, using statistical confidence limits, are used to derive a safe driving policy of the ADS. The results highlight the importance of leveraging field data in order to improve the system's abilities and performance, while remaining safe. The proposed methodology, leveraging a data-driven approach, also shows how the system's safety can be monitored and maintained, while allowing for incremental expansion and improvements of the ADS. 

Place, publisher, year, edition, pages
Aachen, Germany, 2022.
National Category
Vehicle and Aerospace Engineering
Identifiers
URN: urn:nbn:se:kth:diva-312006DOI: 10.1109/IV51971.2022.9827255ISI: 000854106700085Scopus ID: 2-s2.0-85135378288OAI: oai:DiVA.org:kth-312006DiVA, id: diva2:1656913
Conference
IEEE Symposium on Intelligent Vehicle
Projects
SALIENCE4CAV (2020-02946)WASP
Funder
Vinnova, 2020-02946Wallenberg AI, Autonomous Systems and Software Program (WASP)
Note

QC 20220511

Available from: 2022-05-09 Created: 2022-05-09 Last updated: 2025-02-14Bibliographically approved
In thesis
1. Efficient Strategies for Safety Assurance of Automated Driving Systems
Open this publication in new window or tab >>Efficient Strategies for Safety Assurance of Automated Driving Systems
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

By relieving the human driver of the responsibility of safely operating the vehicle, Automated Driving Systems (ADSs) (colloquially known as self-driving cars) can free up time and possibly also reduce the number of road accidents. Paradoxically, even though safety is one of the main expectations of ADSs, it is also one of the major challenges and arguably one of the key reasons why we have yet to see widespread market deployment of such systems. Contrary to previous generations of automotive systems, common development and safety assurance practises no longer suffice to accommodate the increased system complexity and operational uncertainty inherent to an ADS. Indeed, concrete models and means to show safety fulfilment before deployment remain elusive. For that purpose, this thesis focuses on efficient strategies for safety assurance of ADSs and explores this from three angles. 

Firstly, a comprehensive review of the state of the art has been conducted to identify and structure available methods for providing (predictive) evidence of the safety of the ADS, and to identify gaps and directions where further research is needed.

Secondly, the task of ensuring completeness of both the Verification and Validation (V&V) as well as the safety requirements of the ADS has been explored. The appropriate definition, formalisation and management of an Operational Design Domain (ODD) provide a means to ensure alignment between specification, testing and operations of the ADS – suggesting one way of closing the completeness gap for the V&V. Furthermore, to address the exhaustiveness of the safety requirements, this thesis proposes the use of a Quantitative Risk Norm (QRN) to elicit quantitative vehicle-level requirements. A QRN facilitates this exhaustiveness by considering frequencies of loss events (e.g. accidents) rather than requiring an enumeration of all possible hazards pertaining to the ADS.

Thirdly, this thesis extends the concept of Precautionary Safety (PcS) proposing a methodology for connecting the quantitative safety requirements of the QRN and the runtime decisions of the ADS. This is enabled by augmenting the ADS’s situation awareness (SAW) with an understanding of its own ability to avoid different loss events. Using this enhanced SAW model and by subsequently accounting for the uncertainties of the loss event probabilities, enables an assessment of the QRN even when there is limited data available. Consequently, the proposed methodology can ensure that the ADS indeed only takes decisions that are known to fulfil the QRN.

Jointly, the work presented in this thesis paves a way for how to bridge quantitative safety requirements and runtime decision-making of the ADS, and a possible strategy for efficient safety assurance of ADSs is outlined – drawing upon the contributions of the appended papers. There are still several open questions to understand the implications of this approach but the work showcased herein provides a solid foundation for such future work.

 

 

 

Abstract [sv]

Automatiserade förarsystem (ADSer) (även kallade självkörande bilar) kan frigöra tid och möjligen även minska antalet olyckor i traffiken, genom att avlösa den mänskliga föraren från ansvaret för att köra säkert. Även om säkerhet (safety, security är inte inkluderat i denna avhandling) är en av de största förväntningarna på ADSer, så är det paradoxalt nog även en av de största utmaningarna. Kanske till och med en av huvudanledningarna till att vi ännu inte har sett någon bred lansering av denna typ av system på våra vägar. Metoder för utveckling och säkerhetsbevisning som använts för tidigare generationers system inom bilindustrin är inte längre tillräckliga för att hantera den ökade systemkomplexiteten och de osäkerhetsfaktorer som kännetecknar en ADS. Trots framsteg saknas accepterade, konkreta modeller och metoder för att framställa säkerhetsbevis innan ADSen lanseras på publika vägar. Som en del i att råda bot på detta fokuserar denna avhandling på strategier för säkerhetsbevisning av ADSer och utforskar detta område ur tre vinklar. 

För det första, har en omfattande litteraturestudie genomförts för att identifiera och strukturera befintliga metoder som bidrar till säkerhetsbevisningen för ADSer. I det arbetet identifierades också kvarstående forskningsluckor, som kräver ytterligare forskning.

För det andra, har komplettheten av både verifikationen och valideringen (V&V) samt säkerhetskraven på ADSen utforskats. Genom att bidra med en tillräcklig definition, formalisering och hantering av en Operational Design Domain (ODD) kan det verktyget stötta både specifikationen och testningen av systemet samt när det väl är i funktion (i runtime). ODDen ger således en potentiell väg framåt för att säkerställa komplettheten av V&V processerna och fyra konkreta strategier för att undvika att lämna ODDen presenteras. Vidare, så har en Kvantitativ Risk Norm (QRN) föreslagits för att förenkla arbetet med att uppnå kompletthet av säkerhetskraven på ADSen. Detta genom att kräva uppfyllnad av kvantitativa krav på antalet incidenter istället för att kräva en uppräkning av alla potentiella risker (hazards).

För det tredje, har konceptet med försiktig säkerhet (Precautionary safety) (PcS) vidare-utvecklats för att ge en konkret koppling mellan uppfyllnaden av en QRN och de beslut ADSen tar i runtime. Detta möjliggörs genom att utöka ADSens medvetenhet (situation awareness, SAW) om sin omgivning med en förståelse för det egna systemets förmåga att undvika olika incidenter. Trots begränsad tillgång till data möjliggör denna metod att ta fram en säker körpolicy som uppfyller QRNen genom att hantera de olika osäkerheterna i modellerna som underbygger PcS konceptet. Denna hantering gör det även möjligt att ADSen bara tar beslut som den vet kommer uppfylla QRNen.

Dessa tre områden utgör en möjlig väg framåt för en effektiv (efficient inte bara effektiv) strategi för säkerhetsbevisning för ADSer. Det finns visserligen mycket jobb kvar att göra för att förstå alla implikationer av denna strategi, men det arbete som läggs fram i denna avhandling ger en bra bas att stå på inför en fortsatt utforskning av denna eller ytterligare strategier för effektiv säkerhetsbevisning av ADSer.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2025. p. 267
Series
TRITA-ITM-AVL ; 2025:3
Keywords
Automated Driving, Safety, Precautionary Safety, Quantitative Safety, Safety Assurance
National Category
Reliability and Maintenance
Research subject
Machine Design
Identifiers
urn:nbn:se:kth:diva-359967 (URN)978-91-8106-176-5 (ISBN)
Public defence
2025-03-12, https://kth-se.zoom.us/j/66985007478, F3, Lindstedtsvägen 26-28, Stockholm, 13:15 (English)
Opponent
Supervisors
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)
Note

QC 20251030

Available from: 2025-02-17 Created: 2025-02-14 Last updated: 2025-10-30Bibliographically approved

Open Access in DiVA

fulltext(1553 kB)526 downloads
File information
File name FULLTEXT02.pdfFile size 1553 kBChecksum SHA-512
9b8d37e1b8414086e08affcc3dd2998c649a0b44f0d030ae881be7da798f6802744aaac3b8d6c8f4548e0930e3dc98768a4d1dadcd1a7afc55565af35cfce828
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Gyllenhammar, MagnusTörngren, Martin

Search in DiVA

By author/editor
Gyllenhammar, MagnusTörngren, Martin
By organisation
Mechatronics
Vehicle and Aerospace Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 526 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 1482 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf