kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Least-Violating Motion Planning for Traffic-Compliant Autonomous Driving
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Robotics, Perception and Learning, RPL.ORCID iD: 0000-0001-8163-1004
2022 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Over the last decade, autonomous vehicles has received an increasing amount of interest from industries and research institutes. For autonomous vehicles to properly function alongside human drivers, safety guarantees are a must. Safety in traffic is more than just avoiding collisions with other drivers, it is also necessary to seamlessly act and interact in traffic.

Traffic is an environment rife with rules, both straightforward road rules, e.g. “stay in your lane”, and more subtle road rules, e.g. “give way to emergency vehicles”. Given the safety-critical nature of the environments in which an autonomous system needs to act, it is essential that the specification language chosen to encode its behaviour is able to express the full range of possible rules, both straightforward and subtle. Linear Temporal Logic (LTL) is a popular specification language used in motion planning. While LTL is suitable to express many basic rules, more elaborate rules need to incorporate continuous measures of satisfaction. For instance, it is possible to formalize ``maintain the speed limit'' in LTL. However, there is a big difference between violating the speed limit by \SI{2}{km/h} and \SI{30}{km/h}, this difference can not be quantified by LTL. Such measures are offered by Signal Temporal Logic (STL). In our work, we have used both LTL and STL to encode complex road rules including allowable distances to obstacles, as well as more complex road rules for various situations.

The aim of our work has been to formalize and verify safety guarantees for motion planning in autonomous vehicles. This thesis’ contribution encompasses three main venues of research in this area. First, current methods employed in formal synthesis for motion planning are too computationally expensive to reliably provide motion plans in real-time. To this end, we propose solutions to two different problems, scalability and guided sampling for sampling-based motion planners (Papers A and D). Second, we deal with the problem of encoding road rules for motion planning applications. We propose a new spatial-temporal quantitative semantic for STL, that allows the user to calibrate preference for efficiency (duration of mission) against perceived safety (violation of specification)(Paper B). We later show how STL can be used to encode traffic behaviours (Paper E). Third, we investigate the problem of least-violating motion planning in mixed-traffic scenarios (Papers C and E). Here we consider two different viewpoints, humans as dynamic obstacles to avoid (Paper C) and humans as participants in traffic (Paper E). We demonstrate how least-violating motion planning combined with STL, can be utilized to encode road rules in such a way as to produce different forms of driving styles that are perceivable by human users.

Abstract [sv]

Självkörande fordon har under de senaste åren uppmärksammats från både industrin och akademien. För att självkörande fordon ska fungera jämte människor i trafiken är säkerhetsgarantier ett måste. Säkerhet i trafiken är mer än att bara undgå kollisioner med andra trafikanter. Det är även nödvändigt att dessa fordon kan interagera och sammarbeta med andra trafikanter. 

Trafik är en miljö med många regler, både tydliga, såsom ``stanna i ditt körfält'', och mer otydliga regler, såsom ``väj för utryckningsfordon''. Givet den säkerhetskritiska karaktären hos den miljö där det självkörande fordonet verkar, så måste ett specifikationsspråk som kan uttrycka både tydliga och subtila regler användas. Linjär tidslogik (LTL) är ett populärt specifikationsspråk som används inom banplanering. Många grundläggande regler kan beskrivas med LTL, men mer komplexa regler kräver att man kan mäta graden av tillfredsställelse. Det är möjligt att formalisera ``håll dig till hastighetsbegränsningen'' med LTL, men det är en stor skillnad mellan att bryta hastighetsbegränsningen med \SI{2}{km/h} och \SI{30}{km/h}. Denna skillnad kan inte mätas med LTL. Signal tidslogik (STL) kan användas för att mäta sådana skillnader. I vårt arbete använder vi LTL och STL för att formalisera avancerade trafikregler för att t.ex. hålla avstånd till väghinder, samt mer avancerade trafikregler i olika situationer. 

Vårt mål har varit att formalisera och verifiera säkerhetsgarantier för banplanering till självkörande fordon. Denna avhandlings bidrag innefattar tre huvudsakliga spörsmål. Till att börja med identifierar vi att nuvarande metoder för banplanering har för hög tidskomplexitet för att tillförlitligt implementeras för att uppnå banplanering i realtid. Vi föreslår lösningar för två problem inom detta område, skalbarhet, och guidad sampling för sampling-baserad banplanering (Artiklar A och D). Vidare undersöker vi problemet med att formalisera trafikregler för banplanering. Vi föreslår en ny rum-tids kvantitativ semantik för STL, som möjliggör användaren att kalibrera banans effektivitet (uppgiftens varaktighet) mot användarens uppfattade säkerhet (överträdelse av formaliserade regler)(Artikel B). Slutligen visar vi hur STL kan användas för att formalisera beteende i trafiken (Artikel E). Vi undersöker problemet med banplanering som minimerar säkerhetsöverträdelse i trafikscenarion med människor inblandade (Artiklar C och E). I dessa verk har vi två olika synvinklar, antingen människor som dynamiska hinder som måste undvikas (Artikel C), eller människor som medtrafikanter (Artikel E). Vi visar hur vår metod, kombinerad med STL, kan användas för att formalisera trafikregler på sådant sätt att det går att generera olika körstilar som kan uppfattas av människor.

Place, publisher, year, edition, pages
KTH Royal Institute of Technology, 2022. , p. 75
Series
TRITA-EECS-AVL ; 2022:21
Keywords [en]
Motion Planning, Formal Methods, Temporal Logic
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:kth:diva-312153ISBN: 978-91-7873-929-5 (print)OAI: oai:DiVA.org:kth-312153DiVA, id: diva2:1658012
Public defence
2022-06-01, https://kth-se.zoom.us/j/67837765464, F3, Lindstedtsvägen 26 & 28, Stockholm, 15:00 (English)
Opponent
Supervisors
Note

QC 20220516

Available from: 2022-05-16 Created: 2022-05-13 Last updated: 2022-06-25Bibliographically approved
List of papers
1. Multi-vehicle motion planning for social optimal mobility-on-demand
Open this publication in new window or tab >>Multi-vehicle motion planning for social optimal mobility-on-demand
Show others...
2018 (English)In: 2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), IEEE COMPUTER SOC , 2018, p. 7298-7305Conference paper, Published paper (Refereed)
Abstract [en]

In this paper we consider a fleet of self-driving cars operating in a road network governed by rules of the road, such as the Vienna Convention on Road Traffic, providing rides to customers to serve their demands with desired deadlines. We focus on the associated motion planning problem that tradesoff the demands' delays and level of violation of the rules of the road to achieve social optimum among the vehicles. Due to operating in the same environment, the interaction between the cars must be taken into account, and can induce further delays. We propose an integrated route and motion planning approach that achieves scalability with respect to the number of cars by resolving potential collision situations locally within so-called bubble spaces enclosing the conflict. The algorithms leverage the road geometries, and perform joint planning only for lead vehicles in the conflict and use queue scheduling for the remaining cars. Furthermore, a framework for storing previously resolved conflict situations is proposed, which can be use for quick querying of joint motion plans. We show the mobility-on-demand setup and effectiveness of the proposed approach in simulated case studies involving up to 10 selfdriving vehicles.

Place, publisher, year, edition, pages
IEEE COMPUTER SOC, 2018
Series
IEEE International Conference on Robotics and Automation ICRA, ISSN 1050-4729
National Category
Transport Systems and Logistics
Identifiers
urn:nbn:se:kth:diva-237168 (URN)10.1109/ICRA.2018.8462968 (DOI)000446394505081 ()2-s2.0-85063127749 (Scopus ID)978-1-5386-3081-5 (ISBN)
Conference
IEEE International Conference on Robotics and Automation (ICRA), MAY 21-25, 2018, Brisbane, AUSTRALIA
Funder
Swedish Research Council
Note

QC 20181024

Available from: 2018-10-24 Created: 2018-10-24 Last updated: 2022-06-26Bibliographically approved
2. Sampling-based Motion Planning with Temporal Logic Missions and Spatial Preferences
Open this publication in new window or tab >>Sampling-based Motion Planning with Temporal Logic Missions and Spatial Preferences
2020 (English)Conference paper, Published paper (Refereed)
Abstract [en]

While motion planning under temporal logic specifications has been addressed in several state-of-the-art works, spatial aspects have been so far largely neglected. In this work, we enrich the semantics of robot motion specifications by including preferences on spatial relations between its trajectory and various elements in its environment. The spatial preferences are given in a fragment of Signal Temporal Logic (STL) on top of complex missions in syntactically co-safe Linear Temporal Logic (scLTL). We propose a cost function with user-specified parameters, which determines the compromise between efficiency and spatial robustness of a trajectory.  The proposed modification of the incremental sampling-based RRT$^\star$ driven by this cost function guarantees that the motion plan (if found) simultaneously satisfies the mission and asymptotically minimize the cost. The paper includes several case studies showcasing the effects of the user-adjustable parameters on the resulting trajectories.

Place, publisher, year, edition, pages
Elsevier BV, 2020
Series
IFAC-PapersOnLine, ISSN 2405-8963
Keywords
Temporal Logic, Trajectory Planning, Path Planning, Formal Methods, Robotics
National Category
Robotics and automation Control Engineering
Research subject
Computer Science
Identifiers
urn:nbn:se:kth:diva-291660 (URN)10.1016/j.ifacol.2020.12.2397 (DOI)000652593600369 ()2-s2.0-85116737518 (Scopus ID)
Conference
IFAC, International Federation of Automatic Control virtually from Tuesday to Friday, May 25-28, 2021,
Note

QC 20210318

Available from: 2021-03-17 Created: 2021-03-17 Last updated: 2025-02-05Bibliographically approved
3. Intention-aware motion planning with road rules
Open this publication in new window or tab >>Intention-aware motion planning with road rules
2020 (English)In: IEEE International Conference on Automation Science and Engineering, Institute of Electrical and Electronics Engineers (IEEE) , 2020, p. 526-532Conference paper, Published paper (Refereed)
Abstract [en]

We present an approach for intention-aware motion planning in an autonomous driving scenario, where a vehicle aims to traverse a road segment as quickly as possible, while constrained by road rules encoded in syntactically co-safe linear temporal logic. We show that by combining the RRTx algorithm with trajectory prediction using Mixed Observable Markov Decision Processes (MOMDP), we can achieve least-violating behavior wrt. mission completion time and the road rules, while ensuring that the likelihood of collisions remains below a user specified threshold. We illustrate the validity of our approach using simulations of a variety of traffic scenarios. 

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2020
Keywords
Markov processes, Motion planning, Roads and streets, Autonomous driving, Linear temporal logic, Markov Decision Processes, Mission completion, Road rules, Road segments, Trajectory prediction, Highway planning
National Category
Robotics and automation
Identifiers
urn:nbn:se:kth:diva-301090 (URN)10.1109/CASE48305.2020.9217037 (DOI)000612200600075 ()2-s2.0-85094175545 (Scopus ID)
Conference
16th IEEE International Conference on Automation Science and Engineering, CASE 2020, 20-21 August 2020, Hong Kong, China
Note

Part of proceedings: ISBN 978-1-7281-6904-0

QC 20210906

Available from: 2021-09-06 Created: 2021-09-06 Last updated: 2025-02-09Bibliographically approved
4. When to Terminate: Path Non-existence Verification Improves Sampling-based Motion Planning
Open this publication in new window or tab >>When to Terminate: Path Non-existence Verification Improves Sampling-based Motion Planning
Show others...
2021 (English)In: 2021 20Th International Conference On Advanced Robotics (ICAR), Institute of Electrical and Electronics Engineers (IEEE) , 2021, p. 594-600Conference paper, Published paper (Refereed)
Abstract [en]

In this work, we combine a sampling based motion planner with path non-existence verification. We show that, using our approach, it is possible to: 1) provide termination criteria to sampling-based motion planners, based on the problem specific constraints; 2) generate a method for rejection sampling that can adapt to the scenario, for instance, leveraging the relative priority between constraints. Furthermore, we describe a language-guided sampling technique based on IRRT?, that utilizes the results from the path non-existence verification procedure to reduce runtime of the underlying motion planner. The approach is studied using route and motion planning for an autonomous vehicle that aims to service transportation tasks while constrained by rules of the road. We evaluate the proposed approach using a set of real-life inspired traffic scenarios. Finally, we show that the resulting runtime of a motion planner with path non-existence verification is significantly shortened when compared to the same motion planner with traditional termination criteria, such as a resource or time limit.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2021
National Category
Robotics and automation Computer Sciences Control Engineering
Identifiers
urn:nbn:se:kth:diva-310886 (URN)10.1109/ICAR53236.2021.9659459 (DOI)000766318900090 ()2-s2.0-85124695597 (Scopus ID)
Conference
20th International Conference on Advanced Robotics (ICAR), Ljubljana, Slovenia, December 7-10, 2021
Note

Part of ISBN 978-1-6654-3684-7

QC 20250922

Available from: 2022-04-13 Created: 2022-04-13 Last updated: 2025-09-22Bibliographically approved
5. Encoding Human Driving Styles in Motion Planning for Autonomous Vehicles
Open this publication in new window or tab >>Encoding Human Driving Styles in Motion Planning for Autonomous Vehicles
Show others...
2021 (English)In: 2021 IEEE International Conference on Robotics and Automation (ICRA), Institute of Electrical and Electronics Engineers (IEEE) , 2021, p. 11262-11268Conference paper, Published paper (Refereed)
Abstract [en]

Driving styles play a major role in the acceptance and use of autonomous vehicles. Yet, existing motion planning techniques can often only incorporate simple driving styles that are modeled by the developers of the planner and not tailored to the passenger. We present a new approach to encode human driving styles through the use of signal temporal logic and its robustness metrics. Specifically, we use a penalty structure that can be used in many motion planning frameworks, and calibrate its parameters to model different automated driving styles. We combine this penalty structure with a set of signal temporal logic formula, based on the Responsibility-Sensitive Safety model, to generate trajectories that we expected to correlate with three different driving styles: aggressive, neutral, and defensive. An online study showed that people perceived different parameterizations of the motion planner as unique driving styles, and that most people tend to prefer a more defensive automated driving style, which correlated to their self-reported driving style.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2021
Series
Proceedings - IEEE International Conference on Robotics and Automation, ISSN 1050-4729
Keywords
Autonomous vehicle navigation, Formal methods in robotics and automation, Human factors, Human-in-the-loop
National Category
Robotics and automation Control Engineering Computer Sciences
Identifiers
urn:nbn:se:kth:diva-310389 (URN)10.1109/ICRA48506.2021.9561777 (DOI)000765738801034 ()2-s2.0-85109997697 (Scopus ID)
Conference
2021 IEEE International Conference on Robotics and Automation, ICRA 2021, 30 May 2021 through 5 June 2021, Xian, China
Note

QC 20220502

Part of proceedings: ISBN 978-1-7281-9077-8

Available from: 2022-04-04 Created: 2022-04-04 Last updated: 2025-02-05Bibliographically approved
6. Calibrating Driving Styles in Motion Planning for Autonomous Vehicles
Open this publication in new window or tab >>Calibrating Driving Styles in Motion Planning for Autonomous Vehicles
Show others...
(English)Manuscript (preprint) (Other academic)
Abstract [en]

To display perceivably different driving styles is an important ability for autonomous vehicles in real-life traffic scenarios. By encouraging predictable driving styles, we can promote trust and collaboration between vehicle and human drivers in traffic. However, many motion planners lack the ability to provide different driving styles using one method.As a result, many applications are overly defensive to ensure safety, and can not be tailored to the users' preferences. In this work, we build on our previous works on encoding perceivable driving styles using Signal Temporal Logic (STL) and generating motion planning trajectories using user preferences. We refine our previously proposed spatial constraints based on the Responsibility-Sensitive Safety (RSS) model. We illustrate how the motion planner can be parameterized to produce aggressive, neutral and defensive driving behaviors, respectively.  We evaluate the resulting driving styles on a set of real-life inspired driving scenarios, modeled in the Carla simulator and provide a detailed statistical analysis of the generated trajectories.

Keywords
Motion Planning, Formal Methods, STL
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-312152 (URN)
Note

QC 20220518

Available from: 2022-05-13 Created: 2022-05-13 Last updated: 2022-06-25Bibliographically approved

Open Access in DiVA

kappa(1627 kB)570 downloads
File information
File name FULLTEXT01.pdfFile size 1627 kBChecksum SHA-512
402b79ea4043a80e70f0b19aa4cae035f2bcff4589ffc58e7055a480d23bc11e6162415b65856a4e0c3d2bd6f075040035d1ac6d6f80db1401b4613b5e750e66
Type fulltextMimetype application/pdf

Authority records

Karlsson, Jesper

Search in DiVA

By author/editor
Karlsson, Jesper
By organisation
Robotics, Perception and Learning, RPL
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 570 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1005 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf