kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Remote Driving of Road Vehicles: A Survey of Driving Feedback, Latency, Support Control, and Real Applications
KTH, School of Engineering Sciences (SCI), Engineering Mechanics, Vehicle engineering and technical acoustics.ORCID iD: 0000-0001-6695-848x
KTH, School of Engineering Sciences (SCI), Engineering Mechanics, Vehicle engineering and technical acoustics.ORCID iD: 0000-0002-2265-9004
Swedish National Road and Transport Research Institute (VTI), Linköping, Sweden.ORCID iD: 0000-0003-4951-5315
KTH, School of Engineering Sciences (SCI), Engineering Mechanics, Vehicle engineering and technical acoustics.ORCID iD: 0000-0002-2480-5554
Show others and affiliations
2024 (English)In: IEEE Transactions on Intelligent Vehicles, ISSN 2379-8858, E-ISSN 2379-8904, Vol. 9, no 10, p. 6086-6107Article in journal (Refereed) Published
Abstract [en]

This literature survey explores the domain of remote driving of road vehicles within autonomous vehicles, focusing on challenges and state-of-the-art solutions related to driving feedback, latency, support control, as well as remote driving platform and real applications. The advancement towards Level-5 autonomy faces challenges, including sensor reliability and diverse scenario feasibility. Currently, remote driving is identified as vital for commercialization, however, it comes with challenges like low situational awareness, latency, and a lack of comprehensive feedback mechanisms. Solutions proposed include enhancing visual feedback, developing haptic feedback, employing prediction techniques, and use control methods to support driver. This paper reviews the existing literature on remote driving in these fields, revealing research gaps and areas for future studies. Additionally, this paper reviews the industry applications of remote driving and shows the state-of-art use cases.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2024. Vol. 9, no 10, p. 6086-6107
Keywords [en]
autonomous vehicles, Cameras, driving feedback, Force feedback, latency, Location awareness, Remote driving, situational awareness, support control, Surveys, Task analysis, teleoperation, Vehicles, Visualization
National Category
Vehicle and Aerospace Engineering Control Engineering
Identifiers
URN: urn:nbn:se:kth:diva-367385DOI: 10.1109/TIV.2024.3362597Scopus ID: 2-s2.0-85184824344OAI: oai:DiVA.org:kth-367385DiVA, id: diva2:1984685
Note

QC 20250717

Available from: 2025-07-17 Created: 2025-07-17 Last updated: 2025-08-20Bibliographically approved
In thesis
1. Remote Driving of Road Vehicles: Feedback Effects, Latency Compensation, and Driver Behavior
Open this publication in new window or tab >>Remote Driving of Road Vehicles: Feedback Effects, Latency Compensation, and Driver Behavior
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Remote driving has appeared as an effective solution to address challenges in achieving full autonomy for vehicles, bridging the gap between Level 4 and Level 5autonomy. Beyond autonomous vehicles (AVs), remote driving can be widely applied in various industries, such as mining, timber cutting, and warehouse logistics, where it can enhance safety, efficiency, and operational reliability. Despite its advantages, remote driving faces significant challenges, including latency, and reduced situational awareness, which impact remote drivers’ performance and experience. This thesis delves into these challenges and investigates solutions to enhance teleoperated driving systems, focusing on user experience, driving feedback and delay compensation.

The research is structured around six research questions, examining the influence of driving feedback on driving behavior and user experience, and strategies to mitigate latency in remote driving and its influence on remote drivers, as well as the learning rate of remote drivers. An integrated approach including quantitative and qualitative analysis is employed, combining experimental studies on areal-life remote driving platform and hardware-in-the-loop (HIL) simulations using IPG CarMaker. Comprehensive experiments evaluate the impact of steering force, motion-cueing, and sound and vibration feedback on driving behavior and experience. Additionally, innovative delay compensation strategies, including an enhanced model-free predictor and a square-root cubature Kalman filter-based predictor, are developed and validated to address signal transmission challenges. Finally, the learning rate of remote drivers under the delayed environment are also explored on a driving simulator.

The research results demonstrate that integrating multimodal driving feedback, such as steering force, motion-cueing, sound, and vibration, can substantially enhance remote drivers’ situational awareness and perceived confidence. However, delays in these feedback channels, particularly motion cues, are found to degrade driving precision and control stability. These challenges highlight the need for more robust delay compensation strategies. In response, a square-root cubature Kalman filter-based predictor is developed, significantly outperforming conventional approaches by maintaining accurate state prediction under latency. It is also found that remote drivers can be used for a certain driving task after 4–5 training rounds in delayed scenarios, suggesting a low adaptation threshold. These findings not only validate the technical feasibility of the proposed methods but also offer practical advantages in deploying scalable, operator-friendly remote driving systems in dynamic, real-world environments.

While the experiments provide meaningful results, certain limitations exist, including the use of a single 4G SIM card for communication and controlled testing environments. Future studies could explore dual-carrier 5G setups and advanced feedback systems to further enhance remote driving platforms.

Overall, this research contributes to the growing field of remote driving by addressing critical challenges and proposing actionable solutions, paving the way for safer, more efficient, and scalable remote driving systems across diverse applications.

Abstract [sv]

Fjärrstyrd körning av fordon  har framträtt som en effektiv lösning för att hantera utmaningarna med att uppnå fullständigt självkörande fordon och överbrygga gapet mellan  nivå 4 och nivå 5  i graden av självkörande. Utöver självkörande fordon (AV) kan fjärrstyrning användas  brett inom olika industrier, såsom gruvdrift, skogsavverkning och lagerlogistik, där det kan förbättra säkerheten, effektiviteten och driftsäkerheten. Trots dess fördelar står fjärrstyrd körning inför betydande utmaningar, såsom latens och minskad situationsmedvetenhet, vilket påverkar fjärrförarnas prestation och upplevelse. Denna avhandling undersöker dessa utmaningar och utforskar lösningar för att förbättra fjärrstyrda körsystem med fokus på användarupplevelse, föraråterkoppling och fördröjningskompensation.

Forskningen struktureras kring sex forskningsfrågor, där man undersöker föraråterkopplingens påverkan på körbeteendet och användarupplevelsen, strategier för att mildra latens vid fjärrstyrd körning samt dess effekt på fjärrförare och fjärrförarnas anpassningsförmåga. Kombinerade metoder  används vilket  inkluderar experimentella studier på en verklig plattform för fjärrstyrning, "hardware-in-the-loop" (HIL) med IPG CarMaker, samt kvantitativa och kvalitativa användarenkäter. Omfattande experiment utvärderar effekten av styrkraft, rörelseåterkoppling samt ljud- och vibrationsåterkoppling på körbeteende och upplevelse. Dessutom utvecklas och valideras innovativa strategier för fördröjningskompensation, däribland en förbättrad modellfri kompensator och en kompensator baserad på en kvadratrot-kubatur-Kalmanfilter, för att hantera utmaningar vid signalöverföring. Slutligen undersöks även fjärrförarnas anpassningsförmåga under fördröjda förhållanden med hjälp av en  körsimulator.

Forskningsresultaten visar att integrering av multimodal föraråterkoppling – såsom styrkraft, rörelseåterkoppling, ljud och vibrationer – avsevärt stärker fjärrförarnas situationsmedvetenhet och upplevda trygghet. Studien utgör ett tidigt empiriskt bidrag som kvantifierar dessa effekter med hjälp av både subjektiva och objektiva mått i en realistisk fjärrkörningsmiljö. Den föreslagna prediktionsmodellen, baserad på kvadratrot-kubatur-Kalmanfilter, uppvisar betydligt högre robusthet och noggrannhet jämfört med konventionella metoder under varierande fördröjningsförhållanden. Studien visar också att fjärrförare kan bli van ett specifikt köruppdrag  efter endast 4–5 träningsomgångar i nya scenarier med fördröjning, vilket tyder på en låg inlärningströskel. Sammantaget bekräftar resultaten metodernas tekniska genomförbarhet och pekar på praktiska fördelar vid implementering av skalbara och användarvänliga fjärrkörningssystem i dynamiska, verkliga miljöer.

Även om experimenten ger meningsfulla resultat finns vissa begränsningar, såsom användningen av ett enda 4G SIM-kort för kommunikation och kontrollerade testmiljöer. Framtida studier kan utforska lösningar med dubbla operatörer och avancerade återkopplingssystem för att ytterligare förbättra plattformar för fjärrstyrning. 

Sammantaget bidrar denna forskning till det växande området för fjärrstyrd körning genom att hantera kritiska utmaningar och föreslå konkreta lösningar, vilket banar väg för säkrare, effektivare och mer skalbara system för fjärrstyrning inom olika tillämpningar.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2025. p. xv, 79
Series
TRITA-SCI-FOU ; 2025:30
Keywords
Remote driving, driving feedback, driving behavior, driving experience, delay compensation, autonomous vehicles, Fjärrkörning, Köråterkoppling, Körbeteende, Körupplevelse, Fördröjningskompensation, Autonoma fordon
National Category
Vehicle and Aerospace Engineering
Research subject
Vehicle and Maritime Engineering
Identifiers
urn:nbn:se:kth:diva-368744 (URN)978-91-8106-335-6 (ISBN)
Public defence
2025-09-15, Sal Kollegiesalen, Brinellvägen 6, Stockholm, 10:00 (English)
Opponent
Supervisors
Funder
Vinnova, 2022-01647
Note

QC-2025-08-22

Available from: 2025-08-22 Created: 2025-08-20 Last updated: 2025-09-15Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Zhao, LinNybacka, MikaelRothhämel, MalteDrugge, LarsJiang, Frank

Search in DiVA

By author/editor
Zhao, LinNybacka, MikaelAramrattana, MaytheewatRothhämel, MalteHabibovic, AzraDrugge, LarsJiang, Frank
By organisation
Vehicle engineering and technical acousticsDecision and Control Systems (Automatic Control)
In the same journal
IEEE Transactions on Intelligent Vehicles
Vehicle and Aerospace EngineeringControl Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 109 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf