kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Adopting Graph Neural Networks to Understand and Reason about Dynamic Driving Scenarios
KTH, School of Industrial Engineering and Management (ITM), Engineering Design, Mechatronics and Embedded Control Systems.ORCID iD: 0000-0002-8028-3607
KTH, School of Electrical Engineering and Computer Science (EECS), Electrical Engineering, Electronics and Embedded systems.
KTH, School of Industrial Engineering and Management (ITM), Engineering Design, Mechatronics and Embedded Control Systems.ORCID iD: 0000-0001-7048-0108
2025 (English)In: IEEE Open Journal of Intelligent Transportation Systems, E-ISSN 2687-7813, Vol. 6, p. 579-589Article in journal (Refereed) Published
Abstract [en]

 With advances in Deep Neural Networks (DNN), Automated Driving Systems (ADS) enable the vehicle to perceive their surroundings in dynamic driving scenarios and perform behaviors by collecting operational data from sensors such as LiDAR and cameras. Current DNN typically detect objects by analyzing and classifying unstructured data (e.g., image data), providing critical information for ADS planning and decision-making. However, advanced ADS, particularly those required to perform the Dynamic Driving Task (DDT) autonomously, are expected to understand driving scenarios across various Operational Design Domains (ODD). This capability requires the support for a continuous comprehension of driving scenarios according to operational data collected by sensors. This paper presents a framework that adopts Graph Neural Networks (GNN) to describe and reason about dynamic driving scenarios via analyzing graph-based data based on collected sensor inputs. We first construct the graph-based data using a meta-path, which defines various interactions among different traffic participants. Next, we propose a design of GNN to support both the classification of the node types of objects and predicting relationships between objects. As results, the performance of the proposed method shows significant improvements compared to the baseline method. Specifically, the accuracy of node classification increases from 0.77 to 0.85, while that of relationships prediction rises from 0.74 to 0.82. To further utilize graph-based data constructed from dynamic driving scenarios, the proposed framework supports reasoning about operational risks by analyzing the observed nodes and relationships in the graph-based data. As a result, the model achieves a MRR of 0.78 in operational risks reasoning. To evaluate the practicality of the proposed framework in real-world systems, we also conduct a real-time performance evaluation by measuring the average process time and the Worst Case Execution Time (WCET). Compared to the baseline models, the results demonstrate the proposed framework presents acceptable real-time performance in analyzing graph-based data

Place, publisher, year, edition, pages
IEEE, 2025. Vol. 6, p. 579-589
Keywords [en]
Graph Neural Network, Dynamic Driving Scenario, Object Detection
National Category
Industrial engineering and management Computer Vision and Learning Systems Embedded Systems Control Engineering
Research subject
Machine Design; Computer Science; Transport Science
Identifiers
URN: urn:nbn:se:kth:diva-363059DOI: 10.1109/ojits.2025.3563428ISI: 001487986600001Scopus ID: 2-s2.0-105003460586OAI: oai:DiVA.org:kth-363059DiVA, id: diva2:1956103
Note

QC 20250505

Available from: 2025-05-05 Created: 2025-05-05 Last updated: 2025-12-30Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Su, PengConglei, Xiang

Search in DiVA

By author/editor
Su, PengConglei, XiangChen, Dejiu
By organisation
Mechatronics and Embedded Control SystemsElectronics and Embedded systems
In the same journal
IEEE Open Journal of Intelligent Transportation Systems
Industrial engineering and managementComputer Vision and Learning SystemsEmbedded SystemsControl Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 155 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf