kth.sePublications KTH
Change search
Link to record
Permanent link

Direct link
Alternative names
Publications (10 of 47) Show all publications
Tian, Y., Zhao, X., Liu, R., Yu, Q., Zhu, X., Wang, S. & Meinke, K. (2024). Driving Intention Recognition and Speed Prediction at Complex Urban Intersections Considering Traffic Environment. IEEE Transactions on Intelligent Transportation Systems, 25(5), 4470-4488
Open this publication in new window or tab >>Driving Intention Recognition and Speed Prediction at Complex Urban Intersections Considering Traffic Environment
Show others...
2024 (English)In: IEEE Transactions on Intelligent Transportation Systems, ISSN 1524-9050, E-ISSN 1558-0016, Vol. 25, no 5, p. 4470-4488Article in journal (Refereed) Published
Abstract [en]

Reliable motion prediction of surrounding vehicles is the key to safe and efficient driving of autonomous vehicles, especially at urban intersections with complex traffic environments. This study models driving intentions and future driving speeds at urban intersections and improves model prediction performance by considering traffic environment characteristics. Key feature parameters including environmental characteristics are first extracted through driving behavior analysis and existing research experience. Then models with different input combinations are constructed to explore the effectiveness of different factors in predicting driving intention and future speed. In particular, in vehicle speed modeling, a target detection algorithm is used to identify traffic participants. Based on the identified traffic participant and vehicle position information, a new method for speed prediction that can reflect the dynamic interaction characteristics between the driver and the traffic environment is proposed. Models are trained and tested using natural driving data from China. Finally, the models with the simplest input and the best effect are determined. The driving intention recognition model can accurately predict the driving maneuvers of straight-Ahead, stopping, turning left and right 4 seconds before reaching the intersection. The speed prediction model can significantly improve the speed prediction accuracy, and shows stronger robustness and adaptability than existing models. This research provides important technical support for developing intelligent driving systems suitable for complex urban traffic environments.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
Keywords
autonomous vehicles, Driving intention, speed prediction, traffic environment, urban intersections
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-350172 (URN)10.1109/TITS.2023.3330008 (DOI)001119913100001 ()2-s2.0-85178045507 (Scopus ID)
Note

QC 20240709

Available from: 2024-07-09 Created: 2024-07-09 Last updated: 2025-08-28Bibliographically approved
Ye, Y., Zhang, H., Tian, Y., Sun, J. & Meinke, K. (2024). Flow to Rare Events: An Application of Normalizing Flow in Temporal Importance Sampling for Automated Vehicle Validation<sup>∗</sup>. In: IAVVC 2024 - IEEE International Automated Vehicle Validation Conference, Proceedings: . Paper presented at 2024 IEEE International Automated Vehicle Validation Conference, IAVVC 2024, Pittsburgh, United States of America, Oct 21 2024 - Oct 23 2024. Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>Flow to Rare Events: An Application of Normalizing Flow in Temporal Importance Sampling for Automated Vehicle Validation<sup>∗</sup>
Show others...
2024 (English)In: IAVVC 2024 - IEEE International Automated Vehicle Validation Conference, Proceedings, Institute of Electrical and Electronics Engineers (IEEE) , 2024Conference paper, Published paper (Refereed)
Abstract [en]

Automated Vehicle (AV) validation based on simulated testing requires unbiased evaluation and high efficiency. One effective solution is to increase the exposure to risky rare events while reweighting the probability measure. However, characterizing the distribution of risky events is particularly challenging due to the paucity of samples and the temporality of continuous scenario variables. To solve it, we devise a method to represent, generate, and reweight the distribution of risky rare events. We decompose the temporal evolution of continuous variables into distribution components based on conditional probability. By introducing the Risk Indicator Function, the distribution of risky rare events is theoretically precipitated out of naturalistic driving distribution. This targeted distribution is practically generated via Normalizing Flow, which achieves exact and tractable probability evaluation of intricate distribution. The rare event distribution is then demonstrated as the advantageous Importance Sampling distribution. We also promote the technique of temporal Importance Sampling. The combined method, named as TrimFlow, is executed to estimate the collision rate of Car-following scenarios as a tentative practice. The results showed that sampling background vehicle maneuvers from rare event distribution could evolve testing scenarios to hazardous states. TrimFlow reduced 86.1% of tests compared to generating testing scenarios according to their exposure in the naturalistic driving environment. In addition, the TrimFlow method is not limited to one specific type of functional scenario.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
Keywords
Accelerated Validation, Importance Sampling, Normalizing Flow, Rare Events, Temporal Distribution
National Category
Transport Systems and Logistics
Identifiers
urn:nbn:se:kth:diva-359646 (URN)10.1109/IAVVC63304.2024.10786477 (DOI)001417799100022 ()2-s2.0-85216404683 (Scopus ID)
Conference
2024 IEEE International Automated Vehicle Validation Conference, IAVVC 2024, Pittsburgh, United States of America, Oct 21 2024 - Oct 23 2024
Note

Part of ISBN 979-8-3503-5407-2

QC 20250211

Available from: 2025-02-06 Created: 2025-02-06 Last updated: 2025-12-05Bibliographically approved
Hasegawa, T., Arvidsson, H., Tudzarovski, N., Meinke, K., Sugars, R. V. & Nair, A. (2023). Edge-Based Graph Neural Networks for Cell-Graph Modeling and Prediction. In: Information Processing in Medical Imaging - 28th International Conference, IPMI 2023, Proceedings: . Paper presented at 28th International Conference on Information Processing in Medical Imaging, IPMI 2023, San Carlos de Bariloche, Argentina, Jun 18 2023 - Jun 23 2023 (pp. 265-277). Springer Nature
Open this publication in new window or tab >>Edge-Based Graph Neural Networks for Cell-Graph Modeling and Prediction
Show others...
2023 (English)In: Information Processing in Medical Imaging - 28th International Conference, IPMI 2023, Proceedings, Springer Nature , 2023, p. 265-277Conference paper, Published paper (Refereed)
Abstract [en]

Identification and classification of cell-graph features using graph-neural networks (GNNs) has been shown to be useful in digital pathology. In this work, we consider the role of edge labels in cell-graph modeling, including histological modeling techniques, edge aggregation in GNN architectures, and edge label prediction. We propose EAGNN (Edge Aggregated GNN), a new GNN model that aggregates both node and edge label information to take advantage of topological information about cellular data and facilitate edge label prediction. We introduce new edge label features that improve histological modeling and prediction. We evaluate our EAGNN model for the task of detecting the presence and location of the basement membrane in oral mucosal tissue, as a proof-of-concept application.

Place, publisher, year, edition, pages
Springer Nature, 2023
Keywords
Basement Membrane, Cell-Graph, Digital Pathology, Graph Neural Network, Oral Mucosa
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-334530 (URN)10.1007/978-3-031-34048-2_21 (DOI)001116102900021 ()2-s2.0-85163966942 (Scopus ID)
Conference
28th International Conference on Information Processing in Medical Imaging, IPMI 2023, San Carlos de Bariloche, Argentina, Jun 18 2023 - Jun 23 2023
Note

Part of ISBN 978-3-031-34047-5

QC 20231123

Available from: 2023-08-23 Created: 2023-08-23 Last updated: 2024-01-16Bibliographically approved
Nair, A., Arvidsson, H., Gatica, J., Tudzarovski, N., Meinke, K. & Sugars, R. V. (2022). A graph neural network framework for mapping histological topology in oral mucosal tissue. BMC Bioinformatics, 23(1), Article ID 506.
Open this publication in new window or tab >>A graph neural network framework for mapping histological topology in oral mucosal tissue
Show others...
2022 (English)In: BMC Bioinformatics, E-ISSN 1471-2105, Vol. 23, no 1, article id 506Article in journal (Refereed) Published
Abstract [en]

Background Histological feature representation is advantageous for computer aided diagnosis (CAD) and disease classification when using predictive techniques based on machine learning. Explicit feature representations in computer tissue models can assist explainability of machine learning predictions. Different approaches to feature representation within digital tissue images have been proposed. Cell-graphs have been demonstrated to provide precise and general constructs that can model both low- and high-level features. The basement membrane is high-level tissue architecture, and interactions across the basement membrane are involved in multiple disease processes. Thus, the basement membrane is an important histological feature to study from a cell-graph and machine learning perspective. Results We present a two stage machine learning pipeline for generating a cell-graph from a digital H &E stained tissue image. Using a combination of convolutional neural networks for visual analysis and graph neural networks exploiting node and edge labels for topological analysis, the pipeline is shown to predict both low- and high-level histological features in oral mucosal tissue with good accuracy. Conclusions Convolutional and graph neural networks are complementary technologies for learning, representing and predicting local and global histological features employing node and edge labels. Their combination is potentially widely applicable in histopathology image analysis and can enhance explainability in CAD tools for disease prediction.

Place, publisher, year, edition, pages
Springer Nature, 2022
Keywords
Digital pathology, Graph neural network, Tissue topology, Cell-graph, Convolutional neural network, Machine learning, Oral mucosa
National Category
Bioinformatics and Computational Biology Computer graphics and computer vision
Identifiers
urn:nbn:se:kth:diva-322488 (URN)10.1186/s12859-022-05063-5 (DOI)000888744700001 ()36434526 (PubMedID)2-s2.0-85142530024 (Scopus ID)
Note

QC 20221216

Available from: 2022-12-16 Created: 2022-12-16 Last updated: 2025-02-05Bibliographically approved
Meinke, K. (2021). Active Machine Learning to Test Autonomous Driving. In: 2021 IEEE International Conference On Software Testing, Verification And Validation Workshops (Icstw 2021): . Paper presented at 14th IEEE Conference on Software Testing, Verification and Validation (ICST), APR 12-16, 2021, ELECTR NETWORK (pp. 286-286). Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>Active Machine Learning to Test Autonomous Driving
2021 (English)In: 2021 IEEE International Conference On Software Testing, Verification And Validation Workshops (Icstw 2021), Institute of Electrical and Electronics Engineers (IEEE) , 2021, p. 286-286Conference paper, Published paper (Refereed)
Abstract [en]

Autonomous driving represents a significant challenge to all software quality assurance techniques, including testing. Generative machine learning (ML) techniques including active ML have considerable potential to generate high quality synthetic test data that can complement and improve on existing techniques such as hardware-in-the-loop and road testing.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2021
Series
IEEE International Conference on Software Testing Verification and Validation Workshops, ISSN 2159-4848
Keywords
autonomous driving, machine learning, synthetic data, system testing
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-299977 (URN)10.1109/ICSTW52544.2021.00055 (DOI)000680833800042 ()2-s2.0-85108028705 (Scopus ID)
Conference
14th IEEE Conference on Software Testing, Verification and Validation (ICST), APR 12-16, 2021, ELECTR NETWORK
Note

Part of proceedings: ISBN 978-1-6654-4456-9, QC 20230117

Available from: 2021-08-20 Created: 2021-08-20 Last updated: 2023-01-17Bibliographically approved
Meinke, K. & Khosrowjerdi, H. (2021). Use Case Testing: A Constrained Active Machine Learning Approach. In: Lecture Notes in Computer Science: . Paper presented at 15th International Conference on Tests and Proofs, TAP 2021 held as part of Software Technologies: Applications and Foundations, STAF 2021, Virtual, Online, 21-22 June 2021 (pp. 3-21). Springer Nature
Open this publication in new window or tab >>Use Case Testing: A Constrained Active Machine Learning Approach
2021 (English)In: Lecture Notes in Computer Science, Springer Nature , 2021, p. 3-21Conference paper, Published paper (Refereed)
Abstract [en]

As a methodology for system design and testing, use cases are well-known and widely used. While current active machine learning (ML) algorithms can effectively automate unit testing, they do not scale up to use case testing of complex systems in an efficient way. We present a new parallel distributed processing (PDP) architecture for a constrained active machine learning (CAML) approach to use case testing. To exploit CAML we introduce a use case modeling language with: (i) compile-time constraints on query generation, and (ii) run-time constraints using dynamic constraint checking. We evaluate this approach by applying a prototype implementation of CAML to use case testing of simulated multi-vehicle autonomous driving scenarios.

Place, publisher, year, edition, pages
Springer Nature, 2021
Keywords
Autonomous driving, Constraint solving, Learning-based testing, Machine learning, Model checking, Requirements testing, Use case testing, Application programs, Modeling languages, Software testing, Well testing, Active machine learning, Dynamic constraints, Multi-vehicles, Parallel distributed processing, Prototype implementations, Query generation, Use case model
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-310723 (URN)10.1007/978-3-030-79379-1_1 (DOI)000884995900001 ()2-s2.0-85111470675 (Scopus ID)
Conference
15th International Conference on Tests and Proofs, TAP 2021 held as part of Software Technologies: Applications and Foundations, STAF 2021, Virtual, Online, 21-22 June 2021
Note

Part of proceedings ISBN: 978-3-030-79378-4

QC 20220413

Available from: 2022-04-13 Created: 2022-04-13 Last updated: 2022-12-02Bibliographically approved
Nair, A., Roy, A. & Meinke, K. (2020). FuncGNN: A graph neural network approach to program similarity. In: International Symposium on Empirical Software Engineering and Measurement: . Paper presented at 14th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2020, 5 October 2020 through 7 October 2020. IEEE Computer Society
Open this publication in new window or tab >>FuncGNN: A graph neural network approach to program similarity
2020 (English)In: International Symposium on Empirical Software Engineering and Measurement, IEEE Computer Society , 2020Conference paper, Published paper (Refereed)
Abstract [en]

Background: Program similarity is a fundamental concept, central to the solution of software engineering tasks such as software plagiarism, clone identification, code refactoring and code search. Accurate similarity estimation between programs requires an in-depth understanding of their structure, semantics and flow. A control flow graph (CFG), is a graphical representation of a program which captures its logical control flow and hence its semantics. A common approach is to estimate program similarity by analysing CFGs using graph similarity measures, e.g. graph edit distance (GED). However, graph edit distance is an NP-hard problem and computationally expensive, making the application of graph similarity techniques to complex software programs impractical. Aim: This study intends to examine the effectiveness of graph neural networks to estimate program similarity, by analysing the associated control flow graphs. Method: We introduce funcGNN1, which is a graph neural network trained on labeled CFG pairs to predict the GED between unseen program pairs by utilizing an effective embedding vector. To our knowledge, this is the first time graph neural networks have been applied on labeled CFGs for estimating the similarity between highlevel language programs. Results: We demonstrate the effectiveness of funcGNN to estimate the GED between programs and our experimental analysis demonstrates how it achieves a lower error rate (1.94 ×10-3), with faster (23 times faster than the quickest traditional GED approximation method) and better scalability compared with state of the art methods. Conclusion: funcGNN posses the inductive learning ability to infer program structure and generalise to unseen programs. The graph embedding of a program proposed by our methodology could be applied to several related software engineering problems (such as code plagiarism and clone identification) thus opening multiple research directions.

Place, publisher, year, edition, pages
IEEE Computer Society, 2020
Keywords
Attention Mechanism, Control Flow Graph, Graph Edit Distance, Graph Embedding, Graph Neural Network, Graph Similarity, Machine Learning, Program Similarity, Software Engineering, Application programs, Cloning, Data flow analysis, Embeddings, Flow graphs, Graphic methods, Intellectual property, NP-hard, Semantics, Approximation methods, Experimental analysis, Graph neural networks, Graph similarity measures, Graphical representations, In-depth understanding, Similarity estimation, State-of-the-art methods, Neural networks
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:kth:diva-290329 (URN)10.1145/3382494.3410675 (DOI)2-s2.0-85095830506 (Scopus ID)
Conference
14th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2020, 5 October 2020 through 7 October 2020
Note

QC 20210224

Available from: 2021-02-24 Created: 2021-02-24 Last updated: 2023-03-30Bibliographically approved
Khosrowjerdi, H., Nemati, H. & Meinke, K. (2020). Spatio-Temporal Model-Checking of Cyber-Physical Systems Using Graph Queries. In: Wolfgang Ahrendt and Heike Wehrheim (Ed.), Tests and Proofs: . Paper presented at Tests and Proofs - 14th International Conference, TAP@STAF 2020, Bergen, Norway, June 22-23, 2020 (pp. 59-79). New York: Springer Nature, 12165
Open this publication in new window or tab >>Spatio-Temporal Model-Checking of Cyber-Physical Systems Using Graph Queries
2020 (English)In: Tests and Proofs / [ed] Wolfgang Ahrendt and Heike Wehrheim, New York: Springer Nature, 2020, Vol. 12165, p. 59-79Conference paper, Published paper (Refereed)
Abstract [en]

We explore the application of graph database technology to spatio-temporal model checking of cooperating cyber-physical systems-of-systems such as vehicle platoons. We present a translation of spatio-temporal automata(STA) and the spatio-temporal logic STAL to se-mantically equivalent property graphs and graph queries respectively. We prove a sound reduction of the spatio-temporal verification problem tograph database query solving. The practicability and efficiency of thisapproach is evaluated by introducing NeoMC, a prototype implementation of our explicit model checking approach based on Neo4j. To evaluate NeoMC we consider case studies of verifying vehicle platooning models. Our evaluation demonstrates the effectiveness of our approach in terms of execution time and counterexample detection.

Place, publisher, year, edition, pages
New York: Springer Nature, 2020
Series
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349 ; 12165
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:kth:diva-282827 (URN)10.1007/978-3-030-50995-8_4 (DOI)000908023800004 ()2-s2.0-85087280755 (Scopus ID)
Conference
Tests and Proofs - 14th International Conference, TAP@STAF 2020, Bergen, Norway, June 22-23, 2020
Note

QC 20201007

Available from: 2020-09-30 Created: 2020-09-30 Last updated: 2023-09-21Bibliographically approved
Nair, A., Meinke, K. & Eldh, S. (2019). Leveraging mutants for automatic prediction of metamorphic relations using machine learning. In: MaLTeSQuE 2019 - Proceedings of the 3rd ACM SIGSOFT International Workshop on Machine Learning Techniques for Software Quality Evaluation, co-located with ESEC/FSE 2019: . Paper presented at 3rd ACM SIGSOFT International Workshop on Machine Learning Techniques for Software Quality Evaluation, MaLTeSQuE 2019, co-located with ESEC/FSE 2019, 27 August 2019 (pp. 1-6). Association for Computing Machinery, Inc
Open this publication in new window or tab >>Leveraging mutants for automatic prediction of metamorphic relations using machine learning
2019 (English)In: MaLTeSQuE 2019 - Proceedings of the 3rd ACM SIGSOFT International Workshop on Machine Learning Techniques for Software Quality Evaluation, co-located with ESEC/FSE 2019, Association for Computing Machinery, Inc , 2019, p. 1-6Conference paper, Published paper (Refereed)
Abstract [en]

An oracle is used in software testing to derive the verdict (pass/fail) for a test case. Lack of precise test oracles is one of the major problems in software testing which can hinder judgements about quality. Metamorphic testing is an emerging technique which solves both the oracle problem and the test case generation problem by testing special forms of software requirements known as metamorphic requirements. However, manually deriving the metamorphic requirements for a given program requires a high level of domain expertise, is labor intensive and error prone. As an alternative, we consider the problem of automatic detection of metamorphic requirements using machine learning (ML). For this problem we can apply graph kernels and support vector machines (SVM). A significant problem for any ML approach is to obtain a large labeled training set of data (in this case programs) that generalises well. The main contribution of this paper is a general method to generate large volumes of synthetic training data which can improve ML assisted detection of metamorphic requirements. For training data synthesis we adopt mutation testing techniques. This research is the first to explore the area of data augmentation techniques for ML-based analysis of software code. We also have the goal to enhance black-box testing using white-box methodologies. Our results show that the mutants incorporated into the source code corpus not only efficiently scale the dataset size, but they can also improve the accuracy of classification models.

Place, publisher, year, edition, pages
Association for Computing Machinery, Inc, 2019
Keywords
Data augmentation, Fault Identification, Machine Learning, Metamorphic Testing, Mutation Testing, Source Code Analysis, Test Case Generation, Classification (of information), Codes (symbols), Computer software selection and evaluation, Learning algorithms, Learning systems, Quality control, Support vector machines, Testing, Fault identifications, Black-box testing
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:kth:diva-268549 (URN)10.1145/3340482.3342741 (DOI)000532562700001 ()2-s2.0-85076425007 (Scopus ID)
Conference
3rd ACM SIGSOFT International Workshop on Machine Learning Techniques for Software Quality Evaluation, MaLTeSQuE 2019, co-located with ESEC/FSE 2019, 27 August 2019
Note

QC 20200324

Part of ISBN 9781450368551

Available from: 2020-03-24 Created: 2020-03-24 Last updated: 2024-10-18Bibliographically approved
Khosrowjerdi, H. & Meinke, K. (2018). Learning-Based testing for autonomous systems using spatial and temporal requirements. In: MASES 2018 - Proceedings of the 1st International Workshop on Machine Learning and Software Engineering in Symbiosis, co-located with ASE 2018: . Paper presented at 1st International Workshop on Machine Learning and Software Engineering in Symbiosis, MASES 2018, co-located with ASE 2018 Conference, 3 September 2018 (pp. 6-15). Association for Computing Machinery, Inc
Open this publication in new window or tab >>Learning-Based testing for autonomous systems using spatial and temporal requirements
2018 (English)In: MASES 2018 - Proceedings of the 1st International Workshop on Machine Learning and Software Engineering in Symbiosis, co-located with ASE 2018, Association for Computing Machinery, Inc , 2018, p. 6-15Conference paper, Published paper (Refereed)
Abstract [en]

Cooperating cyber-physical systems-of-systems (CO-CPS) such as vehicle platoons, robot teams or drone swarms usually have strict safety requirements on both spatial and temporal behavior. Learning-based testing is a combination of machine learning and model checking that has been successfully used for black-box requirements testing of cyber-physical systems-of-systems. We present an overview of research in progress to apply learning-based testing to evaluate spatio-temporal requirements on autonomous systems-of-systems through modeling and simulation.

Place, publisher, year, edition, pages
Association for Computing Machinery, Inc, 2018
Keywords
Automotive software, Black-box testing, Learningbased testing, Machine learning, Model-based testing, Requirements testing, Spatio-temporal logic, Artificial intelligence, Cyber Physical System, Embedded systems, Learning systems, Model checking, System of systems, Systems engineering, Autonomous systems, Cyber physical systems (CPSs), Model and simulation, Model based testing, Safety requirements, Spatio temporal, Temporal behavior
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:kth:diva-247188 (URN)10.1145/3243127.3243129 (DOI)001317490800006 ()2-s2.0-85055868610 (Scopus ID)9781450359726 (ISBN)
Conference
1st International Workshop on Machine Learning and Software Engineering in Symbiosis, MASES 2018, co-located with ASE 2018 Conference, 3 September 2018
Note

QC 20190506

Available from: 2019-05-06 Created: 2019-05-06 Last updated: 2025-12-08Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-9706-5008

Search in DiVA

Show all publications