Vexed by VEX Tools: Consistency Evaluation of Container Vulnerability Scanners
2026 (English)In: Foundations and Practice of Security - 18th International Symposium, FPS 2025, Revised Selected Papers, Springer Nature , 2026, Vol. 16402 LNCS, p. 139-156Conference paper, Published paper (Refereed)
Abstract [en]
The Vulnerability Exploitability eXchange (VEX) format has been introduced to complement Software Bill of Materials (SBOM) with security advisories of known vulnerabilities. VEX gives an accurate understanding of vulnerabilities found in the dependencies of third-party software, which is critical for secure software development and risk analysis. In this paper, we present a study that analyzes state-of-the-art VEX-generation tools (Trivy, Grype, DepScan, Scout, Snyk, OSV, Vexy) applied to containers. Our study examines how consistently different VEX-generation tools perform. By evaluating their performance across multiple datasets, we aim to gain insight into the overall maturity of the VEX-generation tool ecosystem, beyond any single implementation. We use the Jaccard and Tversky indices to produce similarity scores of tool results for three different datasets created from container images. Overall, our results show a low level of consistency among the tools, thus indicating a low level of maturity in the VEX tool space. We perform a number of experiments to explore the impact of different factors on the consistency of the results, with the difference in vulnerability databases queried showing the largest impact.
Place, publisher, year, edition, pages
Springer Nature , 2026. Vol. 16402 LNCS, p. 139-156
Keywords [en]
Cybersecurity, Docker Containers, Software Bill of Materials, Software Supply Chain, Software Vulnerability Management, Vulnerability Exploitability eXchange
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-383423DOI: 10.1007/978-3-032-20018-1_8Scopus ID: 2-s2.0-105040619279OAI: oai:DiVA.org:kth-383423DiVA, id: diva2:2070813
Conference
18th International Symposium on Foundations and Practice of Security, FPS 2025, Brest, France, Nov 25 2025 - Nov 27 2025
Note
Part of ISBN 9783032200174
QC 20260612
2026-06-122026-06-122026-06-12Bibliographically approved