kth.sePublications KTH
Operational message
There are currently operational disruptions. Troubleshooting is in progress.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
To Adapt or Not to Adapt?: Real-Time Adaptation for Semantic Segmentation
KTH.
Silo AI, Helsinki, Finland..
King, Stockholm, Sweden..
Univrses, Stockholm, Sweden..
Show others and affiliations
2023 (English)In: 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), Institute of Electrical and Electronics Engineers (IEEE) , 2023, p. 16502-16513Conference paper, Published paper (Refereed)
Abstract [en]

The goal of Online Domain Adaptation for semantic segmentation is to handle unforeseeable domain changes that occur during deployment, like sudden weather events. However, the high computational costs associated with bruteforce adaptation make this paradigm unfeasible for realworld applications. In this paper we propose HAMLET, a Hardware-Aware Modular Least Expensive Training framework for real-time domain adaptation. Our approach includes a hardware-aware back-propagation orchestration agent (HAMT) and a dedicated domain-shift detector that enables active control over when and how the model is adapted (LT). Thanks to these advancements, our approach is capable of performing semantic segmentation while simultaneously adapting at more than 29FPS on a single consumer-grade GPU. Our framework's encouraging accuracy and speed trade-off is demonstrated on OnDA and SHIFT benchmarks through experimental results.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2023. p. 16502-16513
Series
IEEE International Conference on Computer Vision, ISSN 1550-5499
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-346099DOI: 10.1109/ICCV51070.2023.01517ISI: 001169500501012Scopus ID: 2-s2.0-85188276872OAI: oai:DiVA.org:kth-346099DiVA, id: diva2:1855844
Conference
IEEE/CVF International Conference on Computer Vision (ICCV), OCT 02-06, 2023, Paris, France
Note

QC 20240503

Part of ISBN: 979-8-3503-0718-4

Available from: 2024-05-03 Created: 2024-05-03 Last updated: 2024-05-03Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Azizpour, HosseinKjellström, Hedvig

Search in DiVA

By author/editor
Colomer, Marc BotetAzizpour, HosseinKjellström, Hedvig
By organisation
KTHRobotics, Perception and Learning, RPL
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 110 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf