kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Novel View Synthesis and Dataset Augmentation for Hyperspectral Data Using NeRF
Zhejiang Univ, Ctr Opt & Electromagnet Res, State Key Lab Modern Opt Instrumentat, Hangzhou 310058, Peoples R China..
Zhejiang Univ, Ctr Opt & Electromagnet Res, State Key Lab Modern Opt Instrumentat, Hangzhou 310058, Peoples R China..
Zhejiang Univ, Ctr Opt & Electromagnet Res, State Key Lab Modern Opt Instrumentat, Hangzhou 310058, Peoples R China..
KTH, School of Electrical Engineering and Computer Science (EECS), Electrical Engineering, Electromagnetic Engineering and Fusion Science. Zhejiang Univ, Ctr Opt & Electromagnet Res, State Key Lab Modern Opt Instrumentat, Hangzhou 310058, Peoples R China.ORCID iD: 0000-0002-3401-1125
2024 (English)In: IEEE Access, E-ISSN 2169-3536, Vol. 12, p. 45331-45341Article in journal (Refereed) Published
Abstract [en]

Hyperspectral data for the 3D domain is relatively difficult to acquire. Existing hyperspectral datasets are unsuitable for 3D research, suffer from issues of severe data scarcity, and a lack of multi-perspective images of the same object, etc. To address these challenges, data augmentation with limited data is essential. In this study, we applied neural rendering method (such as Neural Radiance Field) to hyperspectral images for dataset augmentation. We conducted experiments on novel view synthesis for hyperspectral images from 360-degree multi-perspectives, demonstrating that our method can generate high-quality hyperspectral images from various perspectives. Through experiments involving key points extraction and 3D reconstruction, we validated the efficacy of generating a substantial volume of high-quality hyperspectral images from a restricted set of varying perspectives. These results contribute to addressing the challenges associated with data augmentation. We also conducted experiments of neural radiance fields in the hyperspectral data domain under different network parameters and training conditions to find the appropriate settings.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2024. Vol. 12, p. 45331-45341
Keywords [en]
Hyperspectral imaging, Three-dimensional displays, Cameras, Rendering (computer graphics), Training, Data augmentation, Image reconstruction, Dataset augmentation, hyperspectral image, NeRF, novel view synthesis
National Category
Computer graphics and computer vision
Identifiers
URN: urn:nbn:se:kth:diva-345564DOI: 10.1109/ACCESS.2024.3381531ISI: 001193962600001Scopus ID: 2-s2.0-85189159795OAI: oai:DiVA.org:kth-345564DiVA, id: diva2:1851122
Note

QC 20240412

Available from: 2024-04-12 Created: 2024-04-12 Last updated: 2025-02-07Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

He, Sailing

Search in DiVA

By author/editor
He, Sailing
By organisation
Electromagnetic Engineering and Fusion Science
In the same journal
IEEE Access
Computer graphics and computer vision

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 62 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf