Hyperspectral image classification (HSIC) is a challenging task due to the high dimensionality of hyperspectral data, the complex interplay of spatial and spectral features, and the scarcity of annotated samples. Existing approaches, mainly based on tokenization-based feature extraction, introduce artificial segmentation, increasing computational cost, and may lead to information loss. To address these issues, a novel framework, byte latent Mamba with knowledge distillation (BLM-KD), which overcomes explicit tokenization by directly learning byte-level spectral–spatial representations from raw hyperspectral data, is proposed. The byte latent Mamba architecture learns compact and expressive byte-level features through an end-to-end convolutional encoder, preserving spectral continuity and spatial structure. A structured state-space model (SSM) is integrated to model long-range spatial–spectral dependencies efficiently via learned dynamic state transitions. Additionally, an adaptive knowledge distillation (KD) strategy is adopted, where a high-capacity teacher model selectively transfers salient features to a lightweight student model, driven by a temperature-controlled weighting schedule. This ensures robust generalization with reduced model complexity. A patch-based preprocessing scheme also excludes irrelevant zero-labeled samples, refining the training process. Extensive experiments conducted on multiple real-world hyperspectral benchmarks demonstrate that BLM-KD outperforms existing state-of-the-art methods in both classification accuracy and computational efficiency.

Byte Latent Mamba With State Space and Knowledge Distillation for Hyperspectral Image Classification

Ahmad, Muhammad
;
Mazzara, Manuel
;
Distefano, Salvatore
;
2025-01-01

Abstract

Hyperspectral image classification (HSIC) is a challenging task due to the high dimensionality of hyperspectral data, the complex interplay of spatial and spectral features, and the scarcity of annotated samples. Existing approaches, mainly based on tokenization-based feature extraction, introduce artificial segmentation, increasing computational cost, and may lead to information loss. To address these issues, a novel framework, byte latent Mamba with knowledge distillation (BLM-KD), which overcomes explicit tokenization by directly learning byte-level spectral–spatial representations from raw hyperspectral data, is proposed. The byte latent Mamba architecture learns compact and expressive byte-level features through an end-to-end convolutional encoder, preserving spectral continuity and spatial structure. A structured state-space model (SSM) is integrated to model long-range spatial–spectral dependencies efficiently via learned dynamic state transitions. Additionally, an adaptive knowledge distillation (KD) strategy is adopted, where a high-capacity teacher model selectively transfers salient features to a lightweight student model, driven by a temperature-controlled weighting schedule. This ensures robust generalization with reduced model complexity. A patch-based preprocessing scheme also excludes irrelevant zero-labeled samples, refining the training process. Extensive experiments conducted on multiple real-world hyperspectral benchmarks demonstrate that BLM-KD outperforms existing state-of-the-art methods in both classification accuracy and computational efficiency.
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11570/3365421
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 6
  • ???jsp.display-item.citation.isi??? 6
social impact