期刊論文
| 學年 | 114 |
|---|---|
| 學期 | 1 |
| 出版（發表）日期 | 2025-10-28 |
| 作品名稱 | A Batch-Statistics-Free Adaptive Normalization Method for Robust Few-Shot Learning and Domain Adaptation |
| 作品名稱（其他語言） | |
| 著者 | Jih-Pin Yeh; Yihjia Tsai; Hwei Jen Lin; Yoshimasa Tokuyama; Wei-Lun Hsu |
| 單位 | |
| 出版者 | |
| 著錄名稱、卷期、頁數 | International Journal of Pattern Recognition and Artificial Intelligence 39(16) , p.2551033 |
| 摘要 | Batch Normalization (BN) has been widely adopted in deep neural networks for its ability to stabilize training and improve convergence. However, BN relies on batch-wise mean and variance estimates, which can become inaccurate during inference, particularly in Few-shot Learning (FSL) and domain adaptation scenarios where the test distribution differs from training or the available batch size is small. This dependency often causes performance degradation due to mismatched or outdated statistics. In this work, we introduce Meta Affine Transformation (MetaAFN), a batch-statistics-free normalization strategy that replaces the normalization step in BN with a meta-network-generated affine transformation. By entirely removing the reliance on batch statistics, MetaAFN avoids mismatched training-set statistics and instead uses a lightweight meta-network to dynamically produce scale ( γ ) and shift ( β ) parameters conditioned on the current input features. This design enables the model to adaptively modulate representations without explicit BN, improving robustness to distribution shifts. We evaluate MetaAFN on two representative tasks — FSL and source-free domain adaptation — using multiple benchmark datasets. Experimental results show that MetaAFN consistently outperforms or matches BN and MetaBN, with clear advantages under significant distributional shifts. These findings highlight MetaAFN as an effective and practical alternative to BN, offering improved adaptability and generalization in heterogeneous data scenarios. |
| 關鍵字 | Batch normalization;whitening-free normalization;meta affine transformationadaptive normalization;few-shot learning;source-free domain adaptation |
| 語言 | en_US |
| ISSN | |
| 期刊性質 | 國外 |
| 收錄於 | SCI |
| 產學合作 | |
| 通訊作者 | HJ |
| 審稿制度 | 是 |
| 國別 | SGP |
| 公開徵稿 | |
| 出版型式 | ,電子版 |
| 相關連結 |
機構典藏連結 ( http://tkuir.lib.tku.edu.tw:8080/dspace/handle/987654321/128256 ) |