transfer-freezing

KO | EN

gitlite — search

#awesome-list #devops #vue #generative-ai #markdown #react #kotlin #computer-vision #cli #codex

transfer-freezing

(★ 9)

[ICISS 2026] A Systematic Study of Layer Freezing Strategies for Transfer Learning in Music Genre Classification

파일 탐색기

ZIP 다운로드

- plot.py
- - results_summary.csv
- models.py
- preprocess_data.py
- paired_t_test.py
.gitignore
config.yaml
dataset.py
LICENSE
README.md
requirements.txt
results_log.txt
results_summary.csv
results_summary_aug.csv
results_summary_aug_freeze.csv
run_experiments.sh
testvit.sh
train.py

# CDN으로 사용하기

jsDelivr

jsDelivr는 공개 GitHub 리포지토리를 별도 설정 없이 CDN으로 즉시 서빙합니다. 버전과 파일을 고르면 웹페이지에 바로 붙일 수 있는 링크와 예시 코드가 만들어집니다.

버전

파일

링크

예시

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

**Systematic comparison: Exploring ViT-B/16 transfer alternative freezing strategies for music spectrograms.**

## ABSTRACT
This repository contains the codebase and experimental results for a study investigating the transferability of ImageNet-pretrained Vision Transformers (`ViT-B/16`) to the domain of audio classification (GTZAN dataset).

Contrary to standard practices in Convolutional Neural Networks (CNNs) where freezing early layers is monotonic in effect, our large-scale evaluation (**N=10 random seeds**) reveals a non-monotonic **"dip-and-recover"** phenomenon in Transformers. While partial freezing generally degrades performance, we observe a statistically significant recovery in accuracy when freezing the first 50% of the network, suggesting distinct feature adaptation dynamics in attention-based architectures compared to CNNs.

## KEY FINDINGS

We evaluated five distinct freezing configurations. The aggregated results (Mean ± Std Dev) indicate:

![ViT Freezing Analysis Plot](https://raw.githubusercontent.com/ssrhaso/transfer-freezing/main/outputs/results/plots/vit_freezing_analysis_n10.png)

## REPOSITORY STRUCTURE
```bash
transfer-freezing/
├── analysis/           # Scripts for statistical aggregation and plotting (N=10)
├── outputs/            # Logs, checkpoints, and generated figures
├── scripts/            # Core model definitions and data processing modules
│   ├── models.py       # Custom ViT and ResNet wrappers with partial freezing logic
│   └── dataset.py      # GTZAN loading and stratified splitting
├── config.yaml         # Centralized hyperparameter configuration
├── train.py            # Main training loop with seed control
├── run_experiments.sh  # Shell script for batch execution across seeds
├── requirements.txt    # Python dependencies
└── README.md           # Project documentation
```

## METHODOLOGY

### 1. Data Preprocessing
Audio samples are transformed into visual representations to leverage computer vision architectures:
*   **Transformation:** Log-Mel Spectrograms (128 Mel bands, 224x224 resolution).
*   **Normalization:** Per-sample **Min-Max Normalization** to the $$ range.[1]
*   **Augmentation:** No augmentation applied during validation/testing to ensure consistent evaluation.

### 2. Model Architecture
*   **Backbone:** `ViT-B/16` (Pretrained on ImageNet-1k).
*   **Modifications:** The classification head is replaced to match the GTZAN classes (10 genres).
*   **Input Adaptation:** 1-channel spectrograms are replicated to 3 channels to satisfy pre-trained weight dimensions.

### 3. Experimental Setup
*   **Optimizer:** SGD (Learning Rate: $1e^{-4}$, Momentum: $0.9$).
*   **Regularization:** Weight Decay: $0.0$, Dropout: Default pretrained configuration.
*   **Robustness:** All experiments are repeated across **10 random seeds** to verify statistical significance.
*   **NOTE::** None of the experiments included data augmentation so far.

## RUNNING:

### PREREQUISTIES
Ensure you have Python 3.8+ and PyTorch installed.

```bash
pip install -r requirements.txt
```

### REPRODUCTION
To reproduce the full N=10 study, use the provided shell script:

```bash
# Make script executable
chmod +x run_experiments.sh

# Run batch experiments
./run_experiments.sh
```

To run a single specific configuration (e.g., Seed 42, Freeze 50%):
```bash
python train.py --model vit_b_16 --freeze_mode freeze_patch_0_5 --seed 42 --config config.yaml
```

## VISUALIZATION
To generate the summary plots after training is complete:

```bash
python analysis/plot.py
```
This will output the `vit_freezing_analysis_n10.png` figure visualizing the mean accuracy and standard deviation bands.

*Research focus: Deep Learning, Audio Signal Processing, and Transfer Learning Dynamics.*

transfer-freezing

오너의 다른 레포

파일 탐색기

# CDN으로 사용하기

Was this content helpful?

Recent Feedback

transfer-freezing

오너의 다른 레포

파일 탐색기

# CDN으로 사용하기

Was this content helpful?

Recent Feedback

Download README