123456789101112131415161718 |
- DATA:
- DATASET: imagenet22K
- MODEL:
- TYPE: swin
- NAME: swin_small_patch4_window7_224_22k
- DROP_PATH_RATE: 0.2
- SWIN:
- EMBED_DIM: 96
- DEPTHS: [ 2, 2, 18, 2 ]
- NUM_HEADS: [ 3, 6, 12, 24 ]
- WINDOW_SIZE: 7
- TRAIN:
- EPOCHS: 90
- WARMUP_EPOCHS: 5
- WEIGHT_DECAY: 0.05
- BASE_LR: 1.25e-4 # 4096 batch-size
- WARMUP_LR: 1.25e-7
- MIN_LR: 1.25e-6
|