123456789101112131415161718 |
- DATA:
- DATASET: imagenet22K
- MODEL:
- TYPE: swin
- NAME: swin_large_patch4_window7_224_22k
- DROP_PATH_RATE: 0.2
- SWIN:
- EMBED_DIM: 192
- DEPTHS: [ 2, 2, 18, 2 ]
- NUM_HEADS: [ 6, 12, 24, 48 ]
- WINDOW_SIZE: 7
- TRAIN:
- EPOCHS: 90
- WARMUP_EPOCHS: 5
- WEIGHT_DECAY: 0.05
- BASE_LR: 1.25e-4 # 4096 batch-size
- WARMUP_LR: 1.25e-7
- MIN_LR: 1.25e-6
|