Training Configurations
Finetuned from: Animagine XL 3.1
Pretraining:
Dataset size: ~23,500 images
GPU: 1xA100 80GB
Optimizer: AdaFactor
Unet Learning Rate: 3.75e-6
Text Encoder Learning Rate: 1.875e-6
Batch Size: 48
Gradient Accumulation: 1
Warmup steps: 100 steps
Min SNR: 5
Epoch: 10 (epoch 9 is used)
Finetuning:
Dataset size: ~6,800 images
GPU: 1xA100 80GB
Optimizer: AdaFactor
Unet Learning Rate: 2e-6
Text Encoder Learning Rate: - (Train TE set to False)
Batch Size: 48
Gradient Accumulation: 1
Warmup steps: 5%
Min SNR: 5
Epoch: 10
Noise Offset: 0.0357
Wuthering Waves, Zenless Zone Zero and hololiveEN -Justice- have been added to the model.