Changelog from v8 Configuration
MAX_NUM_STEPS:
10000>> 30000CHECKPOINTING_STEPS:
100>> 200TRAIN_BATCH_SIZE: 2 (unchanged)
GRADIENT_ACCUMULATION_STEPS:
1>> 2RESOLUTION:
1024>> 512LEARNING_RATE: 1.0 (unchanged)
OPTIMIZER: Prodigy (unchanged)
VALIDATION_GUIDANCE: 3.5 (unchanged)
VALIDATION_GUIDANCE_REAL:
1.0>> 2.0INSTANCE_PROMPT: Not Set >> "AndroFlux, "
TRAINER_EXTRA_ARGS:
base_model_precision: fp8-quanto (unchanged)
lora_rank:
8>> 16max_grad_norm:
0.01>> 1.0gradient_precision: Not Set >> unmodified
base_model_default_dtype:
bf16>> fp32