The build list
- A worker image with the model weights, the inference server and its dependencies, rebuilt when any of them changes.
- A queue, retries and a webhook or polling layer so callers are not blocked while a worker starts.
- Cold-start tuning: every scale-up loads the model into GPU memory, and RunPod bills that load time.
- GPU availability planning: the class you tuned for is not always in stock in your region.
- Monitoring, logs and on-call for when a worker hangs or a model update breaks the image.