01
- Cold-start tuning
- Images slimmed, model weights put on volumes rather than baked in, keep-warm pools sized to your traffic shape and the latency contract you need to hold.
02
- GPU capacity planning
- Right-sized GPU choices, region selection and quota requests set before the workload hits them, with fallbacks for when a specific GPU is temporarily tight.
03
- Jobs and schedules
- Batch pipelines with checkpointing, retries and dead-letter handling, so a long fine-tune does not start over every time the timeout trips.
04
- App and environment hygiene
- Staging and production parity, volumes and secrets mirrored, and App.lookup patterns that are safe against in-flight deploys.
05
- Observability
- Logs, metrics and traces wired to the APM you already use, with per-function cost attribution so the Modal bill matches what each product surface is actually doing.
06
- Managed Tech
- Ongoing watch on the Modal footprint, image rebuilds against new base images, GPU price and capacity tracking, and a team to call when a deploy goes sideways.