Performance Monitoring

Monitor both infrastructure and application/model behavior. Relevant measures may include CPU, memory, disk, accelerator utilization, service response time, worker queue/load, model response latency and database/storage performance.

AiX may rely on customer/infrastructure monitoring tooling for metrics not exposed by the application. Document that boundary explicitly.