Local Model Management

Purpose

Local models allow AiX deployments to execute approved AI workloads within customer-controlled infrastructure.

Record for Each Supported Model

• Model name and version
• Runtime
• Quantization, where applicable
• Context size
• Capabilities
• Minimum/recommended CPU, memory and accelerator requirements
• Installation or pull procedure
• AiX registration/configuration
• Health check
• Upgrade and rollback procedure
• Removal procedure

Lifecycle

flowchart TD
    Install[Install Runtime] --> Obtain[Obtain Approved Model]
    Obtain --> Register[Register with AiX]
    Register --> Validate[Validate]
    Validate --> Enable[Enable for Use]
    Enable --> Monitor[Monitor]
    Monitor --> Replace[Upgrade / Replace]
    Replace --> Retire[Retire Old Model]