Skip to content

Model Providers and Runtimes

Document the AI model providers and runtimes supported by the current AiX release.

Type Provider / Runtime Deployment Status Notes
Local Ollama Customer environment Supported / TBD
Local vLLM Customer environment Supported / TBD
Local vLLM-Ascend Ascend environment Supported / TBD
External Approved API provider External Supported / TBD

Customer-specific endpoints, enabled models and credentials belong in the customer documentation. Never store API keys or tokens here.