Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

5.3. Error Handling

Error responses from the OpenAI-compatible API follow the OpenAI error envelope:

{"error": {"message": "...", "type": "...", "code": "..."}}
HTTPcodeCause
400invalid_requestMissing or empty messages, n greater than 1, or an invalid body
503service_unavailableNo model loaded or model not ready
429rate_limit_exceededScheduler queue full; Retry-After header is set
500internal_errorUnexpected inference error

See also


<- 5.2 OpenAI-Compatible API  |  Table of Contents  |  5.4 OpenAPI Spec ->