Endpoint
Request
Send the standard OpenAI Chat Completions body. Common fields:Response
The response follows the OpenAI shape:Streaming
Set"stream": true to receive incremental chat.completion.chunk events as
server-sent events, terminated by a [DONE] sentinel, identical to the OpenAI
streaming format. The OpenAI SDKs expose this through their streaming helpers.
Supported sampling parameters and context length depend on the deployed model and
its serving engine. If a deployment is stopped, requests fail until it is resumed.