Streaming

Set stream to true for Server-Sent Events compatible output:

{
  "model": "YOUR_MODEL_ID",
  "stream": true,
  "messages": [
    {
      "role": "user",
      "content": "Hello"
    }
  ]
}

Streaming support can vary by endpoint, model and upstream provider route.