Skip to content

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

update the openai docs to explain how to set the context size (#6548)

Patrick Devine8e4e509fa4e8
diff --git a/docs/openai.md b/docs/openai.md
index 75d2c5955..0cbea6cc9 100644
--- a/docs/openai.md
+++ b/docs/openai.md
@@ -300,3 +300,28 @@ curl http://localhost:11434/v1/chat/completions \
]
}'
```
+
+### Setting the context size
+
+The OpenAI API does not have a way of setting the context size for a model. If you need to change the context size, create a `Modelfile` which looks like:
+
+```modelfile
+FROM <some model>
+PARAMETER num_ctx <context size>
+```
+
+Use the `ollama create mymodel` command to create a new model with the updated context size. Call the API with the updated model name:
+
+```shell
+curl http://localhost:11434/v1/chat/completions \
+ -H "Content-Type: application/json" \
+ -d '{
+ "model": "mymodel",
+ "messages": [
+ {
+ "role": "user",
+ "content": "Hello!"
+ }
+ ]
+ }'
+```