You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -2331,9 +2318,11 @@ Safety modes are not yet configurable in combination with `tools` and `documents
2331
2318
2332
2319
**maxTokens:**`Optional<Integer>`
2333
2320
2334
-
The maximum number of tokens the model will generate as part of the response.
2321
+
The maximum number of output tokens the model will generate in the response. If not set, `max_tokens` defaults to the model's maximum output token limit. You can find the maximum output token limits for each model in the [model documentation](https://docs.cohere.com/docs/models).
2322
+
2323
+
**Note**: Setting a low value may result in incomplete generations. In such cases, the `finish_reason` field in the response will be set to `"MAX_TOKENS"`.
2335
2324
2336
-
**Note**: Setting a low value may result in incomplete generations.
2325
+
**Note**: If `max_tokens` is set higher than the model's maximum output token limit, the generation will be capped at that model-specific maximum limit.
2337
2326
2338
2327
</dd>
2339
2328
</dl>
@@ -2435,8 +2424,14 @@ When `NONE` is specified, the model will be forced **not** to use one of the spe
2435
2424
If tool_choice isn't specified, then the model is free to choose whether to use the specified tools or not.
2436
2425
2437
2426
**Note**: This parameter is only compatible with models [Command-r7b](https://docs.cohere.com/v2/docs/command-r7b) and newer.
2427
+
2428
+
</dd>
2429
+
</dl>
2430
+
2431
+
<dl>
2432
+
<dd>
2438
2433
2439
-
**Note**: The same functionality can be achieved in `/v1/chat` using the `force_single_step` parameter. If `force_single_step=true`, this is equivalent to specifying `REQUIRED`. While if `force_single_step=true` and `tool_results` are passed, this is equivalent to specifying `NONE`.
2434
+
**thinking:**`Optional<Thinking>`
2440
2435
2441
2436
</dd>
2442
2437
</dl>
@@ -2582,19 +2577,6 @@ When set to `true`, tool calls in the Assistant message will be forced to follow
2582
2577
<dl>
2583
2578
<dd>
2584
2579
2585
-
**rawPrompting:**`Optional<Boolean>`
2586
-
2587
-
When enabled, the user's prompt will be sent to the model without
@@ -2622,9 +2604,11 @@ Safety modes are not yet configurable in combination with `tools` and `documents
2622
2604
2623
2605
**maxTokens:**`Optional<Integer>`
2624
2606
2625
-
The maximum number of tokens the model will generate as part of the response.
2607
+
The maximum number of output tokens the model will generate in the response. If not set, `max_tokens` defaults to the model's maximum output token limit. You can find the maximum output token limits for each model in the [model documentation](https://docs.cohere.com/docs/models).
2608
+
2609
+
**Note**: Setting a low value may result in incomplete generations. In such cases, the `finish_reason` field in the response will be set to `"MAX_TOKENS"`.
2626
2610
2627
-
**Note**: Setting a low value may result in incomplete generations.
2611
+
**Note**: If `max_tokens` is set higher than the model's maximum output token limit, the generation will be capped at that model-specific maximum limit.
2628
2612
2629
2613
</dd>
2630
2614
</dl>
@@ -2726,8 +2710,14 @@ When `NONE` is specified, the model will be forced **not** to use one of the spe
2726
2710
If tool_choice isn't specified, then the model is free to choose whether to use the specified tools or not.
2727
2711
2728
2712
**Note**: This parameter is only compatible with models [Command-r7b](https://docs.cohere.com/v2/docs/command-r7b) and newer.
2713
+
2714
+
</dd>
2715
+
</dl>
2729
2716
2730
-
**Note**: The same functionality can be achieved in `/v1/chat` using the `force_single_step` parameter. If `force_single_step=true`, this is equivalent to specifying `REQUIRED`. While if `force_single_step=true` and `tool_results` are passed, this is equivalent to specifying `NONE`.
2717
+
<dl>
2718
+
<dd>
2719
+
2720
+
**thinking:**`Optional<Thinking>`
2731
2721
2732
2722
</dd>
2733
2723
</dl>
@@ -2875,6 +2865,7 @@ Specifies the types of embeddings you want to get back. Can be one or more of th
2875
2865
*`"uint8"`: Use this when you want to get back unsigned int8 embeddings. Supported with Embed v3.0 and newer Embed models.
2876
2866
*`"binary"`: Use this when you want to get back signed binary embeddings. Supported with Embed v3.0 and newer Embed models.
2877
2867
*`"ubinary"`: Use this when you want to get back unsigned binary embeddings. Supported with Embed v3.0 and newer Embed models.
2868
+
*`"base64"`: Use this when you want to get back base64 embeddings. Supported with Embed v3.0 and newer Embed models.
2878
2869
2879
2870
</dd>
2880
2871
</dl>
@@ -4365,17 +4356,17 @@ Creates a new fine-tuned model. The model will be trained on the dataset specifi
0 commit comments