Effort ea reasoning
E ntjhaModel e nahanang e khutlisa mongolo oa reasoning oa eona haufi le karabo, field ea eona. Ho li-model tse hosted tsa open-weight field e le 'ngoe ea kopo e beha hore na model e nahana ka botebo bofe pele e araba.
POST https://api.shannon-ai.com/v1/chat/completions
from openai import OpenAI
client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.shannon-ai.com/v1")
response = client.chat.completions.create(
model="Kimi-K3-3BIT-REAP",
reasoning_effort="low",
messages=[{"role": "user", "content": "Is 221 a prime number?"}],
)
message = response.choices[0].message
print("Reasoning:", getattr(message, "reasoning_content", None))
print("Answer:", message.content)
print("Reasoning tokens:", response.usage.completion_tokens_details.reasoning_tokens) import OpenAI from "openai";
const client = new OpenAI({ apiKey: "YOUR_API_KEY", baseURL: "https://api.shannon-ai.com/v1" });
const response = await client.chat.completions.create({
model: "Kimi-K3-3BIT-REAP",
reasoning_effort: "low",
messages: [{ role: "user", content: "Is 221 a prime number?" }],
});
const message = response.choices[0].message;
console.log("Reasoning:", message.reasoning_content);
console.log("Answer:", message.content);
console.log("Reasoning tokens:", response.usage.completion_tokens_details.reasoning_tokens); curl https://api.shannon-ai.com/v1/chat/completions \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "Kimi-K3-3BIT-REAP",
"reasoning_effort": "low",
"messages": [
{"role": "user", "content": "Is 221 a prime number?"}
]
}' Karabo e nka mongolo oa reasoning ho reasoning_content, karabo ho content, le tokens tsa reasoning ho usage:
{
"id": "chatcmpl-2a6c8e0b4d1f4a3c9e7b5d3f1a8c6e4b",
"object": "chat.completion",
"created": 1791590400,
"model": "Kimi-K3-3BIT-REAP",
"choices": [
{
"index": 0,
"message": {
"role": "assistant",
"content": "No. 221 = 13 x 17, so it is not prime.",
"reasoning_content": "Try small primes. 221 / 13 = 17, so 221 = 13 x 17."
},
"finish_reason": "stop"
}
],
"usage": {
"prompt_tokens": 14,
"completion_tokens": 43,
"total_tokens": 57,
"prompt_tokens_details": {"cached_tokens": 0},
"completion_tokens_details": {"reasoning_tokens": 27}
}
} Li-model life tse nahanang
| Model | E khutlisa mongolo oa reasoning | E sebelisa field ea effort |
|---|---|---|
shannon-1.6-lite | — | — |
shannon-1.6-pro, shannon-2-lite, shannon-2-pro, shannon-3, shannon-3-pro, shannon-3.1, shannon-3.1-pro, shannon-coder-1 | Ee | — |
| Model e 'ngoe le e 'ngoe e hosted ea open-weight | Ee | Ee |
Tsena ke li-flag capabilities.reasoning le capabilities.reasoning_effort tseo GET /v1/models e li tlalehang bakeng sa id e 'ngoe le e 'ngoe. Karabo e nka mongolo oa reasoning feela ha model e hlahisitse oo. Li-model le litheko
Ho beha effort
Endpoint e 'ngoe le e 'ngoe e na le mokhoa oa eona oa ho ngola effort. Kaofela li khetha e 'ngoe ea maemo a mane a tšoanang.
| Field | Mofuta | Default | Tlhaloso | E sebelisoa ke |
|---|---|---|---|---|
reasoning_effort | string | high | /v1/chat/completions. Hore na model e nahana ka botebo bofe pele e araba: off, low, medium kapa high. | Li-model tse hosted tsa open-weight |
reasoning | object | string | /v1/chat/completions. Boleng bo tšoanang e le {"effort": "low"} kapa e le string e hlakileng. Ha li-field ka bobeli li romeloa, reasoning_effort e a sebetsa. | Li-model tse hosted tsa open-weight | |
reasoning.effort | string | high | /v1/responses. E ngotsoe e le ntho {"effort": "low"}. | Li-model tse hosted tsa open-weight |
thinking | object | /v1/messages. {"type": "enabled", "budget_tokens": n} kapa {"type": "disabled"}. Budget e khetha e 'ngoe ea maemo; bona tafole e ka tlase. | Li-model tse hosted tsa open-weight |
{
"model": "Kimi-K3-3BIT-REAP",
"reasoning_effort": "low",
"messages": [{"role": "user", "content": "Is 221 a prime number?"}]
} {
"model": "Kimi-K3-3BIT-REAP",
"reasoning": {"effort": "low"},
"input": "Is 221 a prime number?"
} {
"model": "Kimi-K3-3BIT-REAP",
"max_tokens": 1024,
"thinking": {"type": "enabled", "budget_tokens": 2048},
"messages": [{"role": "user", "content": "Is 221 a prime number?"}]
} | Boleng | Le tse ling tse amohelwang | Phello |
|---|---|---|
off | none, minimal | Ha ho reasoning. Karabo ha e nke mongolo oa reasoning. |
low | Reasoning e khutšoanyane. | |
medium | default | Botebo bo bohareng. |
high | max | Boemo bo tebileng ka ho fetisisa. Ena ke boemo ba kopo e sa romeleng boleng. |
- Litekanyo li baloa ho sa tsotellehe litlhaku tse kholo kapa tse nyane.
- Boleng
defaultbo bolelamedium. Ho siea field ka ntle ho bolelahigh. - Li-model tsa Shannon (
shannon-*) li iketsetsa botebo ba tsona kopong e 'ngoe le e 'ngoe;GET /v1/modelse tlalehareasoning_effort: falsebakeng sa tsona.
Thinking budget ho /v1/messages
Ho /v1/messages field ea thinking e khetha boemo. budget_tokens e khetha e 'ngoe ea maemo a ka holimo; hase moeli oa tokens oa eona. adaptive e baloa joalo ka enabled.
| U romela | Boemo |
|---|---|
{"type": "disabled"} | off |
{"type": "enabled", "budget_tokens": n} le n ho fihlela ho 2,048 | low |
n ho tloha ho 2,049 ho isa ho 8,192 | medium |
n e kholoanyane, kapa enabled ntle le budget_tokens | high |
Ha ho field ea thinking | high |
Moo mongolo oa reasoning o fihlang teng
Mongolo oa reasoning kamehla o arohane le karabo. Sebopeho se seng le se seng se na le sebaka sa sona sa oona:
| Endpoint | Ntle le streaming | Ka streaming |
|---|---|---|
/v1/chat/completions | choices[0].message.reasoning_content: string, kapa null ha model e sa hlahise letho. | Li-chunk tse nang le choices[0].delta.reasoning_content, pele ho li-chunk tse nang le delta.content. |
/v1/responses | Ntho ea output {"type": "reasoning", "summary": [{"type": "summary_text", "text": "…"}]} pele ho ntho ea message. Ha ho ntho ha ho se na reasoning. | response.output_item.added e nang le ntho ea reasoning, ebe li-event tsa response.reasoning_summary_text.delta le response.reasoning_summary_text.done e le 'ngoe. |
/v1/messages | Content block ea pele {"type": "thinking", "thinking": "…"}, ebe block ea text. Ha ho block ea thinking ha ho se na reasoning. | Content block ea thinking: li-event tsa content_block_start, content_block_delta le thinking_delta, content_block_stop. Block ea mongolo e latela. |
{
"choices": [
{
"index": 0,
"message": {
"role": "assistant",
"content": "No. 221 = 13 x 17, so it is not prime.",
"reasoning_content": "Try small primes. 221 / 13 = 17, so 221 = 13 x 17."
},
"finish_reason": "stop"
}
],
"usage": {
"prompt_tokens": 14,
"completion_tokens": 43,
"total_tokens": 57,
"prompt_tokens_details": {"cached_tokens": 0},
"completion_tokens_details": {"reasoning_tokens": 27}
}
} {
"output": [
{
"id": "rs_6f0a2c4e8b1d4f3a9c7e5b3d1f8a6c4e",
"type": "reasoning",
"summary": [
{
"type": "summary_text",
"text": "Try small primes. 221 / 13 = 17, so 221 = 13 x 17."
}
]
},
{
"id": "msg_1b3d5f7a9c2e4b6d8f0a2c4e6b8d0f1a",
"type": "message",
"role": "assistant",
"status": "completed",
"content": [
{
"type": "output_text",
"text": "No. 221 = 13 x 17, so it is not prime.",
"annotations": []
}
]
}
],
"usage": {
"input_tokens": 14,
"input_tokens_details": {"cached_tokens": 0},
"output_tokens": 43,
"output_tokens_details": {"reasoning_tokens": 27},
"total_tokens": 57
}
} {
"content": [
{
"type": "thinking",
"thinking": "Try small primes. 221 / 13 = 17, so 221 = 13 x 17."
},
{"type": "text", "text": "No. 221 = 13 x 17, so it is not prime."}
],
"stop_reason": "end_turn",
"usage": {
"input_tokens": 14,
"cache_read_input_tokens": 0,
"cache_creation_input_tokens": 0,
"output_tokens": 43
}
} Moo u lokelang ho sheba teng, ka model:
| Li-model | Moo mongolo o fihlang teng |
|---|---|
| Li-model tse hosted tsa open-weight | Ho endpoint e 'ngoe le e 'ngoe, ka streaming kapa ntle le eona. Kopo e nang le effort off, kapa e nang le response_format / text.format, e arajoa ntle le mongolo oa reasoning. |
shannon-3, shannon-3-pro, shannon-3.1, shannon-3.1-pro | Ho endpoint e 'ngoe le e 'ngoe, ka streaming kapa ntle le eona, neng kapa neng ha model e hlahisitse mongolo oa reasoning. |
shannon-2-lite, shannon-2-pro | /v1/chat/completions, ntle le streaming: ho message.reasoning_content. Ka streaming, kopong e se nang tools kapa response_format: stream e nka mela ea maikutlo : thinking ha model e ntse e nahana, ebe li-chunk tsa karabo. /v1/messages, ka streaming: block ea thinking pele ho block ea mongolo. |
shannon-1.6-pro, shannon-coder-1 | Likarabong tsa streaming le likarabong tsa likopo tse nang le tools, neng kapa neng ha model e hlahisitse mongolo oa reasoning. |
Ho /v1/responses, karabo e se nang streaming e nka ntho ea reasoning bakeng sa lelapa la Shannon 3 le li-model tse hosted tsa open-weight.
Ho bala stream
Ho stream mongolo oa reasoning o tla pele, ho li-delta tsa oona, ebe karabo e latela. Gatisa kapa u boloke tse peli ka thoko:
from openai import OpenAI
client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.shannon-ai.com/v1")
stream = client.chat.completions.create(
model="Kimi-K3-3BIT-REAP",
reasoning_effort="medium",
stream=True,
messages=[{"role": "user", "content": "Is 221 a prime number?"}],
)
for chunk in stream:
if not chunk.choices:
continue
delta = chunk.choices[0].delta
reasoning = getattr(delta, "reasoning_content", None)
if reasoning:
print(reasoning, end="", flush=True) # the reasoning text comes first
if delta.content:
print(delta.content, end="", flush=True) # then the answer import OpenAI from "openai";
const client = new OpenAI({ apiKey: "YOUR_API_KEY", baseURL: "https://api.shannon-ai.com/v1" });
const stream = await client.chat.completions.create({
model: "Kimi-K3-3BIT-REAP",
reasoning_effort: "medium",
stream: true,
messages: [{ role: "user", content: "Is 221 a prime number?" }],
});
for await (const chunk of stream) {
const delta = chunk.choices[0]?.delta ?? {};
if (delta.reasoning_content) process.stdout.write(delta.reasoning_content); // the reasoning text comes first
if (delta.content) process.stdout.write(delta.content); // then the answer
} curl -N https://api.shannon-ai.com/v1/chat/completions \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "Kimi-K3-3BIT-REAP",
"reasoning_effort": "medium",
"stream": true,
"messages": [
{"role": "user", "content": "Is 221 a prime number?"}
]
}' Chunk ea pele ea model e hosted ea open-weight, reasoning kapa karabo, e boetse e nka delta.role: "assistant". Phallela
Tokens tsa reasoning le billing
Ho li-model tse hosted tsa open-weight, tokens tsa reasoning ke output tokens: li lefisoa ka theko ea output ea model, mme palo ea output e se e li kenyelletsa. usage e bontša karolo ea reasoning mona:
| Endpoint | Field | Tlhokomeliso |
|---|---|---|
/v1/chat/completions | usage.completion_tokens_details.reasoning_tokens | E se e kenyellelitsoe ho completion_tokens. |
/v1/responses | usage.output_tokens_details.reasoning_tokens | E se e kenyellelitsoe ho output_tokens. |
/v1/messages | usage.output_tokens | Reasoning le karabo hammoho. Sebopeho sena ha se na palo e arohaneng. |
- Ho li-model tse hosted tsa open-weight
max_tokense lekanyetsa mongolo oa karabo. Tokens tsa reasoning ha li baloe ho eona. - Kaha reasoning e lefisoa e le output, boemo ba effort le bona ke setting ea theko:
offha e hlahise tokens tsa reasoning. - Li-model tsa Shannon li tlaleha
prompt_tokens,completion_tokensletotal_tokens(input_tokensleoutput_tokensho/v1/messages) ntle le karolo ea reasoning, mme li lefisa theko e le 'ngoe e sa fetoheng ka token. Li-model le litheko
Reasoning kopong e latelang
Ha u hloke ho romela reasoning hape. Block ea thinking kapa ntho ea reasoning moqoqong oo u o romelang ha e fetisetsoe ho model, kahoo turn ea assistant e ka khutla le eona kapa ntle le eona. Block ea thinking e na le li-field tse peli type le thinking; ha e na signature.
Liphoso
| Boemo | Mofuta | Molaetsa | Neng |
|---|---|---|---|
400 | invalid_request_error | unknown reasoning effort '<value>'; expected off, low, medium or high | Model e hosted ea open-weight e amohetse boleng bo kantle ho lenane, mohlala xhigh. Ha ho letho le nkoang ho balance ea hau. |
422 | invalid_request_error | Failed to deserialize the JSON body into the target type: … | reasoning_effort hase string. |
Liphoso tsa netefatso, balance le server li tšoana le tsa kopo e 'ngoe le e 'ngoe. Diphoso