Simira kuzvirimo
Reasoning effort

Reasoning effort

Nyowani

Model inofunga inodzosa reasoning text padivi pemhinduro, mu-field yayo pachayo. Pa-hosted open-weight models request field imwe inosarudza kudzika kwekufunga kwe-model isati yapindura.

POST https://api.shannon-ai.com/v1/chat/completions

from openai import OpenAI

client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.shannon-ai.com/v1")

response = client.chat.completions.create(
    model="Kimi-K3-3BIT-REAP",
    reasoning_effort="low",
    messages=[{"role": "user", "content": "Is 221 a prime number?"}],
)

message = response.choices[0].message
print("Reasoning:", getattr(message, "reasoning_content", None))
print("Answer:", message.content)
print("Reasoning tokens:", response.usage.completion_tokens_details.reasoning_tokens)

Mhinduro inotakura reasoning text mu-reasoning_content, mhinduro mu-content, ne-reasoning tokens mu-usage:

200 JSON
{
  "id": "chatcmpl-2a6c8e0b4d1f4a3c9e7b5d3f1a8c6e4b",
  "object": "chat.completion",
  "created": 1791590400,
  "model": "Kimi-K3-3BIT-REAP",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "No. 221 = 13 x 17, so it is not prime.",
        "reasoning_content": "Try small primes. 221 / 13 = 17, so 221 = 13 x 17."
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 14,
    "completion_tokens": 43,
    "total_tokens": 57,
    "prompt_tokens_details": {"cached_tokens": 0},
    "completion_tokens_details": {"reasoning_tokens": 27}
  }
}

Ma-model anofunga

Model Inodzosa reasoning text Inoshandisa effort field
shannon-1.6-lite — —
shannon-1.6-pro, shannon-2-lite, shannon-2-pro, shannon-3, shannon-3-pro, shannon-3.1, shannon-3.1-pro, shannon-coder-1 Hongu —
Hosted open-weight model imwe neimwe Hongu Hongu

Idzi ndidzo flags capabilities.reasoning ne-capabilities.reasoning_effort dzinoratidzwa ne-GET /v1/models pa-id imwe neimwe. Mhinduro inotakura reasoning text chete kana model yagadzira. Ma-model nemitengo

Kuisa effort

Endpoint imwe neimwe ine manyorerwo ayo e-effort. Ese anosarudza imwe yema-level mana akafanana.

Field Mhando Default Tsananguro Inoshandiswa ne
reasoning_effort string high /v1/chat/completions. Kudzika kwekufunga kwe-model isati yapindura: off, low, medium kana high. Hosted open-weight models
reasoning object | string /v1/chat/completions. Value imwechete se-{"effort": "low"} kana se-string chete. Kana ma-field ese maviri akatumirwa, reasoning_effort ndiyo inoverengwa. Hosted open-weight models
reasoning.effort string high /v1/responses. Inonyorwa se-object {"effort": "low"}. Hosted open-weight models
thinking object /v1/messages. {"type": "enabled", "budget_tokens": n} kana {"type": "disabled"}. Budget inosarudza imwe yema-level; tarisa tafura iri pazasi. Hosted open-weight models
{
  "model": "Kimi-K3-3BIT-REAP",
  "reasoning_effort": "low",
  "messages": [{"role": "user", "content": "Is 221 a prime number?"}]
}
Value Dzinogamuchirwawo Mhedzisiro
off none, minimal Hapana reasoning. Mhinduro haitakure reasoning text.
low Kufunga pfupi.
medium default Kudzika kwepakati.
high max Level yakadzika kwazvo. Ndiyo level ye-request isingatumiri value.
  • Values dzinoverengwa pasina kutarisa mavara makuru kana madiki.
  • Value default inoreva medium. Kusiya field kunze kunoreva high.
  • Shannon models (shannon-*) dzinozvisarudzira kudzika kwadzo pa-request imwe neimwe; GET /v1/models inoratidza reasoning_effort: false kwadziri.

Thinking budget pa-/v1/messages

Pa-/v1/messages thinking field inosarudza level. budget_tokens inosarudza imwe yema-level ari pamusoro; haisi token limit yayo. adaptive inoverengwa se-enabled.

Unotumira Level
{"type": "disabled"} off
{"type": "enabled", "budget_tokens": n} ne-n kusvika ku-2,048 low
n kubva ku-2,049 kusvika ku-8,192 medium
n huru, kana enabled isina budget_tokens high
Hapana thinking field high

Kunosvika reasoning text

Reasoning text inogara yakaparadzaniswa nemhinduro. Format imwe neimwe ine nzvimbo yayo:

Endpoint Isiri streamed Streamed
/v1/chat/completions choices[0].message.reasoning_content: string, kana null kana model isina kugadzira. Ma-chunk ane choices[0].delta.reasoning_content, pamberi pema-chunk ane delta.content.
/v1/responses output item {"type": "reasoning", "summary": [{"type": "summary_text", "text": "…"}]} pamberi pe-message item. Hapana item kana pasina reasoning. response.output_item.added ine reasoning item, wozoteverwa ne-response.reasoning_summary_text.delta events ne-response.reasoning_summary_text.done imwe.
/v1/messages Content block yekutanga {"type": "thinking", "thinking": "…"}, wozoteverwa ne-text block. Hapana thinking block kana pasina reasoning. thinking content block: content_block_start, content_block_delta events ne-thinking_delta, content_block_stop. Text block inotevera.
{
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "No. 221 = 13 x 17, so it is not prime.",
        "reasoning_content": "Try small primes. 221 / 13 = 17, so 221 = 13 x 17."
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 14,
    "completion_tokens": 43,
    "total_tokens": 57,
    "prompt_tokens_details": {"cached_tokens": 0},
    "completion_tokens_details": {"reasoning_tokens": 27}
  }
}

Kwekutarisa, pa-model:

Ma-model Kunosvika text
Hosted open-weight models Pa-endpoint imwe neimwe, streamed kana kwete. Request ine effort off, kana ine response_format / text.format, inopindurwa pasina reasoning text.
shannon-3, shannon-3-pro, shannon-3.1, shannon-3.1-pro Pa-endpoint imwe neimwe, streamed kana kwete, chero kana model yagadzira reasoning text.
shannon-2-lite, shannon-2-pro /v1/chat/completions, isiri streamed: mu-message.reasoning_content. Streamed, mu-request isina tools kana response_format: stream inotakura comment lines : thinking apo model ichifunga, wozouya answer chunks. /v1/messages, streamed: thinking block pamberi pe-text block.
shannon-1.6-pro, shannon-coder-1 Mu-streamed replies nemu-replies ku-requests dzinotakura tools, chero kana model yagadzira reasoning text.

Pa-/v1/responses, mhinduro isiri streamed inotakura reasoning item ye-mhuri ye-Shannon 3 ne-hosted open-weight models.

Kuverenga stream

Mu-stream reasoning text inouya kutanga, mu-deltas dzayo, uye mhinduro inotevera. Priinta kana chengeta zviviri izvi zvakasiyana:

from openai import OpenAI

client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.shannon-ai.com/v1")

stream = client.chat.completions.create(
    model="Kimi-K3-3BIT-REAP",
    reasoning_effort="medium",
    stream=True,
    messages=[{"role": "user", "content": "Is 221 a prime number?"}],
)

for chunk in stream:
    if not chunk.choices:
        continue
    delta = chunk.choices[0].delta
    reasoning = getattr(delta, "reasoning_content", None)
    if reasoning:
        print(reasoning, end="", flush=True)      # the reasoning text comes first
    if delta.content:
        print(delta.content, end="", flush=True)  # then the answer

Chunk yekutanga ye-hosted open-weight model, reasoning kana mhinduro, inotakurawo delta.role: "assistant". Kuyerera

Reasoning tokens ne-billing

Pa-hosted open-weight models, reasoning tokens i-output tokens: dzinobhadharwa pa-output price ye-model, uye output count yatoidzisanganisira. usage inoratidza reasoning share pano:

Endpoint Field Note
/v1/chat/completions usage.completion_tokens_details.reasoning_tokens Yatoiswa mu-completion_tokens.
/v1/responses usage.output_tokens_details.reasoning_tokens Yatoiswa mu-output_tokens.
/v1/messages usage.output_tokens Reasoning nemhinduro pamwe chete. Format iyi haina count yakasiyana.
  • Pa-hosted open-weight models max_tokens inogumira text yemhinduro. Reasoning tokens hadziverengwi pairi.
  • Nekuti reasoning inobhadharwa se-output, effort level iri zvakare cost setting: off haigadzire reasoning tokens.
  • Shannon models dzinoratidza prompt_tokens, completion_tokens ne-total_tokens (input_tokens ne-output_tokens pa-/v1/messages) pasina reasoning share, uye dzinobhadharisa mutengo mumwe wakatarwa pa-token imwe. Ma-model nemitengo

Reasoning mu-request inotevera

Hauna kufanira kutumira reasoning kudzoka. thinking block kana reasoning item muhurukuro yaunotumira haipiwi kuna model, saka assistant turn inogona kudzoka iine kana isina. thinking block ine ma-field maviri type ne-thinking; haina signature.

Errors

Status Mhando Message Rinhi
400 invalid_request_error unknown reasoning effort '<value>'; expected off, low, medium or high Hosted open-weight model yagamuchira value iri kunze kwe-list, semuenzaniso xhigh. Hapana chinobviswa mu-balance yako.
422 invalid_request_error Failed to deserialize the JSON body into the target type: … reasoning_effort haisi string.

Authentication, balance ne-server errors zvakafanana nepa-request imwe neimwe. Zvikanganiso