Tlola ho ea ho litaba
Effort ea reasoning

Effort ea reasoning

E ntjha

Model e nahanang e khutlisa mongolo oa reasoning oa eona haufi le karabo, field ea eona. Ho li-model tse hosted tsa open-weight field e le 'ngoe ea kopo e beha hore na model e nahana ka botebo bofe pele e araba.

POST https://api.shannon-ai.com/v1/chat/completions

from openai import OpenAI

client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.shannon-ai.com/v1")

response = client.chat.completions.create(
    model="Kimi-K3-3BIT-REAP",
    reasoning_effort="low",
    messages=[{"role": "user", "content": "Is 221 a prime number?"}],
)

message = response.choices[0].message
print("Reasoning:", getattr(message, "reasoning_content", None))
print("Answer:", message.content)
print("Reasoning tokens:", response.usage.completion_tokens_details.reasoning_tokens)

Karabo e nka mongolo oa reasoning ho reasoning_content, karabo ho content, le tokens tsa reasoning ho usage:

200 JSON
{
  "id": "chatcmpl-2a6c8e0b4d1f4a3c9e7b5d3f1a8c6e4b",
  "object": "chat.completion",
  "created": 1791590400,
  "model": "Kimi-K3-3BIT-REAP",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "No. 221 = 13 x 17, so it is not prime.",
        "reasoning_content": "Try small primes. 221 / 13 = 17, so 221 = 13 x 17."
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 14,
    "completion_tokens": 43,
    "total_tokens": 57,
    "prompt_tokens_details": {"cached_tokens": 0},
    "completion_tokens_details": {"reasoning_tokens": 27}
  }
}

Li-model life tse nahanang

Model E khutlisa mongolo oa reasoning E sebelisa field ea effort
shannon-1.6-lite — —
shannon-1.6-pro, shannon-2-lite, shannon-2-pro, shannon-3, shannon-3-pro, shannon-3.1, shannon-3.1-pro, shannon-coder-1 Ee —
Model e 'ngoe le e 'ngoe e hosted ea open-weight Ee Ee

Tsena ke li-flag capabilities.reasoning le capabilities.reasoning_effort tseo GET /v1/models e li tlalehang bakeng sa id e 'ngoe le e 'ngoe. Karabo e nka mongolo oa reasoning feela ha model e hlahisitse oo. Li-model le litheko

Ho beha effort

Endpoint e 'ngoe le e 'ngoe e na le mokhoa oa eona oa ho ngola effort. Kaofela li khetha e 'ngoe ea maemo a mane a tšoanang.

Field Mofuta Default Tlhaloso E sebelisoa ke
reasoning_effort string high /v1/chat/completions. Hore na model e nahana ka botebo bofe pele e araba: off, low, medium kapa high. Li-model tse hosted tsa open-weight
reasoning object | string /v1/chat/completions. Boleng bo tšoanang e le {"effort": "low"} kapa e le string e hlakileng. Ha li-field ka bobeli li romeloa, reasoning_effort e a sebetsa. Li-model tse hosted tsa open-weight
reasoning.effort string high /v1/responses. E ngotsoe e le ntho {"effort": "low"}. Li-model tse hosted tsa open-weight
thinking object /v1/messages. {"type": "enabled", "budget_tokens": n} kapa {"type": "disabled"}. Budget e khetha e 'ngoe ea maemo; bona tafole e ka tlase. Li-model tse hosted tsa open-weight
{
  "model": "Kimi-K3-3BIT-REAP",
  "reasoning_effort": "low",
  "messages": [{"role": "user", "content": "Is 221 a prime number?"}]
}
Boleng Le tse ling tse amohelwang Phello
off none, minimal Ha ho reasoning. Karabo ha e nke mongolo oa reasoning.
low Reasoning e khutšoanyane.
medium default Botebo bo bohareng.
high max Boemo bo tebileng ka ho fetisisa. Ena ke boemo ba kopo e sa romeleng boleng.
  • Litekanyo li baloa ho sa tsotellehe litlhaku tse kholo kapa tse nyane.
  • Boleng default bo bolela medium. Ho siea field ka ntle ho bolela high.
  • Li-model tsa Shannon (shannon-*) li iketsetsa botebo ba tsona kopong e 'ngoe le e 'ngoe; GET /v1/models e tlaleha reasoning_effort: false bakeng sa tsona.

Thinking budget ho /v1/messages

Ho /v1/messages field ea thinking e khetha boemo. budget_tokens e khetha e 'ngoe ea maemo a ka holimo; hase moeli oa tokens oa eona. adaptive e baloa joalo ka enabled.

U romela Boemo
{"type": "disabled"} off
{"type": "enabled", "budget_tokens": n} le n ho fihlela ho 2,048 low
n ho tloha ho 2,049 ho isa ho 8,192 medium
n e kholoanyane, kapa enabled ntle le budget_tokens high
Ha ho field ea thinking high

Moo mongolo oa reasoning o fihlang teng

Mongolo oa reasoning kamehla o arohane le karabo. Sebopeho se seng le se seng se na le sebaka sa sona sa oona:

Endpoint Ntle le streaming Ka streaming
/v1/chat/completions choices[0].message.reasoning_content: string, kapa null ha model e sa hlahise letho. Li-chunk tse nang le choices[0].delta.reasoning_content, pele ho li-chunk tse nang le delta.content.
/v1/responses Ntho ea output {"type": "reasoning", "summary": [{"type": "summary_text", "text": "…"}]} pele ho ntho ea message. Ha ho ntho ha ho se na reasoning. response.output_item.added e nang le ntho ea reasoning, ebe li-event tsa response.reasoning_summary_text.delta le response.reasoning_summary_text.done e le 'ngoe.
/v1/messages Content block ea pele {"type": "thinking", "thinking": "…"}, ebe block ea text. Ha ho block ea thinking ha ho se na reasoning. Content block ea thinking: li-event tsa content_block_start, content_block_delta le thinking_delta, content_block_stop. Block ea mongolo e latela.
{
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "No. 221 = 13 x 17, so it is not prime.",
        "reasoning_content": "Try small primes. 221 / 13 = 17, so 221 = 13 x 17."
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 14,
    "completion_tokens": 43,
    "total_tokens": 57,
    "prompt_tokens_details": {"cached_tokens": 0},
    "completion_tokens_details": {"reasoning_tokens": 27}
  }
}

Moo u lokelang ho sheba teng, ka model:

Li-model Moo mongolo o fihlang teng
Li-model tse hosted tsa open-weight Ho endpoint e 'ngoe le e 'ngoe, ka streaming kapa ntle le eona. Kopo e nang le effort off, kapa e nang le response_format / text.format, e arajoa ntle le mongolo oa reasoning.
shannon-3, shannon-3-pro, shannon-3.1, shannon-3.1-pro Ho endpoint e 'ngoe le e 'ngoe, ka streaming kapa ntle le eona, neng kapa neng ha model e hlahisitse mongolo oa reasoning.
shannon-2-lite, shannon-2-pro /v1/chat/completions, ntle le streaming: ho message.reasoning_content. Ka streaming, kopong e se nang tools kapa response_format: stream e nka mela ea maikutlo : thinking ha model e ntse e nahana, ebe li-chunk tsa karabo. /v1/messages, ka streaming: block ea thinking pele ho block ea mongolo.
shannon-1.6-pro, shannon-coder-1 Likarabong tsa streaming le likarabong tsa likopo tse nang le tools, neng kapa neng ha model e hlahisitse mongolo oa reasoning.

Ho /v1/responses, karabo e se nang streaming e nka ntho ea reasoning bakeng sa lelapa la Shannon 3 le li-model tse hosted tsa open-weight.

Ho bala stream

Ho stream mongolo oa reasoning o tla pele, ho li-delta tsa oona, ebe karabo e latela. Gatisa kapa u boloke tse peli ka thoko:

from openai import OpenAI

client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.shannon-ai.com/v1")

stream = client.chat.completions.create(
    model="Kimi-K3-3BIT-REAP",
    reasoning_effort="medium",
    stream=True,
    messages=[{"role": "user", "content": "Is 221 a prime number?"}],
)

for chunk in stream:
    if not chunk.choices:
        continue
    delta = chunk.choices[0].delta
    reasoning = getattr(delta, "reasoning_content", None)
    if reasoning:
        print(reasoning, end="", flush=True)      # the reasoning text comes first
    if delta.content:
        print(delta.content, end="", flush=True)  # then the answer

Chunk ea pele ea model e hosted ea open-weight, reasoning kapa karabo, e boetse e nka delta.role: "assistant". Phallela

Tokens tsa reasoning le billing

Ho li-model tse hosted tsa open-weight, tokens tsa reasoning ke output tokens: li lefisoa ka theko ea output ea model, mme palo ea output e se e li kenyelletsa. usage e bontša karolo ea reasoning mona:

Endpoint Field Tlhokomeliso
/v1/chat/completions usage.completion_tokens_details.reasoning_tokens E se e kenyellelitsoe ho completion_tokens.
/v1/responses usage.output_tokens_details.reasoning_tokens E se e kenyellelitsoe ho output_tokens.
/v1/messages usage.output_tokens Reasoning le karabo hammoho. Sebopeho sena ha se na palo e arohaneng.
  • Ho li-model tse hosted tsa open-weight max_tokens e lekanyetsa mongolo oa karabo. Tokens tsa reasoning ha li baloe ho eona.
  • Kaha reasoning e lefisoa e le output, boemo ba effort le bona ke setting ea theko: off ha e hlahise tokens tsa reasoning.
  • Li-model tsa Shannon li tlaleha prompt_tokens, completion_tokens le total_tokens (input_tokens le output_tokens ho /v1/messages) ntle le karolo ea reasoning, mme li lefisa theko e le 'ngoe e sa fetoheng ka token. Li-model le litheko

Reasoning kopong e latelang

Ha u hloke ho romela reasoning hape. Block ea thinking kapa ntho ea reasoning moqoqong oo u o romelang ha e fetisetsoe ho model, kahoo turn ea assistant e ka khutla le eona kapa ntle le eona. Block ea thinking e na le li-field tse peli type le thinking; ha e na signature.

Liphoso

Boemo Mofuta Molaetsa Neng
400 invalid_request_error unknown reasoning effort '<value>'; expected off, low, medium or high Model e hosted ea open-weight e amohetse boleng bo kantle ho lenane, mohlala xhigh. Ha ho letho le nkoang ho balance ea hau.
422 invalid_request_error Failed to deserialize the JSON body into the target type: … reasoning_effort hase string.

Liphoso tsa netefatso, balance le server li tšoana le tsa kopo e 'ngoe le e 'ngoe. Diphoso