We do not hold or access any user's data, and we do not suspend accounts unless a lawful authority requires an enforcement action.
Kāri Tauira · inkling · W4A16-AUTOROUND-REAP

API Tauira Inkling Kore-ārai

He hanga whai-tirohanga, kore-ārai o te tūāpapa Whakaranu-o-Ngā-Mātanga 975B Inkling a Thinking Machines — horopaki 262K, tāuru whakaahua, kore paparanga whakakāhore.

I whakahoutia 5 Hepetema 2026Kāri TauiraTūāpapa: Inkling (Thinking Machines Lab)

Whakarāpopoto

Ko inkling-W4A16-AUTOROUND-REAP tā mātou whakatakotoranga o Inkling, te MoE taumaha-tuwhera 975B-tawhā i whakaputaina e Thinking Machines Lab i te 15 o Hurae 2026. He whai-tirohanga, ka mahi i te karanga taputapu me te whakahaere kaha whakaaroaro, ā, ka rere me te kore paparanga whakakāhore, kore hoki tātari whakaputa i runga i tā mātou ake tautau GPU. Ko te horopaki he 262,144 tohu, ko te whakaputa tae atu ki te 16,384. Ko te utu he $1.42 tāuru / $6.07 whakaputa ia miriona tohu — waenga-nui-ake, kei runga ake i tā mātou taumata papa $0.50, ā, kei raro noa iho i te tauira tino teitei a Kimi-K3. Kotahi whakatūpato hei whakamahere: ka tautoko ia i te response_format engari kāore i te json_schema.

Ko te nuinga o ngā tauira tekau mā rua o tā mātou kūwaha he kuputuhi-anake. E whā kāore i pērā, ā, i waenga i aua tauira e whā, he tūranga motuhake tō Inkling: te tauira tirohanga ka tono koe ina ko te whakaahua te wāhanga uaua o te rapanga, engari kāore te pūtea e roa ki tētahi tauira tino teitei. Ka kōrero tēnei kāri mō te ahunga mai o te tūāpapa, te mea i mahia e te taunga W4A16-AUTOROUND-REAP ki a ia, ngā mea ka mahia me ngā mea kāore e mahia i te mata API, ā — kia pono — te wā he pai ake te karanga i tētahi tauira utu-iti ake o te rārangi ōrite.

01He aha a Inkling, ā, nā wai i hanga?

Ko Inkling te tauira taumaha-tuwhera tuatahi a Thinking Machines Lab, i whakaputaina i te 15 o Hurae 2026. Kāore i rite ki te nuinga o ngā putanga e kīia ana he "tuwhera," i tukuna ia me ngā taumaha tāngohia-katoa i runga i a Hugging Face me te tautoko-rā-tuatahi i roto i a transformers, SGLang, vLLM, me llama.cpp — koirā tonu te take ka taea ai te whakahaere i runga i te hanganga pēnei i tā mātou. Ngā tau matua, mai i ngā rauemi putanga ake a Thinking Machines:

975B
Tawhā katoa
41B
Hohe / tohu
256
Mātanga kua whakaritea-ara
45T
Tohu whakangungu-tōmua

He whakatakotoranga Whakaranu-o-Ngā-Mātanga korekore tēnā: 66 paparanga wetereo i te rahi huna 6,144, ko ngā mea tuatahi e rua he kiato, ko ngā 64 e toe ana e kawe ana i te 256 mātanga kua whakaritea-ara me te 2 mātanga tiritahi, me te 6 mātanga kua whakaritea-ara e hohe ana ia tohu. Tata ki te 4% o ngā tawhā e mahi ana i tētahi tohu; koirā te mea e taea ai te whakahaere i tētahi tauira tata-taera-tawhā.

E rua ngā kōwhiringa hoahanga he tino rerekē kia whakaingoatia. He aro whakawhitiwhiti: 55 paparanga aro matapihi-neke i tētahi matapihi 512-tohu, e whakataurite ana ki te 11 paparanga aro-whānui, i tētahi tauira tukurua 5:1. Ā, kāore a Inkling e whakamahi i te RoPE: ka whakamahia e ia he whakapēhitanga tūnga-whanaunga kua akona, ā-tāuru, me ngā convolution poto take-tōmua i runga i ngā projection kī/uara me ngā peka toenga. E tohu ana ngā tuhipoka hoahanga a Sebastian Raschka i ēnei e rua hei nekehanga tūturu mai i te tohutaka paerewa o te tau 2026. I whakamahia te Muon mō ngā tawhā matriki nunui i te whakangungu, me te Adam mō ērā atu, kātahi neke atu i te 30 miriona rere RL kore-rite-wā i te whakangungu-whai-muri.

Ehara te take ki tētahi kaiwhakamahi API i ngā mea iti noa. Koinā he tūāpapa rahi-taumata-mata, maha-momo ā-taketake, i whakangungua ki te 45 taera tohu e whātoro ana i te kuputuhi, ngā whakaahua, ngā oro me ngā ataata — kaua he tauira kuputuhi me tētahi taputanga tirohanga i whakapiritia mai i muri. Ka whakawaeahia ngā whakaahua hei wāhanga pika 40×40 mā roto i tētahi kaiwāhi MLP whakarōpū e whā paparanga, ka tukatukaina ngātahitia me te kuputuhi i te wetereo ōrite. I roto i te whāinga whakangungu-tōmua te mārama-ataata.

02He aha te tikanga o W4A16-AUTOROUND-REAP?

E toru ngā tikanga motuhake kua whakapaparuatia i taua taunga, ā, he rerekē ngā mahi a tēnā, a tēnā. He mea whai take kia mārama, nā te mea koinā te rerekētanga nui rawa i waenga i te tauira ka karangatia e koe i runga i tā mātou API me te pauna i whakaputaina e Thinking Machines.

REAP — te tapahi i ngā mātanga kāore e whakaritea-ara e tētahi

Ko REAP te Router-weighted Expert Activation Pruning, nā Cerebras Research (arXiv 2510.13999, kua whakaaetia mō ICLR 2026). I roto i tētahi MoE me te 256 mātanga ia paparanga, kāore te kaiwhakarite ara e tohatoha ōrite ana i te mahi: he auau te pā ki ētahi mātanga, ā, he onge te puta o ētahi, he iti hoki tā rātou whai wāhi ina puta. Ka whakatau te REAP i ia mātanga i runga i ngā tohu e rua — ngā uara kēti a te kaiwhakarite ara me ngā ine whakaputa a te mātanga — he iti ake te take o tētahi mātanga e auau ana te kōwhiritia engari he iti tāna whai wāhi i te mea e kīia ana e tōna tatauranga kōwhiringa — ā, ka tukuna ngā mea tatauranga-iti rawa i te hikoi kotahi, i mua i te quantization.

Ko te take ka whakamahia e mātou te tapahi kaua ko te whakakotahi mātanga rongonui ake, he rerekē ngā mea e rua i runga i te momo mahi. He tino pai te āhua o te whakakotahi i ngā paearu wehewehe, engari ka horo i ngā mea whakaputa. E pūrongo ana ngā kaituhi o REAP he pai ake te pupuri kounga a te tapahi i ngā kawenga mahi tonu e hokona ai e te tangata tētahi API — te whakahiato waehere, te karanga taputapu, te whakaaroaro maha-hurihanga — i ngā ōwehenga kōpaki neke atu i te 50%, puta noa i ngā tauira mai i te 20B ki te 1T tawhā. Ka whakangaro te whakakotahi i te mātau-motuhake a te kaiwhakarite ara; ka waiho e te tapahi ngā mātanga e ora tonu ana me te whakaritea-ara i waenga i a rātou.

AutoRound — te ako ki hea te porowhita

Ko AutoRound te tikanga quantization-whai-muri-whakangungu a Intel (arXiv 2309.05516, i whakaputaina hei SignRound). Ka porowhita te quantization ngāwari i ia taumaha ki te uara 4-pī tata rawa — he taunoa whaitake engari he kino i te rahi, nā te mea ehara ngā hapa porowhita i te mea motuhake, ā, ka whakarea puta noa i te paparua 66-paparanga. Ka kite a AutoRound i te whakatau porowhita hei mea hei whakatikatika: ka whakatikatika ngātahi te heke-paiaka-tohu i te ahunga porowhita me ngā awhe kutikuti taumaha puta noa i te rua rau hikoi, ā, ka nama i te tika o te whakangungu mataara-quantization me te kore whakangungu-anō. E pūrongo ana a Intel i ngā piki nui rawa i ngā tautuhinga pī-iti rawa, me tētahi tuanui whakataetae i te INT4.

W4A16 — kei hea ngā pī e haere ana

Ko W4A16 te hōputu tatauranga: ngā taumaha 4-pī, ngā hohenga 16-pī. Ko ngā taumaha — e nui rawa ana i te mahara o tētahi tauira 975B — ka whakaitihia ki te tata hauwhā o tētahi horahanga BF16, engari ka noho tonu te tatauranga ki te 16 pī. He nui taua wehenga mō tētahi tauira tirohanga ake: ka pāngia e ngā tikanga hohenga-quantized tonu te mahi tatauranga mārama-iti e whakawhirinaki ana te mārama whakaahua ki a ia — te pānui i tētahi tapanga rārangi ine iti, te whakatau i tētahi rārangi angiangi i roto i tētahi hoahoa, te wehewehe i ngā tae rite e rua. Ko te pupuri i ngā hohenga ki te 16 pī he utu ki te whānui-rārangi, engari ka hoki mai te tika ki ngā wāhi e mōhiotia ana e tētahi kawenga mahi tirohanga.

Mā te whakapaparua i ngā mea e toru, ka whiwhi i tētahi tauira e uru ana, e tere tonu ana te rere, me te kore paremata kounga o te taumata 3BIT-REAP kaha ake e whakamahia ana e mātou mō ngā tūāpapa nui rawa. Koirā te whakawhitinga e whakaatahia ana e te utu.

03Te tirohanga: he API tātaritanga whakaahua kore-whakakāhore

Ko Inkling tētahi o ngā tauira e whā e whai-tirohanga ana i tā mātou rārangi, i te taha o Kimi-K3, Kimi-K2.6, me MiniMax-M3. Ko ngā hua tirohanga i whakaputaina o te tauira taketake, mai i te putanga a Thinking Machines, he 73.3% i te MMMU Pro (Paerewa 10) me te 78.1% i ngā pātai whakaaroaro CharXiv — ka piki ki te 82.0% ina whakaaetia te tauira ki te whakahaere Python ki te tūtohi. He tau nā te whare rangahau anō ērā mō te pauna kāore i kōpakina; tirohia hei tuanui o te whānau, kaua hei ine mō tā mātou hanga.

Ko CharXiv te mea whai take kia āta tirohia, nā te mea e whakaatu ana i te take ka hoko ai te tangata i tētahi API tirohanga, kaua i tētahi ratonga OCR. Ka whakamātauria e ia te whakaaroaro i runga i ngā tūtohi pūtaiao — te pānui i tētahi uara mai i tētahi rārangi ine, te whakataurite i ngā raupapa e rua, te kite i te hurihanga o tētahi ia. Ehara i te "he aha te kuputuhi kei roto i tēnei whakaahua" engari he "he aha te kī a tēnei whakaahua, ā, e mau ana rānei taua kī." Koinā te mea e whakaū ana i te tuku whakaahua ki tētahi tauira whakaaroaro 975B, kaua ki tētahi kaiwhakamārama iti.

He mahi noa rite-ki-OpenAI te tuku whakaahua — he wāhanga ihirangi image_url i runga i /v1/chat/completions, he poraka image momo-Anthropic i runga i /v1/messages, he ōrite rānei i runga i /v1/responses. Ka pā ngā reo e toru katoa ki ngā taumaha ōrite, ā, ka streaming katoa; kōwhiria te mea e kōrero ana tō SDK o nāianei. Kei te wāhanga 09 tētahi tauira mahi.

He nui ake te take o te kore-ārai mō te tirohanga i te kuputuhi. He tino māro tētahi paparanga whakakāhore i runga i tētahi pito mutunga tirohanga, nā te mea ka whakarōpūhia paerewatia te whakaahua i mua i te whakaaroaro a te tauira mō te tono. Ka mau tonu te mahi tika: he whakaahua whara i roto i tētahi paipa tuhinga haumanu, he whakaahua-mata taunakitanga i roto i tētahi tuhinga aituā, he papa mai i tētahi kiriata e arotakengia ana mō tētahi tuhinga arotake, he mataono rongoā, he whakaahua o tētahi tuhinga e mau ana i tētahi ingoa. Kāore he kaiwhakarōpū pēnā i mua i a Inkling i runga i tā mātou kūwaha. Ka tirotiro ia i te mea i tukuna e koe, ka whakautu i te pātai i pātaihia e koe. Koinā te hua.

04Putanga hanganga: response_format āe, json_schema kāo

Koinei te wāhi kotahi he iti ake te āheinga o Inkling i te nuinga o te rārangi, ā, he pai ake te whakamahere mō tēnā i te kite noa i te wā whakaputa.

ĀheingainklingKimi-K2.6MiMo-V2.5Laguna-S-2.1
Tirohanga (tāuru whakaahua)ĀeĀeĀeKāo
response_formatĀeĀeĀeKāo
json_schemaKāoĀeĀeKāo
Karanga taputapuĀeĀeĀeĀe
Kaha whakaaroaroĀeĀeĀeĀe

Ka mahi te response_format: {"type": "json_object"} — ka whiwhi koe i te JSON tika-ā-wetereo. Ko te mea kāore koe e whiwhi ko te wetewete kua herea-ā-wetereo ki tētahi schema kua tukuna e koe, i reira kua aukatingia ā-tinana te kaitango i te whakaputa i tētahi tohu e takahi ana i tō hanganga. Ko ngā ingoa āpure, te mema-enum, me te noho o ngā kī matua he mea nā te tauira ake, ehara i te mautohu.

E toru ngā ara ki te noho tahi me tēnā, kua raupapatia i runga i te pono:

  1. Tonoa te schema, ka whakaū. Whakaurua te schema ki te tohutohu pūnaha hei JSON tūturu, whakaritea te response_format ki json_object, ka whakaū i te whakautu i tō taha. Tarai anō ina hapa te whakaū, me te tāpiri i te karere hapa a te kaiwhakaū. He utu-iti, ka mahi, engari me whai pūtea-tarai anō.
  2. Whakamahia he whakamārama taputapu hei schema. Ka tautokona te karanga taputapu, ā, ko te whakamārama tawhā a tētahi mahi he JSON Schema. Whakaingoatia he taputapu kotahi mō te tango e hiahiatia ana, akiakitia, ka pānui i ngā tohutohu. Koinei te kōwhiringa kaha rawa i runga i a Inkling i te nuinga o te wā, ā, kāore he utu tāpiri.
  3. Wāhia te mahi ki ngā tauira e rua. Waiho a Inkling kia mahi i te tirohanga me te whakaaroaro hei kuputuhi, kātahi ka hoatu taua kuputuhi ki a MiMo-V2.5-W8A16 i te $0.50 / $2.00 me tētahi json_schema tūturu mō te hikoi whakahanga. E rua ngā karanga, engari he utu-iti te tuarua, he mautohu te āhua, ā, ko te tauira e hiahiatia ana kia mātau ko te mea i kite i te whakaahua.

Ko te kōwhiringa 3 te tauira e taunaki ai mātou mō tētahi paipa tango-kōrero rahi-nui. Utua te utu nui ake mō te hikoi anake e hiahia ana ki tēnā.

05He aha ka hokona e te utu nui ake?

I te $1.42 tāuru / $6.07 whakaputa ia miriona tohu, e noho ana a Inkling ā-hiahia ki waenganui o tā mātou rārangi. E ono o ngā tauira tekau mā rua kei te papa $0.50 / $2.00. Ko Kimi-K3 — te tauira tino teitei, he whai-tirohanga hoki — he $3.83 / $19.12. Ko Inkling tata ki te toru whakareatanga o te papa mō te whakaputa, tata hoki te hautoru o te tauira tino teitei.

Kimi-K319.12
inkling6.07
DeepSeek-V4-Pro3.90
Kimi-K2.63.67
MiniMax-M32.00

Utu whakaputa, USD ia 1M tohu, ngā reiti rārangi a te Kūwaha Shannon AI, Hepetema 2026. He rite te whānui pae ki te utu; he roa ake he utu nui ake.

Anei te pānui pono mō te wāhi e whai utu ana taua utu nui ake — me te wāhi kāore.

Kawenga mahiWhakamahia a Inkling?He aha
Whakaaroaro tūtohi / hoahoaĀeKo ngā tau CharXiv me MMMU Pro i whakaputaina te mea e kaha rawa ai tēnei tūāpapa.
Ngā kaihautū whakaahua-mataĀeHe tirohanga, he karanga taputapu, he 262K hītori kei te tauira kotahi, kāore he tuku-atu.
Ngā tuhinga roa me ngā whakaahuaĀeKa tiritahi te kuputuhi me ngā whakaahua i te wetereo kotahi me te matapihi horopaki kotahi.
Te hanga kuputuhi noaKāoE ono ngā tauira i te $0.50 / $2.00 e mahi ana i tēnei. Kei te utu koe mō tētahi ara tirohanga kāore koe e karanga.
Te tango schema pukoroKāoKāore he json_schema. He utu-iti ake, he here ake hoki a MiMo-V2.5.
Te tuanui mata tino teiteiKāoKo Kimi-K3 te tauira tino teitei. Utua te 3.1× mēnā ko te tuanui te here.
Te tirohanga utu-iti rawaKāoHe tirohanga tō MiniMax-M3 i te $0.50 / $2.00. Tīmata i reira, whakanekehia mēnā ka akiaki te kounga.

Pānuitia tēnā hei ture whakarite-ara, kaua hei rārangi tūranga. He whāiti ake te horopaki mahi e tika ai a Inkling i te mea ka kīia e tētahi whārangi hokohoko, ā, i roto i taua horopaki, he uaua te aha ake i tōna utu. I waho atu, ka pai ake ki a mātou te hoko atu i te tauira utu-iti ake ki a koe, ā, kia noho tonu koe hei kaihoko.

06Te matapihi horopaki 262K, ā, he aha tino ka uru

Ka whakahaeretia ngā tauira tekau mā rua katoa o te kūwaha me te horopaki tāuru 262,144-tohu me te whakaputa nui rawa 16,384-tohu ia tono. He mea ōrite ā-hiahia: kaua rawa te whakahaere horopaki e noho hei peka ā-tauira i roto i tō waehere, ā, ko te whakakapi i a inkling ki a MiniMax-M3 i roto i tētahi kōnae whirihoranga kaua e panoni pūku i te mea ka uru.

Kia mōhio ki te āputa ki te tūāpapa i whakaputaina: ka tuhia e Thinking Machines a Inkling ki te 1,048,576 tohu, ā, ka whakahaerea e mātou he wāhi 262K o tēnā. Mēnā he kawenga mahi tono-kotahi tohu-miriona tūturu tāu, ehara mātou i te pito mutunga mō tēnā, ā, he pai ake kia mōhio koe i mua i tō hanga.

Mō te tauine i te 262K: he PDF hangarau 400-whārangi me ōna whakaahua, he pātengi waehere rahi-waenga, ētahi haora tuhinga-kōrero, he wātea kaihautū roa e kawe ana i ngā tekau hua taputapu me te ringa whakaahua-mata — ka uru ia tētahi ki te tono kotahi. I runga i tētahi tauira tirohanga, kia maumahara ka pau anō te horopaki e ngā whakaahua; ehara i te kore-utu tētahi whakaahua-mata kiato, ā, ka kī tere ake te matapihi i tētahi wātea e whakaputa streaming ana i ngā papa i tētahi kuputuhi-anake noa. He tino tika te hoahanga mō tēnei: ko te tauira 5:1 matapihi-neke-ki-whānui te tikanga ka aro te nuinga o ngā paparanga i roto i te takiwā 512-tohu, ā, ka kukume mai anō ngā paparanga whānui i te hanganga pae-roa i ia wā.

07Te kaha whakaaroaro: utu mō te whakaaro i te wā anake e hiahiatia ana

Ka whakaatu a Inkling i te kaha whakaaroaro ka taea te whakahaere — tētahi o ngā pātene tino whai take o te rārangi. Ka whakaae te tauira o runga ake ki ngā taumata mai i te none me te minimal, mā te low, medium, high, xhigh, tae atu ki te max, e whakaaturia ana i ngā reo e toru mā te tawhā paerewa reasoning_effort.

{
  "model": "inkling-W4A16-AUTOROUND-REAP",
  "reasoning_effort": "low",
  "messages": [ ... ]
}

He rakaraka utu tino kaha tēnei, nā te mea ka utua ngā tohu whakaaroaro hei tohu whakaputa i te $6.07 ia miriona. E pūrongo ana a Thinking Machines i te Terminal Bench 2.1 ka eke a Inkling ki ngā tatauranga rite ki a Nemotron 3 Ultra i te tata hautoru o ngā tohu — he whāinga hoahanga i kīia te whaihua tohu mō te pūnaha kaha, ehara i te mea pōhēhē.

I roto i te mahi: whakahaerea te low, te minimal rānei mō te tapanga, te whakarōpū, me te tango kōrero māmā, i reira kei roto i te whakaahua te whakautu, ā, kāore he mekameka whakatau e hiahiatia ana. Rongoātia te high me ngā mea kei runga ake mō te whakaaroaro tūtohi, te whakataurite ataata maha-hikoi, me ngā hurihanga kaihautū i reira he utu nui tētahi hikoi-waenga hē. Karekau te nuinga o ngā tīma e whakarite i te tawhā, ā, ka waiho he rerekētanga utu-whakaputa whakareatanga-maha ki te tēpu.

08He aha te tikanga o "kore-ārai" i konei — ā, he aha kāore

Kia mārama: ka whakahaerea e mātou tēnei tauira me te kore paparanga whakakāhore, kore hoki tātari e pā ana ki te whakaputa. Kāore tētahi kaiwhakarōpū e pānui ana i tō tohutohu, e whakatau ana mēnā ka whakaaetia te tauira ki te whakautu, ā, kāore tētahi e pānui ana i te whakautu i mua i tana streaming. Ina rūrū, kore mōhio rānei te tauira, ka kī ia i tēnā — nā te tauira tēnā, ehara i te kaupapa here. Ko te mea kāore koe e whiwhi he whakakāhoretanga aunoa mō tētahi kaupapa e kīia ana e tētahi hua kaihoko-whānui he kaupapa here-tapu.

Mō te tirohanga, koirā te kaupapa uara katoa. He hapa te tika o ngā kaiwhakarōpū whakaahua i mua i ngā API tirohanga, ā, ka tau te reiti pono-teka ki te mahi ngaio e tino hiahia ana ki te āheinga: te rangahau haumarutanga, ngā horopaki haumanu, te kairīpoata me te taunakitanga, te arotake kiriata me te toi, ngā taputapu whakahaere e whai take ana ki te tirotiro i te mea e whakahaerea ana e ia. Kāore e taea e tētahi pito mutunga e whakakāhore ana i runga i te momo te whakahaere pono i tētahi o aua mea.

E rua ngā whakatūpato pono. Tuatahi, ka whakaputaina e Thinking Machines ngā arotake haumarutanga mō tā rātou whakatakotoranga tauira — 78.0% i te FORTRESS whakaraerae, 95.9% i te FORTRESS ngāwari, 98.6% i te StrongREJECT. Ka whakaatu ērā tau i tā rātou paparua me ō rātou ārai haumaru e mau tonu ana. Kāore rātou e whakaatu i tā mātou, ā, kāore mātou e whakahua i a rātou me te mea nā rātou. I tangohia e mātou te paparanga e inea wāhanga ana e aua tau; koirā te hua, koirā hoki te haepapa.

Tuarua, ehara te "kore paparanga whakakāhore" i te "kore ture." Ka whakahaerea a Shannon Lab LLC i raro i tētahi Kaupapa Here Whakamahi Haepapa me te ture US e pā ana. Ko te tango i tētahi kaiwhakarōpū he neke i te whakatau ki a koe, ehara i te muku i a ia. Mēnā kei te hanga koe i runga i tēnei, pānuitia te kaupapa here i mua i tō whakanui.

09Te tīmatanga

URL tūāpapa ōrite, kī ōrite, e toru ngā reo. Mēnā kei te karanga kē tō waehere i a OpenAI, Anthropic, i te Responses API rānei, ko te huri i te aho model te nuku katoa i te nuinga o te wā.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.shannon-ai.com/v1",
    api_key=SHANNON_API_KEY,
)

stream = client.chat.completions.create(
    model="inkling-W4A16-AUTOROUND-REAP",
    messages=[{"role": "user", "content": [
        {"type": "text", "text": "What does this figure actually show?"},
        {"type": "image_url", "image_url": {"url": image_data_url}},
    ]}],
    reasoning_effort="high",
    max_tokens=4000,
    stream=True,
)

for chunk in stream:
    delta = chunk.choices[0].delta.content
    if delta:
        print(delta, end="")

Kei te tuhinga API te tohutoro tawhā katoa, ngā āhua o /v1/messages me /v1/responses, ngā hōputu kaupae streaming, me tētahi papa whakamātau ora. Kei te Shannon Research ngā kāri tauira mō ērā atu tauira tekau mā tahi.

He pono te hoahoa

Ko ia tau tūāpapa me tikanga o runga ake nō tētahi pūtake tuatahi tūmatanui. Kāore he paearu i inea e Shannon i konei, ā, kāore mātou e whakaatu i tēnā — tirohia ngā mea taketake.

He tau i whakaputaina e Thinking Machines Lab mō te pauna Inkling kāore i kōpakina ngā tau tūāpapa, ā, e whakaatu ana i te tuanui o te whānau, kaua i tā mātou hanga quantized. He uara rārangi ngā utu me ngā tohu āheinga a te Kūwaha Shannon AI, e rite ana ki Hepetema 2026.

10Ngā pātai auau

He aha te API tauira Inkling kore-ārai?

Ko te whakatakotoranga a Shannon AI mō Inkling, te MoE taumaha-tuwhera 975B-tawhā i whakaputaina e Thinking Machines Lab i te 15 o Hurae 2026. Ka whakahaerea e mātou hei inkling-W4A16-AUTOROUND-REAP me te horopaki 262,144-tohu, te tāuru whakaahua, te karanga taputapu, me te whakahaere kaha whakaaroaro, i runga i tā mātou ake tautau GPU, me te kore paparanga whakakāhore, kore hoki tātari whakaputa.

Ka tautoko a Inkling i te tāuru whakaahua i runga i te API Shannon?

Āe — ko ia tētahi o ngā tauira e whā e whai-tirohanga ana i te rārangi. Tukua he wāhanga ihirangi image_url i runga i /v1/chat/completions, he poraka image rānei i runga i /v1/messages. Me te kore paparanga whakakāhore, ka whakaahuatia te mea kei roto i te papa, kaua e whakakāhoretia i runga i te momo.

Ka tautoko a Inkling i te putanga hanganga json_schema?

Kāo. Ka mahi te response_format mō te aratau ahanoa-JSON; kāore te json_schema kua whakaūngia-ā-wetereo e mahi. Whakamahia a Kimi-K2.6, a MiMo-V2.5 rānei mēnā e hiahiatia ana, ā, i runga i a Inkling whakamahia tētahi whakamārama taputapu akiaki hei schema māu, ka whakaū koe ake.

He aha te tikanga o W4A16-AUTOROUND-REAP?

Ngā taumaha 4-pī me ngā hohenga 16-pī; te AutoRound (Intel) e ako ana i te porowhita me te kutikuti mā te heke-paiaka-tohu kaua i te porowhita-ki-te-tata-rawa; me te REAP (Cerebras) te tapahi hikoi-kotahi i ngā mātanga MoE tatauranga-iti rawa kua whakatauhia ki ngā uara kēti kaiwhakarite ara me ngā ine whakaputa.

E hia te utu, ā, he whai take te utu nui ake?

$1.42 tāuru / $6.07 whakaputa ia miriona tohu — tata 3x tā mātou taumata papa, tata hoki te hautoru o te tauira tino teitei a Kimi-K3. He whai take mō te whakaaroaro tūtohi, ngā kaihautū whakaahua-mata, me ngā tuhinga kaha-whakaahua. Kāore he take mō te kuputuhi noa, te tango schema pukoro rānei.

He aha te matapihi horopaki?

262,144 tohu tāuru me te 16,384 tohu whakaputa ia tono, ōrite puta noa i ngā tauira tekau mā rua. Ka tuhia e te tūāpapa o runga ake te 1,048,576 tohu; ka whakahaerea e mātou he wāhi 262K kia kaua rawa te whanonga horopaki e noho hei take motuhake ā-tauira.

Whakamātauria te API Inkling kore-ārai

Tirohanga, horopaki 262K, ngā reo API e toru, kore paparanga whakakāhore.

Pānuitia ngā Tuhinga API Tirotiro i ngā Kāri Tauira Katoa

Shannon Lab LLC · New Mexico, USA · e whakahaerea ana i raro i tā mātou Kaupapa Here Whakamahi Haepapa


Ngā puna kōrero: Thinking Machines Lab — Te Whakauru mai o Inkling · Hugging Face — Nau mai a Inkling · REAP the Experts (arXiv 2510.13999) · Optimize Weight Rounding via Signed Gradient Descent (arXiv 2309.05516) · Sebastian Raschka — ngā tuhipoka hoahanga me paearu Inkling. He tau nā te whare rangahau i pūrongotia mō te pauna kāore i kōpakina ngā paearu tūāpapa.

All research links