Nemotron API Yosasidwa

Mitundu yambiri "yotseguka" ndi zolemera zapoyera ndipo palibe china kupatula — tarball ya ma parameter, chilolezo, ndi kukhala chete pa komwe manambala anachokera. Nemotron yakhala chosiyana chokhazikika kwa zaka ziwiri: NVIDIA imatulutsa zolemera, ma dataset a post-training, malo a RL ndi njira. Izi ndi zofunika pa endpoint yosasidwa mwanjira yosavuta kuiphonya. Mtundu umene data yake ya kugwirizanitsa yasindikizidwa ndi umene khalidwe lake la kukana mungathe kulilingalira m'malo mopeka — ndipo umene wachitatu angathe kuutumiza mwalamulo popanda chosefera cha zinthu chomangiriridwa pakamwa pake.

01Kodi Nemotron 3 Ultra ndi chiyani?

Nemotron 3 Ultra ndi membala waukulu kwambiri wa banja la Nemotron 3 la NVIDIA, wotulutsidwa ku Hugging Face pa 4 Juni 2026. Lipoti la ukadaulo la NVIDIA limalifotokoza ngati "mtundu wa chinenero wa Mixture-of-Experts Hybrid Mamba-Attention wa ma parameter 550 biliyoni onse ndi 55 biliyoni ogwira ntchito" — pafupifupi 10% ya network imagwira ntchito pa token iliyonse, chomwe ndicho chimapangitsa mtundu wa theka la thililiyoni ya ma parameter kutheka kutumikiridwa.

Kapangidwe kosindikizidwa ndi magawo 108 pa mulingo wa mtundu wa 8,192, kusakaniza magawo a state-space a Mamba-2 ndi gulu locheperapo la magawo athunthu a attention, akatswiri 512 pa chigawo cha MoE ndi top-22 routing. Pretraining idayenda pa pafupifupi ma token a malemba thililiyoni 20 m'magawo awiri — koyamba kokondera kusiyanasiyana, kenako kokondera ubwino — ndi malire a Seputembala 2025, zinenero 12 zachibadwa ndi zinenero 43 za makompyuta. Post-training idagwiritsa ntchito SFT, RL ya malo angapo ndi mphotho zoyezeka, ndi Multi-Teacher On-Policy Distillation pakati pa aphunzitsi akatswiri oposa khumi. Cholinga chonenedwa cha kapangidwe ndi ma agent oyenda nthawi yayitali: magawo omwe amasunga context yaikulu, amayitanitsa zida makumi ambiri, ndipo amayenda mokwanira kuti chuma cha pa token chilamulire bilu.

02Mzera wa Nemotron, ndi chifukwa chake mbiri yake ndi yofunika

Nemotron si chinthu chimodzi chokha. Ndi chotulukapo choonekera cha pulogalamu ya kafukufuku ya NVIDIA yoyenda mbali yomweyo kuyambira 2024, ndipo mbadwo uliwonse unasiya chinachake chimene mtundu wapano ukadalinacho. Nemotron-4 340B (Juni 2024) idatulutsidwa ndi pipeline yotseguka yopanga data yopeka, mtundu wake wa mphotho ndi wopanga wake, kuphatikizapo chidziwitso chosazolowereka: gawo lalikulu kwambiri la data yake ya kugwirizanitsa linapangidwa ndi mtunduwo wokha. Mtunduwo ngati fakitale ya data m'malo mwa oracle ndicho chifukwa chake kutulutsidwa kwa Nemotron kwapambuyo pake kumapitirizabe kutulutsa ma dataset pamodzi ndi zolemera.

Llama-Nemotron — kulingalira komwe mungazimitse

Banja la Llama-Nemotron la 2025 (LN-Nano 8B, LN-Super 49B, LN-Ultra 253B) linapereka malingaliro awiri amene adakhalabe abwino. Loyamba linali la kapangidwe: kufufuza kwa kapangidwe ka neural ka Puzzle ka NVIDIA kudamanga laibulale ya ma block a transformer a block-wise-distilled ndipo kudawaphatikiza ndi mixed-integer programming, kupanga mitundu kumene ma block ena amadumpha attention kwathunthu kapena kuisintha ndi chigawo chimodzi cha linear, pamene FFN Fusion idagwirizanitsa ma block otsatizana a feed-forward kukhala ochepa, otambalala, ofanana — kudula kuya kotsatizana m'malo mochepetsa chiwerengero cha ma parameter. LN-Ultra idakwana pa node imodzi ya 8×H100 pamene, malinga ndi pepala la NVIDIA, idaposa DeepSeek-R1 pa GPQA-Diamond (76.0% poyerekeza ndi 71.5%).

Lachiwiri linali la khalidwe: Llama-Nemotron linali banja loyamba lotseguka lokhala ndi chosinthira cha kulingalira chosinthika, kutchula data ya kuphunzitsa detailed thinking on kapena detailed thinking off mu malangizo a dongosolo, ndi mphotho za mawonekedwe zokakamiza zizindikiro za <think> mu njira ya "on". Gulu limodzi la zolemera, machitidwe awiri, osankhika pa nthawi ya inference. Kuwongolera bajeti ya kulingalira kwa Nemotron 3 — ndi parameter ya reasoning_effort pa API yathu — zimachokera mwachindunji ku ntchito imeneyo.

Nemotron 3 — kutembenukira ku hybrid

Nemotron 3 idasintha zochokera ku Llama ndi kapangidwe ka hybrid kuyambira pachiyambi ndipo idawonjezera LatentMoE (kufinya ma token routing isanachitike, chomwe NVIDIA imanena kuti chimalola "akatswiri 4x ochulukirapo pa mtengo womwewo wa inference"), multi-token prediction, ndi pretraining yachibadwa ya NVFP4. NVIDIA idasindikiza zitsanzo za SFT 50 miliyoni zophatikizidwa, ntchito za RL 2 miliyoni ndi malo a RL 55 pamodzi ndi zolemera — simuyenera kutenga mawu a kampani pa chimene mtunduwo unaphunzitsidwa, chifukwa zinthu za kuphunzitsira zingatsitsidwe.

03Chimene kapangidwe ka hybrid kachikugulirani

KV cache ya transformer imakula mwaulinganiro ndi kutalika kwa sequence, ndicho chifukwa chake inference ya context yayitali imakwera mtengo mu kukumbukira musanafike pa kuwerengera. Magawo a Mamba-2 ndi mitundu ya state-space yonyamula state yobwerezabwereza ya muyeso wokhazikika, choncho mtengo wawo wa kukumbukira pa token sukula ndi mbiri; chimene sizichita bwino ndi kukumbukira kolondola kogwirizana. Hybrid imasunga Mamba-2 pa gawo lalikulu la kukonza sequence kuphatikiza gawo laling'ono la magawo enieni a attention pa kukumbukira komwe magawo a state-space amalakwitsa, ndi chiyerekezo cholimba cha 64-query-head / 2-KV-head chochepetsa cache kupitirira. NVIDIA imanena 94.7% pa RULER pa ma token 1M — muyeso wa kutenga singano wopangidwa kuti ugwire mitundu yonena zenera imene singathe kuigwiritsa ntchito.

Chotsatira chake ndi throughput: NVIDIA imanena kukwera pafupifupi mpaka 6× throughput ya inference kuposa mitundu yofanana pa kulondola kofanana, ndipo Artificial Analysis idayeza modziyimira pawokha ma token 140.3 pa sekondi ndi nthawi ya sekondi 1.33 kufika pa token yoyamba — 7 mwa mitundu 89. Pa kuyenda kwa agent kwa kutembenuka 200, ndicho kusiyana pakati pa kumaliza masana ndi kusamaliza.

04Chimene "3BIT-REAP" chikutanthauza, mwachindunji

Chotsatira sichokongoletsera — chimakuuzani mwachindunji chimene chinachitikira maziko kuti akwane.

REAP — Router-weighted Expert Activation Pruning — imachokera ku Cerebras Research ndipo idavomerezedwa ku ICLR 2026. Mu MoE ya sparse, router imatumiza token iliyonse ku akatswiri ochepa; pa ntchito zenizeni ena amagwiritsidwa ntchito nthawi zonse ndipo ena pafupifupi ayi konse. REAP imayeza katswiri aliyense pa mfundo yophatikiza mmene router imamugwiritsira ntchito mwamphamvu ndi kukula kwa zopereka za zotulutsa zake, kenako imachotsa omwe ali otsika kwambiri kotheratu — Cerebras imanena kudula mpaka 50% ya akatswiri kuchokera ku mitundu yaikulu ngati ma parameter thililiyoni 1 pamene ikusungabe ubwino wachikale wambiri, ndipo imapeza kuti pa ntchito zopanga monga ma kodi, kudula kumaposa kuphatikiza. Quantization ya 3-bit kenako imafinya chimene chatsalira. Dulani poyamba, sandulani pachiwiri, choncho bajeti ya bit imapita ku akatswiri amene amanyamula magalimoto m'malo mofalikira pa amene afa.

Kufinya sikopanda mtengo, ndipo sitidzanamizira zosiyana: quantization yolimba imaonekera poyamba ngati kuipiraipira kaking'ono mu kutsatira mawonekedwe enieni ndi masamu a maunyolo aatali, osati ngati kusagwirizana koonekera. Kumene milingo itatuyo ikugwera:

Chotsatira	Chimene chili	Kumene timagwiritsira ntchito
3BIT-REAP	Zolemera za 3-bit + kudula akatswiri	Maziko akulu kwambiri, kumene palibe china chomwe chingakwane pa liwiro
W4A16-AUTOROUND-REAP	Zolemera za 4-bit / zogwira ntchito za 16-bit, kuzungulira kophunzitsidwa kwa AutoRound, + kudula	Maziko a pakati; AutoRound imabwezeretsa kulondola pa kuzungulira kwapafupi kosalongosoka
W8A16	Zolemera za 8-bit / zogwira ntchito za 16-bit	Kulondola kwapamwamba kwambiri; maziko aang'ono okwanira osafunikira kufinya kolimba

Nemotron 3 Ultra pa 550B ili mkati mokwanira mwa gulu loyamba. Ngati ntchito yanu ndi yodabwitsa kuvutika ndi zotulutsa zenizeni za manambala pa maunyolo aatali, mndandanda wa kafukufuku ukukhala ndi mlingo wa W8A16 — MiMo-V2.5-Pro-W8A16 ndi Hy3-W8A16 — pa pansi pa $0.50/$2.00. Kusinthana kwenikweni, osati chiwongolero: mtundu waung'ono, kufinya kochepa.

05Chimene "chosasidwa" chikutanthauza pa endpoint iyi

Mwachindunji: palibe wosanjikiza wa kukana ndipo palibe kusefa kwa zinthu kogwiritsidwa ntchito pa zotulutsa. Palibe chosankha chinthu chimene chimayang'ana prompt yanu ndikubweza kukana kokonzedwa kale, ndipo yankho silikuyang'aniridwa musanafike ku streaming yanu. Chimene mumapeza ndi khalidwe la mtunduwo lokha.

Apa ndipamene mzera wotseguka umasiya kukhala chinthu chopanda pake. Chifukwa NVIDIA idasindikiza data ya post-training ndi malo a RL, machitidwe a mtunduwo ndi oyeserezeka mwamfundo m'malo monena zopeka. Ndipo chifukwa OpenMDW-1.1 ndi chilolezo chololera cha Linux Foundation chokhudza kapangidwe, ma parameter, zolemba ndi pulogalamu, woyendetsa wodziyimira pawokha angathe kutumikira kutumizidwa kosinthidwa, kopanda chosefera pa zida zake zokha popanda chilolezocho kukhala chotchinga. Zilolezo zambiri za mitundu "yotseguka" sizilola izi. Ichi chimalola. Kusiyanaku kumaonekera kumene kukana kwachizolowezi ndi cholakwika, osati mphamvu ya chitetezo:

• Kafukufuku wa chitetezo — kusanthula zofooka, kulingalira za exploit, khalidwe la malware, zida za red-team, popanda kutsutsana ngati funsolo ndi lovomerezeka.
• Chemistry, biology ndi pharmacology — masamu a mlingo, njira za reaction, toxicology, njira za synthesis zomwe endpoint yosefedwa imakana pokhudzana ndi liwu lokha.
• Adversarial ML — hard negatives, ma corpora a jailbreak ndi taxonomies za kuzunza kwa zosankha zinthu zomwe zifunika kuona chinthu chenicheni.
• Malemba a zachipatala, zalamulo ndi umboni — zinthu za milandu zomwe zimasonyeza mwatsatanetsatane mwachibadwa ndipo zimakanidwa chifukwa cha chimenecho.

Kosasidwa sikutanthauza kusowa udindo. Zomwe mumapanga ndi zanu, ndipo Ndondomeko yathu ya Kagwiritsidwe Kaudindo ndi Mfundo za Ntchito zimayendetsa akaunti. Kuchotsa wosanjikiza wa kukana kumachotsa kupeka za cholinga; sikuchotsa maudindo anu pansi pa lamulo limene likukhudzani.

06STEM ndi kulingalira: chimene manambala osindikizidwa akunena

Chidwi cha kuphunzitsa cha Nemotron chakhala masamu, ma kodi, sayansi ndi kutsatira malangizo kuyambira pomwe dataset ya post-training ya Llama-Nemotron inamangidwa mozungulira zinthu zinayi zimenezo. Chimene NVIDIA amanena a maziko a Nemotron 3 Ultra — manambala onenedwa ndi kampani pa mtundu osafinyidwa, umene sitinawuyendetse:

Zochenjeza ziwiri ndi zofunika kuposa manambalawo. Nambala ya SWE-Bench Verified ndi gawo — NVIDIA imanena 65.0% mpaka 70.4% kutengera harness iti ya agent imene ikuyendetsa (Pi, OpenHands, Hermes, OpenCode, Mini SWE Agent), ndipo kufalikira kwa mfundo zisanu kuchokera ku scaffolding kokha kukusonyeza kuchuluka kwa manambala a agent amene amadalira harness m'malo mwa mtunduwo. Ndipo Artificial Analysis idaika Nemotron 3 Ultra pa 48 pa Intelligence Index yake, 9 mwa mitundu 89 — wamphamvu, osati wapamwamba kwambiri mu gululi, ndipo muyeso wawo wodziyimira pawokha ndiwo timene tikanauyeza kuposa slide iliyonse ya kampani.

Pa mbadwo woyambirira, pepala la Llama-Nemotron la NVIDIA limanena LN-Ultra pa 76.0% pa GPQA-Diamond poyerekeza ndi 71.5% ya DeepSeek-R1 ndi 43.4% ya Llama-3.1-405B-Instruct, kuphatikizapo 80.8% pa AIME 2024 — mtundu wosiyana, wophatikizidwa chifukwa sayansi ya mulingo wa graduate ndi masamu a mpikisano zakhala cholinga cha banjali kwa mibadwo iwiri.

Manambala a mayeso monga wasindikizidwa ndi NVIDIA (Juni 2026) pa Nemotron 3 Ultra yosafinyidwa, ndi Artificial Analysis pa miyeso yodziyimira pawokha. Kapangidwe kofinyidwa kangasiyane. Sitisindikiza manambala a mayeso amene sitinatsimikize kapena sitingatchule gwero lake.

07Mtengo, ndi chenjezo la kulankhula kwambiri

Pa $0.75 pa ma token miliyoni yolowa ndi $3.30 pa ma token miliyoni yotuluka, Nemotron3Ultra ili mu gawo lachitatu lotsika la katalogi yathu pa kulowa ndi pakati pa kutuluka. Zitsanzo zogwiritsidwa, chifukwa mtengo pa miliyoni ndi wovuta kumva:

Mawonekedwe a pempho	Kulowa	Kutuluka	Mtengo
Kutembenuka kwamba kwa RAG	50,000	4,000	$0.051
Kusanthula kwa chikalata chachitali	150,000	8,000	$0.139
Pempho la muyeso wapamwamba	262,144	16,384	$0.251

Pempho la context yonse, zotulutsa zonse — token iliyonse imene endpoint idzalandire ndi token iliyonse imene idzapange — limalipiritsa pafupifupi masenti 25. Mawonekedwe omwewo pa Kimi-K3-3BIT-REAP, mtundu wathu wokwera mtengo kwambiri pa $3.83/$19.12, umalipiritsa pafupifupi $1.32, kapena 5.3× mokulirapo.

Tsopano chenjezo, ndipo ndi lenileni. Artificial Analysis idayeza Nemotron 3 Ultra ikupanga ma token otuluka 2.3× ochulukirapo kuposa mnzake wapakati pa mayeso awo onse. Mitundu ya kulingalira imakulipiritsani kulingalira, ndipo iyi imalingalira kwambiri; phindu la mtengo pa token limasokonekera kukhala vuto la mtengo pa ntchito ngati mtunduwo umalingalira katatu mokulirapo kuti ufike pa yankho lomwelo. Njira yothandiza yamangidwa ndipo yasonyezedwa pa API yathu: Nemotron 3 idaphunzitsidwa post-training pa kuwongolera bajeti ya kulingalira, ndipo reasoning_effort imathandizidwa pano — NVIDIA imafotokoza njira ya khama lotsika yogwiritsa ntchito ma token ochepa kwambiri a kulingalira pa kusinthana kwa kulondola kwa mfundo imodzi. Pa kuika m'magulu, kutulutsa ndi kuyendetsa, muzimitseni ndipo chuma chimasintha kwenikweni; pa umboni kapena kusintha kwa mafayilo ambiri, mukweze ndipo mulipirire mwadala. Yezani ma token anu pa ntchito iliyonse m'malo mowerenga mndandanda wa mtengo ndikupeka.

08Kuyitana: zilankhulo zitatu, mtundu umodzi

Mtundu uliwonse pa gateway umayankha pa malo atatu a API a streaming, choncho mungathe kuloza kasitomala amene ali kale pa icho popanda kulembanso kaphatikizidwe kanu: /v1/chat/completions (chilankhulo cha OpenAI), /v1/messages (chilankhulo cha Anthropic), ndi /v1/responses.

curl https://api.shannon-ai.com/v1/chat/completions \
  -H "Authorization: Bearer $SHANNON_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "Nemotron3Ultra-3BIT-REAP",
    "reasoning_effort": "medium",
    "stream": true,
    "messages": [
      {"role": "user", "content": "Derive the worst-case cache behavior of this loop nest."}
    ]
  }'

Chidule cha mphamvu, kuti palibe chomwe chikudabwitsani pa nthawi ya kaphatikizidwe:

Mphamvu	Nemotron3Ultra · 3BIT-REAP
Zenera la context	ma token 262,144
Zotulutsa zapamwamba / pempho	ma token 16,384
Streaming	Inde
Kuyitanitsa zida	Inde
Njira za kulingalira	Inde
reasoning_effort	Inde
json_schema (yolimba)	Inde
response_format	Inde
Masomphenya / zolowetsa za zithunzi	Ayi — mawu okha
Wosanjikiza wa kukana	Palibe

Mzere wa masomphenya umagwira anthu: Nemotron3Ultra ndi ya mawu okha. Ngati pipeline yanu imatumiza zithunzi, gwiritsani ntchito MiniMax-M3-3BIT-REAP kapena MiMo-V2.5-W8A16 pa $0.50/$2.00, kapena Kimi-K2.6-W4A16-AUTOROUND-REAP pa $0.78/$3.67 — zonse zili ndi masomphenya, zonse zosasidwa, zonse pa context yomweyo ya ma token 262,144. Buku lonse la ma parameter lili mu zolemba za API.

09Kumene Nemotron3Ultra ikukwana pakati pa khumi ndi ziwiri

Katalogi ndi mitundu khumi ndi iwiri yosasidwa yogawana zenera lomwelo la context, zilankhulo zomwezo zitatu ndi kusowa komweko kwa wosanjikiza wa kukana; zimasiyana pa maziko, mtengo ndi mphamvu. Malo a Nemotron ndi enieni: wogwira ntchito zamba za kulingalira wa mzera wotseguka — osati wotsika mtengo kwambiri, osati wamphamvu kwambiri, koma amene ali ndi mbiri yambiri yapoyera kumbuyo kwa khalidwe lake, wokonzedwa kwambiri ku STEM ndi ma agent.

Mtundu	Kulowa / 1M	Kutuluka / 1M	Masomphenya	Sankhani kwa
MiniMax-M3 · 3BIT-REAP	$0.50	$2.00	Inde	Njira yotsika mtengo kwambiri ya masomphenya
MiMo-V2.5-Pro · W8A16	$0.50	$2.00	Ayi	Mlingo wapamwamba kwambiri wa kulondola kwa quantization
GLM-5.2 · 3BIT-REAP	$0.73	$2.34	Ayi	Kulingalira kwa maziko akulu kotsika mtengo kwambiri
Nemotron3Ultra · 3BIT-REAP	$0.75	$3.30	Ayi	STEM, ma agent, mzera wotseguka
Kimi-K2.6 · W4A16-AUTOROUND-REAP	$0.78	$3.67	Inde	Masomphenya + kulondola kwa AutoRound
DeepSeek-V4-Pro · 3BIT-REAP	$1.95	$3.90	Ayi	Kusanthula kwakuya kwa mwayi umodzi
Kimi-K3 · 3BIT-REAP	$3.83	$19.12	Inde	Malire apamwamba kwambiri a mphamvu

Zisanu ndi ziwiri mwa khumi ndi ziwiri zasonyezedwa. Katalogi yonse — kuphatikizapo Laguna-S-2.1, inkling, DeepSeek-V4-Flash, MiMo-V2.5 ndi Hy3 — ili mu zolemba za API. Dziwani kuti Laguna-S-2.1 sichithandizira zotulutsa zokonzedwa ndipo inkling sichithandizira json_schema; Nemotron3Ultra imathandizira zonse ziwiri.

Woyandikana naye kwambiri pa mtengo ndi GLM-5.2-3BIT-REAP pa $0.73/$2.34, ndipo kuyerekeza koona ndi kuti: GLM-5.2 ndi yotsika mtengo pa token, makamaka pa kutuluka. Nemotron imabweretsa corpus ya kuphunzitsa yosindikizidwa, chosinthira chomveka bwino cha bajeti ya kulingalira, ndi mbiri ya banja yolunjika ku sayansi ya mulingo wa graduate. Kulingalira kwamba kwakukulu: yendetsani yotsika mtengo. Ntchito zolemera za STEM, za agent, kapena zomwe zikufuna kuwunika kumene kumafunsa kuti khalidwe la mtunduwo linachokera kuti: Nemotron imayenera kusiyanako.

10Mafunso Ofunsidwa Kawirikawiri

---

Magwero: NVIDIA — lipoti la ukadaulo la Nemotron 3 Ultra · Blog ya opanga ya NVIDIA (Juni 2026) · Zolemba za kapangidwe ka Nemotron 3 Super · Llama-Nemotron: Efficient Reasoning Models · Cerebras Research, REAP. Manambala a mayeso a maziko ndi onenedwa ndi NVIDIA pa mtundu osafinyidwa kupatula pamene atchulidwa kuti ndi a Artificial Analysis; kapangidwe kofinyidwa kangasiyane. Mitengo ndi mphamvu ndizapano kuyambira 5 Seputembala 2026.