Li-endpoint tse ngotsoeng, Tor le I2P

Li-base URL

Liaterese tse nne li isa ho API e le 'ngoe. Sebelisa e loketseng marang-rang a hau, ka senotlolo sa API se tšoanang le likopo tse tšoanang.

• SDK ea OpenAI e nka base URL joalo ka ha e bontšitsoe, e nang le /v1. SDK ea Anthropic e e nka ntle le /v1.
• Ho hlahloba aterese, bala li-header tsa karabo tsa https://api.shannon-ai.com: Onion-Location e nka aterese ea onion mme X-I2P-Location e nka aterese ea I2P. Aterese ea onion e qala ka shannon.

Litsela life tse sebetsang

Tsela e 'ngoe le e 'ngoe ea /v1 e araba ho liaterese tsohle tse nne:

• POST /v1/chat/completions
• POST /v1/responses
• POST /v1/messages
• POST /v1/messages/count_tokens
• POST /v1/tokenize
• GET /v1/models

GET /v1/models ha e hloke senotlolo, e leng e etsang hore e be teko e potlakileng ea hore proxy ea hau e fihla ho API.

Se tšoanang le se fapaneng

Balance le meeli li hlalositsoe leqepheng la tsona. Meeli le balance

cURL ka Tor

Tsamaisa Tor client mochining oa hau. E fana ka SOCKS5 proxy ho 127.0.0.1:9050. --socks5-hostname e fa proxy eo lebitso la .onion.

# 1. Is the onion service reachable? No key needed.
curl --socks5-hostname 127.0.0.1:9050 http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion/v1/models

# 2. A streamed chat call. -N prints the stream as it arrives.
curl -N --socks5-hostname 127.0.0.1:9050 http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "shannon-3",
    "stream": true,
    "messages": [{"role": "user", "content": "Hello over Tor"}]
  }'

cURL ka I2P

Tsamaisa I2P router mochining oa hau. E fana ka HTTP proxy ho 127.0.0.1:4444, e amohelang lebitso la .b32.i2p joalo ka ha le le.

# 1. Is the eepsite reachable? No key needed.
curl --proxy http://127.0.0.1:4444 http://acvnvkdea4xaczzjap7chysqqi4kkvp2eorfwkasindzmjpa47da.b32.i2p/v1/models

# 2. A streamed chat call.
curl -N --proxy http://127.0.0.1:4444 http://acvnvkdea4xaczzjap7chysqqi4kkvp2eorfwkasindzmjpa47da.b32.i2p/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "shannon-3",
    "stream": true,
    "messages": [{"role": "user", "content": "Hello over I2P"}]
  }'

Base URL ea SDK

SDK e hloka liphetoho tse peli: base URL ea marang-rang, le HTTP client e fetang proxy. Ho Python li-SDK ka bobeli tsa semmuso li amohela httpx client. Bakeng sa SOCKS proxy install httpx[socks].

# pip install openai "httpx[socks]"
import httpx
from openai import OpenAI

client = OpenAI(
    api_key="YOUR_API_KEY",
    base_url="http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion/v1",
    http_client=httpx.Client(proxy="socks5h://127.0.0.1:9050", timeout=600),
)

stream = client.chat.completions.create(
    model="shannon-3",
    messages=[{"role": "user", "content": "Hello over Tor"}],
    stream=True,
)
for chunk in stream:
    if chunk.choices and chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="", flush=True)

# pip install openai
import httpx
from openai import OpenAI

client = OpenAI(
    api_key="YOUR_API_KEY",
    base_url="http://acvnvkdea4xaczzjap7chysqqi4kkvp2eorfwkasindzmjpa47da.b32.i2p/v1",
    http_client=httpx.Client(proxy="http://127.0.0.1:4444", timeout=600),
)

stream = client.chat.completions.create(
    model="shannon-3",
    messages=[{"role": "user", "content": "Hello over I2P"}],
    stream=True,
)
for chunk in stream:
    if chunk.choices and chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="", flush=True)

# pip install anthropic "httpx[socks]"
import anthropic
import httpx

client = anthropic.Anthropic(
    api_key="YOUR_API_KEY",
    base_url="http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion",
    http_client=httpx.Client(proxy="socks5h://127.0.0.1:9050", timeout=600),
)

with client.messages.stream(
    model="shannon-1.6-lite",
    max_tokens=1024,
    messages=[{"role": "user", "content": "Hello over Tor"}],
) as stream:
    for text in stream.text_stream:
        print(text, end="", flush=True)

Streaming le keep-alive ho likhokahano tse liehang

Streaming e sebetsa ho marang-rang ka bobeli. Ha stream e bulehile mme model e se na letho la ho romela, API e romela keep-alive, e le hore connection e se shebahale e shoele ho proxy kapa ho client ea hau.

• Romela "stream": true. Karabo ea streaming e qala ho fihla hang ha model e ngola, mme keep-alive e bontša hore kopo e ntse e sebetsoa. Karabo e se nang streaming ha e romele letho ho fihlela karabo eohle e loketse.
• Fa client read timeout e telele. Mehlala e sebelisa metsotsoana e 600. Timeout e khutšoanyane ho feta metsotsoana e 15 e ka felisa stream pakeng tsa li-keep-alive tse peli.
• Lumella SSE reader ea hau hore e tlole mela ea maikutlo le li-event tsa ping. Li-SDK li se li etsa sena.
• U se ke ua romela kopo hape hang ha connection e khaoha. Kopo e fihletseng API e tsoela pele ho fihlela qetellong mme e baloa, esita le ha connection e ile.
• Leka tsela ka GET /v1/models pele. Ha e hloke senotlolo mme e khutlisa lenane le lekhutšoanyane la JSON.

Mathata a connection

Phoso e 'ngoe le e 'ngoe e tšoana le ea clear web. Diphoso

Senotlolo sa hau ntle le JavaScript

Shannon e boetse e na le webosaete ntle le JavaScript, e fumanehang ho clear web, e le onion service le e le eepsite. Leqephe la eona la /keys le bontša senotlolo sa hau sa API mme le u lumella ho se fetola, kahoo u ka fumana senotlolo ntle le ho tsoa ho Tor kapa I2P. encrypted.shannon-ai.com/keys

Liaterese tsa webosaete eo marang-rang a mararo kaofela li thathamisitsoe mona: Phihlello e ngotsoeng