Endpoint zilizosimbwa, Tor na I2P

Base URL

Anwani nne zinaelekea kwenye API ile ile. Tumia ile inayofaa mtandao wako, na API key ile ile na maombi yale yale.

• SDK ya OpenAI inapokea base URL kama inavyoonyeshwa, pamoja na /v1. SDK ya Anthropic inaipokea bila /v1.
• Ili kukagua anwani, soma headers za jibu za https://api.shannon-ai.com: Onion-Location hubeba anwani ya onion na X-I2P-Location anwani ya I2P. Anwani ya onion huanza na shannon.

Routes zipi zinafanya kazi

Kila route ya /v1 hujibu kwenye anwani zote nne:

• POST /v1/chat/completions
• POST /v1/responses
• POST /v1/messages
• POST /v1/messages/count_tokens
• POST /v1/tokenize
• GET /v1/models

GET /v1/models haihitaji key, jambo linaloifanya jaribio la haraka kwamba proxy yako inafikia API.

Nini ni sawa na nini kinatofautiana

Salio na mipaka vimeelezwa kwenye ukurasa wake. Mipaka na salio

cURL kupitia Tor

Endesha Tor client kwenye kompyuta yako. Inatoa SOCKS5 proxy kwenye 127.0.0.1:9050. --socks5-hostname huipa proxy hiyo jina la .onion.

# 1. Is the onion service reachable? No key needed.
curl --socks5-hostname 127.0.0.1:9050 http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion/v1/models

# 2. A streamed chat call. -N prints the stream as it arrives.
curl -N --socks5-hostname 127.0.0.1:9050 http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "shannon-3",
    "stream": true,
    "messages": [{"role": "user", "content": "Hello over Tor"}]
  }'

cURL kupitia I2P

Endesha I2P router kwenye kompyuta yako. Inatoa HTTP proxy kwenye 127.0.0.1:4444, ambayo inapokea jina la .b32.i2p kama lilivyo.

# 1. Is the eepsite reachable? No key needed.
curl --proxy http://127.0.0.1:4444 http://acvnvkdea4xaczzjap7chysqqi4kkvp2eorfwkasindzmjpa47da.b32.i2p/v1/models

# 2. A streamed chat call.
curl -N --proxy http://127.0.0.1:4444 http://acvnvkdea4xaczzjap7chysqqi4kkvp2eorfwkasindzmjpa47da.b32.i2p/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "shannon-3",
    "stream": true,
    "messages": [{"role": "user", "content": "Hello over I2P"}]
  }'

Base URL ya SDK

SDK inahitaji mabadiliko mawili: base URL ya mtandao, na HTTP client inayopita kwenye proxy. Kwenye Python SDK zote mbili rasmi zinakubali httpx client. Kwa SOCKS proxy sakinisha httpx[socks].

# pip install openai "httpx[socks]"
import httpx
from openai import OpenAI

client = OpenAI(
    api_key="YOUR_API_KEY",
    base_url="http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion/v1",
    http_client=httpx.Client(proxy="socks5h://127.0.0.1:9050", timeout=600),
)

stream = client.chat.completions.create(
    model="shannon-3",
    messages=[{"role": "user", "content": "Hello over Tor"}],
    stream=True,
)
for chunk in stream:
    if chunk.choices and chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="", flush=True)

# pip install openai
import httpx
from openai import OpenAI

client = OpenAI(
    api_key="YOUR_API_KEY",
    base_url="http://acvnvkdea4xaczzjap7chysqqi4kkvp2eorfwkasindzmjpa47da.b32.i2p/v1",
    http_client=httpx.Client(proxy="http://127.0.0.1:4444", timeout=600),
)

stream = client.chat.completions.create(
    model="shannon-3",
    messages=[{"role": "user", "content": "Hello over I2P"}],
    stream=True,
)
for chunk in stream:
    if chunk.choices and chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="", flush=True)

# pip install anthropic "httpx[socks]"
import anthropic
import httpx

client = anthropic.Anthropic(
    api_key="YOUR_API_KEY",
    base_url="http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion",
    http_client=httpx.Client(proxy="socks5h://127.0.0.1:9050", timeout=600),
)

with client.messages.stream(
    model="shannon-1.6-lite",
    max_tokens=1024,
    messages=[{"role": "user", "content": "Hello over Tor"}],
) as stream:
    for text in stream.text_stream:
        print(text, end="", flush=True)

Streaming na keep-alive kwenye viungo vya polepole

Streaming inafanya kazi kwenye mitandao yote miwili. Stream ikiwa wazi na model haina cha kutuma bado, API hutuma keep-alive, ili muunganisho usionekane umekufa kwa proxy au kwa client yako.

• Tuma "stream": true. Jibu la stream huanza kufika mara model inapoandika, na keep-alive inaonyesha kwamba ombi bado linashughulikiwa. Jibu lisilo la stream halitumi chochote hadi jibu zima liwe tayari.
• Ipe client read timeout ndefu. Mifano inatumia sekunde 600. Timeout fupi kuliko sekunde 15 inaweza kukatisha stream kati ya keep-alives mbili.
• Acha SSE reader yako iruke mistari ya maoni na matukio ya ping. SDK tayari hufanya hivyo.
• Usitume tena ombi mara muunganisho unapokatika. Ombi lililofika kwenye API huendelea hadi mwisho na huhesabiwa, hata muunganisho ukiwa umepotea.
• Jaribu njia kwanza kwa GET /v1/models. Haihitaji key na hurudisha orodha fupi ya JSON.

Matatizo ya muunganisho

Kila kosa lingine ni lile lile kama kwenye clear web. Ushughulikiaji wa Makosa

Key yako bila JavaScript

Shannon pia ina tovuti isiyo na JavaScript, inayopatikana kwenye clear web, kama onion service na kama eepsite. Ukurasa wake wa /keys unaonyesha API key yako na kukuruhusu kuibadilisha, kwa hiyo unaweza kupata key bila kuondoka Tor au I2P. encrypted.shannon-ai.com/keys

Anwani za tovuti hiyo kwenye mitandao yote mitatu zimeorodheshwa hapa: Ufikiaji uliosimbwa