Endpoints masu ɓoyewa, Tor & I2P

Base URLs

Adireshi huɗu suna kai wa API iri ɗaya. Ku yi amfani da wanda ya dace da hanyar sadarwarku, da API key iri ɗaya da requests iri ɗaya.

• OpenAI SDK yana ɗaukar base URL yadda aka nuna, da /v1. Anthropic SDK yana ɗaukarsa ba tare da /v1 ba.
• Don tabbatar da adireshi, ku karanta headers na amsar https://api.shannon-ai.com: Onion-Location yana ɗauke da adireshin onion kuma X-I2P-Location adireshin I2P. Adireshin onion yana farawa da shannon.

Wane routes ke aiki

Kowane route na /v1 yana amsawa a dukkan adireshi huɗun:

• POST /v1/chat/completions
• POST /v1/responses
• POST /v1/messages
• POST /v1/messages/count_tokens
• POST /v1/tokenize
• GET /v1/models

GET /v1/models ba ya buƙatar maɓalli, wanda ya sa shi gwaji mai sauri cewa proxy ɗinku yana kaiwa API.

Abin da ke iri ɗaya da abin da ya bambanta

An bayyana balance da iyakoki a shafinsu na kansu. Iyakoki da balance

cURL ta Tor

Ku gudanar da Tor client a na'urarku. Yana bayar da SOCKS5 proxy a 127.0.0.1:9050. --socks5-hostname yana mika sunan .onion ga wannan proxy.

# 1. Is the onion service reachable? No key needed.
curl --socks5-hostname 127.0.0.1:9050 http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion/v1/models

# 2. A streamed chat call. -N prints the stream as it arrives.
curl -N --socks5-hostname 127.0.0.1:9050 http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "shannon-3",
    "stream": true,
    "messages": [{"role": "user", "content": "Hello over Tor"}]
  }'

cURL ta I2P

Ku gudanar da I2P router a na'urarku. Yana bayar da HTTP proxy a 127.0.0.1:4444, wanda ke ɗaukar sunan .b32.i2p yadda yake.

# 1. Is the eepsite reachable? No key needed.
curl --proxy http://127.0.0.1:4444 http://acvnvkdea4xaczzjap7chysqqi4kkvp2eorfwkasindzmjpa47da.b32.i2p/v1/models

# 2. A streamed chat call.
curl -N --proxy http://127.0.0.1:4444 http://acvnvkdea4xaczzjap7chysqqi4kkvp2eorfwkasindzmjpa47da.b32.i2p/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "shannon-3",
    "stream": true,
    "messages": [{"role": "user", "content": "Hello over I2P"}]
  }'

Base URL na SDK

SDK yana buƙatar canje-canje biyu: base URL na hanyar sadarwa, da HTTP client da ke bi ta proxy. A Python SDKs na hukuma biyun suna ɗaukar httpx client. Don SOCKS proxy ku shigar da httpx[socks].

# pip install openai "httpx[socks]"
import httpx
from openai import OpenAI

client = OpenAI(
    api_key="YOUR_API_KEY",
    base_url="http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion/v1",
    http_client=httpx.Client(proxy="socks5h://127.0.0.1:9050", timeout=600),
)

stream = client.chat.completions.create(
    model="shannon-3",
    messages=[{"role": "user", "content": "Hello over Tor"}],
    stream=True,
)
for chunk in stream:
    if chunk.choices and chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="", flush=True)

# pip install openai
import httpx
from openai import OpenAI

client = OpenAI(
    api_key="YOUR_API_KEY",
    base_url="http://acvnvkdea4xaczzjap7chysqqi4kkvp2eorfwkasindzmjpa47da.b32.i2p/v1",
    http_client=httpx.Client(proxy="http://127.0.0.1:4444", timeout=600),
)

stream = client.chat.completions.create(
    model="shannon-3",
    messages=[{"role": "user", "content": "Hello over I2P"}],
    stream=True,
)
for chunk in stream:
    if chunk.choices and chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="", flush=True)

# pip install anthropic "httpx[socks]"
import anthropic
import httpx

client = anthropic.Anthropic(
    api_key="YOUR_API_KEY",
    base_url="http://shannonmd773o5vxz75byha5rkea7nzr3srotw46uwythq3pjl6y4cad.onion",
    http_client=httpx.Client(proxy="socks5h://127.0.0.1:9050", timeout=600),
)

with client.messages.stream(
    model="shannon-1.6-lite",
    max_tokens=1024,
    messages=[{"role": "user", "content": "Hello over Tor"}],
) as stream:
    for text in stream.text_stream:
        print(text, end="", flush=True)

Streaming da keep-alive a haɗi masu jinkiri

Streaming yana aiki a hanyoyin sadarwa biyun. Yayin da stream ke buɗe kuma model bai da abin aikawa tukuna, API yana aika keep-alive, don haka haɗin ba ya zama kamar ya mutu ga proxy ko client ɗinku.

• Ku aika "stream": true. Amsa ta streaming tana fara isowa da zarar model ya rubuta, kuma keep-alive yana nuna cewa ana ci gaba da aiki a kan request. Amsa ba tare da streaming ba ba ta aika komai ba sai dukkan amsar ta shirya.
• Ku ba client read timeout mai tsawo. Samfuran suna amfani da daƙiƙa 600. Timeout da ya gaza daƙiƙa 15 na iya kawo ƙarshen stream tsakanin keep-alives biyu.
• Ku bar SSE reader ɗinku ya tsallake layukan sharhi da events na ping. SDKs suna yin haka tuni.
• Kada ku sake aika request da zarar haɗi ya katse. Request da ya isa API yana gudana har ƙarshe kuma ana ƙidaya shi, ko da haɗin ya tafi.
• Ku fara gwada hanyar da GET /v1/models. Ba ya buƙatar maɓalli kuma yana mayar da ɗan gajeren jerin JSON.

Matsalolin haɗi

Kowane sauran kuskure iri ɗaya ne da na clear web. Kuskuren Gudanarwa

Maɓallinku ba tare da JavaScript ba

Shannon yana kuma da gidan yanar gizo ba tare da JavaScript ba, wanda ake kaiwa gare shi a clear web, a matsayin onion service da kuma eepsite. Shafinsa na /keys yana nuna API key ɗinku kuma yana ba ku damar sauya shi, don haka kuna iya samun maɓalli ba tare da barin Tor ko I2P ba. encrypted.shannon-ai.com/keys

An lissafa adireshin wannan gidan yanar gizo a dukkan hanyoyin sadarwa uku a nan: Samun dama mai ɓoyewa