Skip to main content

Use EigenAI

Get Access​

EigenAI is available on request. To get access, please contact us.

We currently support the gpt-oss-120b-f16 and qwen3-32b-128k-bf16 models, and are expanding from there. To request access or inquire about additional models, please contact us.

Chat Completions API Reference​

Refer to the swagger documentation for the EigenAI API.

Chat Completions API Examples​

$ curl -X POST https://eigenai-sepolia.eigencloud.xyz/v1/chat/completions \
-H "X-API-Key: <api-key>" \
-H "Content-Type: application/json" \
-d '{
  "model": "gpt-oss-120b-f16",
  "max_tokens": 120,
  "seed": 42,
  "messages": [{"role": "user", "content": "Write a story about programming"}]
}' | jq

OpenAI Client usage​

Step 1​

from openai import OpenAI

client = OpenAI(
    base_url="https://eigenai.eigencloud.xyz/v1",
    default_headers={"x-api-key": api_key},
)

tools: List[Dict[str, Any]] = [
    {
        "type": "function",
        "function": {
            "name": "get_current_weather",
            "description": "Get the current weather in a given location",
            "parameters": {
                "type": "object",
                "properties": {
                    "location": {
                        "type": "string",
                        "description": "The city and state, e.g. San Francisco, CA",
                    },
                    "unit": {
                        "type": "string",
                        "enum": ["celsius", "fahrenheit"],
                    },
                },
                "required": ["location"],
            },
        },
    }
]

step1 = client.chat.completions.create(
    model=model,
    messages=[{"role": "user", "content": "What is the weather like in Boston today?"}],
    tools=tools,
    tool_choice="auto",
)

Step 2​

messages_step2: List[Dict[str, Any]] = [
    {"role": "user", "content": "What is the weather like in Boston today?"},
    {
        "role": "assistant",
        "content": None,
        "tool_calls": [
            {
                "id": tool_call_id,
                "type": "function",
                "function": {
                    "name": "get_current_weather",
                    "arguments": json.dumps({"location": "Boston, MA", "unit": "fahrenheit"}),
                },
            }
        ],
    },
    {"role": "tool", "tool_call_id": tool_call_id, "content": "58 degrees"},
    {"role": "user", "content": "Do I need a sweater for this weather?"},
]

step2 = client.chat.completions.create(model=model, messages=messages_step2)