MODEL INFERENCE API
More models. One API.
Connect language, image, speech, and retrieval models through an OpenAI-compatible interface. Focus on your product, with less infrastructure to manage.
Get an API keyOPEN MODELS. REAL POSSIBILITIES.
The right model for your next idea.
From conversations to images, speech, and search. Find the model for your workload and connect it through one API.
BUILT FOR YOUR STACK
Familiar code. New possibilities.
Connect your familiar OpenAI SDK to the GIGACOMMA Model API. Use the connection setup and a console-issued key to get started in your existing applications.
Expand connection setup and run the preparation commands first. Then save and run the Python or cURL example.
Connection setup & preparationActual API address, model ID, and environment variables
- API address
https://api.ecohash.com/v1- API model ID
llama-3.1-8b-instruct
Replace YOUR_API_KEY with the full inference API key issued in the console. Run setup in macOS/Linux or a compatible shell. JSON cURL examples use the Python standard library to build the request body.
python -m pip install openai
export GIGACOMMA_API_BASE_URL='https://api.ecohash.com/v1'
export GIGACOMMA_MODEL_ID='llama-3.1-8b-instruct'
export GIGACOMMA_API_KEY="YOUR_API_KEY"GIGACOMMA_API_KEY is the environment variable name. Its value is an inference API key from the console, not an OpenAI API key. Get an API key
import osfrom openai import OpenAIMODEL_ID = os.environ["GIGACOMMA_MODEL_ID"]client = OpenAI( base_url=os.environ["GIGACOMMA_API_BASE_URL"], api_key=os.environ["GIGACOMMA_API_KEY"],)response = client.chat.completions.create( model=MODEL_ID, messages=[{"role": "user", "content": "Hello!"}], max_tokens=256,)print(response.choices[0].message.content)GOOD TO KNOW
A few things before you start.
What is the difference between GPU Cloud and Model API?
GPU Cloud gives you dedicated GPU resources to run your own models and software. Model API lets you call available models without managing infrastructure. Choose either, or use both to suit your workload.
Can I use my existing OpenAI SDK?
Yes. We provide an OpenAI-compatible endpoint. Configure the API URL, your API key, and the model ID. Check the developer documentation for each model’s supported capabilities and request format.
Where can I find pricing?
The pricing page shows current GPU and model API rates. Check the console for final charges and available configurations. Prices are displayed in USD.
Can I launch a GPU on this website?
This is the official website for exploring products and models. GPU launch, API key creation, billing, and account management are available in the console.
COMPUTE WITHOUT BOUNDARIES
Your next AI. Starts with GIGACOMMA.
Start something bigger with the compute you need.