llama 3.1 8b instruct fp8

llama 3.1 8b instruct fp8 specifications

llama 3.1 8b instruct fp8 pricing in rubles

You pay for what you use, per token and per unit. The final request cost is returned in the API response.

Prices are in rubles and may change with exchange rates.

What llama 3.1 8b instruct fp8 can do

• Function calling
• Streaming responses

llama 3.1 8b instruct fp8 API: connection and code examples

The service exposes a single OpenAI-compatible API. Set our base_url and the key from your dashboard.

from openai import OpenAI

client = OpenAI(
    api_key="YOUR_API_KEY",
    base_url="https://api.neuralbridge.ru/v1",
)

response = client.chat.completions.create(
    model="meta-llama/llama-3.1-8b-instruct-fp8-08130",
    messages=[{"role": "user", "content": "Привет! Расскажи о себе."}],
)

print(response.choices[0].message.content)

import requests

response = requests.post(
    "https://api.neuralbridge.ru/v1/chat/completions",
    headers={"Authorization": "Bearer YOUR_API_KEY"},
    json={
        "model": "meta-llama/llama-3.1-8b-instruct-fp8-08130",
        "messages": [{"role": "user", "content": "Привет! Расскажи о себе."}],
    },
)

print(response.json()["choices"][0]["message"]["content"])

curl https://api.neuralbridge.ru/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.1-8b-instruct-fp8-08130",
    "messages": [{"role": "user", "content": "Привет! Расскажи о себе."}]
  }'

API endpoints

Supported request parameters