← All models
Meta logo

Llama 3.1 8B Instruct

Chat

meta:llama-3.1-8b-instruct

Added July 23, 2024

Usage

import OpenAI from "openai";

const client = new OpenAI({
    baseURL: "https://api.tributary.cc/openai/v1",
    apiKey: "<TRIBUTARY_API_KEY>",
});

const completion = await client.chat.completions.create({
    model: "meta:llama-3.1-8b-instruct",
    messages: [
        { role: "user", content: "Hello!" }
    ],
});

console.log(completion.choices[0].message.content);

Providers

Provider Model Context Output Input $/M Output $/M
DeepInfra meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo 131K 131K $0.02 $0.03
DeepInfra meta-llama/Meta-Llama-3.1-8B-Instruct 131K 131K $0.02 $0.05
Novita meta-llama/llama-3.1-8b-instruct 16K 16K $0.02 $0.05
Nebius meta-llama/Meta-Llama-3.1-8B-Instruct 131K 4K $0.02 $0.06
Nebius meta-llama/Meta-Llama-3.1-8B-Instruct-fast 131K 4K $0.03 $0.09
Cerebras llama3.1-8b 33K 8K $0.10 $0.10
Context/output in tokens. Prices in USD per 1M tokens.