Llama 3.1 70B Instruct

meta/llama-3.1-70b

A chat model with a 128K-token context window, at $0.756 per million input tokens and $0.756 per million output tokens.

Details

Maker: meta
Kind: Chat
Context window: 128,000 tokens
Max output: 8,192 tokens
Input: $0.756 per million tokens
Output: $0.756 per million tokens
Capabilities: Tool use
Takes: Text
Returns: Text
Zero data retention: Yes, on every provider
No training on requests: Yes, on every provider
Released: 2024-07-23
Newer model: meta/muse-spark-1.3-contributorReleased later by the same maker, costs no more, and lists the same capabilities. Compare the two

Description

An update to Meta Llama 3 70B Instruct that includes an expanded 128K context length, multilinguality and improved reasoning capabilities.

Call it

curl

curl https://phantom.codes/v1/chat/completions \
  -H "Authorization: Bearer $PHANTOM_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta/llama-3.1-70b",
    "messages": [
      {"role": "user", "content": "Hello"}
    ]
  }'

Set PHANTOM_KEY to your key. Any OpenAI client works with the base URL https://phantom.codes/v1.

Get a key Compare with another model