HostYourAI
Get Started
Model garden

Llama 3.1 70B Instruct

Instantly via the EU router or as a dedicated GPU deployment. Data stays in Europe.

Llama 3.1 70B Instruct is an open-source language model from Meta with 71B parameters, hosted on EU GPUs via an OpenAI-compatible API.

Start for free ← All models
meta-llama/Llama-3.1-70B-Instruct vLLM ready
text->text · meta-llama · EU-hosted
71B
Parameters
—
Context window
163GB
Minimum VRAM
POST /api/v1/chat/completions200 OK

Specifications

Parameters 71B
Minimum VRAM 163 GB
Architecture LlamaForCausalLM (vLLM)
License llama3.1
Modality text->text
Released July 2024
Publisher meta-llama ↗

Pricing

€0.40
Input (per 1M tokens)
€0.60
Output (per 1M tokens)

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly — see pricing.

✓ Verified working on 23-06-2026 — responded in 127 ms on our EU infrastructure.

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/Llama-3.1-70B-Instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run Llama 3.1 70B Instruct in the EU?

Yes. HostYourAI runs Llama 3.1 70B Instruct on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting Llama 3.1 70B Instruct GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does Llama 3.1 70B Instruct cost?

Via the shared EU router you pay €0.40 per million input tokens and €0.60 per million output tokens, with no fixed costs. For high volume or isolation you can also run Llama 3.1 70B Instruct as a dedicated hourly GPU instance.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from Meta

Llama Guard 4 12B

Llama Guard 4 12B is an multimodal language model from Meta with 12B parameters, hosted on EU GPUs via an OpenAI-compatible API.

12B View model →
Llama 4 Maverick 17B 128E

Llama 4 Maverick 17B 128E is an multimodal language model from Meta with 402B parameters, hosted on EU GPUs via an OpenAI-compatible API.

402B View model →
Llama 4 Scout 17B 16E

Llama 4 Scout 17B 16E is an multimodal language model from Meta with 109B parameters, hosted on EU GPUs via an OpenAI-compatible API.

109B View model →
Llama 4 Scout 17B 16E Instruct

Llama 4 Scout 17B 16E Instruct is an multimodal language model from Meta with 109B parameters, hosted on EU GPUs via an OpenAI-compatible API.

109B View model →
Llama 4 Maverick 17B 128E Instruct

Llama 4 Maverick 17B 128E Instruct is an multimodal language model from Meta with 402B parameters, hosted on EU GPUs via an OpenAI-compatible API.

402B View model →
Llama 4 Maverick 17B 128E Instruct FP8

Llama 4 Maverick 17B 128E Instruct FP8 is an multimodal language model from Meta with 402B parameters, hosted on EU GPUs via an OpenAI-compatible API.

402B View model →

Try Llama 3.1 70B Instruct for free

Creating an account takes a minute. Test Llama 3.1 70B Instruct straight away in the playground.

Start for free