HostYourAI
Get Started
Model garden

Qwen3 0.6B FP8

Instantly via the EU router or as a dedicated GPU deployment. Data stays in Europe.

Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities,...

Start for free ← All models
Qwen/Qwen3-0.6B-FP8 vLLM ready
text->text · Qwen · EU-hosted
0.8B
Parameters
41K
Context window
8GB
Minimum VRAM
POST /api/v1/chat/completions200 OK

Specifications

Parameters 0.8B
Context window 40,960 tokens
Minimum VRAM 8 GB
Architecture Qwen3ForCausalLM (vLLM)
License apache-2.0
Modality text->text
Released April 2025
Publisher Qwen ↗

Pricing

€0.03
Input (per 1M tokens)
€0.06
Output (per 1M tokens)

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly — see pricing.

✓ Verified working on 28-06-2026 — responded in 821 ms on our EU infrastructure.

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "Qwen/Qwen3-0.6B-FP8",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run Qwen3 0.6B FP8 in the EU?

Yes. HostYourAI runs Qwen3 0.6B FP8 on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting Qwen3 0.6B FP8 GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does Qwen3 0.6B FP8 cost?

Via the shared EU router you pay €0.03 per million input tokens and €0.06 per million output tokens, with no fixed costs. For high volume or isolation you can also run Qwen3 0.6B FP8 as a dedicated hourly GPU instance.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from Qwen

Qwen3.6 27B FP8

[!Note] This repository contains FP8-quantized model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc. The quantization method is fine-grained fp8 quantization with block size of 128, and its performance metrics are nearly identical to those of the original model.

28B View model →
Qwen3.6 27B

[!Note] This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc.

28B View model →
Qwen3.6 35B A3B FP8

[!Note] This repository contains FP8-quantized model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc. The quantization method is fine-grained fp8 quantization with block size of 128, and its performance metrics are nearly identical to those of the original model.

36B View model →
Qwen3.6 35B A3B

[!Note] This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc.

36B View model →
Qwen3.5 35B A3B GPTQ Int4

[!Note] This repository contains int4-quantized model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc.

36B View model →
Qwen3.5 27B GPTQ Int4

[!Note] This repository contains int4-quantized model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc.

28B View model →

Try Qwen3 0.6B FP8 for free

Creating an account takes a minute. Test Qwen3 0.6B FP8 straight away in the playground.

Start for free