ReasoningDenseContext: 125K
Qwen 2.5 72B Instruct
Comprehensive deployment profile and benchmark telemetry for Qwen 2.5 72B Instruct. Self-hosting memory footprints, verified token economics, and direct API endpoints.
Verified Engineering Benchmarks
SWE-bench
49.2%
LiveCodeBench
61.6%
MATH-500
94%
MMLU
90%
VRAM Requirements & Sizing
🔗 Quick Actions
🖥️ Compatible GPUs & Self-Host Pricing
Deterministic VRAM math from entity graph. Green = fits in single GPU.
| GPU | VRAM | FP16 | FP8 | INT4 | Calculator Link |
|---|---|---|---|---|---|
| H100 SXM5 | 80 GB | OOM | OOM | ✓ fits | Pre-filled → |
| H200 | 141 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| B200 | 192 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| A100 80GB | 80 GB | OOM | OOM | ✓ fits | Pre-filled → |
| L40S | 48 GB | OOM | OOM | ✓ fits | Pre-filled → |
| RTX 4090 | 24 GB | OOM | OOM | OOM | Pre-filled → |
⚡ Verified Free API Available
Active API Providers & Free Tiers
| Provider | Input / 1M | Output / 1M | Speed | Free Tier Status |
|---|---|---|---|---|
| DeepInfra | $0.35 | $0.40 | 50 tok/s | Paid API Only |
| Together AI | $0.90 | $0.90 | 40 tok/s | Paid API Only |
| OpenRouter | $0.40 | $0.50 | 45 tok/s | Paid API Only |
OpenAI SDK Drop-in
import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://api.deepinfra.com/v1",
apiKey: process.env.DEEPINFRA_API_KEY,
});
const response = await client.chat.completions.create({
model: "qwen-2.5-72b",
messages: [{ role: "user", content: "Hello" }],
});