EdgeDenseContext: 125K
Qwen 2.5 7B Instruct
Comprehensive deployment profile and benchmark telemetry for Qwen 2.5 7B Instruct. Self-hosting memory footprints, verified token economics, and direct API endpoints.
Verified Engineering Benchmarks
SWE-bench
49.2%
LiveCodeBench
65.9%
MATH-500
97.3%
MMLU
90.8%
VRAM Requirements & Sizing
🔗 Quick Actions
🖥️ Compatible GPUs & Self-Host Pricing
Deterministic VRAM math from entity graph. Green = fits in single GPU.
| GPU | VRAM | FP16 | FP8 | INT4 | Calculator Link |
|---|---|---|---|---|---|
| H100 SXM5 | 80 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| H200 | 141 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| B200 | 192 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| A100 80GB | 80 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| L40S | 48 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| RTX 4090 | 24 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
Active API Providers & Free Tiers
| Provider | Input / 1M | Output / 1M | Speed | Free Tier Status |
|---|---|---|---|---|
| DeepInfra | $0.05 | $0.05 | 300 tok/s | Paid API Only |
| OpenRouter | $0.04 | $0.04 | 250 tok/s | ⚡ 20 RPM |
OpenAI SDK Drop-in
import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://api.deepinfra.com/v1",
apiKey: process.env.DEEPINFRA_API_KEY,
});
const response = await client.chat.completions.create({
model: "qwen-2.5-7b",
messages: [{ role: "user", content: "Hello" }],
});