ReasoningDenseContext: 125K
DeepSeek R1 Distill 70B
Comprehensive deployment profile and benchmark telemetry for DeepSeek R1 Distill 70B. Self-hosting memory footprints, verified token economics, and direct API endpoints.
Verified Engineering Benchmarks
SWE-bench
49.2%
LiveCodeBench
60.1%
MATH-500
92.5%
MMLU
88%
VRAM Requirements & Sizing
🔗 Quick Actions
🖥️ Compatible GPUs & Self-Host Pricing
Deterministic VRAM math from entity graph. Green = fits in single GPU.
| GPU | VRAM | FP16 | FP8 | INT4 | Calculator Link |
|---|---|---|---|---|---|
| H100 SXM5 | 80 GB | OOM | OOM | ✓ fits | Pre-filled → |
| H200 | 141 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| B200 | 192 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| A100 80GB | 80 GB | OOM | OOM | ✓ fits | Pre-filled → |
| L40S | 48 GB | OOM | OOM | ✓ fits | Pre-filled → |
| RTX 4090 | 24 GB | OOM | OOM | OOM | Pre-filled → |
Active API Providers & Free Tiers
| Provider | Input / 1M | Output / 1M | Speed | Free Tier Status |
|---|---|---|---|---|
| Together AI | $0.55 | $2.19 | 40 tok/s | Paid API Only |
| OpenRouter | $0.60 | $2.40 | 35 tok/s | Paid API Only |
| DeepInfra | $0.35 | $1.40 | 38 tok/s | Paid API Only |
| Cloudflare Workers AI | $0.01 | $0.01 | 100 tok/s | Paid API Only |
OpenAI SDK Drop-in
import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://api.together.xyz/v1",
apiKey: process.env.TOGETHER_AI_API_KEY,
});
const response = await client.chat.completions.create({
model: "deepseek-r1-distill-llama-70b",
messages: [{ role: "user", content: "Hello" }],
});