GeneralDenseContext: 8K
Gemma 2 27B
Comprehensive deployment profile and benchmark telemetry for Gemma 2 27B. Self-hosting memory footprints, verified token economics, and direct API endpoints.
Verified Engineering Benchmarks
SWE-bench
49.2%
LiveCodeBench
65.9%
MATH-500
97.3%
MMLU
90.8%
VRAM Requirements & Sizing
🔗 Quick Actions
🖥️ Compatible GPUs & Self-Host Pricing
Deterministic VRAM math from entity graph. Green = fits in single GPU.
| GPU | VRAM | FP16 | FP8 | INT4 | Calculator Link |
|---|---|---|---|---|---|
| H100 SXM5 | 80 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| H200 | 141 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| B200 | 192 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| A100 80GB | 80 GB | ✓ fits | ✓ fits | ✓ fits | Pre-filled → |
| L40S | 48 GB | OOM | ✓ fits | ✓ fits | Pre-filled → |
| RTX 4090 | 24 GB | OOM | OOM | ✓ fits | Pre-filled → |
Active API Providers & Free Tiers
| Provider | Input / 1M | Output / 1M | Speed | Free Tier Status |
|---|---|---|---|---|
| Groq | $0.10 | $0.10 | 250 tok/s | ⚡ 30 RPM / 14,400 RPD |
| DeepInfra | $0.10 | $0.10 | 70 tok/s | Paid API Only |
| OpenRouter | $0.10 | $0.10 | 80 tok/s | Paid API Only |
OpenAI SDK Drop-in
import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://api.groq.com/openai/v1",
apiKey: process.env.GROQ_API_KEY,
});
const response = await client.chat.completions.create({
model: "gemma-2-27b",
messages: [{ role: "user", content: "Hello" }],
});