Published: August 4, 2026 | Reading time: 8 minutes
We ran the same prompt through two different models on the same GPU. One kept digging. One stopped at the surface. The numbers don't tell the whole story — but they do start it.
| GPU | AMD Radeon R9700 AI Pro (32GB VRAM, ROCm 7.2.4) |
| Runtime | llama.cpp (latest main, AMD FP4 backend) |
| Context | 65,536 tokens (single slot) |
| Task | Website evaluation: storyreserve.com |
| Framework | Hermes Agent (same prompt, same toolset) |
| Metric | Laguna XS 2.1 | Qwen 3.6 27B |
|---|---|---|
| Generation speed | 46 tok/s | 38 tok/s |
| VRAM used | ~27 GB | ~19 GB |
| Model size (Q4_K_M) | ~7.5 GB | ~16 GB |
| Context window | 65K | 65K |
| Load time (cold) | ~8s | ~12s |
Laguna is faster. Uses more VRAM for KV cache. Lighter model file. Quicker to warm up.
Here's what happened when both models were asked to evaluate storyreserve.com:
Total steps: 3. Total time: ~12 seconds. Clean. Fast. Incomplete.
/data/works.json (1.7MB catalog file)POST /api/submit is aliveTotal steps: 8+. Total time: ~25 seconds. Slower. Thorough. Actionable.
Same framework. Same tools. Same GPU. Different model behavior:
| Behavior | Laguna | Qwen |
|---|---|---|
| First action | Fetch homepage, summarize | Fetch homepage, probe structure |
| When tool returns data | Surface-level interpretation | Hunts for additional endpoints |
| On 404 error | Loops same failing call | Pivots to sitemap/alternative |
| Depth instinct | "Good enough" | "What else is there?" |
Laguna feels like a planner — efficient, structured, stops when the plan is complete. Qwen feels like a pragmatist — probing, adapting, keeps going until the job is actually done.
| Use case | Recommended | Why |
|---|---|---|
| Quick summary, first impression | Laguna | Fast, coherent, gets the gist |
| Website audit, security review | Qwen | Discovers hidden endpoints, counts real assets |
| Code review, multi-file analysis | Qwen | Cross-references, follows imports, finds edge cases |
| Chatbot, customer-facing Q&A | Laguna | Fast response, lower latency, friendlier tone |
| Data extraction, catalog processing | Qwen | Handles large JSON, structured counting, validation |
Both models run on AMD's ROCm stack — not CUDA. The R9700 AI Pro is a 32GB card with dedicated AI acceleration, and llama.cpp's AMD FP4 backend gives us competitive performance without the NVIDIA tax.
Key ROCm-specific notes:
We don't need dual GPUs. One 32GB Radeon handles 65K context with room to spare — something two RTX 3060s (12GB each) can't match without splitting layers across PCIe.
If you're choosing local AI models for your business:
We run Laguna for quick tasks and Qwen for audits. Same box. No cloud. Your data never leaves the server.
About BizFlowAI: We build custom AI automation for small businesses powered by local AI on AMD and NVIDIA hardware. Talk to us about your stack.
Related: Atomic Agent vs Hermes: Two Local AI Agents Compared | How We Produce AI Benchmark Videos End-to-End