Architecture decisions used to take 1 week. Now 5 minutes. Here is exactly how.
In 2024 we were paying $2,000 per session for CTO-level consulting on architecture decisions. Not because we lacked technical judgment — but because external validation on high-stakes technical choices was worth the cost. At three sessions per month, that was $6,000/month.
We stopped in Q1 2025. Here is what replaced it.
THE CONSULTING PATTERN WE WERE BUYING
The external CTO consultant did three things well: 1. Challenged assumptions we had stopped questioning internally 2. Brought cross-industry pattern knowledge we did not have 3. Created accountability — the decision was documented and signed off
The price was not for the answer. It was for the process.
THE AI COUNCIL EQUIVALENT
We now run technical architecture questions through a 5-agent council: - CTO Agent (DeepSeek-chat): evaluates technical feasibility, stack risk, build vs buy - Security Auditor (DeepSeek-chat): surfaces attack surface, compliance implications - Cost Analyst (DeepSeek-chat): models infrastructure cost at 10x, 100x scale - Devil's Advocate (DeepSeek-chat): assigned to find the failure mode in the proposed approach - External Perspective (DeepSeek-chat): instructed to reason as a skeptical investor, not an insider
Gemini 2.5 Pro with thinking synthesizes the five positions into a structured decision document: recommendation, key risks, open questions, dissenting views.
A REAL EXAMPLE: SWITCHING TO RAILWAY
In February 2025 we evaluated moving from self-managed VPS to Railway for our CPaaS infrastructure. The council session ran in 6 minutes.
Security Auditor flagged: vendor lock-in risk and audit trail limitations for regulated markets. Cost Analyst modeled: Railway becomes cost-competitive at our scale only above 40 concurrent services. Devil's Advocate: "You are optimizing for developer convenience, not for the architecture your regulated clients actually require."
We did not move all infrastructure to Railway. We moved non-regulated workloads. Regulated client infrastructure stayed on self-managed VPS with full audit trails.
That call — which the council identified — would have cost $8,000 in retroactive migration if we had not caught it.
THE ECONOMICS
$6,000/month consulting → $0.80 per council session (API costs). Decision quality is comparable. The calibration investment: ~40 hours writing and refining system prompts for each agent role. One-time cost. The prompts are now in version control.
→ The Debate Engine powering this is open source. github.com/nealkhis/debate-engine