doorman ollama queuing proxy

For source, see ~arrdem/source/projects/doorman.

Local Hardware (capital) $10000.00
Cloud Spent $102.30
· OpenRouter / Vast $102.30 / $0.00
Would-be: Frontier / DeepSeek / OR $7760.20 / $92.00 / $169.60
Saved vs Frontier / DeepSeek / OR $7738.20 / $70.00 / $147.50
Capital Recouped 77.4%
Avg Daily Savings $95.00/d
Days to CapEx 105d

Queue

State Backend User Model Endpoint Wait ≥ 1st tok ETA
in-flight hieroglyph anonymous gemma4:e4b /v1/chat/completions 16s ≥0s ~20s

Backends

Name Health URL Cost Class Used Free Budget In-Flight Loaded Pulling
hieroglyph (openai) healthy http://llama-swap-server:11434 0 66 GB 22 GB 96 GB 1 gemma4:e4b, qwen3-embedding:latest, qwen3.6:35b, qwen3.6:35b-b —
lux (openai) unhealthy http://10.0.0.19:11434 1 0 GB 22 GB 24 GB 0 — —
openrouter (openai) healthy https://openrouter.ai/api 100 6640 GB 0 GB 0 GB 0 415 models (catalog) —

Models

Model Status Loaded On Input Tokens Output Tokens Context (tok/s) Generate (tok/s)
deepseek-coder:33b unloaded — 0 0 0.0 0.0
deepseek/deepseek-v4-flash unloaded — 162,785,076 4,680,774 0.0 35.9
gemma4:26b unloaded — 321,307 84,151 6429.8 152.9
gemma4:31b unloaded — 372,419,654 13,659,252 1759.2 60.8
gemma4:e2b unloaded — 1,691,790 3,060,874 4241.0 230.5
gemma4:e4b loaded hieroglyph 71,566,625 86,958,357 14884.7 182.1
google/gemma-4-31b-it unloaded — 73,947,820 400,812 0.0 4.7
gpt-oss:20b unloaded — 349,241 190,401 4134.0 120.7
nvidia/nemotron-3-ultra-550b-a55b unloaded — 48,734 10,073 0.0 115.9
openai/gpt-oss-120b unloaded — 1,944,429 55,799 0.0 216.7
qwen/qwen3-235b-a22b-thinking-2507 unloaded — 13,253 85,647 0.0 56.0
qwen/qwen3-coder unloaded — 5,009,439 17,160 0.0 58.0
qwen/qwen3-coder-30b-a3b-instruct unloaded — 5,672,997 33,805 0.0 88.9
qwen/qwen3.6-35b-a3b unloaded — 24 397 0.0 113.7
qwen3-embedding:latest loaded hieroglyph 62,233,641 0 3363.4 0.0
qwen3.6:27b unloaded — 588,046 391,176 1403.0 70.6
qwen3.6:35b loaded hieroglyph 618,323,212 88,192,265 1746.8 149.7
qwen3.6:35b-b loaded hieroglyph 0 0 0.0 0.0

Users

User Requests Input Tokens Output Tokens Time Cost (Frontier) Cost (DeepSeek) Cost (OpenRouter) Cost (Local)
anonymous 698,405 940,418,818 181,202,776 505.1h $9232.20 $117.30 $215.00 $80.50
joe 85,227 92,460,972 4,076,863 73.2h $564.20 $9.10 $9.50 $3.00
arrdem 16,207 31,607,157 3,009,698 27.8h $233.30 $3.40 $4.60 $1.20
arrdem (via joe) 13,737 293,787,108 4,387,107 51.3h $1578.60 $27.20 $39.80 $38.40
rubberstamp (via joe) 4,825 13,184,703 1,016,041 15.4h $91.30 $1.40 $1.90 $0.70
marge (via joe) 441 2,862,167 73,122 2.2h $16.10 $0.30 $0.40 $0.10
localscene 393 2,544,675 4,046,269 12.7h $113.90 $1.00 $0.60 $0.50
drain-test 13 175 10,557 2.8m $0.30 $0.00 $0.00 $0.00
burnin 11 850 2,284 38s $0.10 $0.00 $0.00 $0.00
synthetic-validate 2 39 32 1s $0.00 $0.00 $0.00 $0.00
probe 1 0 0 0s $0.00 $0.00 $0.00 $0.00
embed-test 1 10 0 0s $0.00 $0.00 $0.00 $0.00
spill-test 1 49,770 2 7s $0.20 $0.00 $0.00 $0.00
Total 819,264 1,376,916,444 197,824,751 687.8h $11830.20 $159.50 $271.80 $124.30

Daily

Day (UTC) Requests Input Tokens Output Tokens Cost (Frontier) Cost (DeepSeek) Cost (OpenRouter) Cost (Local) Saved
2026-08-19 11,269 3,381,135 1,939,513 $61.70 $0.60 $0.90 $0.10 $61.60
2026-08-18 11,225 10,409,740 2,701,765 $90.80 $1.00 $1.50 $0.20 $90.60
2026-08-17 11,429 5,988,858 2,910,909 $94.30 $0.90 $1.40 $0.20 $94.00
2026-08-16 13,147 9,830,953 2,976,864 $99.00 $1.00 $1.70 $0.20 $98.80
2026-08-15 10,823 5,991,266 2,789,397 $89.90 $0.90 $1.40 $0.20 $89.70
2026-08-14 11,102 12,453,722 2,959,425 $100.20 $1.10 $1.90 $0.20 $100.00
2026-08-13 10,967 6,110,117 2,833,785 $92.50 $0.90 $1.50 $0.20 $92.30