BeanGenie
An AI coffee discovery platform: crawls 1,700+ specialty roasters nightly and turns messy product pages into structured data with an LLM running on his own GPUs.
How it works →Infrastructure · AI · Chicago
Infrastructure engineer behind Tubi's production EKS clusters and its 100M+ logs/day OpenTelemetry pipeline. On-prem, he runs frontier open models at ~8,500 tok/s prefill, powering a crawler that indexes 28,000+ coffees nightly at a fraction of a cent per million tokens.
Click a stage to watch it run.
Answered live by a model running on Wynn's own on-prem GPUs.
Answers come from a fact sheet Wynn approved, generated live by a model on his own GPUs. It can still be wrong.
Electricity only, measured at the wall. Doesn't include the cost of the GPUs.
logs/day through the OpenTelemetry pipeline Wynn led at Tubi
nodes across Karpenter GPU/EFA node pools he provisioned
coffee roasters crawled nightly by BeanGenie
coffees indexed
median decode and ~8,500 tok/s cold prefill, self-hosted GLM-5.3-Flash on 2× on-prem Blackwell GPUs
$1,148 saved per month ($13,776 per year)
Product extraction, August 2026 · 100,974 LLM calls
100,974 × (3,712 in × $2/M + 401 out × $10/M)
100,974 × (740 W × 2.19 s × $0.16/kWh)
2.19 s (one measured call) = 0.48 s prefill (3,712 in ÷ 7,662 tok/s) + 1.65 s decode (401 out ÷ 243 tok/s) + 0.06 s overhead
740 W = whole-machine wall power while busy, measured at the UPS
Extraction job only; other jobs are not counted and therefore real savings are even greater.
An AI coffee discovery platform: crawls 1,700+ specialty roasters nightly and turns messy product pages into structured data with an LLM running on his own GPUs.
How it works →Two RTX PRO 6000 Blackwell GPUs serving frontier open models behind llama-swap (vLLM/SGLang), with every request traced in Langfuse. Wynn tunes precision, KV cache, speculative decoding and scheduling per model, and measures cost per token from wall power.
A multi-node k3s cluster run entirely through Flux GitOps: observability on SigNoz/ClickHouse, self-hosted services, CI runners, and the BeanGenie crawlers.