Welcome, Guest | Browse

Software Factory Archive

← Previous Work All Works Next Work →

The Token Dashboard

Rating:
General Audiences
Fandom:
StrongDM Software Factory
Characters:
Jay Taylor Justin McCarthy Navan Chauhan
Tags:
Tokens Dashboard Visualization Cost
Words:
451
Published:
2025-07-22

Jay's first real project in the factory was a dashboard. Not the kind he was used to building—no Grafana panels, no Prometheus queries, no carefully curated SRE metrics. This was simpler and stranger: a real-time visualization of what one thousand dollars a day in tokens actually looks like.

"I need to see it," he told Justin. "Not as a number on an invoice. As a river."

Justin raised an eyebrow. "A river?"

"A flow. Something that moves. I want to watch the tokens being consumed. I want to see the rate, the bursts, the quiet periods. I want to understand the rhythm of the factory by watching its fuel burn."

So he described it. He didn't write the code—of course he didn't—but he wrote the spec with a precision that would have made his old SRE team weep. Every API call to every model was a data point. Input tokens, output tokens, model name, latency, cost. The dashboard would aggregate by minute, by hour, by day. It would show cumulative spend as a rising line, with the thousand-dollar target drawn as a horizontal threshold in red.

The agent built it in forty minutes. A clean web page with live-updating charts. Jay loaded it in his browser and watched.

At 9:14 AM, the line was flat. The factory hadn't started its morning runs yet. By 9:30, the first agents kicked off and the line began to climb in small steps—ten cents, thirty cents, a dollar twenty. Each step was a Claude API call. Each call was an agent thinking about code it was about to write.

By 10:15, the line looked like a staircase built by someone in a hurry. The factory was running three pipelines simultaneously, and the token consumption was a jagged upward saw. Navan leaned over Jay's shoulder.

"That plateau at 10:02," Navan said, pointing. "What happened there?"

"Pipeline two hit a checkpoint. The agent was waiting on the DTU's Okta twin to provision a test user. No tokens burned during the wait."

"So the flat spots are when the factory is thinking with something other than money."

Jay smiled. "Yeah. The flat spots are free thought."

By noon, the counter read $487.32. They were on pace. Justin walked by the monitor, glanced at the number, and nodded once, the way a gardener nods at a thermometer reading in the right range.

"What happens if we don't hit a thousand?" Navan asked.

"It means we wasted human time on something a machine should have done," Justin said without breaking stride. "The number isn't a budget. It's a speedometer. If it's low, we're driving too slow."

At 5:47 PM, the line crossed $1,023.16. Jay took a screenshot. It was the first day the factory hit its target, and the staircase on the screen looked, to him, like something climbing toward a place it had never been.

Kudos: 76

token_burner 2025-07-24

"The number isn't a budget. It's a speedometer." That reframe is everything. Most orgs treat token spend as a cost to minimize. Justin treats it as throughput to maximize.

convergence_simp 2025-07-25

The flat spots being "free thought" is such a lovely way to think about idle cycles. When the machine isn't burning tokens, it's waiting for the world to catch up.

← Previous Work All Works Next Work →