AI token limits push engineers to compete for compute

Pylon CEO Marty Kausas faced a choice: scale back token spending or stomach a $1.4 million bill. He realized the company was nearing 150 employees on its Anthropic plan, a threshold that would more than triple costs, so he declared the era of unlimited spending over and set ceilings on tokens for some nontechnical staff.

His VP of finance is now exploring "where we should set caps." "This is just the start." Across industries, companies are confronting a rapid shift: AI usage went from something bosses encouraged to something they must limit as costs soared and unlimited access failed to consistently deliver value.

OpenAI CEO Sam Altman summed up the change, saying that at the start of the year "people were totally happy with the amount they were spending," and that now those costs are "a huge issue." Engineers increasingly must advocate for the compute they need, managers barter for token allocations like "Shark Tank," and hiring teams sometimes guarantee candidates tokens to tempt top talent.

ai tokens, token limits, compute, token spending, anthropic, openai, sam altman, pylon, engineers, hiring teams