Lilith.
⌕
Editorial illustration: Open models can cut the cost of narrow tasks without leading the general agent race
Lilith illustration · editorial remix

In his How Open Models Win talk, Nathan Lambert argues that open models should compete in tightly defined work that repeats at scale. Along with lower cost, they can offer private deployment, customization and greater control over data.

Open models trail by months while product companies capture the revenue

Lambert points to two independent capability indexes. Artificial Analysis puts leading open weights about 3 months behind the closed frontier. Epoch AI arrives at roughly 5 months. These are broad capability measures, not a promise of equal quality on every task.

The economic gap is wider. OpenAI and Anthropic combine the model, API, application and customer relationship. The open ecosystem splits those roles among weight developers, inference providers and post-training companies. Revenue from usage therefore travels back to base model builders slowly.

Repetitive work turns model pricing into cost per finished task

Lambert recommends competing where a company can define the job precisely, repeat it at scale and measure the result. In that setting, cost per completed task matters more than a score on a general benchmark.

Fireworks says some tasks for customer Factory cost as little as 6% of a frontier model. This is a vendor case study, not a universal comparison. It still shows why a narrowly deployed open model can be useful without topping a leaderboard. Customer control is the other advantage. A company can adapt the model and run it in its own environment.

Cheap inference does not fund the next model by itself

This is where Lambert's argument meets its central tension. Model builders need revenue for training and research, yet the proposed strategy pushes inference pricing close to compute cost. More usage does not automatically create a sustainable business for the companies paying the development bill.

Private operation is not automatically cheaper either. A company needs evals, security, oversight and enough volume to justify the investment. A paid API may still be the practical choice for irregular work.

Workflow bills and builder revenue will settle the argument

The first signal to watch is total workflow cost at equal quality. An open model succeeds if it cuts the cost of a finished task over time without adding an expensive maintenance layer.

The second signal sits with the weight developers. If they capture enough revenue to fund another training cycle, the open ecosystem may keep the gap measured in months. If revenue remains with inference and applications, cheap usage will finance someone else's product rather than the next model.

Lilith's verdict

A closed model may win on stage. The market will be decided in production, where the same task returns a thousand times and every cent appears on the bill.