When inference drops below $1, databases inherit the agent problem
BAIR argues that GPT-4-class inference has fallen from roughly $30 per million tokens to under $1. For data teams, the bottleneck moves from the model itself to memory, coordination and control around agents.