The latest AI models are hungry for inference compute
Inference costs are pushing AI companies toward smaller models.
When Sam Altman tweeted on September 12 that OpenAI’s new o1 models were available to all ChatGPT Plus users, someone asked him “when are we getting the new voice features?”
Altman responded with evident irritation: “How about a couple of weeks of gratitude for magic intelligence in the sky, and then you can have more toys soon?”
OpenAI rolled out Advance…
Keep reading with a 7-day free trial
Subscribe to Understanding AI to keep reading this post and get 7 days of free access to the full post archives.