OpenAI

The Future of LLMs: Sam Altman on Why Size Won’t Matter Anymore

Altman believes that size is an inaccurate measure of model quality. He emphasises the importance of focusing on rapidly increasing capability rather than getting hung up on parameter count. He admits that if there is a reason for the parameter count to decrease over time or for multiple models to collaborate, we would do so. What matters is that the world receives the most capable, useful, and safe models.