According to OpenAI CEO Sam Altman, the size of large language models (LLMs) will become less important in the future. According to an interview with Altman at MIT’s Imagination in Action event, we’ve reached the limit of LLM size for the sake of size. Altman believes that there has been too much emphasis on parameter count, comparing it to the chip speed races of the 1990s and 2000s, where everyone was trying to point to a large number.
