When do you think { compiler | http | von Neumann architecture } capability will reach its ceiling?
Unless replaced by something far more capable, refinements and incremental improvements will continue to be applied to LLMs. They will become less expensive and more specialized. Machine learning and neural networks are part of the software stack. LLMs will continue to grow and improve for the foreseeable future.
AI is the latest downstream consequence of the 15 order of magnitude increase in global digital compute since 1946. If compute increases into the foreseeable future; so too will the capability of AI.
Unless replaced by something far more capable, refinements and incremental improvements will continue to be applied to LLMs. They will become less expensive and more specialized. Machine learning and neural networks are part of the software stack. LLMs will continue to grow and improve for the foreseeable future.