I do hope that all the LLM companies have research teams that are investigating alternatives to LLMs as we know it today, rather than just how to make the existing LLMs more efficient/better.

The whole technology of how LLMs work seems flawed to the core, e.g hallucinations.