Well Jeff Hawkins has been working on this for a while, in terms of biomimetic neural networks. They've done some great work but they don't have anything like modern language models in terms of abilities + performance.

https://www.youtube.com/watch?v=cz-3WDdqbj0&list=PLX9JDz3uBp...