In an interview with Curt Jaimungal, Elan Barenholtz from Florida Atlantic University shares intriguing ideas about language and how it works in our minds.
He explains that language doesn’t point to meanings in the world like we often think. Instead, it builds itself through relationships between words, much like how large language models (LLMs) like ChatGPT predict the next word based on what came before. Barenholtz believes this shows that human language works the same way, using a simple process of guessing the next word to create complex speech.
The role of language in shaping our reality
Barenholtz argues that this process of autoregressive autogeneration reveals a core property of language itself. He suggests that because LLMs can master language with this method, humans likely use it too. This idea challenges the belief that words need to connect to real objects or experiences to make sense. He sees language as a self-contained system, separate from our senses, like sight or touch. For example, the word “red” doesn’t carry the actual color but relates to other words like “orange” or “color.” This separation means language can run on its own, as seen in LLMs, without needing to “know” the world.
He also explores how language and perception differ. Our senses give us direct experiences, like feeling pain, while language handles these as symbols. He suggests there might be a shared space, or latent space, where these systems exchange information, allowing us to act based on what we see or hear. For instance, saying “close the door” uses language to guide action, but the meaning comes from this interaction, not the words alone.
This view leads him to question if language disconnects us from a deeper, animal-like unity with the universe. Animals may experience the world directly, while our reliance on language might create a false sense of reality. He admits this idea is speculative but hopes it opens new ways to study the mind and even physics, suggesting the universe itself might have a memory. His work invites further exploration into how language shapes our thoughts and actions.
Also listen to this related conversation. Is your brain an LLM?