Language Agnostic LLMs
What is the difference between a human brain and an LLM? What is it that a human brain has that LLMs don’t which allows it to learn a language with far less data than an LLM? Life originated about 3.5 billion years ago. So the human brain is a model that has been trained for 3.5 billion years. In a sense, LLMs are part of that training process. An analog model that was trained for 3.5 billion years created a digital model that was trained for a few years.
When we are born, we have a brain that has been trained for 3.5 billion years. With a bit of fine tuning, we can learn a language in a few years. So whatever information is in the human brain when we are born, are language agnostic.
I really shoudn’t draw parallels between the human brain and LLMs. Forgive me lord for I have sinned. It’s a total assumption.