What I think he is wrong with is that LLMs are, despite being named as "Artificial Intelligence", not intelligent
.
I guess that some people confound the source of information with its medium. A book might contain Newtons equation of motion, Gauss' works, Maxwell's equations, or an introduction of Einstein's theory of special relativity. But it is not the book that is intelligent, it is the people that wrote up the ideas.
You can see that confusion between the medium and authority by the holy scriptures of the large religions which were among the first human organizations that employed written words for their purposes - for example, muslim and Jewish people treat their respective foundational books as holy themselves.
With LLMs, it is clear that when you average the writing of many more or less intelligent people, the result might appear more or less intelligent. In the same way as common sense, sometimes, does make sense. But it is still not the medium that is intelligent, but the authors of the input.
But what the blog author is probably right about is persuasion by influencing communities which in turn influence individuals. That is exactly how Googles or Facebooks practices that violate privacy - like offering free emails accounts which use data from personal mails for advertising - became widely accepted even if it is clear they are not good for individuals.
I think that dimension of persuasion might be often overlooked when people, for example, think about the Cambridge Analytica scandal:
I guess that some people confound the source of information with its medium. A book might contain Newtons equation of motion, Gauss' works, Maxwell's equations, or an introduction of Einstein's theory of special relativity. But it is not the book that is intelligent, it is the people that wrote up the ideas.
You can see that confusion between the medium and authority by the holy scriptures of the large religions which were among the first human organizations that employed written words for their purposes - for example, muslim and Jewish people treat their respective foundational books as holy themselves.
With LLMs, it is clear that when you average the writing of many more or less intelligent people, the result might appear more or less intelligent. In the same way as common sense, sometimes, does make sense. But it is still not the medium that is intelligent, but the authors of the input.
But what the blog author is probably right about is persuasion by influencing communities which in turn influence individuals. That is exactly how Googles or Facebooks practices that violate privacy - like offering free emails accounts which use data from personal mails for advertising - became widely accepted even if it is clear they are not good for individuals.
I think that dimension of persuasion might be often overlooked when people, for example, think about the Cambridge Analytica scandal:
https://longform.org/posts/the-great-british-brexit-robbery
https://www.europeanpressprize.com/article/great-british-bre...
https://ia601000.us.archive.org/28/items/civ53332855/great-b...