A few years ago in a class I had a group of students analyze a set of CSV files and charts relating to the performance of a large YouTube channel.
This was right as generative AI was coming out and back when it would struggle with this type of analysis.
The first analysis was done the old-fashioned way – you had to understand what you were looking at, you had to know what to do with the data, and had to be willing to work through uncertainty. The assignment: take this raw data and make recommendations to the channel owner on what to do (left open for interpretation).
Results?
- 30% of submissions were terrible.
- 60% were good, though not really complete.
- 10% were amazing, producing creative recommendations, and better than I expected.
The semester after that I did something I never did before: I assigned the same thing. The same data and instructions, but this time with the requirement to use AI in the analysis.
Results?
- Much of the worst work decreased. Only 5% of submissions were terrible.
- 90%+ were good.
- But at most 5% were amazing. AI usage had mostly eliminated the worst results (30% in the first attempt), but it had also hurt the top output (the 10%), with results condensed toward the center. In some cases this might be the outcome you want, but in other situations you might want to take some terrible results so that you can also benefit from the excellent ones.
Or be disciplined enough not to let AI completely think for you.
musicale · 11h ago
The problem isn't limited to creativity. When you let machines think for you, your own ability to think atrophies.
Maybe long division wasn't a particularly necessary skill (though I think learning arithmetic algorithms is beneficial). But calculators could only complete a small subset of school assignments, while the set of traditional school assignments that gen AI cannot complete is getting smaller and smaller.
On the other hand, the game of "turn in assignments until you have enough grade letters to get a piece of paper" game seems to be over, at least in its recent form.
4b11b4 · 2h ago
> The ‘web’ of today is a legacy technology that remains a footnote in an LLM’s response when asked, “How was AI trained?” – not that anyone would bother to ask such a thing.
oof
visarga · 13h ago
Art was not based on copyright for a long time, it won't disappear, just return to the natural way of sharing it. This trend started decades ago with internet, not with AI.
A second fallacy is that AI art is public. Not true, most of it is seen exactly one time by human eyes. It is a private affair, and doesn't need to be perfect if it captures the intent of the user. Art made for one.
musicale · 11h ago
> Art was not based on copyright for a long time, it won't disappear, just return to the natural way of sharing it. This trend started decades ago with internet, not with AI.
The old internet was a giant copy machine, not a giant slop machine.
beeslol · 13h ago
The opening line
> This is written of a future. Not the future, but a future – one of many possibilities.
> This is a YouTube video from a future. Not the future, just a future.
Not sure if intentional or if you're both referencing something else, fun parallel nonetheless.
welldonehn · 13h ago
Has a Twilight Zone/Night Gallery feel to it.
JKCalhoun · 13h ago
I kept getting put off when “artists” was used as though they are a species or something. How strange.
Go see live music downtown. AI is only a threat to corporate art (which never was art, ha ha).
I’ve not been buying the fear-mongering. Maybe someone can convince me I’m mistaken, but this piece did not.
krzn · 11h ago
Yes, AI is only a threat to corporate art for now. But what will happen when the new generations grow up in a world with technology that can generate in seconds or minutes something they enjoy and keep them entertained? Why bother going through the painful process of learning new creative abilities when AI will probably be able to generate everything future generations will consume (if things keep going as they are)?
Something like that is already happening with video games and game engines. When you talk with other game developers about making a game "from scratch" the first question they ask is "why?". Why bother making your own engine if there's already Unity/Unreal/Godot?
That's just a little example of how as something gets more and more accessible people forgets and disregard making it more manually. The same can absolutely happen with art in general, which is sad.
The only way I can think this won't happen is that we end up in a future with enough free time to invest in our hobbies and that more people than I expect will enjoy making things by themselves or maybe using AI for new ways to express themselves, which is the "good" future many AI enthusiasts mention and what I honestly would prefer too, but I don't have much hope.
yetihehe · 8h ago
> Something like that is already happening with video games and game engines. When you talk with other game developers about making a game "from scratch" the first question they ask is "why?". Why bother making your own engine if there's already Unity/Unreal/Godot?
There will still be people, that will do things "just because". Why write a new kernel, when Unix already exists? People will be creative and social value of doing something new (with or without use of AI) will be high. Performing will be valued a little more than now. I'm pretty sure there will be counter-culture of people appreciating visual and music art that is not touched by AI, because there are always some counter-cultures. People like doing art just for the sake of doing it, not only for recognition. There will be wealthy people willing to buy such "unique" pieces.
dingnuts · 9h ago
> But what will happen when the new generations grow up in a world with technology that can generate in seconds or minutes something they enjoy and keep them entertained?
This is why culture is important. Technology cannot in seconds generate a song you teach your child to play or sing with you in the tradition of your people.
We should get back to song readers and sing a longs and unearth the old songs of our histories and celebrate them together with our children.
chrisbrandow · 12h ago
No one bothers going downtown much. Too much bother when they can just fire up Netflix.
analog31 · 12h ago
Indeed, I think there are greater threats to live music, than computer generated music. Consider televised sports. Compare videos of old football broadcasts from the 1970s to the level of technology and engagement achieved today. Compare the commercials. Live music can't offer that level of spectacle.
Disclosure: Live musician.
JKCalhoun · 12h ago
Sports, live music … apples, oranges.
(And by live music, you should be able to accidentally spill your beer on the stage. I don’t mean arena music.)
degamad · 13h ago
An interesting possible future, and a great read.
We have some escape valves from that future though - one key assumption in the evolution of that future is:
> Because creatives had excluded themselves, their values, and their opinions from model’s knowledge, they found themselves disregarded by history. LLMs are the main way of education and learning and have lost the ability to educate people on human-created art.
Prior to the pushback from creatives (indeed, many prior to the digital age, even), many thousands of books were created which describe and discuss human-created art, including how to make it, how to compare artworks, and what aspects of art we value. The digitisation of these works from the last few hundred years is likely to have been incorporated into the training data for the LLMs.
LLMs know how to manufacture [0] and play [1] a violin, even if they don't include any new concertos. They know how to teach yourself sketching [2], even if no new sketches are added to the training data post 2020. Many other artistic and creative endeavours have been documented over the last few hundred years.
It's true that the state of the art in the early-mid-21st century may be poorly captured in the training data. That people may lose the ability to learn how to make LoFi, Hyperpop, or Seapunk music, because they're "too new" to be in the training corpus, but how to make music won't be excised from the data.
Similarly, the idea that people may never learn how to use old tech like Roland 808s because of AI is also unlikely - there are undoubtedly enough 808 tutorials which will be incorporated into the LLMs prior to the current AI disillusionment amongst creatives preventing the creation of more. So if a future creative finds an ancient 808 in a flea market, they will be able to find out enough about it to repair it and play it. There may not be as much information about newer tech like the Roland TR-8S, but that doesn't mean that the future music production nerds will have nothing to start from.
A weird coincidence: I had a copy of [0], the violin making book. I'd rate it as being sufficient to make a passable violin for an amateur or fiddler, if that person had already seen and played violins. But nothing close to a high quality contemporary instrument.
Also, the violin-making art is evolving over time, and it's speculated that designs will have to change in response to the disappearance of old growth timber. A rumored consequence of global warming is that trees grow faster, changing the grain structure of the wood. There's been great progress in making bows from carbon fiber.
It strikes me as a bit weird that violin playing could be taught from a book, especially Suzuki 1 (both my kids used it, and it's great). Again, theories about how the violin is played have changed since that book was written. For instance, there has been a growing emphasis on ergonomics and physical health, that was glossed over when I learned as a kid.
Of course these are just two books. It's not unthinkable that the knowledge from multiple books could be combined with recordings, videos, and even measurements of known violins if things like 3d imaging become cheap.
degamad · 13h ago
Although, the limitation on what is available to use might still exist: a future creative may be able to find out how to repair and play an 808, but they may not be able to acquire the relevant parts, because the manufacturing of such things went out of production...
skybrian · 10h ago
> In spite of the flaws, not having to compensate creators was seemingly incentive enough for some people to switch over.
This doesn’t quite land because free is nothing special. The Internet has lots of free content that nobody cares about. There needs to be something other than “it’s cheaper” that attracts people’s interest.
One reason AI art is becoming popular is that there are tools that make it easy and fun to make your own. And I expect that the tools will get better.
I suppose it’s true that being able to take selfies quickly and easily competes with professional photography. But it doesn’t feel like direct competition when you wouldn’t have considered hiring a photographer or a portrait artist.
This was right as generative AI was coming out and back when it would struggle with this type of analysis.
The first analysis was done the old-fashioned way – you had to understand what you were looking at, you had to know what to do with the data, and had to be willing to work through uncertainty. The assignment: take this raw data and make recommendations to the channel owner on what to do (left open for interpretation).
Results? - 30% of submissions were terrible. - 60% were good, though not really complete. - 10% were amazing, producing creative recommendations, and better than I expected.
The semester after that I did something I never did before: I assigned the same thing. The same data and instructions, but this time with the requirement to use AI in the analysis.
Results? - Much of the worst work decreased. Only 5% of submissions were terrible. - 90%+ were good. - But at most 5% were amazing. AI usage had mostly eliminated the worst results (30% in the first attempt), but it had also hurt the top output (the 10%), with results condensed toward the center. In some cases this might be the outcome you want, but in other situations you might want to take some terrible results so that you can also benefit from the excellent ones.
Or be disciplined enough not to let AI completely think for you.
Maybe long division wasn't a particularly necessary skill (though I think learning arithmetic algorithms is beneficial). But calculators could only complete a small subset of school assignments, while the set of traditional school assignments that gen AI cannot complete is getting smaller and smaller.
On the other hand, the game of "turn in assignments until you have enough grade letters to get a piece of paper" game seems to be over, at least in its recent form.
oof
A second fallacy is that AI art is public. Not true, most of it is seen exactly one time by human eyes. It is a private affair, and doesn't need to be perfect if it captures the intent of the user. Art made for one.
The old internet was a giant copy machine, not a giant slop machine.
> This is written of a future. Not the future, but a future – one of many possibilities.
reminded me of the opening line from Tom Scott's The Artificial Intelligence That Deleted A Century https://www.youtube.com/watch?v=-JlxuQ7tPgQ
> This is a YouTube video from a future. Not the future, just a future.
Not sure if intentional or if you're both referencing something else, fun parallel nonetheless.
Go see live music downtown. AI is only a threat to corporate art (which never was art, ha ha).
I’ve not been buying the fear-mongering. Maybe someone can convince me I’m mistaken, but this piece did not.
Something like that is already happening with video games and game engines. When you talk with other game developers about making a game "from scratch" the first question they ask is "why?". Why bother making your own engine if there's already Unity/Unreal/Godot?
That's just a little example of how as something gets more and more accessible people forgets and disregard making it more manually. The same can absolutely happen with art in general, which is sad.
The only way I can think this won't happen is that we end up in a future with enough free time to invest in our hobbies and that more people than I expect will enjoy making things by themselves or maybe using AI for new ways to express themselves, which is the "good" future many AI enthusiasts mention and what I honestly would prefer too, but I don't have much hope.
There will still be people, that will do things "just because". Why write a new kernel, when Unix already exists? People will be creative and social value of doing something new (with or without use of AI) will be high. Performing will be valued a little more than now. I'm pretty sure there will be counter-culture of people appreciating visual and music art that is not touched by AI, because there are always some counter-cultures. People like doing art just for the sake of doing it, not only for recognition. There will be wealthy people willing to buy such "unique" pieces.
This is why culture is important. Technology cannot in seconds generate a song you teach your child to play or sing with you in the tradition of your people.
We should get back to song readers and sing a longs and unearth the old songs of our histories and celebrate them together with our children.
Disclosure: Live musician.
(And by live music, you should be able to accidentally spill your beer on the stage. I don’t mean arena music.)
We have some escape valves from that future though - one key assumption in the evolution of that future is:
> Because creatives had excluded themselves, their values, and their opinions from model’s knowledge, they found themselves disregarded by history. LLMs are the main way of education and learning and have lost the ability to educate people on human-created art.
Prior to the pushback from creatives (indeed, many prior to the digital age, even), many thousands of books were created which describe and discuss human-created art, including how to make it, how to compare artworks, and what aspects of art we value. The digitisation of these works from the last few hundred years is likely to have been incorporated into the training data for the LLMs.
LLMs know how to manufacture [0] and play [1] a violin, even if they don't include any new concertos. They know how to teach yourself sketching [2], even if no new sketches are added to the training data post 2020. Many other artistic and creative endeavours have been documented over the last few hundred years.
It's true that the state of the art in the early-mid-21st century may be poorly captured in the training data. That people may lose the ability to learn how to make LoFi, Hyperpop, or Seapunk music, because they're "too new" to be in the training corpus, but how to make music won't be excised from the data.
Similarly, the idea that people may never learn how to use old tech like Roland 808s because of AI is also unlikely - there are undoubtedly enough 808 tutorials which will be incorporated into the LLMs prior to the current AI disillusionment amongst creatives preventing the creation of more. So if a future creative finds an ancient 808 in a flea market, they will be able to find out enough about it to repair it and play it. There may not be as much information about newer tech like the Roland TR-8S, but that doesn't mean that the future music production nerds will have nothing to start from.
--
[0] Broadhouse, John; Bull, Cie Bornemann, "How to make a violin. And Violin notes by Ole Bull", 1900 https://archive.org/details/howtomakeviolinv00broa
[1] Suzuki, Shinichi, "Suzuki violin school : violin part, volume 1", 1978 https://archive.org/details/suzukiviolinscho00suzu
[2] Crawshaw, Alwyn, "Learn to sketch", 1983 https://archive.org/details/learntosketch0000craw_o0h9
Also, the violin-making art is evolving over time, and it's speculated that designs will have to change in response to the disappearance of old growth timber. A rumored consequence of global warming is that trees grow faster, changing the grain structure of the wood. There's been great progress in making bows from carbon fiber.
It strikes me as a bit weird that violin playing could be taught from a book, especially Suzuki 1 (both my kids used it, and it's great). Again, theories about how the violin is played have changed since that book was written. For instance, there has been a growing emphasis on ergonomics and physical health, that was glossed over when I learned as a kid.
Of course these are just two books. It's not unthinkable that the knowledge from multiple books could be combined with recordings, videos, and even measurements of known violins if things like 3d imaging become cheap.
This doesn’t quite land because free is nothing special. The Internet has lots of free content that nobody cares about. There needs to be something other than “it’s cheaper” that attracts people’s interest.
One reason AI art is becoming popular is that there are tools that make it easy and fun to make your own. And I expect that the tools will get better.
I suppose it’s true that being able to take selfies quickly and easily competes with professional photography. But it doesn’t feel like direct competition when you wouldn’t have considered hiring a photographer or a portrait artist.