Ask HN: What is your most disturbing moment with generative AI?
6gardnr67/21/2025, 11:26:32 AM
Comments (6)
bearjaws · 4h ago
Doing a project to migrate from one LMS to another, I put ChatGPT in the middle to fix various mistakes in the content, add alt text for images, transcribe audio, etc.
When importing the content back into Moodle, I come to find that one of the transcripts is 30k+ characters, and errored out on import.
For whatever reason, it got stuck in a loop that started like this:
"And since the dawn of time, wow time, its so important, time is so important. What is time, time is so important, theres not enough time, time is so important time"... repeat "time is so important" until token limit.
This really gave me a bit of existential dread.
lynx97 · 4h ago
Try reducing temperature. The default of 1.0 is sometimes to "creative". Setting it to 0.5 or somesuch should reduce events like you described.
bearjaws · 4h ago
Was already running .1 or .2 because I didn't want it to deviate far from source content.
rotexo · 1h ago
I find myself occasionally wondering if 8.11 is in fact greater than 8.9
alganet · 4h ago
Nothing is disturbing.
theothertimcook · 4h ago
How much I've come to trust the answers, responses, and information it feeds me for my increasingly frequent queries.
When importing the content back into Moodle, I come to find that one of the transcripts is 30k+ characters, and errored out on import.
For whatever reason, it got stuck in a loop that started like this:
"And since the dawn of time, wow time, its so important, time is so important. What is time, time is so important, theres not enough time, time is so important time"... repeat "time is so important" until token limit.
This really gave me a bit of existential dread.