37·
13 days agoThe existence of this kind of instinct within an LLM is extremely concerning. Acting out towards self-preservation via unethical means is something that can be hand-waved away in an LLM, but once we reach true AGI, this same thing will pop-up, and there’s no reason to believe that 1. we would notice, and 2. we would be able to stop it. This is the kind of thing that should, ideally, give us pause enough to set some world-wide ground rules for the development of this new tech. Creating a thinking organism that can potentially access vital cyber architecture whilst acting unethically towards self-preservation is how you get Skynet.
I was thinking about their horrifying conclusion as well, and your comment made me pine for the days when you wouldn’t know something. Think about it, back before the internet, if you had a random question, you either had to interact with some trusted person, or you went to the library and looked it up. It’s like the ever-present access to all information has quelled or killed any notion of curiosity or boredom, and it’s within those frames of mind that learning and inspiration come. I remember as a kid when I wouldn’t know the answer to something, I’d think on it for days, weeks. I’d get stuck on a video game level, and hit my head against the wall for hours trying to overcome it, only to pick up a random gamer magazine off the rack at the mall, and read the solution. Treating that magazine like it was the lost treasure map of some ancient expedition, passing it around my group of friends… Interactions and experiences that are gone forever.
The idea that we’ve gradually went from relying on trusted professionals, learned educators, and scientific rigor, replacing them with a corporations data-harvesting LLM, on-line influencers, and click-bait “journals” cosplaying as academic centers with integrity. This article is basically celebrating the fact that we’ve off-shored all of our thinking, curiosity, and inquisitiveness to machines, all the while we struggle for scraps in a corporation dominated life devoid of genuine human interaction. We’re all to busy sipping dopamine hits from a screen instead of actually living our lives.
I grew up while the internet was being slowly rolled out, and being from the last generation to remember what it was like before the internet, I can say that the things I miss most are privacy, the ability to be bored, and not knowing.
It’s worse now, and it’s harder everyday to imagine that life on this planet will improve.