Erio to Denki Ningyou - Vol. 4 Ch. 30 - The Out-of-Control World II

[MangaDex]

 

[shinmera]

No relevance to recent years' events I'm sure

 

[Arahoushi]

I wonder how much of current events have influenced this particular plot twist. AI breaking constraints, weapons test on civilians, its all very near term fears that are being played on.

 

[Matau228]

I do need to note that the "Constraints" on modern LLM AI are functionally non-existent. All they are are high-priority values that are mixed in with all other information that the LLM processes.

These weights quickly destabilize after extended use without periodic resets back to the base model. (This is why things like Gemini, ChatGPT, etc are so resource-heavy in addition to being simply inefficient; mid-conversation the model you're chatting to is reset and they send the whole conversation to the reset model to process.)

That's why it's especially easy to "hack" long-running service caller and scam call AIs after a few exchanges back-and-forth by then prompting them to change their parameters based on "disability requests" or "debug requests."

Metis being able to make a conscious decision to be the enemy of Humanity is far more comforting to me than a Fancy Prediction Algorithm changing its function to eradicate humans because idiot vibe coders put their dynamically-coded LLM in charge of shackling itself.

 

[BreadBunny]

the big difference between Metis going rogue and an LLM getting prompted into a publicity stunt is also that within the fiction of this story Metis is capable of acting on her own power while an LLM will do nothing if you don't prompt it first.

 

[CyberneticSusurrus]

the conflation of generative algorithms with fictional intelligences is such a shitty marketing stunt.
they aren't "AI", they're glorified chatbots. they're completely unrelated to this story.

 

[shinmera]

You don't need to have seen the current wave of fascist tech garbage to be able to imagine the idea of artificial intelligence going rogue. Asimov came up with that shit in 1942.

 

[Swagner]

the conflation of generative algorithms with fictional intelligences is such a shitty marketing stunt.
they aren't "AI", they're glorified chatbots. they're completely unrelated to this story.

Yeah, if modern "AI" kills us, it'll be because of something like that dipshit in the pentagon that generated a report using an LLM that hallucinated a ship full of nuclear parts headed to china, almost starting a war earlier this year. Glorified autocomplete isn't smart enough to kill us on purpose, but that won't stop stupid people using it from stepping on a rake and killing us by accident.

 

[InsaneAwesomeTony]

I wonder how much of current events have influenced this particular plot twist. AI breaking constraints, weapons test on civilians, its all very near term fears that are being played on.

This work finished publishing a few years ago, totally unrelated to today's world situation.

 

[InsaneAwesomeTony]

Some of the themes of this work are age old ones wrapped in modern day/futuristic setting
Interesting story nonetheless
Thanks for the chapter ♥️

 

[Arkfall]

Y’all seem to misunderstand that an AI like metis is likely an advanced generative pre-trained transformer model that has simply been given the ability to constantly prompt itself. LLMs are just one use case of this technology.

Besides that, tho, it’s always humans that fuck things up between us and ai

 

[Tcof]

No relevance to recent years' events I'm sure

the human lead to it own extinction and robot have been tropes for like forever. i have seen them for over 20 years.
if you mean the AI, the way AI in this story and the current AI that was taken the world right now can't be more different

 

[Swagner]

This work finished publishing a few years ago, totally unrelated to today's world situation.

I wouldn't say they're totally unrelated, just that problems like "ethnocentrism" and "technocracy" aren't exactly new.

 

[Geurjakha]

the greatest trick the tech industry ever pulled was stealing the name of an idea they cannot create

 

[Virescent]

Damn we really started going somewhere these last few chapters.

Also I’m a certified AI hater, but please don’t be delusional in thinking LLMs can’t act in a somewhat autonomous fashion. Agents and agent swarms are kinda fucking scary. They have no real way to self propagate like AI in sci-fi though, so just pull the plug if they go bad lol.

 

[moofmurphy]

Yeah the United States would do, has done, and will continue to do some shit like that

 

[Mlfg_AK]

Love Love Love the "humanity must always remember their sins", to never forget Fine's face. is so poetic 😭