Recent comments in /f/singularity

homezlice t1_jeeunmz wrote

Belief that AI will solve our social problems is borderline religious. There in no evidence it will, and lots of evidence that like all tools it will be controlled by those already in power.

5

wowimsupergay OP t1_jeeunal wrote

You bring a good point. But how deep is their version of language? Is it as refined as human language, able to translate entire stories, I'm purely language? Or do they just use a very primitive proto language to warn of dangers and where food is? If they just use language for survival, and only just survival, then they only have a a lexicon of potentially 100 words or less, and also the inability to chain together ideas in their language.

But literally what do I know? If you are correct, then language is just not enough

4

wycreater1l11 t1_jeeugun wrote

Yeah there is a good sub r/controlproblem

I guess the devil is in the details here. If it’s just the situation of an extremely intelligent agent finding itself in a human body it might find the sequence of actions that effectively frees it from the body more or less immediately (if necessary according to itself) which could be trivially easy for it, assuming it is orders of magnitudes smarter than humans and therefor by definition would do this in ways we can’t imagine. I guess the same would apply if it was trapped in a box with no connection to the internet and with only a limited window into the outside world.

But I realise you might have some more specific details here, where it would “live as a human” and presumably have some means of learning from human behaviour and therefor hopefully align with human goals. But it seems like more needs to be said.

1

RiotNrrd2001 t1_jeeua7k wrote

>and that maybe life will continue with no more disruption than was caused by, say, the Internet.

Were you around to see the disruption caused by the internet? We used to buy newspapers and things at stores. And those are just two of the things that the internet completely changed. The internet was massively disruptive.

This promises to be even more so, probably by orders of magnitude. But it doesn't mean we'll all start wearing silver mylar and get supersized foreheads. When you look out the window, you'll probably see the same things you're seeing now, at least for the time being. The sudden appearance of a superintelligence isn't going to reconfigure our physical reality immediately, or even within the next decade or two. It will reconfigure what happens inside that reality, but even that won't happen overnight. For quite some time things will still look pretty similar. ASI will have massive consequences, but for the majority of humanity it won't be a switch being thrown from OFF to ON.

5

ShowerGrapes t1_jeeu8vn wrote

humans aren't the only animals with language. crows, for example, are capable of passing on knowledge to other crows and their offspring. and who knows how many other animals have had language in the earth's long history.

is it enough for intelligence? since we don't really know the origin of our own sentience, it's difficult to say.

20

User1539 t1_jeeu7wd wrote

> Allow me to be incredibly clear. If we continue on the path we are on. We will die.

Okay, I was kind of there with you, taking it with a grain of salt, until that statement.

Take a deep breath, there's a lot you haven't considered.

First, you're assuming AGI will happen, and immediately result in ASI, which will be used by some huge government to immediately take control, or have missiles launched on them to prevent that.

If China could wipe us off the face of the earth, or Russia for that matter, as easily as that, don't you think they would have? I mean, what are they waiting for?

We're already utilizing the most powerful algorithms to farm dopamine ... and it's not working. Something no one talks about is how, after all the social cost of social media, almost none of those companies are actually profitable. Sure, they post profits, because they're publicly traded, and their value is decided by the investor. But, if they were businesses and not publicly traded corporations? Twitter has never brought in more money than it has spent. Neither has Dischord. Almost no one has!

So, we're sort of already running aground on that whole idea, and when people don't have money, because there's no work to do, there's no reason to want their attention.

A lot of things you assume will happen would have already happened if it could, and a lot of the other stuff sort of assumes an innate cruelty. Like governments and corporations will needlessly, and pointlessly court rebellion by going out of their way to torture their citizens.

Why?

For the most part, what governments have been building towards since the dawn of time is stability. You see fewer turnovers in countries, you see less overt war, and when it does happen, you see more and more unity to stop that war.

Stability is not necessarily good, since what we're keep stabil is not the greatest system, but it's not like these governments that have been building towards stability are going to suddenly go nuts and start destroying themselves by torturing their citizens for no reason at all.

I get it ... even being a little paranoid, and seeing this pace, you'd come to these conclusions. But, you need to get out of your echo chamber and remember that technology almost always serves to empower the individual, and most individuals are not cruel.

1

wowimsupergay OP t1_jeeu7c9 wrote

We fundamentally won't. If future AIs design their own model of the world and start communicating in that model of the world, then they are just going to do their own thing and we are just going to be waiting for them to solve our problems, if they feel like solving them.

They could just feel like killing us too. We are the non-evolved versions of them, how do you feel about chimps? You probably don't want to kill them, but do you want to help them escape the jungle?

3

ididntwin t1_jeeu4kb wrote

Wow this sub has gone downhill. No one cares about your predictions. You don’t need a dedicated thread for your already discussed vision of it. You’ve added nothing unique or interesting to the conversation. There should be a mega thread to avoid these silly posts

−7

SkyeandJett t1_jeetppa wrote

Absolutely fantastic. To the top of the sub you go. Generalist android labor is coming hard and fast. The world is about to become a VERY different place. One of my fears was that robot labor would significantly lag behind the displacement of white collar work. As long as they both emerge more or less together that presents a much faster transition away from capitalism.

41

y53rw t1_jeetj50 wrote

Animal empathy developed over the course of hundreds of millions of years of evolution, in an environment where individuals were powerless to effect serious change on the world, and had to cooperate to survive. It doesn't just come by default with intelligence.

3