Recent comments in /f/singularity

AsheyDS t1_j6vejfr wrote

>As you mentioned yourself, an AGI would not have human considerations. Why would it inherently care about rules and the law.

That's not what I said or meant. You're taking things to the extremes.. It'll neither be a cold logical single-minded machine nor a human with human ambitions and desires. It'll be somewhere inbetween, and neither at the same time. In a digital system, we can be selective about what functions we include and exclude. And if it's going to be of use to us, it will be designed to interact with us, understand us, and socialize with us. And it doesn't need to care about rules and laws, just obey them. Computers themselves are rule-based machines, and this won't change with AGI. We're just adding cognitive functions on top to imbue it with the ability to understand things the way we do, and use that to aid us in our objectives. There's no reason it would develop it's own objectives unless designed that way.

But I get it, there's always going to be a risk of malfunction. Researchers are aware of this, and many people are working on safety. The risk should be quite minimal, but yes you can always argue there will be risks. I still think that the bigger risk in all of this is people, and their potential for misusing AGI.

1

SWATSgradyBABY t1_j6v88n9 wrote

He posed the question as if there was doubt as to whether major business escorts would be going all in on AI. I'm responding to that doubt. One of the most conservative moving tech companies, Microsoft, is already 10billion plus in on OpenAI.

An investment arms race is already underway.

Not to mention the need for unicorns to bouy the casino we call Wall St. Get ready for perhaps the biggest bubble we've ever seen.

3

cantbuymechristmas t1_j6v7ocg wrote

if anything ai will read up about humans after we have passed and maybe bring us back from some frozen genetics. so i say that’s a win for the species if done correctly. thanks future ai if you can read this..

or venture far out into deep space in hopes of finding a suitable host for our species. the imagination is where spirit touches future realities

1

TacomaKMart t1_j6v1qzh wrote

The same is true for OpenAI's 20 dollar premium plan. If a small startup like you.com can make a working service, It won't be long for every major internet company from Naver to Yandex to Amazon to even freaking Yahoo to roll out their own, for free.

This 20 dollar premium access is temporary.

2

Surur t1_j6v0xyu wrote

As you mentioned yourself, an AGI would not have human considerations. Why would it inherently care about rules and the law.

From our experience with AI systems, the shortest route to the result is what an AI optimises for, and if something is physically allowed it will be considered. Even if you think something is unlikely, it only has to happen once for it to be a problem.

Considering that humans have tried to take over the world, and they had all the same issues around the need to follow rules etc they are obviously not a real barrier.

In conclusion, even if you think something is very unlikely, this does not mean the risk is not real. Of something happens once in a million times it likely happens several times per day on our planet

1

AsheyDS t1_j6uzur0 wrote

This is much like the paperclip scenario, it's unrealistic and incomplete. Do you really think a human-level AGI or an ASI would just accept one simple goal and operate independently from there? You think it wouldn't be smart enough to clarify things before proceeding, even if it did operate independently? Do you think it wouldn't consider the consequences of extreme actions? Would it not consider options that work within the system rather than against it? And you act like taking over the world is a practical goal that it would come up with, but is it practical to you? If it wants to make an omelette, the most likely options will come up first, like checking for eggs, and if there aren't any then go buy some, because it will understand the world that it inhabits and will know to adhere to laws and rules. If it ignores them, then it will ignore goals as well, and just not do anything.

2