Recent comments in /f/singularity

GorgeousMoron OP t1_je80gha wrote

I think that's a fair point, but I also think it's fair that none of us have any way of knowing whether the chances are 50-50 or anywhere close. We know one of two things will happen, pretty much, but we don't know what the likelihood of either really are.

This is totally uncharted territory here, and it's probably the most interesting of possible times in history. Isn't this kinda cool that we get to share it together, come what may? No way to know why we were born when we were, nor must there be anything resembling a reason. It's just fascinating having this subjective experience at the end of the world as we knew it.

13

DisgruntledNumidian t1_je80cgy wrote

> The ASI is simultaneously so intelligent that it can instantly understand the vast secrets of the universe but too stupid to understand the intent and rationale behind its creation

Most humans are considerably more intelligent than the basic selection mechanisms that gave bacteria sexual reproduction as an evolutionary fitness strategy. We know why it exists and that it is attempting to optimize for maximal reproduction of a genome. Does this stop anyone from satisfying its reward mechanism with cheats like contraceptives and masturbation? No, because being intelligent enough to know what a system is trying to optimize with a reward does not mean intelligent agents will or should care about the initial reasoning more than the reward.

9

GorgeousMoron OP t1_je803n5 wrote

Yes, I agree, but I don't think there's any realistic way this is going to happen given the current geopolitical situation.

My mind could change on this, but I doubt it will: Pandora's box has been opened, it is impossible to close, and we'll just have to wait & see what happens or participate and try somehow to steer it or become more enlightened in the process, or both.

Either way, this is a ride we can't feasibly get off.

3

GorgeousMoron OP t1_je7zoob wrote

Yeah, that's fair as it pertains to AI, more or less. But, I don't think we're necessarily building it with any unified "intent" or "rationale", increasingly: it's more like pure science in a lot of ways--let's see what this does. We still have pretty much no way of knowing what's actually happening inside the "black box".

As for the universe itself, what "vast secrets"? You're talking about the unknown unknown, and possibly a bit of the unknowable. We're limited by our meat puppet nature. If AI were to understand things about the universe we simply cannot due to much more sophisticated sensors than our senses, would it be able to deduce where all this came from, why, and where it's going? Perhaps.

Would it be able to explain any or all of this to us? Perhaps not.

3

Superschlenz t1_je7znzd wrote

She had only one video with the topic AI at https://m.youtube.com/watch?v=fbFUaM1p2l8 for the 2005 "Robots" movie, I don't think her signature is authentic. She is still on stage today, but Sarah Connor is not her real name. Maybe another Sarah Connor has signed the letter.

2

Iffykindofguy t1_je7zkln wrote

We are a doomed society if we dont make serious changes regardless. I'd rather gamble those changes are based off as much advanced science and understanding as we can rather than the alternative which appears to be capitalism and religion. Thats how I see it. We are all going to die if something doesnt change either way. At least the people in the northern hemisphere. Maybe thats for the best.

23

MichaelsSocks t1_je7yneu wrote

The problem is, without AI we're probably headed towards destruction anyway. Issues like climate change are actually a threat to our species, and its an issue that will never be solved by humans alone. I'll take a 50% chance of paradise assuming a benevolent AI rather than the future that awaits us without it.

50

t0mkat t1_je7y77s wrote

It would understand the intention behind its creation just fine. It just wouldn’t care. The only thing it would care about is the goal it was programmed with in the first place. The knowledge that “my humans intended for me to want something slightly different” is neither here nor there, it’s just one interesting more fact about the world that it can use to achieve what it actually wants.

3

Prevailing_Power t1_je7y5qp wrote

The great equalizer. Once everyone is out of work, but still needs to live, what is the point of money? Clearly the AI is going to create so much profit for humanity that they will have no choice but to share or suffer a tidal wave of humanity crashing down on them. There will be no where to flee because it will be total chaos if they don't manage it right.

There's a very real risk that they're going to lose their power.

9