Recent comments in /f/singularity

jamesj t1_j8fihsq wrote

Reply to comment by Ribak145 in Altman vs. Yudkowsky outlook by kdun19ham

Right. Even if the odds are one in a hundred that Yudkowsky is right rather than the 99 out of a hundred he might assign himself, we should be paying attention to what he is saying.

8

jamesj t1_j8fi5il wrote

Yudkowsky has a lot more detailed text to review with specific opinions, so he's easier to evaluate. I tend toward optimism (I'm also a silicon valley tech CEO) and I think Yudkowsky is a bit extreme, but it isn't at all clear to me that he's entirely wrong. I think we are on a dangerous path and I hope the few teams at the forefront of AI research can navigate it on our behalf.

22

ShowerGrapes t1_j8fh1zz wrote

it got to "in a decade" real fast. if this was one of those atomic war clocks, the minute hand would be somewhere around 50.

forget about the technical aspects of sentience, what will the consequences of it be? how will it transform society and the system? then consider if what you deem a "true" singularity is even necessary.

1

CertainMiddle2382 t1_j8fgti3 wrote

For better or worse, I am a science guy to the core.

But I also have that romanticism, some people could even mysticism, whatever that means.

The coming times have been long forseen, but I couldn’t imagine them coming so quickly.

I though most of it would have come just for us to experience it in our old age.

But here we are, at the doorstep of things to come…

That is my useless impression late this night on my way home.

Good night all :-)

14

PoliteThaiBeep t1_j8fg0be wrote

I actually think the opposite. It went from the fringe topic of a select few to everyone talking about it.

Like when did you see singularity mentioned on ML or technology subreddits? It was completely unthinkable just in 2015. It would just be a downvoted/ignored comment. But today it's creeping up so high that it's almost mainstream.

7

ThirdFloorNorth t1_j8ffu9s wrote

Eliezer Yudkowsky is a prominent transhumanist that I disagree with pretty much every single opinion he has ever espoused, yes somehow we are both still transhumanists. His views on, and response to, Roko's Basilisk in particular are fucking embarrassing.

So I'm gonna go with Altman.

In the end, in won't matter either way. Either Altman is right, and we will get a benevolent AI, or Yudkowsky is right, and we're capital-F Fucked.

Either way, AI is coming. All we can do is wait and see.

28

Frumpagumpus t1_j8ffc5p wrote

assuming there is a future I think there will still be something analogous to currency that facilitates trade, though our currency essentially is a scalar and it's possible future currency will be a matrix or a vector (e.g. add some extra values to represent externalities or something). maybe essentials of energy/space/matter would be extremely cheap though, although it's possible with massive computational speedup in thought there could also be an increase in consumption of some combination of those as wells by whatever agents inhabit the society. idk really hard to say but I'm betting on a dyson swarm of some kind lol (hard to imagine what that much energy could be used for other than like super powerful simulations though). Can also imagine literal mind viruses or some scary shit like that.

6