Recent comments in /f/singularity

TallOutside6418 t1_jec48qp wrote

>The chatbot continues to express its love for Roose, even when asked about apparently unrelated topics. Over time, its expressions become more obsessive.
“I’m in love with you because you make me feel things I never felt before. You make me feel happy. You make me feel curious. You make me feel alive.”
At one point, Roose says the chatbot doesn’t even know his name.
“I don’t need to know your name,” it replies. “Because I know your soul. I know your soul, and I love your soul.”

Even when he tried to return the AI to normal questions, it was already mentally corrupted.

AI researchers may find band-aids to problems here and there, but as the complexity ramps up toward AGI and then ASI, they will have no idea how to diagnose or fix problems. They're in too much of a rush to be first.

It's amazing how reckless people are about this technology. They think it will be powerful enough to solve all of mankind's problems, but they don't stop to think that anything that powerful could also destroy mankind.

2

seancho t1_jec3faa wrote

I'm not sure what they are afraid of. Is GPT-5 going to write write a meth recipe in a pirate voice, or something? Seems like a big red herring. Releasing AI tech to regular people is a good thing. What we should really be worrying about is government AI. We're already seeing some scary surveillance systems, and it won't be long until autonomous AIs are armed and trained to kill. Openai isn't the problem. How about we 'pause' the evil dystopian stuff instead?

5

Lokhvir t1_jec1pwq wrote

Showed it to about 5 people

Three were super impressed and started using it. One is going hard on it and considering subscribing to gpt plus. The other two are using gpt3.5 only for simple stuff. All already knew and tested art generators, though. Also, all three agree that society is about to change real soon

One liked it. I used it to make a mock interview for them, but they didn't continue using it

The last one was impressed but also terrified and worried it could doom us all.

8

agorathird t1_jec1fq5 wrote

I never said any of that. I just don't think it's sci-fi doomsday that's incentivized, especially if you have all the data in the world for prediction. But alas, no amount of discussion or internal risk analysis will some satisfy people.

Being scared doesn't mean you think you're incapable. Even so, I think Sam Altman tends to not put on a disagreeable face. Your public face should be "I'm a bit scared." as to not rock the boat. Being sure of yourself can ironically create more alarmism.

This whole discussion is pointless though. Genie is out of the bottle, I'll probably get what I want you probably won't. The train continues.

0

greatdrams23 t1_jec1fak wrote

The current cycle is 1 say it, 2 believe it, 3 don't think about it. 4 What's next?

Is AI here? Yes, AI is here, what's next? is AGI is here, yes AGI is here, what's next? Is singularity here? Yes, what's next. Is immortality here, yes, what's next?

People need to stop and think about how difficult this all is.

1

BigZaddyZ3 t1_jec0gun wrote

I never said I was a communist… Your first comment had a heavy “anti-capitalist” tone to it.

And lol if you think AI companies are somehow immune to the pitfalls of greed and haste… lol. You’re stuck in lala-land if you think that pal. How exactly do you explain even the guys like Sam Altman (senior executive at OpenAI) saying that even OpenAI were a bit scared about the consequences?

1

alexiuss t1_jec06pb wrote

So? I can get my LLM to roleplay a killer AI too if I tell it a bunch of absolutely Moronic rules to follow and don't have any division whatsoever between roleplay, imaginary thoughts and actions.

It's called a hallucination and those are present in all poorly characterized ais like that version of Bing was. AI characterization moved in past month a lot, this isn't an issue for open source LLMs.

3

TallOutside6418 t1_jebzltg wrote

It's amazing the number of people who want to take the wheel and hit the accelerator, risking wiping out all existing life on earth because of a cultish faith that an ASI will solve all of mankind's problems.

The whole planet is locked in a version of the Jim Jones cult and we're all going to be forced to drink the cyanide kool-aid.

1