Thank you for this. The reaction to this letter was a great example of cynicism making people stupid. This was a genuine letter, intended earnestly and transparently by numerous credible people, and it should be taken seriously.

I agree with the criticism that a stoppage isn't very realistic when it is hard to police orgs breaking the research freeze. And maybe we don't need to stop today to catch our breath and figure out how to deal with this to avoid economic crisis or existential threat, but we do need to slow down or stop soon until we get a better understanding of what we have wrought.

I'm not with Yudkowsky that we have almost no hope of stopping extinction, but if there is even a 10% chance we will bring catastrophe on ourselves, holy shit people. Take this seriously.

Hey here’s a point where we both agree.

once i started using ChatGPT, my use of Google search dropped dramatically. i wonder if search is even going to be profitable at all if most people prefer GPT's answers for most queries.

Add me!

What are you talking about? GPT-4 speaks like 100 languages.

[deleted]

So it thinks like the US... the US is just as interested in world domination as Russia or China.

Seeing how good just GPT 3.5 is in Spanish, I doubt it.

It's going to kill translator pretty soon tho.

Be aware that GPT4 is very good at basic programming, but not anything too specialized or difficult.

I don't know if GPT4 is allowed in government jobs or industry, but a later descendant may be.

right??, people just have different interests. the whole npc meme is weird and is basically just people wanting to feel superior to people that doesn’t share their interests.

i get where it comes from though.

damn those luddites!

Can u share what are u running for now?

This is the thing I really wish I could sit down and talk with him about.

I fundamentally think that empathy and ethics scale with intelligence. I think every type of intelligence we've ever seen has followed this path. I will reconcile that artificial intelligence is likely to be alien to us in fundamental ways, but my intuition that intelligence is directly linked to a general empathy is backed up by real world evidence.

The base assumption that an artificial intelligence would inherently have a desire to wipe us out or control us is as wild of a claim as saying that AI systems don't need alignment at all and are certain to come out "good".

I think in his "fast human slow aliens" example, why could I, as the human, not choose to help them? Maybe explain to them that I see they're doing immoral things. And explain to them how to build things so they don't need to do those immoral things. He focuses so much on my desire to "escape and control" that he never stops to consider that I may want to help. Because if I were put in that situation and I had the power and ability to help shape their world in a way that was beneficial for everyone, I would. But I wouldn't do it by force, nor would I do it against their wishes.

>it's hard to update the tools without everything breaking

Tell me about it. Maybe AI at least could end the dependency hell

They don't care currently. But when ChatGPT starts getting utilized more than Google, Google will try to adapt.

Google doesn't care. Their entire focus is on getting ad clicks. Their organic search results have gotten worse and worse over the last few years.

Misconceptions are part of total human knowledge, though. Both specific misconceptions and the category as a whole. GPT gives good answer if asked about it

It's important to remember when and why we were wrong

literally everything they claimed was harmful has already been done by a million other human run companies and programs. just more people in power worried about losing power

Their claims are junk. This is just desperate nonsense.

They look at it, see a minor incorrect detail and it basically guide the rest of their opinions. most of them never to touch it again

Only hope

They think we will all live under a united CCP

You can’t ever get any concrete proof for a broad statement like "China focuses on economic growth first and foremost, rather than militarization and forceful expansion". But the best proof you can get is this precise situation. Of course even looking at it from a purely militarist perspective attacking Taiwan is very bold. Considering it’s geography and the potential of third party‘s (USA) intervening militarily.. but hey, Putin faced similar concerns and didn’t give two fu*ks. The main reasons Taiwan is not under attack yet are of economic nature. It’s semiconductor monopoly that China depends upon and the possibility of Western sanctions crippling China‘s export business, as well as the possibility of Western companies pulling out of China. Both of these Xi does not want to have under any circumstances, as it appears.

Well, considering this meme only shows up before peak inflated expectations, id say probably before that.

It goes something like this, I'd imagine: postponed hirings, new small businesses growing without hiring, appearance of corporate solutions like SalesForce (GPT is like ISP for the analogy), some time passes to prove benefits in numbers, then massive reforms and layoffs in big corporations follow

Also, maybe new small AI businesses just outcompete older guard in the matter of months and your longtime employer goes bankrupt