Because incomprehensibly smart humans are so much safer than AI.

Unfortunately school shootings are becoming quite "generic". What is there to say besides the usual "thoughts and prayers"..

[removed]

He uses thought experiments and unreasonable scenarios to get attention. If this is for commercial reasons, or his mentality, that I don't know. If it would be clear that these are just abstract thought experiments, it wouldn't be a problem, but he acts like these are real threats. He, and other similar "researchers" are building their scenarios on claims like

- AGI or ASI is going to be one algorithm or network, so no insights, no filters possible, ...

- someone will give it the power to do things, or it will seek these powers on it's own

- it will do things without asking and simulating things first, or it just doesn't care about us

- the first one build will be a runaway case

- it will seek and have the power to change materials (nanobots)

- there will be no narrow AI(s) around to constrain or stop it

- no one will have run security tests using more narrow AIs, for example on computer network security

- he never explains why he beliefs these things, at least he's not upfront in his videos about it, just abstract and unrealistic scenarios

This is the typical construction of someone who wants something to be true: Doomer mindset or BS for profit / job security. If he had more influence, then he would most likely be a danger. His wishes for more control of the technology show that. He would stop progress and especially proliferation of the technology. I'm very glad he failed. In some time we'll might have decentralized training, so big GPU farms won't be absolutely necessary. Then it's gonna be even more over than it is already.

Edit: Typo (I'm not a native English speaker)

Yeah, reminds me of a late Seinfeld episode about whether or not it's impolite to make an important phone call on a cellphone.

It was 5 Morbillion parameters

Got some articles for me to mock?

Yeah, in this case the only real issue is that tacking on 'made by ChatGPT' feels kinda weird. I feel like in society we like to keep up appearances and pretend like there's this level of special sincerity in those kinds of messages, but we all know that when we go to write them we're just copying ideas from other similar messages we see elsewhere and doing our best. It's rarely something truly personal, but it's a bit crass to pull back the curtain and show that.

lmao bro, some guy dares question the machine god!

luddites need to burn!😍😍😍😍😍😍

I use ChatGPT to write all of my emails that require more than a line or two, then I go through and make edits as necessary.

We live in strange times, this is like someone in the late 80s writing an E-MAIL to address fatalities, they couldn't even write a normal letter and send it in the mail like everyone else??!

In a couple years we'll look back and nod at how dumb this is.

I respect the fact that he started thinking seriously about AI security early on, but he got stuck in a dead end paradigm of AI security ("friendly AI") where we assume the AI will be all-powerful and our only hope is for its goals to be perfectly aligned with ours. As the flaws of this approach became increasingly apparent, instead of considering other AI security paradigms he just became increasingly pessimistic. He also seems to have a pretty big ego, which prevents him from reconsidering.

Wtf I don't want to interact with a torture simulation

[deleted]

Harry Potter and the Methods of Rationality was great

There was that very popular but completely unfounded rumor about 100T param count. It was debunked by Sam Altman himself.

If you think about it for just 1 second you would realize that 100T param model would need at least 200 TB of VRAM or 2560 Nvidia A100s...

[deleted]

32k tokens would mean approximately 150 kB of text. That is a decent sized code base! Also with this much context memory the known context saving tricks would work much better so this could be theoretically used to create code bases of virtually unlimited size.

This amazes me and also (being software dev) also scares me...

But, as they say, what a time to be alive!

Wow, yeah, this looks amazing. My biggest issue with GPT-3 is the relatively small context window. This will open so many new possibilities.

When is the liquid available for injection?

I think he’s probably too far on the pessimist side, but we need people presenting both extremes. The truth is usually somewhere in the middle.

Exactly this, Google has several very powerful LLMs in play. Looking at the slow motion disaster that is the Bing chat it looks to me that it was perhaps prudent for them to wait a bit instead of rushing.

People are nuts if they don’t think chatgpt is writing all manner of communications. It is very capable of doing so. It still takes finishing work by a human and a proofread for sanity, but definitely yields a good first draft.

"You borrow my brain you'll be like dude can't handle it" -- Charlie Sheen

[deleted]

Google is very strong in LLMs as well, they have several models of excellent quality. For example Google PaLM is 3x bigger than GPT-3.

However, it is rumored that Bard is a scaled down version of Lamda, only a 2B parameter model but trained on a lot more data than GPT-3. The size would probably make it somewhat less powerful, but also dramatically cheaper to run. It is also possible they have some secret sauce that would make a lot smaller model competitive. We shall see.

I think the Google's problem is that they currently completely dominate search and any disruption is simply not good for them as they have everything to lose and not much to gain. Also search is pretty much the only way Google makes money. So this is existential for them. But make no mistake, they are the clear leader in AI in spite of recent advances by OpenAI and Microsoft.