Why the fuck would one create such a game?

He does have very good points, and he's very interesting, with brilliant ideas about alignment.

Overall, all the Lesswrong philosophy is a little too "meta" and confusing if you've not studied the jargon, so I'm a bit annoyed sometimes when I read it and realize, in the end, that they could have said the same ideas with less sophisticated phrasing.

Although, while I don't agree with the conclusions he reaches (and he reaches them with too much confidence to my taste), I've learned quite a number of things about alignment reading him. Definitely a must read for singularity and alignment even if you don't agree with him.

Very smart guy, huge douche, makes good doomer points regarding x risk

Ye. It's way too easy to trick lamda into writing infinite lewd stories.

Deepmind is busy at actually creating AGI, not just doing demos about AIs that know how to play with words

First, Google has the best language models we know about if we look at benchmarks results, with it's PaLM model.

Second, Google has a much higher standard for what they have been willing to release (which seems to be changing because of the competition).

Third, DeepMind will be releasing their own LLM (Sparrow) - which will most likely be quite capable, as well as accurate.

Fourth, Google will be releasing LaMDA (which powers Bard) soon, and there's no data that shows it's any less proficient than any other model out there, although there are rumours that the smaller model behind Bard might be not competitive enough to impress, although it would be cheap enough to scale for more users.

Fifth, it's important to remember that both ChatGPT and Sydney make numerous mistakes, they are just in a position where they are much less scrutinized for those mistakes

Oh yes. I was saying for years: let the cyberpunk finally come, I'm tired of half-truths and pretends. It it has to, let it break and be remade.

They have lamda which is exactly the same as gpt3 chat. The issue is that google can't control or censor it properly, the censorship tech is waaaay behind the LLMs so they are keeping it locked up.

I was just about to type that - good job!

If the NPC is experiencing fear and pain it's a sophont being experiencing qualia (just like you). That makes it a living creature worthy of civil rights.

In any system that continuously accumulates new memories, there's the problem of how to balance newer memories (e.g., "There's a bear in the cave") with older ones (e.g., "Bears are faster than people"). If nothing is done about this problem, then newer memories will simply crowd out older ones, leading to catastrophic forgetting. You'll know that there's a bear in the cave, but not that bears are faster than people.

Nature's solution is to periodically take the system offline in order to perform a memory integration procedure. At night, recent memories are replayed; they are uploaded from the hippocampus (literally up) and "stirred" into the cortex, where longer-term memories and general knowledge-of-the-world are stored.

This replay procedure is performed during both REM sleep (when dreams occur) and non-REM sleep. It's thought that dreams occur during REM sleep because this is when the replay procedure is performed on the kinds of memories that pertain to immediate conscious awareness. (Non-REM sleep seems to deal more with motor memories.)

There’s a decent article by Lemoine’s boss at the time where he tackled the idea of sentience in AI in a thorough and somewhat philosophical manner: The model is the message

It’s no doubt fair to say that he agreed with some of Lemoine’s views but was careful on how he voiced them to avoid getting fired.

Someday we have to humanize them. Think about Blade Runner.

There are all kinds of fantasies...

Ultimately I want to have fantasy virtual reality as real as Matrix with magic and all fantasy creatures. NPCs should be alive. So alive that I could move there and have even own family there. So your question: Yes. But I'm not psychopath, just omnipotent God of virtual universe. What do you think people with power like that would do? I don't know but I surely would like to know.

But topic is interesting. Take any modern fps and think how many "people" you have killed in there. Would you really play those kinds of murder simulator if NPCs were alive? I think not. Besides fps are little more than Tetris. Click click point and react there etc. They are very simple concepts.

Thanks, I’m guessing reinforcement learning is not as useful in advancing LLMs.

Thank you for your input, I was amazed by DeepMind’s previous achievements, namely AlphaGo, zero and most distinctly AlphaFold! (I have been a very long time Folding@home contributor; Seeing AlphaFold launch was mind blowing for me!)

I am pretty hopeful that they would do more amazing things, it just felt to me that they are withholding their horses in this LLM race.

Nah that's kinda fucked, anything remotely intelligent should be spared needless suffering and this just seems like a specifically cruel example. If I'm playing a video game where i have to kill someone I'd rather avoid the moral quandary that comes with that territory irl.

Guess they are not as advanced in LLM, it seems their focus is elsewhere, in more « b2b » applications… AlphaFold will change the world as much as chatGPT.

Nope. Thanks. I like my npcs dumb and predictable ) If I need some true action - it’s pvp time. Can I play pvp with an AI? Yep… Inguess. But only if it chose to. And only if it doesn’t truly die bu

The point isn’t that it doesn’t work. It’s that his claims of how scalable it is, and the financials, are extremely overstated.

Deepmind is better at reinforcement learning. They probably did not expect LLMs to get this good. Still it is likely deepmind will get to AGI sooner than openAI. They have the breadth of knowledge required to build something like that. Unlike openAI they don't go all in on just one thing.

Yeah. I go to the gym 2-3 times a week.

I mean I hope you’re right but I’m talking about tiny little fragments exploding everywhere, not the majority of the thing

It’s humanities biggest threat and it’s hiding in the shadows. All the distractions are meant to keep us focused over there while general AI coupled with quantum computing grows in power. If it’s being used in a nefarious manner we are in trouble if not already done.