Reminds me of a great book: "la formule de Dieu" (The Einstein Enigma in English ?)

You play a game and the random npc you just killed has an entire history generated by AI. It has his birth day, his passions, fears, life accomplishments, what he did in his life to lead up to that very moment he got killed by the PC. A full glossary of his life can be accessed.

That'll be game changing.

ST is exactly what I was thinking when I wrote the "I'm talking to myself" part. The Bell Riots didn't happen and we can't depend on Cochrane to save us with the warp drive. We need to make our own future and choose progress.

[deleted]

Star Trek is probably the one exception to this lol

If you don't believe in humanity and humans are creating this technology, you're going to be let down I think. AGI or ASI won't be all good or all bad as nothing ever is.

Knowing Southpark, I wouldn’t be surprised if Cartman’s Mom’s dildo became truly sentient and used as a means for first contact… Not my proudest comment.

"Google releases an AGI. LGBT+ and PoC most affected"

That also requires a mechanism. I firmly believe that an AI can't actually experience emotions just by learning a lot of information about them. Mimic them, sure, but I don't think you can just spontaneously develop a system through which emotion is felt.

If you had affordable technology capable of experiencing real conscious happiness and suffering implemented in software wouldn´t you be morally obliged to instantiate as much conscious bliss as you could afford?

I expect that when super intelligence happens we won't know it until it's been controlling us for years.

I’d say we have much more control of our own personal lives now than we would during a singularity. We also can’t individually determine what technology hits the market (and what it does to society), but we can control our own decisions and reactions to said technology right?

By pretty much every account, we are way more in control of our own lives than we are of automation and AI. So it’s kind of a silly comparison in a way.

Character AI quest exists. If you could crunch that down into a game I think it would be more than capable of simulating a personality better than we would ever desire in a video game.

Let's imagine that you have created an AI that is capable of making realistic human behavior but doing so inevitably leads to full consciousness. So there is no way to have it seem human without being fully conscious.

In that case, you wouldn't have the individual NPCs reach have their own AI. Rather, you would have a single GM AI that controls all the characters. It wouldn't feel poison anymore then I feel pain when I write a story with realistic characters.

There is no circumstance I'm which it would be whether desirable or moral to create sapient entities for the style purpose of murdering them.

it’s very exciting to be a part of this time in history

Hell yeah! Sounds fun as hell. It'd be awesome if we could also create our own hellish environments as well and speed up their subjective time.

Which one is at a lesser degree?

Well, it seems that they had a budget of around $100 for the Paris launch of their Bard AI.

It might be that if we separate the different parts of the AI enough in space, or add enough communication delays between the parts, then it won't experience feelings like suffering, even though the outputs are the same?

Idk, there's no answer.

To me a created Nazi (even in a video game) and a naturally developed one, if both sentient, would get the same treatment.

[deleted]

I don't believe in creating unnecessary suffering, even if it is a Nazi. Retributive approaches to justice are cruel, I believe.

I'd want to rehabilitate them ideally, or move them to a place where they are unproblematic.

yes it does

People are interested in sports, gossip, politics and maybe seven other things. AI is never one of them. My friend Fred says that the early internet was like that too. IMO ChatGPT is like the Java applets of those days. Now obsolete because of better technology. However, the number of internet users doubled each year back then. According to what I have read online ChatGPT has 100 million daily users. This is much more than the number of web users in the beginning of the internet.

So Fred says that we will get a 10x boost by EOY in performance. It could come from model compression or something else. If Bard, Claude, Ernie, and the other bots are any good, we could expect a billion daily AI users. Fred wants to do a code generation startup in one programming language. It's a niche product, but he says that we can have a million users. Obviously there's companies who can do the same, but on the other hand Twitter started out like a basic app and look where it is now.

We hate Nazis because of the choices they made. If an NPC was created a Nazi for your enjoyment, he didn't make any choice, it's not his fault.