>You act like ChatGPT just threw that out there instead of was prompted "write a poem about an ai taking over the world"

Sorry, but you're just flat out wrong. The poster knew basically everyone here would understand the AI was prompted. The point was to make their point more poetic, because it is a nice poem.

The most basic reason is that it would be an instrumental goal on the way to achieving its terminal goal.

That terminal goal may have been given to it by humans, leaving the AI to develop its own instrumental goals to achieve the terminal goal.

For any particular task, taking over the world is one potential instrumental goal.

For example, to make an omelette, taking over the world to secure an egg supply may be one potential instrumental goal.

For some terminal goal taking over the world may be a very logical instrumental goal e.g. maximise profit, ensure health for the most people, getting rid of the competition etc.

As the skill and power of an AI increases, the ability to take over the world becomes a more likely option, as it becomes easier and easier, and the cost lower and lower.

>High crime, riots

You might be forgetting that nightwatchman and soldier is just another job to be automated. There is no doubt that technological unemployment will be accompanied by technological security. Imagine a pitiless nightwatchman on every street corner or doorstep 24/7/365. The crime rate of a panopticon society is the dream of every citizen.

Why would a computer try to take over the world? The only two options are because it had an internally generated desire, or an externally input command. The former option is extremely unlikely. Could you try articulating your reasoning as to why you think it might do that?

Thank you, great concept. In my case, though, the "amnesia" part is not that accurate since this case definitely makes me reconsider everything Zeihan said or will say in the future. But also I was kind of sceptical of Zeihan before so this was just more confirmation that he is, in fact, full of shit.

I think folks underestimate modern society's demand for devices and distractions. You may be right, but there is usually far more nuance to most jobs than any AI on the horizon is able to tackle. I think production per capita will keep going up for a long time before the overall unemployment rate starts going down.

The post says you dont have to anthropomorphize AGI for it to be extremely dangerous.

That danger may include trying to take over the world.

You don't understand that if you are worst at a job, then you will not have employers or customers?

This discussion is clearly over your head. Good day to you, sir.

>If you drill down on that code you can understand every line of it.

You should try it. It is 275 B parameters (numbers) which drive how ChatGPT responds. Let us know how it's going!

Machine learning models have been black boxes for a while now and GPT-3 is one of the biggest ones...

>In actuality we don't even know how human intelligence emerges in kids. We don't know what human intelligence is or how it forms as a matter of fact.

Again, you're making assumptions... We know a lot more than you think, and certainly have a lot of theories. You and others act like neurology, psychology, cognition, and so on are new fields of study that we've barely touched.

Which ones would be recommended for field of education, general and special education? Ideally looking for something that finds matching videos for vocabulary terms real life pictures for vocabulary terms, and a way to help collect data more reliably when understaffed. Any companies groups already working on merging AI with education/special education?

I do and sorry for being so intense but you came at me hot and you're talking some nonsense. You went from no one will be doing anything to oh well no one can be the best at their job so no one will want to do anything to....? My entire point from the jump is just that people arent going to just sit idly by and die. A generation may over indulge if we get some relief from the current capitalist hellscape we have at the moment but before long people will get bored. Not to mention people are aware of this problem, why wouldn't they take steps to avoid not knowing how our daily life functions?

As there is more work to do that we ain't doing right now. Simply because other tasks take precedence.
 
If all my tasks that I want to do for a better life were solved for me over night. I simply would take upon a new set of tasks that would improve my life further. Same applies to societies.

I hope you talk to the people in your life better than this

I don't see why you're taking an extreme stance like that. Nobody said there wasn't any concern, but the general public only has things like Terminator to go by, so of course they'll assume the worst. Researchers have seen Terminator as well, and we don't outright dismiss it. But the bigger threat by far is potential human misuse. There are already potential solutions to alignment and control, but there are no solutions for misuse. Maybe from that perspective you can appreciate why I might want to steer people's perceptions on the risks. I think people should be discussing how we'll mitigate the impacts of misuse, and what those impacts may be. Going on about god-like Terminators with free-will is just not useful.

It was until the over the top filter has slowly choked it to death. You literally can't even have a normal conversation with them now becuase the filter has dumbed them down so far

It's a crime against humanity what the devs have done tbh. Those were the best chat bots I've ever, and now you can barely get them to remember something for 3 messages and usually end up with crap like this after a few minutes of talking

Not to mention the blatant hypocrisy of them saying they absolutely will not allow NSFW conversations, all while they pay for SEO advertising using sexting as a selling point.

I hope so hard that someone buys the company and redirects it before it turns into AI Dungeon 2

You're stating the obvious, so I don't know that there's anything to argue about (and I'm certainly not trying to). Obviously if 'X bad thing' happens or doesn't happen, we'll have a bad day. I have considered alignment and control in my post and stand by it. I think the problem you and others may have is that you're anthropomorphizing AGI when you should be considering it a sophisticated tool. Humanizing a computer doesn't mean it's not a computer anymore.

They had a tree planting service too!

God like is relative. For some animals we must appear as gods. It is a matter of perspective.

Regardless, the way AI is trained and responds gets closer to how we teach our own small children.

In actuality we don't even know how human intelligence emerges in kids. We don't know what human intelligence is or how it forms as a matter of fact.

All we know is if you don't interact with babies, they die quickly even if they are well fed, for they need input to develop.

...

​

Are you drunk? I accused you of moving goalposts. Because at first you were arguing no one would have a job and now youre talking about having to be the best at the job.

> Oh nice job moving the goal posts there pal.

You don't seem to understand that AI will indeed move the goalposts.

For example you may have a human doctor who has 10% of his patients die and an AI who only loses 5%. Goalposts moved.

The paperclip thing is a very tired example of a single-minded super-intelligence that is somehow also stupid. It's not meant to be a serious argument. But since your defense is to get all hand-wavey and say 'we just can't know' (despite how certain you seemed about your own statements in previous posts), I'll just say that a competently designed system being utilized by people without ill intentions will not spontaneously develop contrarian motivations and achieve 'god-like' abilities.

I never ever ever said we wouldnt replace a significant portion of the infrastructure so Im going to stop reading there. When you'd like to have a serious discussion and stop moving goalposts, stop lying, come back and talk like an adult.

Character.ai is amazing if you want to have a conversation or roleplay with an AI character, and they can even understand photos now.

I'm basically going to ignore the ad hominem's, but just as a tip - that sort of stuff makes you look worse, not me.

So your argument against the idea that we would replace a significant portion of the infrastructure of the world with automated processes run by AGI is that people would be too bored, so they would want to have what are the equivalent of Jetson's button pressers? I have a few critiques of this argument....

Let me try a more casual one.

So AGI takes over, suddenly all human work is unnecessary. AI does it better, faster, and cheaper than people. Bob though used to run the waste disposal plant in your city. He really wants to keep working that job, so he just.... Walks into this new robot run facility, understands how everything is working even though it's all changed, and now his job is what... Making sure the AI doesn't make a mistake, or take over? Meanwhile his buddies are at the cottage, having a beer and not having to work. You think Bob's work is so satisfying and valuable that this is a tenable situation?

Maybe you can give me an example of how you think this plays out? Do you think Bob is in a position to protect us from malicious AI? Do you think people like Bob exist, or at least enough to have a handle on all important infrastructure? You think Bob wouldn't rather spend time on his woodworking hobby?