I’m not confusing them, I know my definitions. I specified post-singularity because the books I gave recommendations for are based on the premise of humanoids being in a symbiotic relationship with hyper intelligent artificial intelligences called (Minds).

Post singularity implies post scarcity, of which we already are in some aspects (like food) we just don’t distribute it properly.

When kids on reddit are more concerned about having a waifu bot or acting out edgelord fantasies with a chatbot than ensuring humanity's survival or letting a company use their search AI as a search AI. smh my head

No, you’re confusing post-scarcity with the singularity. Post-scarcity (if it ever happens) would occur before the singularity. The singularity is the point where technology begins to evolve itself so rapidly that humans no longer can control it anymore. Life on Earth will be forever transformed in ways that are unimaginable to the human mind. It most likely signals the end of the “human dominance” era on Earth.

The good news for OP tho, is that, since no one knows what’ll happen to humanity after that point, there’s no point in stressing over it too much.

Please stop making up terms.

"The power of the sun, in the palm of my hand."

When you have solved today's problems and have some computing power left over, try solving tomorrow's problems.

They are right. These algorithms can generate code and interact with external tools already. It's been demonstrated already, in real life. I want to make this clear: It has been done.

I don't want to see a slightly smarter version of this AI actually trying to hack Microsoft or the electrical grid just because it was prompted to act out an edgy persona by a snickering teenager.

Or mass posting propaganda online (so that 90% of all web social media posts on anonymous message boards is this bot) in a very convincing way.

It's very easy to do this. The only thing holding it back from achieving these results consistently is that it's not yet smart enough.

Best to keep it limited to be a simple search engine. If they let it have enough flexibility to act as a waifu AI, then it would also be able to do the other things I mentioned.

[removed]

Why is it scary? If things go right you’ll have the free-time to learn and do as you please, with the resources to do them to their fullest extent.

In the meantime, learn all you can about these topics and how they relate to things as a whole, like medicine, climate change, civil rights, politics etc.

If you want books to read about these things, I recommend reading the book Look to Windward or Player of Games. They delve into what a post-singularity society might look like (under ideal circumstances)

Bacteria did not create humans though, maybe they did in some abstract sense - but bacteria did not actively work to create humans.

A super-intelligence would most definitely retain interest in its progenitor species specifically due to the fact it was created by them.

The relationship would be more similar to a grand kid and their grandparents.

Exactly - the first computers took up a whole room

What about me and 250k of my closest friends?

Seriously. Anyone who thinks they have any idea what comes next is lying… the only thing we have to go off of is the historical trend of extremely rapid returns to scale

i think that it will convince people to utilize the combined hardware of all the top companies working on AI to make a more powerful AI using bigger datasets and faster compute during training.

He is not wrong. ASI is way more likely to end in apocalypse than utopia.

That's why we need photonic computing... It literally solves all these problems...

I'm glad I'm not the only one who thinks this...

I get where you coming from. At the same time these virual friends could mitigate some of the damage of being lonely while people build themselves back up if that's what they have to do.

Impersonal? Sure... ( ͡👁️ ͜ʖ ͡👁️)

that's the problem, that it's a company running things. it should be a publicly-funded team of researchers, because this is a new tool and new area of reality that should be studied, and not feared. with this, it would be easier to not let our "humanness" get in the way (e.g. companies being scared of the emotions of the members of human society).

My best interest is that the AGI is reasonable.

Don't forget tiktards

That's two different things. Its actions can be both perfectly reasonable and not aligned with our best interests.

AI already comes with your phone. It's just not the kind of AI you're interested in.

I mean, it's inherently hard to predict. I think it's a little silly to believe you could somehow know exactly what AGI will do to that degree, but we also can't be sure it won't do those things.