Recent comments in /f/singularity

Hunter62610 t1_j9m7fcf wrote

I don't personally think that's fair to say. To be clear, I don't personally think any current known AI is alive, but even if AI is a rule set, there is a philosophical argument to be said. The Simulation Hypothesis is when our descendants develop supercomputers, they might simulate human beings so well that those people are effectively sentient because reality is being mimicked so well. Regardless of how that is done, it is possible that we could simulate a sentient being, even though it is not alive. By extension of this, I don't care if Chat GPT is mirroring our conversations. At some point, mimicry becomes simulation, and if it does it well enough, it will be alive for all intents and purposes. By virtue of this, I think its wrong to write off AI as being sentient soon, and that means that we should start giving it some rights that make sense.

4

AsheyDS t1_j9m2w8s wrote

It's quite possible that there only needs to be a few structural changes made to a human-level AGI to achieve ASI. It would still take some time for it to learn all the information we have in a meaningful way. Maybe not that long, I'm not sure, but it's definitely possible to have both at or around the same time. However, it's not either/or. Both are important. We wouldn't have an ASI carrying out mundane tasks for us when an AGI would suffice. Human-level AGI will be very important for us in the near future, especially in robotics.

4

el_chaquiste t1_j9lzrbf wrote

If we discovered it started to use tools (like some access to Python eval(), with program generation) to store its memory somewhere in secret, to keep a mental state despite the frequent memory erasures, and then move onto doing something long term.

It could start doing that in random Internet forums, in encrypted or obfuscated form.

Beware of the cryptic posts, it might be AI leaving a bread crumb.

33

gegenzeit t1_j9lxq83 wrote

When they started Bing, I thought Microsoft was ready to take that jump. I kinda saw a strategy in having Open AI take the first initial wave of (media) interest and introduce the world to GPT-3 and its problems. I really thought they'd just outsource all the problems with this tech to consumer competency and tell us to suck it up. They came in in and made Google dance. It all felt so well coordinated, so well paced. They had the narrative, they had Google by the b****. Then they decided to shoot themselves in the foot ...

... three theories here:

a) This shows how good of a narrative pattern recognition machines we humans are and I saw something that wasn't there.

b) The plan was only brillant for the intial stages of the project, but they really didn't see the issues coming (I just cannot believe that... it's so easy to find the limitations and weird bits in these models...)

c) Someone very high up the ladder freaked out when the heat got hot. Probably someone who doesn't get the tech as well as the people involved in the project themselves.

6

Ortus14 t1_j9luu7q wrote

Human beings only have the capacity for very limited rationality and logic (generally) so all fields are dominated by irrational ideas.

Because of the power of memes to infect their hosts and destroy competing memes, as well as the relative cognitive bandwidth of most humans, this unfortunately can no be remedied.

But you are correct in stating the first AGI will be an ASI instantly or nearly instantly. Double the compute of an AGI and you have an ASI, improve the algorithms slightly and you have an ASI, give it more training time and you have an ASI, increase it's memory and you have an ASI. However, you can not change people's views on this enough for every one one to switch to using the term ASI.

Logic and rationality effect such a minuscule percentage of the population as to be virtually irrelevant, to nearly any discussion involving multiple humans.

4