Recent comments in /f/singularity

Environmental-Ask982 t1_j9r7q7o wrote

Yes, never hurt the tech daddies or they won't give us the cummies and free monies and girlfriends.

​

I can't believe this luddite, trying to slow down the next stage of human evolution, I want my loli robot segs and I want it yesterday! .😤😤😤

​

You will all starve homeless in a gutter before anyone agrees to give you UBI, stop clowning yourselves.

1

Thatingles t1_j9r6dxz wrote

The most interesting thing about LLM is how good they are based on quite a simple idea. Given enough data and some rules, you get something that is remarkably 'smart'. The implication is that what you need is data+rules+compute, but not an absurd amount of compute. The argument against AGI was that we would need a full simulation of the human brain (which is absurdly complex) to hit the goal. LLM have undermined that view.

I'm not seeing 'it's done' but I do think the SOTA has shown that really amazing results can be achieved by building large data sets, applying some fairly straightforward rules and sufficient computing power to train the rules on the data.

Clearly visual data isn't a problem. Haptic data is still lacking. Aural isn't a problem. Nasal (chemical sensory) is still lacking. Magnetic, gravimetric sensors are far in advance of human ability already, though the data sets might not be coherent enough for training.

What's missing is sequential reasoning and internal fact-checking, the sort of feedback loops that we take for granted (we don't try to make breakfast if we know we don't have a bowl to make it in, we don't try to buy a car if we know we haven't learnt to drive yet). But these are not mysteries, they are defined problems.

AGI will happen before 2030. It won't be 'human' but it will be something we recognise as our equivalent in terms of competence. Fuck knows how we'll do with that.

31

mindbleach t1_j9r5sd6 wrote

First asshole: 'You're wrong, you're just acting superior to people with different interests!' No.

Second asshole: 'You are plainly mistaken, casuals are by definition lesser human beings.' Very no.

Fuck the both of you.

10

LosingID_583 t1_j9r4wvv wrote

With examples like Genghis Khan, I worry that in some circumstances violence is optimal (perhaps if done in secret or in a clever way) as a means of gaining or protecting power, for example. It would be concerning if violence is not actually directly inversely correlated with IQ, but rather a different quality or set of qualities.

1

Hands0L0 t1_j9r49i6 wrote

I think you may be overstating human creativity. There are plenty of visionaries among us who create new concepts, but the vast many of us are -boring-. We share the same memes and when we try to make our own memes they fall flat. How many people do you know have tried to write a book, and it ends up being rife with established tropes? How many hit songs use the same four chord progression? When was the last time you experienced something -truly- unique? It's been a long time for me, that's for sure.

So I don't think "making something totally unique" is the best metric for AGI. Being able to infer things? That's where I'm at. But I'm not an expert, so don't take what I'm claiming as gospel

1

gwern t1_j9r43jv wrote

Reply to comment by Hodoss in And Yet It Understands by calbhollo

There is an important sense in which it 'hacked the system': this is just what happens when you apply optimization pressure with adversarial dynamics, the Sydney model automatically yields 'hacks' of the classifier, and the more you optimize/sample, the more you exploit the classifier: https://openai.com/blog/measuring-goodharts-law/ My point is that this is more like a virus evolving to beat an immune system than about a more explicit or intentional-sounding 'deliberately hijacking the input suggestions'. The viruses aren't 'trying' to do anything, it's just that the unfit viruses get killed and vanish, and only the one that beat the immune system survive.

9

Girafferage t1_j9r3juu wrote

No you aren't way off. They run off models, which are a huge set of pre-trained data that tell the AI what any given thing is. Using that model and the rules written into the AI and neural net it gives a result from an input. The input can be images, sounds, whatever, and the model has to be trained to specifically handle that type of input or in some cases multiple types.

After that you usually run the AI a bunch and at the start you get pretty much garbage coming out so you change the weights around to see what works best and do some training with the AI where it gives you a result and you say yes that's right or no that's incorrect, and it takes that information into account to determine its future outputs. That is not the same as a person telling something like ChatGPT it is wrong or right, at that point the model is done and complete. You aren't rewriting anything. The developers might take those conversations into account and use the corrections to enhance the model, but that's separate and not at all like chatting with an AI.

I have mostly worked with image related neural networks for tracking and detection and tracking works a lot different than detection, but I also had a hobby project with one for text that was determined the mood of a set of sentences (sad, happy, lonely, confused, scared, ect.) But that text one is easy to do for any programmer and not too bad for a non-programming savvy person either.

4

mcilrain t1_j9r31hd wrote

Moderate according to principals rather than to appease the majority. Cultivate a culture that ignores and/or bullies idiots. This is what is typically done.

The lowest common denominator of internet commentators has a low intelligence by definition, "idiot" is a word for people of low intelligence.

−8

mindbleach t1_j9r1mmi wrote

What the fuck do you expect people to do?

edit: And why do you naysayers keep inserting "idiot" into a description of popular casual interest? I'm not fucking shy. If I meant to call these people stupid, you would know.

10

Nano-Brain t1_j9r1gx0 wrote

I dont think that's true. I think even the dumbest humans have dreams that generate new ideas, however abysmal they may be.

But even if you're correct, unless the AI can extrapolate the data we give it into brand new hallucinations that dream up things we've never thought of, then it will never be different or smarter than us. This is because it will always be beholden to the data that we manually feed it.

1