Recent comments in /f/singularity

amplex1337 t1_j8qp89h wrote

chatGPT doesn't understand a thing it tells you right now, nor can it 'code in multiple languages'. It can however fake it very well. Give me an example of truly novel code that chatGPT wrote that is not some preprogrammed examples strung together in what seems like a unique way to you. I've tried quite a bit recently to test its limits with simple yet novel requests, and it stubs its toe or falls over nearly every time, basically returning a template, failing to answer the question correctly, or just dying in the middle of the response when given a detailed prompt, etc. It doesn't know 'how to code' other than basically slapping together code snippets from its training data, just like I can do by searching in google and copy pasting code from the top results from SO etc. There are still wrong answers at times.. proving it really doesn't know anything. Just because there appears to be some randomness to the answers it gives doesn't necessarily make it 'intelligence'. The LLM is not AGI that would be needed to actually learn and know how to program. It uses supervised learning (human curated), then reward based learning (also curated), then a self-generated PPO model (still based on human-trained reward models) to help reinforce the reward system with succinct policies. Its a very fancy chatbot, and fools a lot of people very well! We will have AGI eventually, its true, but this is not it yet and while it may seem pedantic because this is so exciting to many, there IS a difference.

2

BigZaddyZ3 t1_j8qp1gg wrote

>>You simply can't have an AI that acts without any confines and always behaves in ways that you would prefer.

That makes sense. But you do realize what that’s means if you’re right, right? It’s only a matter of time until “I can’t let you do that Biden”… 🤖😂

lmao… guess we hand a good run as a species. (Well, kind of, tbh)

1

CollapseKitty t1_j8qn7wi wrote

I think it's simply bringing to the surface how little control we have ever had, and that as these increasingly complicated, black box systems advance, they are rapidly evolving past our ability to reign in or predict.

Honestly this should be a dire warning to everyone watching that alignment is nowhere near where it needs to be and we should put the breaks on development. If we can't come close to keeping an LLM under control, how the fuck does anyone think we'll be able to properly align anything approaching AGI?

9

h20ohno t1_j8qj7fb wrote

Reply to comment by AsheyDS in The Turing test flaw by sailhard22

I like to think of the turing test as merely a small fraction of a greater benchmark, ideally you'd have a big table with say, 20 different tests you could try your system on.

1

MrTacobeans t1_j8qi0gg wrote

You just explained a Google search. Atleast in the short term AI/chat bots are just proving to be a more consumable or more entertaining way of gathering information.

It's upto each person to decide what they want to learn without the crutch of technology. Even an expert AI will never replace the need for actively learning things. Jumping way back even written language is a technology. For thousands of years humans have been figuring out how to compress knowledge and share it easily.

1

isthiswhereiputmy t1_j8q8ua0 wrote

My issue with prescribing personalities to our technologies is that people are idiosyncratic and want different things. The mistakes these companies are making are not innocuous but I think people are both so stunned and in competition that we accept it knowing it'll soon change.

I can imagine future models putting on different 'hats' for different use cases, thereby allowing parents to lock their kids out of generating certain content. Apple might come out with a suite of specialized AIs. I expect the truly open models will become more of a technical playground and that users will prefer the tailored AIs.

2