Recent comments in /f/singularity

UseNew5079 t1_je6lgyb wrote

Reply to How much smaller can a GPT-4-level model get? by Technologenesis

Maybe 7b model can get GPT-4 level performance if trained for _very_ long. Facebook paper showed that performance increased until the end of training and it looks like there was no plateau. Maybe it's just very inefficient but possible? Or maybe there is another way.

2

nevermoreusr t1_je6layp wrote

Reply to comment by WarmSignificance1 in The argument that a computer can't really "understand" things is stupid and completely irrelevant. by hey__bert

It's kinda more and less data at the same time. While llms have definitely been trained on more text than any of us ever will read, to get to our teenage ears, we have 10 years of basically non-stop real time stereoscopic video streaming with associated 5 senses plus six or seven years of iterative memory consolidation. (Though our brain is much slower at processing, it is way more flexible and changes on the fly unlike most of our current models).

Maybe what LLMs need right now is multimodalism for graphical and sound inputs as it can infer much more relevant information regarding positioning, world structure and different intuitions.

23

Dusty_Tokens t1_je6kkpe wrote

Reply to If you can live another 50 years, you will see the end of human aging by thecoffeejesus

I don't think we've found the answer to aging yet, until we can 3D print mechanical hearts that people can survive years off of, if not indefinitely.

That's probably 150 years away, due to governments keeping the cure to aging a secret. The planet would quickly doom itself if breeding were left unchecked, and people were to stop dying off.

I'd say we're quickly approaching the age of the cyborg, being as prosthetics continue to improve and will undoubtedly start supporting internet function.

−1

Supernova_444 t1_je6kc7b wrote

Reply to The Limits of ASI: Can We Achieve Fusion, FDVR, and Consciousness Uploading? by submarine-observer

I think the only real constraints on an ASI would be what's physically possible. We don't really have any reason to consider that there could be a limit to machine intelligence, besides hardware. (And then we just get it to design better hardware.) Stuff that we know could be possible like nuclear fusion and FDVR would be trivial, it's only the more theoretical stuff like FTL travel that might be impossible.

But even a machine that's "only" 100x smarter than us would be a massive game changer. Even with narrow AI designed by humans, we were able to more or less solve the protien folding problem. Imagine what something that thinks at the speed of light would be able to do.

12