Recent comments in /f/singularity

TeamPupNSudz t1_j8z8928 wrote

A significant amount of current AI research is going into how to shrink and prune these models. The ones we have now are horribly inefficient. There's no way it takes a decade before something (granted, maybe less impressive) is available to consumer hardware.

32

prolaspe_king t1_j8z7wf4 wrote

People are why we can't have nice things. I would like to personally thank everyone to who posted those screen caps over the last couple of days, completely ruining the fun for thousands, if not millions of other people.

10

TunaFishManwich t1_j8z6s3n wrote

Reply to comment by onyxengine in Microsoft Killed Bing by Neurogence

The cloud is extremely accessible. If I want thousands of cores and mountains of ram, it’s available to me in minutes. That’s not the problem. To even run one of these models, let alone train it, would be hundreds of thousands of dollars per day, and yes, if I had deep enough pockets I could easily do it on AWS or Azure.

It just requires far too much computing power for regular people to attain, regardless of what you know.

The energy requirements alone are massive. The software is far more ready for regular joes to use it than the hardware is. That’s going to take a decade or two to catch up.

11

Spire_Citron t1_j8z31qo wrote

Right now, they're trying to make an improved search engine. I'm sure they'll keep working on other approaches to AI with different implementations in the future, but you must admit that, as a search engine, an answering machine is a better fit than a friend.

1

IonizingKoala t1_j8z0znz wrote

Reply to comment by timshel42 in Microsoft Killed Bing by Neurogence

Of course "regular" people will be able to use it, the same way regular people get access to state of the art quantum computers and supercomputers.

What TunaFish is saying is unlikely is for everyone to be able to run it in their own home. LLM engineers concur, moore's law isn't quite there anymore.

If you mean server time, that's obviously possible (I can run loads of GPT-3 right now for $5). But that's not exactly running it at home, if you know what I mean.

7