Recent comments in /f/singularity

SoylentRox t1_j9dx7nz wrote

I thought it would require a lot of things. But here we are.

Open source devs have re-created the core of an LLM like GPT-3 (it's what powers chatGPT and BingChat) in a few thousand lines of code.

It's really not that complicated. https://github.com/EleutherAI/gpt-neox

And yet this one repeated algorithm and a few tricks in training and we can get like 50% of human intelligence right there.

3

Honest-Cauliflower64 t1_j9dwh2f wrote

My whole family is aware and they are not in the slightest bit surprised. We’re mostly just curious how it’s going to play out.

Maybe one of the benefits of being a peasant, is you have nothing to lose. Don’t give a shit what happens. It’s most likely going to be a positive change in society. I don’t have any influence so I’m just going to go with it.

12

NTIASAAHMLGTTUD t1_j9duf91 wrote

>get some exercise, eat healthy

I already do that, still have felt pretty miserable for a while. I often say this but if I just had to climb a mountain or do something very difficult to solve my problems, I would! There are definitely some people who just need a good smack on the ass but a lot of us have been trying pretty hard for a while. Of course, I always suggest to keep trying because honestly there is not much else one can do.

12

NTIASAAHMLGTTUD t1_j9dtvqq wrote

Yep, same. Except I'm not 100% on this shit, really I just hope it goes well. It doesn't reach to the level of 'faith' and I do have an inborn skepticism even against things I wish were true.

I was thinking about this the other day, but it seems to me (at least in the west) people have largely given up in believing the future will be better than the past. There is a pervasiveness cynicism without the will to actually improve anything. The great social experiments of the 1900s all failed to produce 'utopic' societies. The idea that people will band together under 'free love' (to reference the hippies, as an example) or another change in the social dynamic to produce a better world is quaint.

Outside of one's personal life, there is really nothing to look forward to in society as a whole. If the doomers are right, things will be getting so bad so soon that there is very little reason to try.

I'm fairly nihilistic as a whole. I believe life can be awesome, if the cards are right, but I don't believe in inherent meaning. My thoughts are: I encourage everyone (even trying myself!) to make the best of life in a very practical way, but I also recognize that is not possible for everyone to do so.

Maybe this whole thing will come to nothing or be underwhelming, but at least it's a possibility of a better world. Not asking rhetorically, but where else can a person look?

edit: last, but not least, if you're fucked in life and need some help, there is very little chance anyone outside family or very close friends are going to extend a hand. It's harsh.

4

ChipsAhoiMcCoy t1_j9dronn wrote

I agre with most of what you sai dhere, but I would be really careful with this line of thinking here

​

>AI isn't going to write the next Great American Novel, though.\* It requires human emotions and an understanding of what it's like to be human to write a book that touches human hearts.

​

I definitely think AI could mimic human emotion in writing, and I think we will absolutely see AI write a great piece of literary art some time in the future. It's just a matter of time. AI is already tricking many users into thinking that it's sentient, and that's just word prediction in the case of LLMs. If it's able to trick humans into ascribing emotion into what the AI is saying and it's just prediction what word should logically follow, I think it's very possible that we could see this. I will fully admit that this is just strictly opinion based, but we will see if it can pass the blind test. Even simply knowing something is written by AI could sour someones opinion about the piece if they already don't think AI could write something emotional and touching to human hearts, so you'd definitely ahve to perform a blind test and see what happens from there.

2

SoylentRox t1_j9dq24m wrote

Note: I work in AI , and have friends who work at OpenAI.

Computer science.

The reason why the other 2 subjects don't matter is they essentially are not used now. Neither neuroscience or cognitive science is relevant for current AI research. Current methods have long since left needing to borrow from nature. The transformer or current activation functions for ANNs do not borrow anything but the vaguest ideas from looking at old neuroscience data.

Current AI research is empirical. We have tasks we want the AI to do, or output we want it to produce, and we will use whatever actually works.

The road to AGI - which may happen before you graduate, it's happening rapidly - will be likely from recursion. Task an existing AI with designing a better AI. By this route, less and less human ideas or prior human knowledge will be used as the AI architectures are evolved in whatever direction maximizes performance.

For an analogy: only for a brief early period in aviation history did anyone study birds. Later aerofoil advancements were made by building fixed shapes and methodically studying variations on those shapes in a wind tunnel. Eventually control surfaces like flaps and other active wing surfaces were developed, still nothing from birds - the shapes all came from empirical data, and later CFD data.

Similarly, none of the other key element of aviation: engines: came from studying nature either. The krebs cycle was never, ever used in the process of making ever more powerful combustion engines. They are so different there is nothing useful to be learned.

6