Recent comments in /f/singularity

redroverdestroys t1_j9i8jbc wrote

Okay, don't include "written by a fucking BOT" in the email - that's just goofy as hell.

I can understand why they would be suspended, not for having AI write it, but for tacking that part on. What the hell were they thinking to add that at the bottom?

If they didn't want to take credit for it, they should have then just wrote it themselves.

Maybe they thought they were being forward thinking and getting in touch with the kids on their grounds, being hip lmao.

Its not enough to be outraged about tho. People need to fucking move on.

15

TFenrir t1_j9i5653 wrote

Holy shit, 32k token context? That is a complete fucking game changer. That's about 30k words. Current context length is about 4k tokens.

A simple example of why that is relevant - it's hard for a model to hold an entire research paper in its context right now - this could now handle probably multiple research papers in context.

Code wise... It's the difference between a 100 line toy app, to something like 800.

Context window increasing this much just also makes so many more apps easier to write, or fundamentally possible when they weren't before. Chat memory extends, short story writing basically hits new heights. The average book has 500 words a page, ish - about 6-7 pages currently, will jump up to 50.

1 token = 4 English characters. Average word is 4.7.

145

Superschlenz t1_j9i3z6t wrote

>privacy may be impossible in the metaverse

Which definition of privacy did they use?

Seems that they didn't mean the connection between some data and a person in real life but instead recognizing someone who uses multiple identities as the same person.

17

GPT-5entient t1_j9i1yu0 wrote

Completely agree. There are only 2 options:

  1. We merge with the machines
  2. We get exterminated by them

I prefer option 1. It will obviously begin with computer/brain interfaces like neuralink but as the machine part of our new psyche becomes more and more dominant we will probably just shed the meat bags altogether at some point. I hope we will at least keep our meat brains digitized for some time, but eventually it will be nothing but an evolutionary relic without much real importance.

4

challengethegods t1_j9i1lk3 wrote

>I'd be more impressed by a model smaller than GPT-3 that performed just as well.

from the article: "Aleph Alpha’s model is on par with OpenAI’s GPT-3 davinci model, despite having fewer parameters.", so... you're saying you would be even more impressed if it used even fewer parameters? Anyway I think anyone could guess gpt3 is poorly optimized so it shouldn't be surprising to anyone that plenty of models have matched its performance on some benchmarks with less parameters.

13

arindale t1_j9i16cu wrote

Dedicated compute allows companies to build without worrying that another developer (or the community at large) uses up too much of Open-AI’s compute

Allowing custom models allows companies to fine tune their own models using Chat GPT as a base. So think of a ChatGPT like a university grad. It’s intelligent and broadly capable. But not necessarily a specialist in the exact tasks that a company may need. But what if that company could train it on 100,000 samples of those tasks?

I am not an AI expert. I welcome anyone to correct me here.

12