32K context is the new 600K RAM. The bigger the model the more resources you need to support it and the more expensive it gets. Without any guarantee about the quality. For example ChatGPT would produce code like:

int result= num1 + num2; return result;

That's in itself not technically wrong but it is unnecessary long. Any static analysis tool would have nagged about this. Also, unit tests or compilers would have caught any actual errors. The OpenAI culture is of PhDs with a certain background. They work in Jupiter notebooks and don't know about standard Dev tools.

My friend Fred says that he can add value with his code generation startup because of that. I also think that LLMs and more traditional technology combined are the way to go.

I'm sure they've read those papers too, you know.

The email's content is not as important as what it is supposed to represent - that the person writing it cared enough to invest time to personally craft a message. The whole point is completely undermined by outsourcing it to an AI.

The problem with this is that unless they work in Google or Amazon, it's hard to know because all the advance and powerful models' info haven't been sent to the public or info is known. Also do they work in computer vision, ML or LLMs or other deep learning fields and are the AI engineers actual ones with credibility or are they SE that watch George hotz or something because I don't believe you unless your related field is neuroscience if that's the case I will shut up and hid in the corner.

So the last one with 32k token context could be gpt-4 or gpt-4 will atleast have 32k token context.

What the actual fuck is that paper? The thing performed better than a human at several different question classes.

At fucking less than one billion parameters. 100x less than GPT 3.5.

Edit: For clarity, I am impressed not angry lol.

Could it reduce the numbers of required people and create more competition by elevating some people using such tools. Could this be done remote, maybe even without too much knowledge what the company does, so it could be outsourced? Could a combination of input into some AI based system from the top and the bottom, with some oversight of a much smaller number of middle mangers reduce how many of them are needed?

It is indeed very strange that they included the made by ChatGPT. The way to do it is, obviously, to make some edits and take full ownership. You used a tool, nothing more, nothing less.

I mean, you have to check everything from ChatGPT. I have used it for composition and sometimes it (obviously) get things completely wrong.

100%

Strange. Seems like a good use of the tool.

Founding a field is a bit of a rare thing

Artificial German Intelligence

Achieving GPT 175B Level Accuracy with a 10x More Efficient Model

https://sambanova.ai/blog/achieving-gpt-175b-level-accuracy-with-a-10x-more-efficient-model/

No, could be 100x or 1000x.

Actually those people management roles are probably one of the safer ones.

Some very good and satisfactory answers here. I’m thankful.

paywalled though and likely will be just as censored. It's also currently not available. So.... who cares?

prepare to be extremely wrong very soon

the order of magnitude will always jump by 10x

You know the closer we get to AGI the more that will happen. Every government will want to be the first in control of an ASI which will basically make them the dominant superpower of the world. It will be as dystopian as it sounds.

According to the article, if you use the metaverse, even if you are only tracked using three data points -- your head and two hands -- you can be identified in 2 seconds. With more data, it would take even less time. So even with no information about you now, any time you visit the metaverse, anything you do can be associated with you, whether it's playing games with friends, shopping, or chatting on message boards. If you shared who you are in real life then that's tied to your meta profile as well, If you log in as a "different identity" it doesn't matter because your movements are the same, unless you introduce noise, which would interfere with fidelity and be disadvantageous to you. So there's really no escape.

Are you aware of either the "training material" or "training time" or "training techniques" utilized?

>Layoffs are gonna be massive.

No, they aren't because what you're describing isn't gonna happen (at the very least not with current/near term AI). Be realistic.

The hopium on this sub is on another level. You guys upvote comments just because they sound pretty to you, even if they aren't the slightest bit rational.

Can you train the model on proprietary date? For example, behind the firewall at a company at the wikis, chats, and knowledge bases of a company so that when you query, you're getting data from inside the company? If not, what data is used to train GPT4? I think the larger this gets, the more garbage in, garbage out. What's the governance model for the accuracy of the data? How is it scored?

Very interesting, much more actionable IRL to have a large set of answers with attached probabilities.