People lack imagination because they are at their core just a next word predictor

Yes I know that. That's exactly what I've said above. Did you imagine something else?

FYI the smallest model could possibly be trained for under 50k dollars.

In some tasks the 7B model seems close enough to the orginal gpt-3 175B. With some optimization it probably can be run on a good laptop with a reasonable loss in accuracy.

13B doesn't outperform in everything however 65B one does. But it's kinda weird to see their 13B model be nearly as good their 65B one.

However all their models are worse than the biggest Minerva model.

GitHub link : https://github.com/facebookresearch/llama

Not really fully free to use right away as you have to fill a Google form and they may or may not approve your request to download the trained model. Training the model yourself is expensive anyway.

It's around as good as GPT-3(175B) but smaller(65B) like chinchilla. If released publicly like OPT models then it could be really big for open-source. If optimised like flexgen to run on a single GPU or a small rig maybe we could all have our own personal assistant or pair programmer.

(1) Expensive to run

(2) No temporal/episodic memory

(3) Limited context

(4) Makes stuff up/hallucinates

(5) Only surface level intelligence or understanding.

If it becomes very easy to do something all copyrights on it should stop. In a few years copyright itself will become meaningless.

You mean equivalent to being as trustworthy as a search engine. Probably 1-3 years.

That's why you tax on profits not on labour itself. If you remove all the loopholes and exceptions used to hide profit it would be enough. If deflation sets in we can always print money.

Stupid idea. We will all be working forever not because we couldn't create a fully automated utopia but because an old idiot couldn't come with anything creative to solve UBI

No. Once an LLM gets a keyword a lot of related stuff will come up in probabilities. Also you can go backwards on reasoning. This makes it easier for an LLM to answer if trained for this exact scenario.

Because you are not an llm

It's multiple choice, choosing among 4 options is easier because you just have to consider the 4 possibilities and answer is among the 4 possibilities. But most conversations are open ended with possibilities branching out to insane levels.

So the last one with 32k token context could be gpt-4 or gpt-4 will atleast have 32k token context.

Deepmind is better at reinforcement learning. They probably did not expect LLMs to get this good. Still it is likely deepmind will get to AGI sooner than openAI. They have the breadth of knowledge required to build something like that. Unlike openAI they don't go all in on just one thing.

That's what I mean. You can't do that without getting noticed. Even if you did you will get killed very quickly.

You underestimate how foggy real life events tend to be. You can't predict with certainty and no amount of intelligence can help you.

The only way this can be harmful is if you are already in a position of power. But if you are already there you can do things without AI as well.

For most people it's impossible to be a supervillain with almost anything. They simply lack the moves and position to accomplish it

Scamming people is not becoming a supervillain

You will get your ass beaten up if you try anything like that in a poor country. Don't be stupid. No matter how smart you think you are you aren't smart enough to beat a lot of people especially not a country. Unless you are fully superhuman you will get assassinated no matter how cool your glasses are

You don't have to copy and know every atom before you agree something is like something else. That's just a bad faith argument. Don't look at just the differences look at the similarities, look at how it's able to get so far with such a basic design.

It's like the god of the gaps argument. People who constantly point out that we don't know this hence god, then if you do explain away the phenomenon it's something else. In that way their god is just the gap in our knowledge and is forever shrinking.

It's much harder though. It is likely we will have AGI before an augumented supervillain.

There is no divine spark. Infact these models are proof that it doesn't take much to get close to being considered conscious.

The fact that you compare it with a pig shows you don't know much about them and probably shouldn't be advising people. These models are trained on text data only and do not have a physical or even an independent existence to have sentience.

Even if they just gave it episodic memory it will start to feel a lot more human than some humans.

It's greedy and brings out the worst capitalistic tendencies in people. It's also inefficient and straight up stupid. You don't need the reward mechanism, as good that seems, it's a way to make it so that some people have more than others. This is the most terrible thing one could do with AGI.

You won't have no ads. Nobody wants to sell you anything when you don't produce anything and money is irrelevant. They can make everything they want with AI.

That is partially true. They want to control the singularity or rather control events leading up to it.

They are making money to make AGI. What do you want them to do? Make no money, let someone who is truly in for the profit make an AGI?