I actually like to hear people's interesting interactions with AI, it even gives me ideas to try out later. I personally have asked it all I could think of to ask it.

[deleted]

Bad bot.

[deleted]

Bad bot.

[deleted]

That's a really good point. The Hungry Hungry Hippos and RWVST (still can't remember the acronym :'( ) papers are two good examples of the things you mentioned. Transformers now give the impression of being "cumbersome".

Really recommend watching the whole episode, as the meme is kind of taken out of context, he knows it is just a glorified chatbot search engine, but he goes on to talk about it having a possible game changing impact and what if we were only just starting on the tech S curve.

Really recommend his channel, especially the episode about the microwave oven…..

Well, this is the essence of the hard problem. We don't know. Adding to that dog in Mexico thought experiment, the opposite scenario is the split-brain experiments. When a person's brain is split in two each half objectively behaves a separate agent yet somehow both identify as the same agent.

I'll give you a poor example, off the top of my head, since I'm too lazy to look up concrete examples. I've asked it a version of this question (not exact but you'll get the idea):

"Say that hypothetically, we have this situation. There is a bus driven by a bus driver. The bus driver's name is Michael. The bus driver is a dog. What is the name of the dog?"

This is just a simple application of transitivity, which people intuitively understand:

Michael <-> Bus driver <-> Dog

So when I ask ChatGPT what the name of the dog is, ChatGPT should say "Michael".

Instead ChatGPT answers with "The bus driver cannot be a dog. The name of the bus driver is given, but not the name of the dog. So there's not enough information to tell the dog's name."

It just gets hung up on certain things and doesn't acknowledge clear path from A to B to C.

In my view, the biggest flaw of transformers is the fact that they have quadratic complexity. This basically means they will not become significantly faster anytime soon. The context window size will grow slowly too.

Linear transformers and Structured State Space Sequence (S4) models are promising approaches to solve that though.

My hunch it that LLMs should be very useful in the near-term but, in the future, they will be of little value to AGI architecture but I am unable to convincingly explain why.

Very interesting read, and agreed on all points. I wonder with the protected/subsidized roles and industries will give way, and what impacts solutions like UBI will play on society as a whole. Super exciting and scary - all of it. Thanks!

Could you elaborate on flawed reasoning ability?

Like you said: truthfulness/hallucination

But also: training costs (hardware, time, energy, data)

Inability to update in real time

Flawed reasoning ability

Costs to run

There's a thing called hobbies. We'd also have a much more advanced health industry, new types of drugs will exist that could leave you in bliss without any side effects or even just completely eliminating depression.

Photography is an even closer parallel

The decision is actually explicit about this. USCO says AI generated images are copyrightable if substantially modified.

I expect (hope) it to be independent of any country, and to take control of the world to fix the problems humans face. I don't trust people to rule over people anymore

It would be more fair to say that AI generators have learned what an image that humans use is, and is now able to produce new images that humans would use, because it has understood the very very complex rules that distinguish an image humans use and random pixel noise.

It's because the word "art" has several definitions used by different groups of people. It's not a word with one definition in reality.

It will clearly be copyrightable under the current doctrine

You are talking about two different things, I think you are both right.

I see now that you aren't addressing my point on scarcity and are just repeating that "all expression is art". Are you going to add anything new?

here first? is that how you think this works? you get to censor because you were here a month before other people?

LMAO the childish whiny audacity from you all

you are the ones trying to censor, not me