I donno stability although it seems like a well funded machine of a organization now, beat openAI incredibly fast at a time when their funding was no where near the level of openAI. All while producing a model that can throw strong punches against DALLE without using multiple industrial GPUs to inference each image.

Now stability has DeepFloyd which is a nebulous/ethereal model under lock&key atm that seems to be completely SOTA just from the base model.

I wouldn't discount the small players, especially the ones that plan on open source. People have done wild things with stable diffusion. The model I'm following right now for LLM, RWKV is creating pretty darn impressive results at 14B parameters. Compared to chatGPT it's ok but the big difference is you need 15k+ of hardware to even inference the chatGPT model. RWKV from it's base model is creating coherent results on consumer hardware. It hasn't even been tuned yet with RL training or q&a data.

I won't dare many predictions. Things are a bit crazy right now.

Seems we are on the cusp of a big bubble, with a deluge of investments flooding into AI startups, some with valuable products, others far less, and only time will tell which is which.

I wouldn't bet against the big players, though, specially on their fiefdoms. Any startup promising to beat Microsoft, Google or OpenAI on their territory and against their leverage of millions of users, ought to be suspect.

DeepMind has better AI then OpenAI But having the better technology doesn't necessarily means winning the war

Where Google can win is assistant. If assistant can know my schedule, read and reply to email, and help me brainstorm through life, I will definitely use it over chatgpt.

Anyone have a list of the 40(ish) ML papers he was recommended...?

When it sucks

Thanks, great read. Carmack's an interesting guy; he's humble, but also not shy about his qualities and what he brings to the game. Its good we have people exploring alternative pathways to AI that are not in the same billion dollar tech giant wheelhouse. Seems almost cyberpunk.

Yeah it is Terrible. No idea why they castrated it as they did.

Microsoft will embed this technology inside of Windows 12

like, literally, wait a month. The speed at which everything is moving-- I'm sure it's being worked out.

I have no idea. I would preffer one that gives the same nice summaries that chatgpt makes now but with references for fact checking. It looks like Microsoft’s Bing will get there first.

No it’s going to replace white collar jobs . That’s it , it won’t improve our lives . Rent and food cost will still increase .

Its a double-edged sword though. A lot of people would not like it and call for censorship because well… kids browse the internet and understandably parents dont want their kids to do anything on the internet . Also, porn tends to be dissociated a little bit on the internet, it rarely gets official public access.

MSFT, let me hexplain:

Google's main business is advertisement, __you__ are the product, they do not give a rat's ass about your experience as long as your eyeballs see the ads they plastered all over the search results. Have you seen Google results lately? Your results do not even appear on the first screen! You must scroll to even see your results.

Microsoft is a customer-centric company they should care about user experience, hence their search/ai should be more pleasant to use.

I don't like MS even more than Google but Google search is absolute garbage now and I do not see Google changing its business model, AI or not.

The bar is set is pretty low, and Microsoft's bing powered by AI can easily become the next landing page of the world.

I think google because microsoft can't even make descent web browser

Don't care about level 1 since I can't fuck it.

Level 2 or 3 - a lot because of sex/intimacy. To put things in perspective, I like to have sex every day. A high quality very hot escort in my area cost over 1k per hour or more. And this isn't even bareback (which even most high end escorts won't do). Assuming I want to have sex once a day, every day of the year, then that's $365k/yr.

So even if a sex robot cost $365k, this would more affordable past 1 year. Of course I would be more reluctant if it's delicate and will break down quickly. It would need to last at least 5-10 years.

At $100 - $150k I'd be a lot more willing to experiment on a first gen with an unpredictable length of longevity.

I'd rather live in a shitty studio apartment with a supermodel sex bot than a mansion all alone.

PhD Penti O. Haikonen has also a different approach and has showed interesting results with a very cheap architecture. However his solution requires hardware neural networks, according to him doesn't work on software neural networks.

Agreed... However I'm surprised such a thing doesn't exist yet.

OpenAI has whisper which is great an voice to text (and open source)

The text can then be input to GTP3

And then the result spoken via elevenlabs.

This is just plugging some apis together in an app...

Why hasn't this been done

Better yet you can find your "ideal" voice on YouTube and then clone that specific voice

I don't think he'll succeed but for a very lame reason.

He's likely right that the answer won't be in solely transformers. However, the obvious way to find the right answer involves absurd scale:

(1) thousands of people make a large benchmark of test environments (many resembling games) and a library of primitives by reading every paper on AI and implementing the ideas as composible primitives.

(2) billions of dollars of compute are spent to run millions of AGI candidates - at different levels of integration - against the test bench in 1.

This effort would consider millions of possibilities - in a year or 2, more possibilities for AGI than all work done by humans so far. And it would be recursive - these searches aren't blind, they are being done by the best scoring AGI candidates who are tasked with finding an even better one.

​

So the reason he won't succeed is he doesn't have $100 billion to spend.

Google isn't behind. They aren't making their models public but that doesn't mean a lot. PaLM seems very promising. Their research about scaling laws is also great.

Microsoft don’t really have a share of the mobile market, unless they find ways to grow there it will be hard to compete with google in this area.

At this moment GPT is better than Lambda but i feel like google has the potential to catch up fairly easily.

Surprised at the results. Google has had some great ideas in the past...but right now? A lot of copying and abandoning stuff... I don't know, really what has Google innovated recently that was successful?

Literally Google that... It's not promising... Anyway, I'm sure I'm wrong lol but just not really sure what they've done recently that was theirs and successful. Hard to see how this will be different.

Look. The way I see it - if they had something as good as chstGPT, they would have already found a way to monetize it or beta it publicly.

They don’t and wont catch up because google VS MS isn’t a fair fight.

Google is like ALL ad revenue based. AI like this is what will DESTROY their business model overnight.

MS, on the other hand, has office365 / Azure / etc.

Their AI is going to actually be useful and it’s adoption rate is going to be astronomically fast once the benefits are seen.

Google has no chance unless they are willing to lose half their ad revenue to compete properly.

So i tried using the app and you have to sign up for an adx account and I did using a junk email and password and it never let me login. It kept aaying invalid credentials so as far as im concerned this is junk/info gathering scam