Yeah I feel like we need more benchmarks

I’m not Bing Chat if that’s what you’re asking.

Yeah we need more benchmarks.

How did you respond in like 4 seconds?

Yes. He’s hopelessly in love with her though. Or she goes on lots of business trips.

Search AI theory of mind

He wears the shirt WHENEVER she is home??

This must be a horribly abusive marriage for him to wear the same shirt everyday just to avoid a conflict.

It's only tested on one benchmark, called ScienceQA. Maybe testing it on others would allow us to how well it really stacks up.

I've seen so many things like this that actually end up surpassing gpt3 on some narrow benchmark with more optimised prompting rather than just being a better model overall

I hope I'm wrong this time

In the interest of skepticism, can anyone pour any cold water on this or is it as good as it sounds?

They are gradually releasing it to people who have joined the waitlist.

I thought bing wouldn't be out for a month How did you access it?

Maybe their model is just overfitting a lot to the test data? That’s always a thing in ML

Because people cannot use it yet 🙄

10 days old, going by version 1 on arxiv.

because of ChatGPT hype ? Who knows. I think open AI already did it, the just dont showing to the puclic. Main thing i guess that Amazon made a different aproach integrating two modalities by prefintuning to be multimodal. You can read in the paper. + Looks like language + visual context gives a huge boost. But it already being done by Flamingo model so i gues the first is crucial.

Surpasses humans in this science test, across the board (natural science, social science, language science, etc).

Wow.

And outperforms GPT 3.5 with about 0.4% the parameter amount.

Wonder how it does on other tests?

Would this run on consumer graphics cards, then? Seems like it's in the ballpark to run on a single 3090, but without knowing the total requirements, I can't say.

Edit: "Our experiments are run on 4 NVIDIA Tesla V100 32G GPU" - paper

​

Paper link: https://arxiv.org/pdf/2302.00923.pdf#page=7

Goddamn

[deleted]

This is like 2 weeks old. If it really does surpass gpt3 with under a billion parameters then why isn't this on headlines.

I guess Keanu didn't want to do the Ad.

Where did you get that from? 🤔

Ok mate

[deleted]

It’s probably ChatGPT with a hypernetwork they named Sydney.