Recent comments in /f/technology
DeliciousJello1717 t1_j871mmq wrote
Reply to Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
These titles get dumber everyday bro
doomgrin t1_j8716gp wrote
Reply to comment by jamesj in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
I asked this to ChatGPT:
Ok. There is a bag of popcorn sitting on the ground. There is no chocolate in the bag. Yet, the bag is labelled “chocolate”. A human named Sarah finds the bag. She had not seen the bag before, and she cannot see inside. She reads the label, what does she expect to find inside the bag?
ChatGPT:
Sarah, based on the label "chocolate" on the bag, would expect to find chocolate inside the bag. She has formed a belief about the contents of the bag based on the information available to her, which is the label. She has not yet had the opportunity to verify the contents of the bag, so her belief may or may not be accurate.
This scenario is a good illustration of the idea that people can form beliefs based on incomplete information, and that these beliefs can influence their expectations and behavior. In this case, Sarah's belief that the bag contains chocolate is based on the information she has received from the label, and it will likely influence what she expects to find when she opens the bag.
VoidAndOcean t1_j871663 wrote
Reply to comment by gurenkagurenda in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
bro i use ml/ai models for my job;
I don't know what to tell you. We know which models to use because we know what it will do.
ElbowWavingOversight t1_j870smg wrote
Reply to comment by PM_ME_GAY_STUF in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
No. Not until these LLMs came around, anyway. What other examples do you have of this? Even in the case of few-shot or zero-shot learning, which allow the model to generalize beyond the classes it sees in its test set, is limited to the associations between classes that it learns during training. It can't learn new associations given new data after-the-fact without rerunning the training loop and updating the parameters.
blackenedEDGE t1_j870qic wrote
Reply to comment by jmpalermo in Millions of passwords stolen from LastPass earlier than company disclosed: Report by BasedSweet
While true, LastPass derives the encryption key from your master password using an algorithm called PBKDF2. There are guidelines for how many iterations of the PBKDF2 you're supposed to use--on the client side, server-side iterations are mostly irrelevant in regards to overall security. LastPass failed to follow these guidelines and failed to guarantee those who had vaults prior to each increase in the recommended iterations--or at least whenever LastPass actually increased the number by default for new vaults--were encouraged to login asap and re-encrypt their vault with a key using the new default number of iterations to derive the key from their master password.
The current guidelines--which LastPass was informed of by OWASP--are to use at least 600,000 iterations. Only after being breached did the increase it...but only to the previous recommended number, 310,000. However, as of the breach that saw vault backups stolen, there were still some vaults that had less than 310K, even as low as 1 for a few people who've been customers for a long time.
zardvark t1_j870jbv wrote
Reply to comment by ThinkCry in Opera is planning to incorporate ChatGPT by Parking_Attitude_519
If you had bothered to read the attachment to the OP's post, you might have noticed:
>Parent company Kunlun Tech is based in Beijing ...
The developers may be in Norway, or Poland, or where ever, but the project is owned by the ChiComs. And since they own it, you'd better believe that the browser will conform to their demands.
gurenkagurenda t1_j870dgf wrote
Reply to comment by ImamTrump in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
God, people who don’t know the first thing about how these models work have got to stop confidently posting their wrong opinions about how these models work. If you don’t want to study it and read the papers, that’s fine. Nobody would blame you. It’s an incredibly dry and difficult subject. But in that case, you know, just sit down.
gurenkagurenda t1_j8700le wrote
Reply to comment by VoidAndOcean in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
If basic explanations don’t convince you, the fact that there’s a boatload of PhDs studying this subject should give you pause. You probably haven’t figured out based on your vaguely informed reckoning that they’re wasting their time.
DefreShalloodner t1_j86zr39 wrote
Reply to comment by PEVEI in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
On the OTW hand I agree with you, but on the OTOH hand I support the rehashing/reframing of scientific or technical ideas in the interest of bending the public's minds.
Similarly, I roll my eyes when concepts from my abstruse specialty get butchered in movies or TV, but at the same time I appreciate the exposure they are giving to those ideas (ersatz or not).
[Edit: fixed acronyms]
Jsharp5680 t1_j86znhp wrote
Reply to comment by williamogle in Millions of passwords stolen from LastPass earlier than company disclosed: Report by BasedSweet
Look at Vaultwarden (Bitwarden written in rust). I've been self hosting for almost 3 years. It's the bees knees!
PM_ME_GAY_STUF t1_j86zf4g wrote
Reply to comment by ElbowWavingOversight in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
The ability to learn without updating parameters is literally a known and intended feature of most modern models though?
ElbowWavingOversight t1_j86z5rp wrote
Reply to comment by PM_ME_GAY_STUF in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
> I'm sorry, isn't this just how ML models are implemented?
No. The novel discovery is the fact that these large language models appear to have learned a form of gradient descent at inference time. This is why they appear to be able to learn even without updates to the weights. FTA:
> We show that it is possible for these models to learn from examples on the fly without any parameter update we apply to the model.
This bodes well for the generalizability of these models, because it means they have the potential to learn new associations merely from the additional context provided during inference, rather than having to be provided with that data ahead of time as part of the training set.
Jsharp5680 t1_j86z0cl wrote
Reply to Millions of passwords stolen from LastPass earlier than company disclosed: Report by BasedSweet
Fuck these mother fucking pieces of shit and the horse they rode in on.
That's how I feel about LastPass. Fucking absolute failure at the one thing they were supposed to get right.
Sad irony about this... I stopped using LP for my family about 2.5 years ago and migrated to a self hosted Bitwarden instance. I kept my free LP account as a "just in case" something goes wrong with self-hosting.
Fast forward to now. Self-hosting Bitwarden has been simplistic, easy to secure and 100% reliable.
Now I'm finding myself going through all of my more sensitive secrets in LP, rotating encryption keys I backed up there, passwords and the like. Major pain in the ass (some of the services used / encryption keys require a full reset and reconfigure - things like off site backups - so, resetting and reconfiguring backup jobs).
Then I have to go take care of my wife's secrets (less sensitive things).
But yeah, for the less technical savvy folks using LP, much more of a nightmare.
PM_ME_GAY_STUF t1_j86y2yr wrote
Reply to comment by thepastyprince in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
Only one or two so far actually, it's been fairly disappointing. A lot of people wanting to chat or RP though which I don't do
[deleted] t1_j86xsf4 wrote
Reply to comment by Hsensei in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
Them cheeks do be mighty
zephyrprime t1_j86wb5a wrote
Reply to comment by PM_ME_GAY_STUF in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
That's pretty much every science and technology article written for laymen media.
56kul t1_j86w8wf wrote
Reply to comment by Breklin76 in Millions of passwords stolen from LastPass earlier than company disclosed: Report by BasedSweet
They did? I tried to look up if they had any history of breaches and everything says they’ve never had one…
jamesj t1_j86w35y wrote
Reply to comment by efvie in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
Did you read the paper? If yes, what do you think explains the results of the paper? If no, no reason to respond.
jamesj t1_j86vz1o wrote
Reply to comment by ekdaemon in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
It wasn't at all clear that it must emerge with transformer based llms to people working in the field a year ago.
Deckma t1_j86vpi9 wrote
Reply to comment by Diknak in Millions of passwords stolen from LastPass earlier than company disclosed: Report by BasedSweet
And enpass supports keyfiles which is an awesome 2nd factor.
Deckma t1_j86vijy wrote
Reply to comment by andrewhy in Millions of passwords stolen from LastPass earlier than company disclosed: Report by BasedSweet
Passkeys are something a few vendors are getting behind.
once_again_asking t1_j86vgfw wrote
Reply to comment by aidenr in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
Remember, science believes there’s a 50/50 chance it was a simulated stroke.
Deckma t1_j86v4s8 wrote
Reply to comment by rlaxton in Millions of passwords stolen from LastPass earlier than company disclosed: Report by BasedSweet
That's what they wanted us to believe. Unfortunately that's not true.
You can see the vault structure of popular password managers here: https://i.imgur.com/QAvoPmb.jpg
URLs we're not encrypted in Lastpass. And almost all the meta data and field names were not encrypted.
efvie t1_j86up5z wrote
Reply to comment by ekdaemon in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
It 100% has not emerged.
__ingeniare__ t1_j8722ii wrote
Reply to comment by skolioban in Scientists Made a Mind-Bending Discovery About How AI Actually Works | "The concept is easier to understand if you imagine it as a Matryoshka-esque computer-inside-a-computer scenario." by Tao_Dragon
You're talking about generative adversarial networks (GANs), which is a type of architecture from many years ago. More recent image generators tend to be based on diffusion, and text generators like in the article are transformer based.