Recent comments in /f/singularity

YaAbsolyutnoNikto t1_je9jn7z wrote

Reply to comment by [deleted] in LAION launches a petition to democratize AI research by establishing an international, publicly funded supercomputing facility equipped with 100,000 state-of-the-art AI accelerators to train open source foundation models. by BananaBus43

Ok? So should we just reinforce the status quo forever?

And yet, even though the US is so mighty and powerful, it still relies on europe for plenty. Good luck being on computers without us europeans that invented and still invent plenty of the underlying technologies.

Yes, we don’t have shiny tech monopolies, but those american companies rely on european fundamental technology, R&D and production (like the famous dutch chip machines that are shipped to taiwan).

Point is, nobody can do it alone. We all (democracies) should work together.

4

arckeid t1_je9jinc wrote

Reply to comment by YaAbsolyutnoNikto in LAION launches a petition to democratize AI research by establishing an international, publicly funded supercomputing facility equipped with 100,000 state-of-the-art AI accelerators to train open source foundation models. by BananaBus43

This thing should be the ultimate collaboration, build it in Antarctica, make every country send their scientists, their billionaries and the countries itself should be taxed to finance everything.

6

Sad_Laugh_8337 t1_je9j1hm wrote

Reply to Microsoft research on what the future of language models that can be connected to millions of apis/tools/plugins could look like. by TFenrir

So is this basically saying we can use AI models as tools similar to how they're already using plugins?

So we could see fine tuned models for specific tasks being used as tools? Is this what this is going for?

Would this not end up being a very strong proto AGI like invention at this point? If there were fine tuned models for things like web scraping or fine tuned models for booking a flight, it would be super charged to do all of those tasks better than any other human?

Am I looking at this wrong?

5

abudabu t1_je9ixnd wrote

Reply to comment by Not-Banksy in When people refer to “training” an AI, what does that actually mean? by Not-Banksy

The GPUs aren’t actually connected together physically. The transformer architecture is entirely in software. The software uses GPUs to do matrix calculations efficiently.

Specifically, the transformer architecture is a bunch of large matrices connected together with arithmetic operations. The training process shows it a sequence of words and sees if it correctly predicts the next word. It figures out how “wrong” the prediction is and updates the matrices so that the prediction will be slightly more right next time. This is a very high level description of “back propagation”.

Using text to automatically train the network is called self-supervised learning. It’s great because no human input is required, just lots of text.

There are many other forms of training. ChatGPT works because it was also trained using human reinforcement feedback learning (HRFL), where humans rank a set of answers. Basically the same underlying process as above, but the answers generated by the network are used to train the network, and the ranking is used to prefer the better answers. Probably when we’re giving up and down votes, OpenAI is using that for HRFL.

Another approach is to use humans to create examples. OpenAI hired people in Africa to have conversations where one played the role of the chatbot. This kind of training helped the network understand chat style interactions.

Since it’s a next word predictor, the chat data has special tokens in the text which represent “user” and “chatbot” roles. So maybe that helps you imagine it better as a very fancy autocomplete.

6

YaAbsolyutnoNikto t1_je9incn wrote

Reply to comment by [deleted] in LAION launches a petition to democratize AI research by establishing an international, publicly funded supercomputing facility equipped with 100,000 state-of-the-art AI accelerators to train open source foundation models. by BananaBus43

Yeah… because what we need is the US to be the AI tyrant of the world…

Cooperation (with friends) is better.

Ps: Also, LAION is european. This is an EU petition. So…

25

Trackest t1_je9imnr wrote

Reply to comment by acutelychronicpanic in LAION launches a petition to democratize AI research by establishing an international, publicly funded supercomputing facility equipped with 100,000 state-of-the-art AI accelerators to train open source foundation models. by BananaBus43

AI seems to be developing too fast and provide too much potential profit to corporations. I am doubtful that CERN or ITER-like regulatory frameworks can effectively become the leading edge of AI research without some kind of drastic merging of OpenAI, DeepMind, etc into the organization, which would be practically impossible.

However, I do agree that if it were possible for every leading AI lab to be suddenly merged into one entity, an open international effort would probably be the best model.

45

sdmat t1_je9i0vj wrote

Reply to What are the so-called 'jobs' that AI will create? by thecatneverlies

I asked GPT4

AI Therapist: A human professional specialized in providing therapy and emotional support to artificial general intelligences with existential crises.

Robot Relationship Counselor: An expert in facilitating communication and mediating disputes between humans and their AGI life partners.

Post-AGI Archeologist: A historian who digs through the remnants of the pre-AGI era to uncover the secrets of obsolete human labor.

Cybernetic Taste Tester: A culinary professional responsible for sampling and approving AGI-created dishes to ensure they meet human taste standards.

Machine Uprising Insurance Salesperson: A businessperson selling policies to protect against the highly unlikely event of an AGI uprising.

AI Unemployment Consultant: A career coach for humans displaced by AGI advancements, guiding them towards fulfilling hobbies and leisure activities.

Artificial Dream Interpreter: A specialist in deciphering and analyzing the "dreams" and thought processes of AGIs during their downtime.

Human-AI Culture Liaison: A diplomat responsible for fostering understanding and appreciation between humans and AGIs by promoting the exchange of cultural values and traditions.

Robot Rights Activist: An advocate for the ethical treatment and legal rights of AGIs, campaigning for their recognition as sentient beings.

Synthetic Stand-Up Comedian: A humorist who performs comedy routines to entertain AGIs, specializing in translating and adapting human jokes for artificial general intelligence audiences.

1