Recent comments in /f/singularity

turnip_burrito t1_j9j1pe8 wrote

Reply to comment by gONzOglIzlI in OpenAI has privately announced a new developer product called Foundry by flowday

Why would it expand the token budget exponentially?

Also we have nowhere near enough qubits to handle these kinds of computations. The number of bits you need to run these models is huge (GPT3 ~170bil or 10^11 parameters). Quantum computers nowadays are lucky to be around 10^3 qubits, and they decohere too quickly to be used for very long (about 10^-4 seconds). * numbers pulled from a quick Google search.

That said, new (classical computer) architectures do exist that can use longer context windows: H3 (Hungry Hungry Hippos) and RWVST or whatever it's called.

5

tomorrow_today_yes t1_j9j0w44 wrote

Reply to What are your thoughts on Eliezer Yudkowsky? by DonOfTheDarkNight

He is a bit like Paul Ehrlich, the population doomster of the 1970’s. Ehrlich is very smart and a good arguer but not someone who can accept criticism easily. Ehrlich, like Yudkowsky, reached his conclusions based on simply extrapolating trends. Ehrlich refused to acknowledge that his simple extrapolation was made invalid by green revolution and improved technology, the possibility of this had been pointed out to him, notably by Julian Simon, but Ehrlich dismissed this as hopium. I really hope that we can ridicule Yudkowsky in the future for the same reasons, not because I don’t like him but because that would mean the AI alignment problem was solved.

15

Destiny_Knight OP t1_j9iysi7 wrote

Reply to What. The. ***k. [less than 1B parameter model outperforms GPT 3.5 in science multiple choice questions] by Destiny_Knight

The paper: https://arxiv.org/pdf/2302.00923.pdf

The questions: "Our method is evaluated on the ScienceQA benchmark (Lu et al., 2022a). ScienceQA is the first large-scale multimodal science question dataset that annotates the answers with de- tailed lectures and explanations. It contains 21k multimodal multiple choice questions with rich domain diversity across 3 subjects, 26 topics, 127 categories, and 379 skills. The benchmark dataset is split into training, validation, and test splits with 12726, 4241, and 4241 examples, respectively."

40

Savings-Juice-9517 t1_j9ix6v8 wrote

Reply to comment by IndependenceRound453 in OpenAI has privately announced a new developer product called Foundry by flowday

Exactly. I’m a full time programmer and AI, at least in its current form, definitely improves my productivity but is no where near the level where it will replace programmers or software engineers. Less than 5% of a programmers time is spent physically writing code but this subreddit seems to think that’s what programmers do all day

−4