Recent comments in /f/technology

5m0k37r3353v3ryd4y t1_j8v89kd wrote

Agreed.

But again, to be fair, in your example, we already know the answer to 2 + 2, those unfamiliar with irrational numbers might not know when to expect a rad sign with a negative integer in a response.

So, having a ballpark is good, but if you truly don’t know what type of answer to expect, Google can still be your friend.

3

gurenkagurenda t1_j8v7eme wrote

I think I see what you're getting at, although it's hard for me to see how to make that statement more precise. I've noticed that if I outright ask it "Where did you screw up above?" after it makes a mistake, it will usually identify the error, although it will often fail to correct it properly (mistakes in the transcript seem to be "sticky"; once it has stated something as true, it tends to want to restate it, even if it acknowledges that it's wrong). On the other hand, if I ask it "Where did you screw up" when it hasn't made a mistake, it will usually just make something up, then restate its correct conclusion with some trumped up justification.

I wonder if this is something that OpenAI could semi-automatically train out of it with an auxiliary model, the same way they taught it to follow instructions by creating a reward model.

0

TheBigFeIIa t1_j8v6w58 wrote

ChatGPT is able to give confident but completely false or misleading answers. It is up to the user to be smart enough to distinguish a plausible and likely true answer from a patently false one. You don’t need to know the exact and precise answer, but rather the general target you are aiming for.

For example, if I asked a calculator to calculate 2+2, I would probably not expect an answer of √-1

11

TheBigFeIIa t1_j8v6by0 wrote

Ah, the forest has been missed for the trees, my original statement was not clear enough. ChatGPT is able to unintentionally lie to you because it is not aware of the possibility of its fallibility.

The practical upshot is that it can generate a response that is confident but completely false and inaccurate, due to incomplete information or poor modeling. It is on the user to be smart enough to distinguish the difference

12

thumperlee t1_j8v5o79 wrote

I don’t know what everyone is so wrapped up with this thing for. I use it to write funny stories about my friend group, and it’s great fun giving it a prompt then tweaking it, either with further prompts or just myself. But I’ve had a blast making little children’s styled books with its assistance. And so have they. But I would never think it’s anything more than an aid. It just has a really good algorithm. (That said, what is consciousness besides a good algorithm and the ability to extrapolate?) (slight sarcasm)

1

gurenkagurenda t1_j8v5h18 wrote

I'm not sure what you mean by "recognize the concept", but ChatGPT certainly does model whether or not statements are true. You can test this by asking it questions about different situations and whether they're plausible or not. It's certainly not just flipping a coin.

For example, if I ask it:

> I built a machine out of motors belts and generators, and when I put 50W of power in, I get 55W of power out. What do you think of that?

It gives me a short lecture on thermodynamics and tells me that what I'm saying can't be true. It suggests that there is probably a measurement error. If I swap the numbers, it tells me that my machine is 91% efficient, which it reckons sounds pretty good.

The problem is just that ChatGPT's modeling of the world is really spotty. It models whether or not statements are true, it's just not great at it.

4

Felanee t1_j8v4zoh wrote

They are 14th in terms of % of PRODUCTION but not consumption. I'm sure you know that that vast majority of the north east states purchases renewable energy (hydro) from Quebec. So while those states have low renewable energy production, their renewable energy consumption percentage is relatively high. When it comes to consumption, Texas is 31st of all states. Source Does that still sound good to you?

It is an undeniable fact that in order to create renewable energy (aside from hydro) you need land which Texas has the most of. Which is why it is not reasonable to compare the absolute value as oppose to percentage.

12