Recent comments in /f/singularity

Fit-Meet1359 t1_j8hipmt wrote

I am surprised that they didn't get anyone to look over the financial reports response. Checking a bunch of numbers should be easy. The presentation must really have been put together in a hurry in order to beat Google.

I'm still really impressed by Bing Chat though. It's quite inaccurate a lot of the time with the small details, even when it searches the web. But it still has made discovering new stuff much much easier than it used to be. I was trying to describe to it a concept I wanted to achieve in Blender after not having used it for a long time, and although it couldn't give me a perfect step by step answer on the first attempt, I was able to converse with it about the mistakes and get it to suggest alternative ideas.

1

vivehelpme t1_j8hiksi wrote

Yudkowsky and the lesswrong community can be described as a science-fiction cargo cult, and that's putting it nicely.

They aren't experts or developers of ML tools. They take loosely affiliated literary themes and transplant them to reality, followed by inventing a long series of pointless vocabulary, long tirades, grinding essays doing rounds on themself with ever more dense neo-philosophical contents. It's a religion based on what best resemble zen koans in content but are interpreted as fundamentalist scripture retelling the exact sequence of future events.

I think the cargo cults would probably take offense at being compared to them.

3

manubfr t1_j8hf8la wrote

I've had access for a few days and I feel quite underwhelmed. Bing chat is VERY inaccurate, I'd say more than half the time when researching on topics I am very familiar with, it correctly identifies information sources and then botches up the output, making very plain mistakes (e.g. pulls the correct statement from a webpage except the year which it gets wrong, replacing 2022 with 2021 within the same statement). It also struggles with disambiguation, eg two homonyms will be mixed up.

I honestly thought web connectivity would massively improve accuracy, but so far I've been very disappointed. However, the short term creative potential of LLMs and image models is insane.

1

red75prime t1_j8hf7aw wrote

Reply to comment by Darustc4 in Altman vs. Yudkowsky outlook by kdun19ham

What is conjectured: nanobots eating everything.

What is happening: "Would... you... be... OK... to... get... answer... in... the... next... decade...?" As experimental processes overwhelm available computational capacity and attempts to create botnet fail as the network is monitored by similarly intelligent systems.

Sure, survival of relatively optimal processes with intelligent selection can give rise to agents, but agents will be fairly limited by computational capacity in non-monitored environment (private computers, mostly) and will be actively hunted and shut down in monitored environments (data-centers).

3

Reddituser45005 t1_j8hedlb wrote

I find the whole hallucination thing fascinating. Researchers are suggesting that LLMs exhibit a theory of mind and that they construct their own machine learning model in its hidden states, the space in between the input and output layers. It is unlikely that machine consciousness would arrive fully developed. Human infants take longer to develop than other primates or mammals. It is unlikely that machine consciousness would just turn on like a switch. It would take time to develop an awareness, to integrate the internal and external worlds, to develop an identity. Are these examples of hallucinations and LLMs developing an internal model the baby steps of developing consciousness?

5

Private_Island_Saver t1_j8hcmh3 wrote

I think like the CEO for MSFT said that this will lower the barriers for people becoming knowledge workers, thats the main short term impact, but that will take some time for societies to adjust to. Basically the amount and quality of knowledge work will grow exponentially which will then in the long term enable the singularity

1

SurroundSwimming3494 t1_j8hbp6w wrote

>a majority of them are in denial of the transformations ahead

Some may be in denial, but others may simply be skeptical.

You can't write off all skeptics as simply being in denial.

>We're all in for the wildest ride in history.

If this sub is correct (which there's no way to know for sure since no one knows what the future holds exactly), then maybe.

If not, then things will probably be somewhat more tame than expected by the people here.

I just hope whatever change does come is both positive and gradual.

1

EulersApprentice t1_j8h7gg4 wrote

See, the problem is the top echelons of society have their wealth in an indestructible unobtainium vault. Not even governments are powerful enough to break into that vault – there are too many layers of defenses keeping intruders out.

People can vote to tax the rich, but the government is simply physically unable to carry out the taxation.

3

Ortus14 t1_j8h7cxk wrote

They both have sound arguments.

Altman's argument is maybe weaker Ai's on the road to AGI will solve Alignment and prevent value drift.

But Yudkowsky should be required reading for every one working in the field of AGI or alignment. He clearly outlines how the problem is not easy, and may be impossible. This should not be taken lightly by those working on AGI because we don't get a second chance.

6