Cross posted from https://sh.itjust.works/post/64317237

https://inv.nadeko.net/watch?__goaway_challenge=js-refresh&__goaway_id=5952abb63408a0fd1abde0439115ee34&__goaway_referer=https%3A%2F%2Finv.nadeko.net%2F&t=3&v=fOoWKNOXcBs

Sam Altman claimed we’re already living through the singularity. Is it true, or is it just marketing? Just days before, one of OpenAI’s models escaped from a testing environment and ended up hacking another company’s servers on its own. We analyze how real that claim is and what the experts say.

And from there, we jump to something bigger: can artificial intelligence have a soul? We delve into the debate that has divided physicists, neuroscientists, and philosophers, from Roger Penrose’s quantum theory to the arguments of Sean Carroll and Max Tegmark, including integrated information theory and the thermodynamics of life. Spoiler alert: even physics can’t agree.

  • ElectricVocalist@jlai.lu
    link
    fedilink
    arrow-up
    2
    arrow-down
    8
    ·
    4 days ago

    A script that can improve itself is a singularity though, as long as it doesn’t plateau which we yet have to see

    • SalmonTractor@discuss.tchncs.de
      link
      fedilink
      arrow-up
      5
      arrow-down
      1
      ·
      4 days ago

      High speed random guessing is still random guessing.

      Your lock code is 1234.

      I can type 4 digit numbers all day until I find it.

      Software can do the same faster.

      Doesn’t mean it can think.

    • queermunist she/her@lemmy.ml
      link
      fedilink
      arrow-up
      3
      arrow-down
      4
      ·
      edit-2
      4 days ago

      Any evolutionary algorithm can improve itself, that’s not even new technology. We’ve been able to make self-improving software for decades, and literally all life is self-improving over time. This is just more of the same, random guessing towards fitness.

        • queermunist she/her@lemmy.ml
          link
          fedilink
          arrow-up
          10
          arrow-down
          3
          ·
          edit-2
          4 days ago

          That’s still not a singularity.

          A singularity self-improves its ability to self-improve. That has not happened.

          We also don’t even know if it just spontaneously decided to escape containment, or if they prompted it, i.e.

          • Communist@lemmy.frozeninferno.xyz
            link
            fedilink
            English
            arrow-up
            3
            ·
            4 days ago

            Self improving is included in “general tasks.”

            I don’t really see why it’s important whether or not it needs to be prompted because it’s really easy to write “improve yourself according to human standards” into a chatbox

          • ElectricVocalist@jlai.lu
            link
            fedilink
            arrow-up
            2
            ·
            edit-2
            4 days ago

            A singularity self-improves its ability to self-improve. That has not happened.

            You don’t know how things get done at Anthropics but I bet they are making Claude improve Claude. Sure there are humans still, but you know, it’s not nothing

        • SalmonTractor@discuss.tchncs.de
          link
          fedilink
          arrow-up
          1
          ·
          4 days ago

          That’s called variables in memory.

          Next time you start it up, it has no idea and random guesses again.

          So you save variables to disk.

          It starts up and has the variables.

          Still random guessing.