• kn0wmad1c@programming.dev
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    6
    ·
    2 years ago

    I’m not an expert. I’d just expect a neural network to follow the core principle of self-improvement. GPT is fundamentally unable to do this. The way it “learns” is closer to the same tech behind predictive text in your phone.

    It’s the reason why it can’t understand why telling you to put glue on pizza is a bad idea.

    • frezik@midwest.social
      link
      fedilink
      arrow-up
      1
      ·
      2 years ago

      “Improvement” is an open ended term. Would having longer or shorter toes be beneficial? Depends on the evolutionary environment.

      ChatGPT does have a feedback loop. Every prompt you give it affects its internal state. That’s why it won’t give you the same response next time you give the same prompt. Will it be better or worse? Depends on what you want.