I’m not an expert. I’d just expect a neural network to follow the core principle of self-improvement. GPT is fundamentally unable to do this. The way it “learns” is closer to the same tech behind predictive text in your phone.
It’s the reason why it can’t understand why telling you to put glue on pizza is a bad idea.
“Improvement” is an open ended term. Would having longer or shorter toes be beneficial? Depends on the evolutionary environment.
ChatGPT does have a feedback loop. Every prompt you give it affects its internal state. That’s why it won’t give you the same response next time you give the same prompt. Will it be better or worse? Depends on what you want.
The core language model isn’t a nueral network? I agree that the full application is more Markov chainy but I had no idea the LLM wasn’t.
Now I’m wondering if there are any models that are actual neutral networks
I’m not an expert. I’d just expect a neural network to follow the core principle of self-improvement. GPT is fundamentally unable to do this. The way it “learns” is closer to the same tech behind predictive text in your phone.
It’s the reason why it can’t understand why telling you to put glue on pizza is a bad idea.
“Improvement” is an open ended term. Would having longer or shorter toes be beneficial? Depends on the evolutionary environment.
ChatGPT does have a feedback loop. Every prompt you give it affects its internal state. That’s why it won’t give you the same response next time you give the same prompt. Will it be better or worse? Depends on what you want.