• 10 Posts
  • 83 Comments
Joined 3 years ago
cake
Cake day: June 1st, 2023

help-circle
  • I like this path of reasoning. Let’s assume whoever invents the AGI wants “greater good”. However malicious humans exist so how does that interact with AGI technology. Let’s say the governments started implementing some sort of universal safety net, but I am malicious and want to be have better status. What can I do?

    I can start stockpiling still-scarce resources. With AGI that’s land and natural resources. I can made my own AGI that aligns with my own values and start a smearing campaign that degrades values I don’t like… but if everyone has AGI access the latter is probably not very effective. I can set up traps and bully others to show how much control I have to get people to fear me… I suppose AGI can amplify this but hopefully it amplifies the “good guys” as well so it cancels out at a societal scales but local cliques will still get hurt.

    I guess land and natural resource hoarding become most viable forms of greed… I wonder if this wood make feudal societies a thing again. Did modern governments happen because intellectual labor was more profitable and so it was more profitable to share land and natural resources in order to have intellectuals work together?


  • This is along the same lines I imagined it as well. And yes modern LLMs are nothing like what I’ve described. We’d need kilowatts of power per every single LLM conversation if we were to gradient descend them per conversation…. Funny enough human brain runs at like 10 watts. So I imagine there’s some huge paradigm shift from what LLMs do to what human brain does. You don’t get 1000 time efficiency boost from just putting all the world’s ram into it.





  • Pretty sure I managed to formally define intelligence and I’m working on implementing it on a computer. You essentially get an LLM that doesn’t need world’s books to talk. I suspect it’ll also not hallucinate because it’s lossless unlike neural networks. I’d say I’m about half way done implementing it.


  • Its an interesting perspective, except… that’s not how AI works (even if it’s advertised that way). Even the latest approach for ChatGPT is not perfect memory. It’s a glorified search functionality. When you type a prompt the system can choose to search your older chats for related information and pull it into context… what makes that information related is the big question here - it uses an embedding model to index and compare your chats. You can imagine it as a fuzzy paragraph search - not exact paragraphs, but paragraphs that roughly talk about the same topic…

    it’s not a guarantee that if you mention not liking sushi in one chat - talking about restaurant of choice will pull in the sushi chat. And even if it does pull that in, the model may choose to ignore that. And even if it doesn’t ignore that - You can choose to ignore that. Of course the article talks about healing so I imagine instead of sushi we’re talking about some trauma…. Ok so you can choose not to reveal details of your trauma to AI(that’s an overall good idea right now anyway). Or you can choose to delete the chat - it won’t index deleted chats.

    At the same time - there are just about as many benefits of the model remembering something you didn’t. You can imagine a scenario where you mentioned your friend being mean to you and later they are manipulating you again. Maybe having the model remind you of the last bad encounter is good here? Just remember - AI is a machine and you control both its inputs and what you’re to do with its outputs.






  • To be fair, there’s only been 24 year’s of 21 century. Most things you gave listed happened at the end of the 20th century. But also the question is somewhat self negating - we won’t know what’s the greatest invention until we see it working great, but it takes much more than 24 years to take an invention from concept to consumption. For example computational biology is kicking off. Computer aided dna generation started in the past 24 years. But it’s so new few people think about it. Just like no one thought of internet as the greatest invention in the 70s… it was just too new








  • 8 years ago I posted on facebook that whoever is interested in keeping in touch should text me and I deleted my account a week later. 4 people texted - all 4 were my high school friend. I’m very good friends with them still. We have a tiny discord server for communication. Since then I had maybe 4 more people who I thought “huh, I wonder what are they up to now” over the years, but my curiosity wasn’t big enough to start facebook again. For the rest I didn’t really care.





  • I think a lot of American privacy/security folks start with realizing the US government isn’t about privacy, so they want smaller government, but the only party pushing for smaller government pushes bigoted views to so the privacy folks get sucked into that mental space… not condoning them at all but I think this situation is the result of two-party government. I’m in security sector, but I do research and so there are a lot more left-leaning people around me. Sorry I don’t know any podcasts to recommend though.