@jam3scampbell - Just finished watching this series. It might be the best
James Campbell✓@jam3scampbell
2024-05-16Just finished watching this series. It might be the best long-form portrayal of the singularity I've seen and the plot is amazing.
Some takeaways for our world:
-PauseAI will be biggest activist movement in history.
-Militaries will get involved and have no qualms about breaking the rules to get what they want.
-Cyber attack/defense will be extremely important. Both are talent bottlenecked and will be ripped open by AI SWE's
-It's really really hard to get a genie back in the bottle, especially if it can copy its code.
-We will need really good monitoring systems to detect bad AGI's out in the world. This currently doesn't exist.
-Every world power will be running AGI projects in parallel. AGI's working for dueling countries will go to war with each other.
-Everything will be increasingly top secret. You won't be able to know what's going on by checking twitter bcuz only 50 ppl in the world know and they're in an air-gapped facility in Norway. Such facilities will probably, actually come to exist (if they don't already)
-Speed is enough for superintelligence. If you can run a human-level AI at 1000 tok/s, it can do three years worth of work in a day.
-Memory enables a lot. The difference between an AGI that has a continuous life vs one that wakes up anew each day is massive
-Multiple intelligent species will co-exist on earth. The deep-seated urge to hate the other species/race will be a major obstacle.
-Bioweapons are a form of weapon that only affect biological species and not digital ones.
-“the only one that can be trusted with so much power is myself” will be the motto of every ambitious technologist
-Ultimately, the key decisions will come down to a very small number of individuals
-There will be fights, even (especially) between people who are noble and principled and who want what’s best for the world
-Utilitarian calculations will be made in real-time. Real people will have to make choices that sound like speculative trolley problems.
-Datacenters will probably, unironically be bombed at some point. They will become the modern-day pyramids.
-In a world of infinite life, the most dangerous person is he who is willing to die for a cause
-"Where's Ilya" was predicted by the show ☠️
-Embodiment defines human life. The experience of being physical versus digital will be different in profound ways.
-If all goes well, then one day you will be a 100,000 year old superintelligent blob hosted on a Dyson Sphere in Alpha Centauri. This will be the same you as the person reading this right now
-The choices you make today will ring out into eternity
roon@tszzl2024-03-31everyone watch Pantheon