From the very first sentence, I can already tell we are doomed if the right breakthroughs are made. It's like people's brains short-circuit when they imagine all the power and wealth that they might command through AI, and they don't take the extra two seconds to consider that any super intelligent system that can deliver on these promises will likely be very quickly outside of their control by definition.
Even during the interval of time these remained under human control, we are talking about people like Altman, Musk and Zuckerberg unilaterally wielding unprecedented economic power. What evidence is there in their behavior or human history in general to believe that this would be anything but bad for the majority of the worlds population?
Meanwhile these companies have been able to successfully nerd-snipe a small army of engineers who are right at that sweet spot of technical excellence and naivete. I won't say this is actually that difficult as these traits actually seem highly correlated in that population as a whole, but they have become the willing instruments of masters which will discard them at the first opportunity.
A global commitment to banning the development of AGI is the only sane response, and the number of people to whom this very premise itself sounds insane tells you just how fucked we are if they pull this off even halfway.
Even during the interval of time these remained under human control, we are talking about people like Altman, Musk and Zuckerberg unilaterally wielding unprecedented economic power. What evidence is there in their behavior or human history in general to believe that this would be anything but bad for the majority of the worlds population?
Meanwhile these companies have been able to successfully nerd-snipe a small army of engineers who are right at that sweet spot of technical excellence and naivete. I won't say this is actually that difficult as these traits actually seem highly correlated in that population as a whole, but they have become the willing instruments of masters which will discard them at the first opportunity.
A global commitment to banning the development of AGI is the only sane response, and the number of people to whom this very premise itself sounds insane tells you just how fucked we are if they pull this off even halfway.