Do you believe that these models will not be replicated outside OpenAI? And do you believe OpenAI will remain relatively benevolent long-term if they are not replicated elsewhere?
I believe they will be replicated outside OpenAI, given enough time. But the fewer details OpenAI releases, the longer it will take for someone else to replicate them.
To your second question, I am worried about the power dynamics of one lab having a monopoly on super-powerful models. But by far the worst risk I'm worried about (and it's my job to try and help mitigate) is catastrophic accidents from someone creating a super-powerful model without the right alignment techniques and safeguards. And that kind of risk is heightened when there are more actors competitively racing to build AGI.
