Paul Christiano Joins OpenAI Board; Ngo Questions the Move
The appointment places a researcher who publicly estimates near-term catastrophic AI risk inside OpenAI's governance structure. Ngo's objection signals disagreement within the alignment research community over whether board participation can improve safety outcomes at frontier labs.
Paul Christiano has joined the OpenAI Foundation Board and its Safety and Security Committee, with fellow AI safety researcher Richard Ngo publicly criticizing the appointment. Christiano, founder of the Alignment Research Center, will also serve as a non-voting observer on the OpenAI Group PBC Board. The Safety and Security Committee is chaired by Zico Kolter and oversees safety and security practices across all of OpenAI. Christiano previously led alignment research at OpenAI from 2017 to 2021 and currently serves as a senior tech advisor at the U.S. Commerce Department's Center for AI Standards and Innovation. In a statement tied to the appointment, Christiano wrote that he estimates a 4% risk of catastrophic AI loss of control in the next year and 15% over three years, and that full automation of AI R&D could deliver more algorithmic progress than the decade since the Transformer appeared in six months. He said he is joining not as an endorsement of OpenAI's current safety practices but because he believes OpenAI could significantly reduce risk, and stated the Safety and Security Committee is not currently doing much actual risk management oversight in practice. Ngo wrote that affiliation with OpenAI has historically led safety researchers to act with less integrity and predicted the main effect of the appointment would be helping OpenAI defuse external criticism.
Richard Ngo, a fellow AI safety researcher, publicly criticized Christiano's September 9 appointment to the OpenAI Foundation Board and its Safety and Security Committee, writing that 'being affiliated with OpenAI has historically led AI safety researchers (including both Paul and myself) to act with less integrity'.
Ngo predicted the main effect of the appointment would be helping OpenAI defuse external criticism rather than strengthen safety oversight.
OpenAI announced September 9 that Paul Christiano, currently a senior tech advisor at the U.S.
Commerce Department's Center for AI Standards and Innovation, joined the OpenAI Foundation Board, its Safety and Security Committee, and the for-profit PBC board as a non-voting observer. Financial Times coverage on September 10 clarified that Christiano holds that government post concurrently with the new role, not formerly, and reported his view that six months of fully automated AI research could deliver more algorithmic progress than the decade since the Transformer architecture appeared.
Christiano published statements September 11 estimating a 4% probability of catastrophic AI loss-of-control within one year and 15% within three years.
He assessed that the Safety and Security Committee he joined is not currently doing much actual risk management oversight in practice, and framed the decision as a bet that OpenAI could reduce risk rather than an endorsement of its current safety practices.
I send one email each morning with the stories that moved. If you would rather just read here, that works too.
Subscribe free