🗣 An OpenAI board member wants AI labs to pause progress "right now"
Paul Christiano, who invented RLHF, the technique behind ChatGPT's training, said on the Dwarkesh Podcast on Monday that "it is not good for US AI labs to be improving pre-training and reinforcement learning given their current security posture."
Should the labs pause? "I think we should." On improving algorithms that could be quickly stolen: "I think they should stop that right now."
He fears China could steal a superintelligence mid-race, so labs couldn't slow down even if their models went off the rails. Host Dwarkesh P
Paul Christiano, who invented RLHF, the technique behind ChatGPT's training, said on the Dwarkesh Podcast on Monday that "it is not good for US AI labs to be improving pre-training and reinforcement learning given their current security posture."
Should the labs pause? "I think we should." On improving algorithms that could be quickly stolen: "I think they should stop that right now."
He fears China could steal a superintelligence mid-race, so labs couldn't slow down even if their models went off the rails. Host Dwarkesh P