Advertising

NIST Employees Express Opposition to Potential Appointment of ‘Effective Altruist’ AI Researcher at US AI Safety Institute

blankNIST Employees Express Opposition to Potential Appointment of ‘Effective Altruist’ AI Researcher at US AI Safety Institute

The National Institute of Standards and Technology (NIST) is facing internal turmoil as employees and scientists voice their opposition to the potential appointment of Paul Christiano at the newly-formed US AI Safety Institute (AISI). Sources with direct knowledge of the situation have revealed that NIST staff members have threatened to resign over the hiring process, which they claim was rushed and lacked transparency.

Christiano, known for his association with the effective altruism (EA) movement and longtermism, has sparked outrage among NIST employees. EA is an intellectual project that focuses on using evidence and reason to benefit others as much as possible. However, critics argue that it has turned into a cult-like group of influential and wealthy adherents, with a primary concern for preventing a future AI catastrophe rather than addressing current AI risks such as bias, misinformation, high-risk applications, and cybersecurity.

The appointment of Christiano was allegedly made by Secretary of Commerce Gina Raimondo, resulting in concerns that his association with EA and longtermism could compromise the objectivity and integrity of the AISI. Employees fear that NIST’s mission and methodology will be affected by this appointment, as they believe NIST should focus on methodical measurement research grounded in science.

Divyansh Kaushik, associate director for emerging technologies and national security at the Federation of American Scientists, emphasizes the importance of ensuring that NIST’s mission remains unaffected. He believes that any appointments made should align with NIST’s strengths and not attempt to redefine its purpose. Kaushik expresses concern that losing NIST’s “superstar scientists” due to controversial appointments would be a significant loss for the organization.

Congressional committees are closely monitoring the work of the AISI, further highlighting the need for strong leadership and scientific integrity within the institute. The controversy surrounding the potential appointment of Christiano raises questions about NIST’s transparency and its commitment to addressing current AI risks.

VentureBeat has reached out to Secretary of Commerce Gina Raimondo, AISI director Elizabeth Kelly, and Paul Christiano for comment. It remains to be seen how this internal crisis will be resolved and whether NIST will prioritize addressing current AI risks or focus solely on preventing future catastrophes.

As the situation unfolds, it is clear that the appointment of key individuals in organizations like the AISI can have far-reaching implications. The controversy surrounding Paul Christiano highlights the importance of transparency, scientific integrity, and a balanced approach to AI safety. NIST must carefully consider the concerns raised by its employees and ensure that its mission and methodology remain grounded in science.