Back to All Events

AGI Safety Fundamentals

  • Online & around TUD campus (map)

This program dives deep into the risks posed by advanced Artificial Intelligence. We talk about current progress in AI, the problems that need to be solved to make sure AI Systems are safe and how to align AI with human values!

We cover questions such as: How can we teach AI to behave ethically? How do we make sure AI follows the intent of it’s creators? How can you test whether an AI is safe to deploy? What is the state-of-the-art in AI and how will it progress in the next years?

Together we will go through the curriculum created by AI Alignment researcher Richard Ngo: https://www.agisafetyfundamentals.com/ai-alignment-curriculum. The first seven weeks are split into 1.5h of reading about the problem and 1.5h of discussing the contents with other interested students. In the remaining 4 weeks you get to pick your own mini-project to develop your skills and knowledge in the field.

Week 1: Artificial General Intelligence

Week 2: Reward misspecification and foundation models

Week 3: Goal mis generalization and instrumental convergence

Week 4: Inverse Reinforcement Learning and Iterated Amplification

Week 5: Debate and unrestricted adversarial training

Week 6: Interpretability

Week 7: Agent foundations, AI governance, and careers in alignment

Week 8-11: You Project

After completing this program you will have a deep understanding of the area and will be able to apply this to help solve one of the worlds most pressing problems!

No programming knowledge is required, however if you are less familiar with concepts in Machine Learning you can prepare with Week 0: Introduction to Machine Learning

You can apply here until 23/02

Previous
Previous
February 20

DAISI Introduction event

Next
Next
March 24

AI Governance Challenge