MIT 學者Lex Fridman 訪談 co-founder of OpenAI Ilya Sutskever

 

1. Elon Musk & Ilya Sutskever receiving Nvidia hardware for the then “Nonprofit” OpenAI

Elon Musk & Ilya Sutskever receiving Nvidia hardware for the then “Nonprofit” OpenAI pic.twitter.com/cIkAW64TpP

— K10 (@Kristennetten) February 18, 2024

 

 

2. MIT 學者Lex Fridman 訪談 co-founder of OpenAI Ilya Sutskever

May 8, 2020

Ilya Sutskever is the co-founder of OpenAI, is one of the most cited computer scientist in history with over 165,000 citations, and to me, is one of the most brilliant and insightful minds ever in the field of deep learning. There are very few people in this world who I would rather talk to and brainstorm with about deep learning, intelligence, and life than Ilya, on and off the mic.

油管鏈接：https://www.youtube.com/watch?v=13CZPWmke6A

 

0:00 - Introduction

2:23 - AlexNet paper and the ImageNet moment

8:33 - Cost functions

13:39 - Recurrent neural networks

16:19 - Key ideas that led to success of deep learning

19:57 - What's harder to solve: language or vision?

29:35 - We're massively underestimating deep learning

36:04 - Deep double descent

41:20 - Backpropagation

42:42 - Can neural networks be made to reason?

50:35 - Long-term memory

56:37 - Language models

1:00:35 - GPT-2

1:07:14 - Active learning

1:08:52 - Staged release of AI systems

1:13:41 - How to build AGI?

1:25:00 - Question to AGI

1:32:07 - Meaning of life