Революция разума: на подступах к Сингулярности. Как технологии изменят общество и сознание - Рэймонд Курцвейл

“MuZero: Mastering Go, Chess, Shogi and Atari Without Rules”, DeepMind, December 23, 2020, https://deepmind.com/blog/article/muzero-mastering-go-chess-shogi-and-atari-without-rules.

86. AlphaStar Team, “AlphaStar: Mastering the Real-Time Strategy Game StarCraft II ”, DeepMind, January 24, 2019, https://deepmind.com/blog/article/alphastar-mastering-real-time-strategy-game-starcraft-ii; Noam Brown and Tuomas Sandholm, “Superhuman AI for Heads-Up No-Limit Poker: Libratus Beats Top Professionals”, Science 359, no. 6374 (January 26, 2018): 418–24, https://doi.org/10.1126/science.aao1733; Cade Metz, “Inside Libratus, the Poker AI That Out-Bluffed the Best Humans”, Wired, February 1, 2017, https://www.wired.com/2017/02/libratus.

87. Подробная информация об игре «Дипломатия»: “Diplomacy: Running the Game #40, Politics #3”, Matthew Colville, YouTube video, July 15, 2017, https://www.youtube.com/watch?v= HWt0AQWjhPg; Ben Harsh, “Harsh Rules: Let’s Learn to Play Diplomacy”, Harsh Rules, YouTube video, August 9, 2018, https://www.youtube.com/watch?v=S-sSWsBdbNI; Blake Eskin, “World Domination: The Game”, Washington Post, November 14, 2004, https:// www.washingtonpost.com/archive/lifestyle/magazine/2004/11/14/world-domination-the-game/b65c9d9f-71c7-4846-961f-6dcdd1891e01; David Hill, “The Board Game of the Alpha Nerds”, Grantland, June 18, 2014, https://grantland.com/features/diplomacy-the-board-game-of-the-alpha-nerds.

88. Matthew Hutson, “AI Learns the Art of Diplomacy”, Science, November 22, 2022, https:// www.science.org/content/article/ai-learns-art-diplomacy-game; Yoram Bachrach and János Kramár, “AI for the Board Game Diplomacy”, DeepMind, December 6, 2022, https://www.deepmind.com/blog/ai-for-the-board-game-diplomacy.

89. Ira Boudway and Joshua Brustein, “Waymo ’s Long-Term Commitment to Safety Drivers in Autonomous Cars”, Bloomberg, January 13, 2020, https://www.bloomberg.com/news/arti cles/2020-01-13/waymo-s-long-term-commitment-to-safety-drivers-in-autonomous-cars.

90. Aaron Pressman, “Google ’s Waymo Reaches 20 Million Miles of Autonomous Driving”, Fortune, January 7, 2020, https://fortune.com/2020/01/07/googles-waymo-reaches-20-million-miles-of-autonomous-driving.

91. Darrell Etherington, “Waymo Has Now Driven 10 Billion Autonomous Miles in Simulation”, TechCrunch, July 10, 2019, https://techcrunch.com/2019/07/10/waymo-has-now-driven-10-billion-autonomous-miles-in-simulation.

92. Gabriel Goh et al., “Multimodal Neurons in Artificial Neural Networks”, Distill, March 4, 2021, https://distill.pub/2021/multimodal-neurons.

93. Больше информации о USE: Yinfei Yang and Amin Ahmad, “Multilingual Universal Sentence Encoder for Semantic Retrieval”, Google Research, July 12, 2019, https://ai.googleblog.com/2019/07/multilingual-universal-sentence-encoder.html; Yinfei Yang and Chris Tar, “Advances in Semantic Textual Similarity”, Google Research, May 17, 2018, https://ai.googleblog.com/2018/05/advances-in-semantic-textual-similarity.html; Daniel Cer et al., “Universal Sentence Encoder”, arXiv:1803.11175v2 [cs.CL], April 12, 2018, https:// arxiv.org/abs/1803.11175.

94. Rachel Syme, “Gmail Smart Replies and the Ever-Growing Pressure to E-Mail Like a Machine”, New Yorker, November 28, 2018, https://www.newyorker.com/tech/annals-of-technology/gmail-smart-replies-and-the-ever-growing-pressure-to-e-mail-like-a-machine.

95. Подробнее о том, как работают трансформеры, а также оригинальная научная статья: Giuliano Giacaglia, “How Transformers Work”, Towards Data Science, March 10, 2019, https://towardsdatascience.com/transformers-141e32e69591; Ashish Vaswani et al., “Attention Is All You Need”, arXiv:1706.03762v5 [cs.CL], December 6, 2017, https://arxiv.org/pdf/1706.03762.pdf.

96. Irene Solaiman et al., “GPT-2: 1.5B Release”, OpenAI, November 5, 2019, https://openai.com/blog/gpt-2-1-5b-release.

97. Tom B. Brown et al., “Language Models Are Few-Shot Learners”, arXiv:2005.14165 [cs.CL], July 22, 2020, https://arxiv.org/abs/2005.14165.

98. Jack Ray et al., “Language Modelling at Scale: Gopher, Ethical Considerations, and Retrieval”, DeepMind, December 8, 2021, https://www.deepmind.com/blog/language-modelling-at-scale-gopher-ethical-considerations-and-retrieval.

99. Pandu Nayak, “Understanding Searches Better Than Ever Before”, Google, October 25, 2019, https://blog.google/products/search/search-language-understanding-bert; William Fedus et al., “Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity”, arXiv:2101.03961 [cs.LG], January 11, 2021, https://arxiv.org/abs /2101.03961.

100. Подробная информация о GPT-3: Greg Brockman et al., “OpenAI API”, Open-AI, June 11, 2020, https://openai.com/blog/openai-api; Brown et al., “Language Models Are Few-Shot Learners”; Kelsey Piper, “GPT-3, Explained: This New Language AI Is Uncanny, Funny – and a Big Deal”, Vox, August 13, 2020, https://www.vox.com/future-perfect/21355768/gpt-3-ai-openai-turing-test-language; “GPT-3 Demo: New AI Algorithm Changes How We Interact with Technology”, Disruption Theory, YouTube video, August 28, 2020, https://www.youtube.com/watch?v=8V20HkoiNtc.

101. David Cole, “The Chinese Room Argument”, in The Stanford Encyclopedia of Philosophy, ed. Edward N. Zalta (Winter 2020), https://plato.stanford.edu/archives/win2020/entries /chinese-room; Amanda Askell (@amandaaskell), “GPT-3 ’s completion of the Chinese room argument from Searle’s ‘Minds, Brains, and Programs’ (original text is in bold)”, Twitter, July 17, 2020, https://twitter.com/AmandaAskell/status/1284186919606251521; David J. Chalmers, The Conscious Mind: In Search of a Fundamental Theory (New York: Oxford University Press, 1996), 327.

102. Cade Metz, “Meet GPT-3. It Has Learned to Code (and Blog and Argue)”, New York Times, November 24, 2020, https://www.nytimes.com/2020/11/24/science/artificial-intelligence-ai-gpt3.html.

103. Больше информации о LaMDA и примеры разговоров, в которых она притворяется карликовой планетой Плутон или бумажным самолетиком: Eli Collins and Zoubin Ghahramani, “LaMDA: Our Breakthrough Conversation Technology”, Google, May 18, 2021, https:// blog.google/technology/ai/lamda; “Watch Google’s AI LaMDA Program Talk to Itself at Length (Full Conversation)”, CNET Highlights, YouTube video, May 18, 2021, https:// www.youtube.com/watch?v=aUSSfo5nCdM.

104. Jeff Dean, “Google Research: Themes from 2021 and Beyond”, Google Research, January 11, 2022, https://ai.googleblog.com/2022/01/google-research-themes-from-2021-and.html.

105. Примеры удивительно креативных изображений, созданных нейросетью DALL-E: Aditya Ramesh et al., “Dall-E: Creating Images from Text”, OpenAI, January 5, 2021, https://openai.com/research/dall-e.

106. “Dall-E 2”, OpenAI, accessed June 30, 2022, https://openai.com/dall-e-2.

107. Chitwan Saharia et al., “Imagen”, Google Research, Brain Team, Google, accessed June 30, 2022, https://imagen.research.google.

108. Saharia et al., “Imagen”.

109. Scott Reed et al., “A Generalist Agent”, DeepMind, May 12, 2022, https://www.deepmind.com/publications/a-generalist-agent.

110. Wojciech Zaremba et al., “OpenAI Codex ”, OpenAI, August 10, 2021, https://openai.com/blog/openai-codex.

111. AlphaCode Team, “Competitive Programming with AlphaCode”, DeepMind, December 8, 2022, https://www.deepmind.com/blog/competitive-programming-with-alphacode; Yujia Li et al., “Competition-Level Code Generation with AlphaCode”, arXiv:2203.07814v1 [cs.PL], February 8, 2022, https://arxiv.org/pdf/2203.07814.pdf.

112. Aakanksha Chowdhery, “PaLM: Scaling Language Modeling with Pathways”, arXiv:2204.02311v3 [cs.CL], April 19, 2022, https://arxiv.org/pdf/2204.02311.pdf; Sharan Narang et al., “Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance”, Google AI Blog, April 4, 2022, https://ai.googleblog.com/2022 /04/pathways-language-model-palm-scaling-to.html.

113. Chowdhery, “PaLM: Scaling Language Modeling with Pathways”.

114. Chowdhery, “PaLM: Scaling Language Modeling with Pathways”.

115. Chowdhery, “PaLM: Scaling Language Modeling with Pathways”.

116. OpenAI, “Introducing ChatGPT”, OpenAI, November 30, 2022, https://openai.com/blog/chatgpt#OpenAI.

117. Krystal Hu, “ChatGPT Sets Record for Fastest-Growing User Base – Analyst Note”, Reuters, February 2, 2023, https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01.

118. Kalley Huang, “Alarmed by A.I. Chatbots, Universities Start Revamping How They Teach”, New York Times, January 16, 2023, https://www.nytimes.com/2023/01/16/technol ogy/chatgpt-artificial-intelligence-universities.html; Emma Bowman, “A College Student Created an App That Can Tell Whether AI Wrote an Essay”, NPR, January 9, 2023, https://www.npr.org/2023/01/09/1147549845/gptzero-ai-chatgpt-edward-tian-plagiarism; Patrick Wood and Mary Louise Kelly, “‘Everybody Is Cheating’: Why This Teacher Has Adopted an Open ChatGPT Policy”, NPR, January 26, 2023, https://www.npr.org/2023 /01/26/1151499213/chatgpt-ai-education-cheating-classroom-wharton-school; Matt O’Brien and Jocelyn Gecker, “Cheaters Beware: ChatGPT Maker Releases AI Detection Tool”, Associated Press, January 31, 2023, https://apnews.com/article/technology-education-col leges-and-universities-france-a0ab654549de387316404a7be019116b; Geoffrey A. Fowler, “We Tested a New ChatGPT-Detector for Teachers. It Flagged an Innocent Student”, Washington Post, April 3, 2023, https://www.washingtonpost.com/technology/2023/04/01 /chatgpt-cheating-detection-turnitin.

119. OpenAI, “GPT-4 ”, OpenAI, March 14, 2023, https://openai.com/research/gpt-4; OpenAI, “GPT-4 Technical Report”, arXiv:2303.08774v3 [cs.CL], March 27, 2023, https://arxiv.org/pdf/2303.08774.pdf; OpenAI, “GPT-4 System Card”, OpenAI, March 23, 2023, https://cdn.openai.com/papers/gpt-4-system-card.pdf.

120. OpenAI, “Introducing GPT-4 ”, YouTube video, March 15, 2023, https://www.youtube.com/watch?v=-khbXchTeE.

121. Daniel Feldman (@d_feldman), «Слева ответ GPT-3.5. Справа – GPT-4. Если вам показалось, что ответ слева говорит о том, что у GPT-3.5 нет внутренней модели мира, вам придется