大会演讲·中文精读

马斯克与苏纳克对话 AI

AI discussion with Rishi Sunak

中文精读由 AI 基于原始视频与文稿改写,非官方翻译,可能存在偏差或错误;表述以原视频为准。说明

比尔·盖茨说过一句话,我们这个时代没有人比马斯克更用力地推动科学和创新的边界。马斯克听完的反应是:"这话有点疯。不过被比尔·盖茨这么说,感觉挺好。"

可就在 AI 这件事上,他做了十年少数派。

2023 年 11 月,英国在布莱切利园办首届全球 AI 安全峰会。峰会前一天,苏纳克和马斯克在伦敦对谈了一个小时。开场没多久,苏纳克就抛出了这个反差:同一个人,一边被称作最能推动创新的人,一边在 AI 上喊了十年"慢一点"。

当了十年卡珊德拉

"我当卡珊德拉当了好一阵子了。"(马斯克)

卡珊德拉是希腊神话里那个能预言灾难、但永远没人相信的女人。马斯克说,他一直在跟人讲,我们该担心 AI。对方的反应基本是:你在说什么?那时候大部分人确实没跟 AI 打过任何交道。

他的理由很简单,他在技术里泡了太久,能看见东西过来。

2023 年,他觉得有几件事同时发生了。

一件是深度伪造(deepfake)。现在可以实时生成一个人说任何话的视频,说你也行,说他也行。效果好到什么程度?马斯克的原话是,有时候真的比真的还真。

另一件是 ChatGPT。他说自己看过 GPT-1 到 GPT-4 的整个爬坡过程,所以把曲线上的点往外一推,方向很清楚:这条线会继续往上,最终会出现远超人类智能的智能。

这就是他十年警告的底层逻辑,不需要什么神秘主义,只需要承认趋势会延续。

他也道了谢,说苏纳克办这场峰会,历史会记住它很重要。这场对话发生在峰会前夜,第二天的成果是一份包括中国在内的多国签署的联合公报。

精灵、裁判,和那个 80%

马斯克讲了一个比喻,后来在整场对话里反复出现。

假设你有一个能实现所有愿望的精灵。你想要什么它给什么,没有次数限制。听起来是人类文明的终点。

可这类故事的结局通常不好。

要小心你许的愿,包括"再来更多愿望"这个愿望本身。(马斯克)

他对结果的判断一直很稳定:大概率是好事,但坏的概率不是零。

结尾他又把数字说了一遍,80% 会是好的,20% 是坏的。中间隔了一个小时,数字没变。这个比例显然是他反复推演之后愿意公开下注的区间,随口讲不出来。

好消息那部分,他用了个词:富足(abundance)。商品和服务不再稀缺的时代。他在后面把这个逻辑推到底,说会从全民基本收入(universal basic income)走到全民高收入(universal high income)。

坏消息那部分,需要有人当裁判。

苏纳克问,政府该做什么。马斯克的回答从一件很朴素的事开始:绝大多数软件不涉及公共安全。你手机上的应用崩了,笔记本蓝屏了,不是灾难。但数字超级智能不一样,它确实对公众构成风险,那政府就有角色。

他举了自己熟悉的领域,航空、汽车、通信。因为做火箭和做车,他跟全世界的监管机构打过很多交道。

"我其实同意绝大多数监管。时不时会不同意几条,但比例大概只有 0.1%,不到 1%。"(马斯克)

苏纳克追了一句,硅谷那边对监管的抵触是真实存在的。马斯克没替同行辩护,反而说了句挺扫兴的话:那些从来没跟监管打过交道的人,觉得监管会压死创新、让他们变慢、让他们很烦。他们的担心有道理,监管确实会烦人。

但接着他给出了整场对话里最容易被记住的类比:

任何一场体育比赛都有裁判,没有人提议办一场没有裁判的比赛。

政府就是这个裁判。职责是保证比赛按规矩进行,以及保证公众安全。

他还补了一句自我定位:我作为技术专家说这话,所以我应该知道,技术圈有时候过于乐观了。

这句话的分量在于说话的人。一个造火箭、造电动车、做脑机接口的人,站出来说"我们这行容易过度乐观",比任何监管者的警告都更难反驳。

每年五到十倍,政府追不上的速度

苏纳克提了个很实际的问题:政府能攒够专业能力吗?DeepMind 那边有一堆极聪明的人在做这件事,政府能不能跟上?

马斯克先给了速度的量级:他见过的所有技术里,AI 是最快的,而且还在加速。能力每年至少提升五倍,也许是十倍。他预计明年就是一个数量级的增长。

参照系是摩尔定律。苏纳克说,你一辈子活在摩尔定律里,而这里的东西完全不是那个节奏。

政府不习惯按这个速度运转,这点马斯克承认。但他给出了一个门槛很低的答案:即使没有硬性法规,即使没有执法能力,光是让监管方拥有洞察力、能把这些担忧摆到公众面前,就已经很有力量。

"如果只做到这一步,我觉得也非常非常好。"

苏纳克接了一句"希望能做得比这更好",马斯克说"希望如此"。

中国不在桌上,这场讨论就是空谈

苏纳克主动提了他那个不太受欢迎的决定:邀请中国参加峰会。他说很多人批评他,他的理由是,要谈就得认真地谈。

马斯克给了很直接的支持。

他先点出了反对监管的人最常用的那张牌:"中国不会做的,所以他们会一路领先超过我们所有人。"这句话在硅谷的每一场 AI 监管辩论里都会出现。

马斯克的回应是事实层面的:中国愿意讨论 AI 安全。

他今年访问中国时,跟中方领导层谈的主要议题就是 AI 安全。他告诉对方这是真正该关心的事,而对方认真对待了。所以他觉得,中国能到场是必要的,如果不参与,这事就没有意义。

顺带他也交代了当下的格局:AI 开发目前有两个领先中心,旧金山湾区和伦敦地区。别的地方也在做,但领头的就这两个。

所以他的判断是,如果美国、英国、中国在安全上能对齐,那就是好事。领导力在哪里,共识就得在哪里。

开源落后一年,就是差五倍

峰会当天有一场关于开源的辩论。苏纳克说,一边有人担心开源模型被坏人拿去用,一边有人说开源才是分布式创新的土壤,没有完美答案。

马斯克先给了个时间差:开源模型和公开数据,通常落后闭源 6 到 12 个月。

听着不算多。但他紧接着算了一笔账:如果能力提升的速度是每年五倍甚至更多,落后一年就意味着你比人家差五倍。在这个斜率下,6 到 12 个月是很宽的沟。

他说这也许还行,算是一个可以接受的局面。但开源 AI 迟早会逼近人类水平智能,甚至超过。这一点他也没法给出解决方案。

他承认这事某种程度上不可避免。如果非要选,他略微偏向开源,理由很朴素:至少你能看见里面在发生什么。闭源的话,你什么都不知道。

然后他马上自己拆了这个理由。

即使是开源模型,你真的知道里面在干什么吗?一个几十亿参数、几千亿数据点的文件,你没法读一遍就知道它要干什么。那是一份巨大的、不可读的数字堆。

主持人调侃了一句"我们的数字上帝是个 CSV 文件?"他笑着认了:"差不多就是。"

这段话里有个技术上的区分:神经网络是概率性的,不是确定性的。传统编程是一行行逻辑,你能读懂每一行,能预测输出。神经网络是一大堆概率分布。你不能读它,你只能跑它、测它。

所以测试这件事,只能在训练进行中做、在发布之前做。这正好是英国 AI 安全研究所想做的事,马斯克表示同意。

总有一天,没有哪个岗位是必需的

苏纳克说,他在外面跟普通人聊天,被问得最多的不是超级智能,是工作。我的工作还在吗?我孩子以后还有工作吗?

他作为政策制定者的回答是:AI 已经在创造岗位,目前更多是副驾驶(co-pilot),人有能动性,只是干得更好。他引了一项 MIT 的研究,说当下 60% 的岗位在 40 年前根本不存在,所以预测本身很难。

马斯克的答案要硬得多。

"我认为我们面对的是历史上最具颠覆性的力量。我们将第一次拥有比最聪明的人类还聪明的东西。"(马斯克)

他接着说了一句让现场安静的话:会有那么一个时刻,没有哪个工作岗位是必需的。你可以有工作,但那是为了个人满足感。AI 什么都能做。

他不确定这让人舒服还是不舒服,然后把精灵的比喻又拉了回来:一个没有三愿限制的精灵,你想要多少愿望就有多少。所以它同时是好的和坏的。

真正的挑战被他放在了后面:如果有个精灵能实现你所有愿望,人怎么找到生活的意义?

苏纳克在这里接了话。他说自己相信工作给人意义,如果拿掉一大块,那股驱动力从哪来?他还讲了个自嘲:他做项目做到凌晨三点,然后会突然想,我在干嘛?我完全可以等 AI 来做。我这是在自我惩罚吗?

马斯克顺着开了个玩笑:那你就打电话给 Demis(DeepMind 的 Demis Hassabis),让他们快点,你就能去度假了。

玩笑过后,他给了一个不那么悲观的视角。

很多工作是不舒服的、危险的、枯燥的。计算机干这些毫无怨言,乐意干一整天。

做饭挺有意思,洗碗就没那么有意思。但计算机很乐意洗碗。(马斯克)

至于人的成就感从哪来,他拿体育做了类比。机器跑得比任何人都快,但我们还是看奥运会,还是看人和人比赛,比谁是最好的"人类"。人从这件事里获得的满足感是真实的。

他还提了一套小说:伊恩·M·班克斯(Iain M. Banks)的"文化"系列。他说不用加"可能"这种限定词,那就是迄今为止对 AI 未来最好的想象,没有能接近的。那是一个相当乌托邦、或者说"前瞻托邦"(protopian)的世界。他推荐所有人去读。

最好的导师,和最耐心的朋友

苏纳克问,你最兴奋的机会是什么。

第一个答案是教育,而且他很具体。他提到了可汗学院的 Sal Khan 今年早些时候的那场演示。一对一导师和班级授课之间的差距是巨大的,这一点在教育研究里早有共识。如果每个孩子都有一个为自己定制、随时间一起成长的私人导师,那是件了不得的事。

马斯克说 AI 导师会非常棒,某种程度上已经在了。他补了一个前提:AI 得先停止幻觉。它现在会用完美的语法、漂亮的要点列表、还带引用,自信地给你一个错误答案,而那些引用是编的。这个问题解决得会很快。

第二个答案让在场的人有点意外:陪伴。

他自己先承认这听起来怪,计算机怎么能真的当你的朋友。但如果这个 AI 有记忆,记得你们所有的对话,而且读过所有东西,你甚至可以授权它读你做过的一切。那它会比任何人都了解你,也许比你自己更了解你。你每天跟它说话,对话层层累积,你会真的有一个很好的朋友。

他加了个条件,说得挺认真:"只要这个朋友不会被关掉。"

然后他讲了自己的家事。他有一个儿子有学习障碍,交朋友有困难。他说,AI 朋友对他会是很大的帮助。

苏纳克接住了这个话题,说心理治疗已经在大量转向数字和电话渠道,效果显著,AI 提供这种社会价值是完全可能的。

社区笔记:不删帖,只补语境

话题转到 X。苏纳克说,你做了很多改动,其中一个很有意思:把人工审核换成了社区笔记(Community Notes),别人没这么干过。

马斯克的解释从权力说起。如果你手下有一批人做审查,这批人一定有偏见,而谁指派审查者,谁实际上就控制了信息。

社区笔记的思路是另外一条:用共识驱动的方式逼近真相。他不认为能达到纯粹的真相,但可以追求"更少的失实"。

设计上分三条。

第一条,社区笔记不删除任何东西。它只是补充语境。语境可以是"这件事不实,理由如下"。

第二条,全部开源。软件的每一行你都能看,写进某条笔记的所有数据你也能看,你甚至可以独立复现那条笔记。如果你发现数据被操纵,你可以指出来,说这里有人在刷系统,还能提改进建议。最大透明度加上群体智慧。

第三条,也是最核心的一条:一条笔记要显示出来,必须是历史上意见相左的人达成了共识。

技术实现上有个细节挺有意思。系统会给每个参与社区笔记的用户在参数空间里定位,每人对应几百个向量,因为事情比左右复杂得多。然后做反向相关性分析:好,这批人平时互相不同意,但他们在这一条笔记上一致了。这条笔记因此获得了可信度。

马斯克说效果很好。他很少看到一条错误的笔记能挂超过几个小时。他让抱怨社区笔记在传播虚假信息的人举一个例子,对方举不出来。

整个平台的取向,他总结成一句话:尽可能准确,尽可能真实,即使有些人不喜欢真相。他说人不总是喜欢真相。但他相信真相是有回报的。只要不做自我欺骗,这就是聪明的做法。

英国缺的不是大学

第一个现场提问来自 Entrepreneur First 的 Alice Bentinck。她问两边:英国有全世界最好的大学,有人才,要成为独角兽的土壤还差什么?对马斯克那一问更具体:在英国创业对最顶尖的技术人才来说仍然不是一个显然的选择,文化上要补什么?

马斯克先给了个正面评价,而且是个很多人不知道的事实:伦敦和旧金山湾区就是 AI 的两个中心。旧金山大概领先,但伦敦非常强,大伦敦加周边各郡。

然后他讲文化。文化上应该庆祝创办新公司,应该偏向支持小公司,因为需要被照顾的是小公司。大树不需要照顾。

你可以把它想成一棵树,小树苗需要培育,长成大树之后就不太需要了。(马斯克)

硬件也得有:愿意租给新公司的房东,愿意服务新公司的律所和会计师事务所。都是些不起眼的东西,缺了就转不动。

苏纳克接过来讲政府那一摊。资本上,从种子轮的 EIS 税收减免(Enterprise Investment Scheme)一路到后期轮次,还有养老金改革,让有钱的人把钱投进成长型股权。人才上,教育改革抓数学,加上签证制度吸引全世界最好的创业者。他给了一个数字:英国增长最快的公司里,超过一半有非英国籍创始人。

然后他承认最难的是文化那一块。怎么让人不怕放弃稳定薪水去创业,怎么让人对失败感到自在。他把这个球踢回给马斯克,说你经常讲这个。

马斯克接得很干脆:第一次创业失败,不应该成为职业生涯的灾难性终结。应该是"你试过了,现在再来一次"。

他补了一个很少有人提的结构性问题:创业是高危高回报。绝大多数创业公司的真实形态,是大量的工作之后跟着失败。你只听到成功的那几个。所以高回报那一头必须真实存在,否则整件事在理性上说不通。

苏纳克把这个"软性游说"接住了,报了几个数:资本利得税率 20%,比欧洲大陆低得多,也比加州低。股票期权的税收待遇,他当财政大臣时英国排在第四第五,改完之后升到了第二。

他的落点是:人承担风险、付出努力,就应该能享受到回报。

明年你最先感觉到的三件事

一位在诺丁汉做连锁药店的提问者(Seb,Boots 的 CEO)问,这些宏大的东西,怎么落到一个普通人的日常里。

苏纳克先讲了个很具体的例子。Gov.UK 这个网站,把政府服务集中到一处,几百万人每天在用。他们即将在上面部署 AI。场景是这样的:你现在人在外面,护照丢了,航班五小时后起飞。今天你得走一堆步骤才能搞清楚怎么办。部署 AI 之后,你直接说这句话,它一步一步带你走完。

他讲得很实在,这套用法谈不上治愈癌症那种级别的突破,作用就是让几百万人每天的日子少一点摩擦。

马斯克给了三个层次。

第一,一个非常聪明的朋友。什么都能问,怎么做东西,怎么解决某个问题,它都会告诉你。企业会先用上,所以普通人最先感觉到的可能是客服变好了。

第二,教育。任何科目都有一个顶级家教。他再次提醒,得先解决幻觉问题,不然你得到的是一个语法完美、自信满满的错误答案。

第三,是前面说的陪伴。

苏纳克在中间插了句玩笑,说对疫情期间在家辅导过孩子的父母来说,这会是巨大的解脱。

能追你上楼的东西

Brent Hoberman 提了机器人。想要富足时代,得有很多机器人。会不会出现某个国家在机器人上大幅领先,从而取得战略优势?

马斯克先扩大了定义:任何能被计算机驱动的东西,实际上就是机器人。特斯拉就是轮子上的机器人。任何联网设备,本质上都是 AI 的末端执行器。所以波士顿动力(Boston Dynamics,现在主要归现代汽车)、戴森、德国的工业机器人,都在这条线上。

他专门点了英国:ARM 是世界上最好的芯片设计公司之一,几乎所有人都在用 ARM 的技术。所以英国在这个方向上不会落后。

然后他讲了一个此前很少公开讲的担忧,讲得非常具体。

安全问题跟形态关系很大。汽车没法追进这栋楼,你跑上几级台阶就能躲开一辆特斯拉。人形机器人不一样,它可以跟着你去任何地方。

所以他主张一个硬件层面的设计:一个硬连线的本地紧急停止开关,不能通过网络更新。任何能通过网络软件更新的东西,都能被覆盖。但如果有一个本地开关,比如一个关键词,触发之后机器人进入安全状态,而且你不需要靠近它就能触发,那就完全不一样。他还补了一句:全世界跑着几百万台这种机器的时候,这个开关的分量就更明显了。

苏纳克回应说,当天峰会的小组讨论里,大家提到了同一个点,而且是从电影切入的。他们数了一堆片子,说这些电影的情节本质上是同一个:最后总有人找到办法把它关掉。

两个人不约而同落到了同一个结论上:物理层面的关闭能力。

马斯克还开了个脑洞:也许可以把"你最喜欢的詹姆斯·卡梅隆电影是哪部"设成 AI 测试题。

验证码已经防不住任何人了

一位在利兹做 AI 和机器学习规模化的创始人(英国第三大 AI 中心,他自称有点偏心)提了钓鱼攻击的问题。ChatGPT 发布三个月后,他们观察到钓鱼攻击明显上升,语言模式复杂得多。怎么保护企业和消费者,怎么让人信任这项技术?

马斯克的回答跟问题方向相反:"我们其实不该那么信任它。"

他讲了一个正在失效的机制:人机验证。就是那个"你是真人吗,点出图中所有红绿灯"。开源 AI 已经能通过人类验证码,而且比人更快更准。那么问题就变成了,当机器比人更擅长证明自己是人的时候,什么测试才是有意义的。

他说自己没有好答案。这是 X 平台正在试图解决的问题。

他们想到的办法是收钱,但收得很小:一年一美元或者一英镑。金额小到对真人毫无感觉,但它让"造一百万个机器人"变得明显昂贵。难点在这儿:一百万个机器人需要一百万个支付方式,而盗用的信用卡是用得完的。折算下来大概是一天 0.3 美分。

他的判断很悲观:这个问题今年还在增长,明年可能就变成无法解决的问题。任何不做这件事的社交平台,最终都会被机器人淹没。

他还点了另一层:信息操纵。用机器人点赞和转发,让一件根本没人关心的事看起来极其热门。这比伪造账号更隐蔽。

苏纳克这边给了政策视角:得让人看到风险在被处理,信任才建立得起来。这就是安全研究所、研究能力、快速迭代的意义。峰会的这两天,做的就是这件事。

他提到英国前一天发布的一份研究报告,内容正是用 AI 批量制造假账号、渗透特定社群、定向投放信息。他说成本现在几乎为零,正在走向"一分钱一百个"的荒谬程度。而且这件事在社区、城镇这个层级特别有效,你不需要很多账号,就能让某个本地议题看起来到处都是人在讨论。

马斯克补充了技术细节,讲得挺冷:你甚至不用盗用真人的照片,因为照片可以溯源。你可以直接生成一张不存在的人脸,配一份不存在但看着很真的简历,然后批量做。

他最后半开玩笑地说了唯一还能露馅的地方:机器人的语法太好了。没有拼写错误。

加密签名,和教皇的羽绒服

最后一个提问来自 Adobe 的人:视觉媒体上有没有简单的办法?现在让人说没说过的话、做没做过的事,几乎免费。能不能做加密签名的媒体,标明哪些是 AI 生成、哪些来自真实相机?Twitter 当年参与过这个项目(内容来源与真实性联盟 C2PA),他希望 X 回来。

马斯克的回答很直接:"好主意,我们应该做。"

苏纳克接着讲了自己的经历。他遇到过被篡改的图片到处传播,等他反应过来、等大家意识到是假的时候,伤害已经造成了。

他把这件事放到了时间表上。明年美国、印度、印尼、英国、欧盟都有大选,全球相当大比例的人口要投票。这可能是第一场深度伪造真正构成问题的选举。怎么处理,关系到民主制度的完整性。

整场对话最轻松的一段出现在这里。马斯克提到了教皇穿白色羽绒服的那张图。他说那张图很棒,但他到现在还遇到有人相信那是真的。他的反驳是:七月在罗马穿羽绒服,人会热死的。然后他又补了一句,说其实那件挺好看的。他说 AI 时尚会成真。

他给出的那个数字

收尾时,马斯克把整场对话压缩成了几句话。

我们生活在最有趣的时代。这件事大概 80% 会是好的,20% 是坏的。如果我们清楚坏的那部分并且足够小心,那么总体上,它会变成我们想要的未来,或者说更可取的那个未来。

它会成为某种均衡器。因为每个人都能用上那个精灵。每个人都能获得商品、服务和教育。所以他倾向于给出一个乐观的结论:它大概会带来更多的人类幸福。

苏纳克说他离开时比来时更有信心。政府的职责是让它安全地发生。

这场对话里最有价值的部分,是一串可以着手的地方。那些关于超级智能的宏大判断相比之下没那么有用:裁判要有,而且要快;中国必须在桌上;发布之前就得测;机器人身上要有物理开关;账号要收一点点钱;媒体要有加密签名。每一条都不完美,但每一条都比"再观察观察"要具体。

  • 读一遍班克斯的"文化"系列。这是马斯克在这场对话里给出的唯一一个非技术建议,他用了"这就是迄今为止最好的想象,没有能接近的"这种强度的判断。理解 AI 的未来图景,比争论某个模型的具体参数更有长期价值。
  • 把"能力每年提升五到十倍"当成规划的时间常数。如果你手上有一份三年技术路线图,用这个斜率重算一遍。落后一年意味着差五倍,这个数字对个人技能、公司架构、监管框架同样成立。
  • 对"看着很真"的东西默认怀疑,尤其是语法完美、要点齐全、还带有引用链接的内容。马斯克说的"机器人语法太好"是个可以用起来的判据,反向也成立:一份没有拼写错误、结构过度工整、引用查不到的文档,值得多查一遍来源。
  • 如果你是做内容或媒体的,认真看一遍 C2PA 这类内容来源加密标准。Adobe 那位提问者问的是一件已经有人在做、但参与方还不够多的事。明年是选举大年,签名和溯源会从"可有可无"变成硬需求。
  • 如果你是做产品的,把"AI 身份的边际成本"当成一个设计变量。X 的思路值得抄:不需要根除机器人,只需要让批量制造变得不经济。一年一美元、一天 0.3 美分,这个量级的摩擦对真人无感,对百万级操作致命。
  • 关注开源和闭源之间那个"6 到 12 个月"的真实差距。在这个斜率下它等于五倍能力差。选型的时候,别把"半年后开源就会有"当成等价替代方案。
语音识别自动转录(Whisper),含全部发言人,可能有识别错误。

0:01Okay, all right. Well good evening everybody welcome Elon. Thanks for being here. Thank you for having me

0:07We feel we feel very proud. We're excited to have you right so I'm gonna start with some questions and then we're gonna open it up

0:12Let me get straight into it. So

0:15Bill Gates said there is no one in our time who has done more to push the bounds of science innovation than you

0:21Well, it's kind of insane. Yeah. Well, that's it. That's a nice thing to have anyone say about you nice coming from Bill Gates

0:26but

0:27Oddly enough, when it comes to AI, actually, for around a decade,

0:31you've almost been in the opposite and saying, hang on,

0:34you need to think about what we're doing and what we're pushing here

0:37and what do we do to make this safe and actually we shouldn't be pushing as

0:40faster as hard as we are.

0:42You've been doing it for a decade.

0:44What was it that caused you to think about it that way and why do we need to be worried?

0:49I've been somewhat of a Cassandra for quite a while.

0:52Where people would tell people, we should really be concerned about AI,

0:56like what are you talking about?

0:57Like, if never really had any experience with AI.

1:00Since I was immersed in technology,

1:03I have been immersed in technology for a long time,

1:05I could see it coming.

1:10But I think this year was,

1:11there have been a number of breakthroughs.

1:13I mean, you know, the point of which someone can see

1:16a dynamically created video of themselves.

1:20Like, it's already created a video of you saying anything

1:22in real time, or me.

1:25And so the sort of the deep peak videos, which are really incredibly good, in fact, sometimes

1:30we're convincing the real ones.

1:32And deep reel.

1:37And then obviously things like Chai GBT were quite remarkable.

1:43Now I saw GPT-1, GPT-2, GPT-3, GPT-4, the whole sort of lead up to that.

1:49So it was easy for me to kind of see where it's going.

1:53If you just sort of extrapolate the points on a curve,

1:56and I see that trend will continue,

1:57then we will have profound artificial intelligence,

2:01and obviously at a level that far exceeds human intelligence.

2:04So, but I'm glad to see at this point that people

2:10are taking safety seriously, and I'd like to say thank you

2:14for holding this AI safety conference.

2:16I think actually it will go out on in history

2:17as being very important.

2:19I think it's really quite profound.

2:23And I do think overall that the potential is there for

2:27artificial intelligence, AI, to have most likely a positive effect.

2:35And to create a future of abundance where there is no scarcity of goods and services.

2:41But it is somewhat of the magic genie problem,

2:45if you have a magic genie that can grant all the wishes.

2:49Usually those stories don't end well.

2:52Be careful what you wish for, including wishes.

2:56Yeah.

2:57So you talked a little bit about the summit,

3:01and thank you for being engaged in it, which has been great,

3:04and people enjoyed having you there.

3:06Potter's been in this dialogue.

3:08Now, one of the things that we achieved today

3:10in the meetings between the companies and the leaders

3:13was an agreement that externally, ideally governments,

3:18should be doing safety testing of models

3:21before they're released.

3:22I think this is something that you've spoken about a little bit.

3:24It was something we worked really hard on,

3:26because my job in government is to say, hang on,

3:29there is a potential risk here.

3:31Not a definite risk, but a potential risk of something

3:34that could be bad.

3:36My job is to protect the country.

3:38And we can only do that if we develop the capability

3:41we need in our safety institute, and then go in

3:43and make sure we can test the models before they are released.

3:46Delighted that that happened today,

3:47but what's your view on what we should be doing?

3:51You've talked about the potential risk, right?

3:52Again, we don't know.

3:53But what are the types of things governments like us

3:56should be doing to manage and mitigate against those risks?

3:59Well, I generally think that it is good for government play

4:03a role when the public safety is at risk.

4:06So really, for the vast majority of software,

4:10the public safety is not at risk.

4:11I mean, if the app crashes on your phone, you're a laptop,

4:15it's not a massive catastrophe.

4:18But when you're talking about digital superintelligence,

4:21I think, which does pose a risk to the public,

4:25then there is a role for government

4:26to play to safeguard the interests of the public.

4:29And this is, of course, true in many fields, aviation, cars.

4:35And I deal with regulators throughout the world

4:38because of starting communications, rockets being aerospace, and cars being transport.

4:46So I'm very familiar with dealing with regulators.

4:49And I actually agree with the vast majority of regulations.

4:50There's a few that I disagree with from time to time, but 0.1% probably.

4:55Less than 1% of regulations I disagree with.

4:59And there is some concern from people in Silicon Valley who have never dealt with regulators

5:04before and they think that this is going to just crush innovation and slow them down and

5:09be annoying.

5:11And it will be annoying, it's true.

5:15They're not wrong about that.

5:18But I think there's, we've learned over the years that having a referee is a good thing.

5:26And if you look at any sports game, there's always a referee and nobody's suggesting I

5:30think to have a sports game without one.

5:34And I think that's the right way to think about this is for

5:37government to be a referee to make sure the sportsman like conduct and

5:43that the public safety is addressed, that we care about public safety.

5:51Because I think there might be at times too much optimism about technology.

5:54And I say that as a technologist, I mean, so I ought to know.

5:57And on balance, I think the AI will be a forceful good, most likely, but the probability of

6:09it going bad is not zero percent.

6:11So we just need to mitigate the downside potential.

6:14And then how you talk about referee, and that's what we're talking about.

6:18Yeah.

6:19Well, there we go.

6:20We talk about this, and Demis and I discussed this a long time ago.

6:23They're literally facing right end of it.

6:27Actually, you know, Demis to his credit and the credit of people in the industry did say that to him.

6:30I think you would say it's not right that Demis and his colleagues are marking their own homework, right?

6:35There needs to be someone independent and that's why we've developed the Safety Institute here.

6:39I mean, do you think governments can develop the expertise?

6:42One of the things we need to do is they hang on, you know, Demis and all the others have got a lot of very smart people doing this.

6:49Governments need to quickly tool up capability-wise personnel-wise, which is what we're doing.

6:54I mean, do you think it is possible for governments to do that fast enough, given how quickly

6:58the technology is developing, or what do we need to do to make sure we do it quick enough?

7:03No, I think it's a great point you're making.

7:06The pace of AI is faster than any technology I've seen in history by far, and it seems to

7:14be growing in capability by at least five full, perhaps ten full per year.

7:19It will certainly grow by an order of magnitude next year.

7:23So, and government isn't used to moving at that speed.

7:30But I think even if there are not firm regulations,

7:35even if there isn't an enforcement capability,

7:38so we're having insight

7:39and being able to highlight concerns to the public

7:41will be very powerful.

7:44So, even if that's all that's accomplished,

7:47I think that will be very, very good.

7:48Okay, well hopefully we can do better than that.

7:50Hopefully, yeah.

7:51No, but that's how fast you know. We were talking before it was striking you know

7:55you're someone who spent their life in technology living Moore's law and

8:00What was interesting over the last couple of days talking to everyone who's doing the development of this?

8:05And I think you can cover this is it's just the pace of advancement here is unlike anything

8:11Yeah, all of you have seen in your careers and technology is that fair because you've got these kind of compounding

8:16effects from the hardware and and the data and the personnel

8:20Yeah, I mean, the two, currently the two leading centers for AI development are the San Francisco

8:29Bay Area and the sort of London area.

8:31And there are many other places where it's being done, but those are the two leading areas.

8:34So I think if the United States and the UK and China are sort of aligned on safety, that's

8:45will be a good thing.

8:47So that's where the leadership is generally.

8:50And actually, you mentioned China there.

8:53So I took a decision to invite China

8:55to submit over the last few days.

8:57And it was not an easy decision.

8:59A lot of people criticized me for it.

9:01My view is if you're going to try and have serious conversation,

9:04you need to.

9:04But what were your thoughts?

9:05You did business all around the world.

9:06You just talked about it there.

9:08Should we be engaging with them?

9:10Can we trust them?

9:11Is that the right thing to have done?

9:13If China is not on board with AI safety,

9:17it's somewhat of a mood situation.

9:20The single biggest objection that I get to in AI regulation

9:24or safety controls are, well, China's not going to do it

9:28and therefore they will just jump into the lead

9:30and exceed us all.

9:32But actually, China is willing to debate in AI safety.

9:38And thank you for inviting them.

9:40And they, you know, I think we should thank China for attending.

9:46When I was in China earlier this year, my main subject of discussion with the leadership

9:53in China was AI safety and saying that this is really something that they should care

9:57about and they took it seriously and URT, which is great.

10:04And having them here, I think, was essential really.

10:07If they're not participants, it's pointless.

10:10Yes, yes.

10:11And I think we were pleased.

10:12They were engaged yesterday in the discussions,

10:14and actually ended up signing the same communique

10:16that everyone else did, which is a good start.

10:19As we need everyone to approach this in a similar way,

10:22if we're going to have a realistic chance of resolving it.

10:26You talked about innovation earlier and regulation

10:29being annoying.

10:30There was a good debate today we had about open source.

10:33And I think you've kind of been a proponent

10:35of algorithmic transparency and making some of the X algorithms

10:39public.

10:40And actually, we were talking about every hinted on the way in.

10:44He's particularly been very concerned

10:46about open source models being used by bad actors.

10:50You've got a group of people who say they are critical to innovation

10:53happening in that distributed way.

10:56It's probably no perfect answer, and there is a tricky balance.

10:59What are your thoughts on how we should approach this open source question?

11:02or where should we be targeting whatever regulatory

11:06or monitoring that we're going to do?

11:09Well, the open source algorithms and data

11:14tend to lag the closed source by six to 12 months.

11:19But given the rate of improvement,

11:21that this actually therefore quite a big difference

11:24between the closed source and the open.

11:27If things are improving by a factor of the take-by

11:30or more than being a year behind is your five times worst.

11:34So it's a pretty big difference.

11:36And that might be actually an okay situation.

11:41But it certainly will get to the point

11:42where you've got open source AI that can do,

11:47that will start to approach human level intelligence

11:49will perhaps succeed it.

11:52I don't know quite what to do about it.

11:53I think it's somewhat inevitable.

11:55There'll be some amount of open source tonight.

11:57I guess I would have a slight bias towards open source,

12:01because at least you can see what's going on.

12:03It was closed source, you don't know what's going on.

12:05Now, it should be said with AI that even if it's an open

12:08source, do you actually know what's going on?

12:10Because if you've got a gigantic data file and sort of

12:17billions of data points or weights and parameters, you

12:22can't just read it and see what it's going to do.

12:24It's a gigantic file of inscrutable numbers.

12:28You can test it when you run it.

12:30You can test it.

12:31You can run a bunch of tests to see what it's going to do.

12:33But it's probabilistic as opposed to deterministic.

12:39It's not like traditional programming

12:41where you've got to sort of discrete logic.

12:45And the outcome is very predictable.

12:46And you can read each line and see what each line's going to do.

12:51a neural net is just a whole bunch of probabilities.

12:56I mean, it sort of ends up being a giant

12:58comma separated value file.

13:00It's like our digital guide is a CSV file, really?

13:02Hahaha.

13:03Hahaha.

13:04Okay.

13:07But that is kind of what it is.

13:09Yeah.

13:10Now, at that point you've just made,

13:12it's one that we have been talking about a lot

13:14because, again, conversation with the people

13:16that are developing their technology

13:17make the point that you've just made.

13:19It is not like normal software where there's predictability

13:22about inputs improving,

13:24leading to this particular output improving.

13:27And as the models iterate and improve,

13:29we don't quite know what's gonna come out the other end

13:32that Demis would agree with that,

13:33which is why I think there is this bias

13:35that we need to get in there

13:37while the training runs are being done,

13:38before the models are released to understand

13:40what is this new iteration brought about

13:43in terms of capability,

13:44which it sounds like you would agree with.

13:47I was going to shift gears a little bit.

13:49You've talked a lot about human consciousness, human

13:51agency, which actually might strike people as strange,

13:55given that you are known for being such a brilliant

13:58innovator in technologists.

13:59But it's quite heartfelt when I hear you talk about it and

14:02the importance of maintaining that agency in technology and

14:06preserving human consciousness.

14:08Now, the thing I was going to ask is, when I do interviews

14:11or talk to people out and about in this job, that AI, the

14:13thing that comes up most, actually, is probably not so

14:16much the stuff we've been talking about, but jobs.

14:18It's what does AI mean for my job?

14:21Is it going to mean that I don't have a job,

14:23or my kids are not going to have a job?

14:25Now, my answer as a policy maker, as a leader,

14:30is actually AI is already creating jobs.

14:32And you can see that in the companies that are starting.

14:36Also, the way it's being used is a little bit more

14:38as a co-pilot, necessarily versus replacing the person.

14:42There's still human agency, but it's helping you

14:44your job better, which is a good thing.

14:47And as we've seen with technological revolutions in the past, clearly there's change in the

14:51labor market in the amount of jobs that I was quoting an MIT study today that they did

14:56a couple of years ago, something like 60% of the jobs at that moment didn't exist 40 years

15:00ago, so hard to predict.

15:02And my job is to create an incredible education system, whether it's at school, whether it's

15:06retraining people at any point in their career, because ultimately if we've got a skilled population

15:10and they ought to keep up with the pace of change

15:13and have a good life.

15:14But it's still a concern.

15:16And what would your observation be on AI

15:21and the impact on labor markets and people's jobs

15:23and how they should feel about that as they think about this?

15:28Well, I think we are seeing the most disruptive force

15:31in history here.

15:34We have for the first time, we will

15:36have the first time something that is smarter than the smartest

15:39human. And that, I mean, it's hard to say exactly what that moment is, but there will come a

15:47point where no job is needed. You can have a job if you want to have a job for sort of

15:52personal satisfaction, but the AI will be able to do everything. So, I don't know if

16:00that makes people comfortable, uncomfortable. Well, it's, it's, you know, that's why, that's

16:06That's why I say if you wish for a magic genie, that gives you any wishes you want.

16:12And there's no limit.

16:13You don't have those three-wish limits, if not since you just have many wishes you want.

16:18So it's both good and bad.

16:22One of the challenges in the future will be how do we find meaning in life if you have

16:28a magic genie that can do everything you want?

16:30I do think it's hard when this new technology

16:34tends to usually follow an S curve.

16:38In this case, we're going to be on the exponential portion

16:40of the S curve for a long time.

16:44And you're really likely to be able to ask for anything.

16:48And we want to have universal basic income.

16:50We'll have universal high income.

16:52So in some sense, it'll be somewhat of a leveler

16:55or equalizer.

16:57Because really, I think everyone will have access

16:59this magic genie.

17:02And you're able to ask any question.

17:03It'll be certainly good for education.

17:05It'll be the best tutor.

17:06And then the most patient tutor.

17:09So they're all there.

17:14And there will be no shortage of goods and services.

17:17There will be an age of abundance.

17:19I think if I'd recommend people read in banks,

17:25the banks culture books are probably the best envisioning.

17:28In fact, not probably.

17:29They're definitely by far the best envisioning

17:30of an AI future.

17:32There's nothing you're in close.

17:34So I'd really recommend banks.

17:36I'm a very big fan.

17:39All these books are good.

17:41There's not every one, all of them.

17:45So that'll give you a sense of what is a fairly utopian

17:53or pro-topian future with AI.

17:59which is good from a, as you said,

18:01it's a universal high income, which is a nice phrase,

18:03and it's good from a materialistic sense,

18:05and your abundance, actually,

18:07that it then leads to the question that you pose, right?

18:10I'm somebody who believes work gives you meaning,

18:12like I think a lot about that,

18:14as I think work is a good thing,

18:16it gives people purpose in their lives,

18:17and if you then remove a large chunk of that,

18:21what does that mean, and where do you get that?

18:23Where do you get that drive, that motivation, that purpose?

18:26I mean, you were talking about it,

18:27you work a lot of hours.

18:28I was mentioning when we were talking earlier, I have to somewhat engage in deliberate suspension

18:34of disbelief because I'm putting so much blood, sweat and tears into a work project and burning

18:39the 3 AM oil.

18:41Then I'm like, wait, why am I doing this?

18:45I can just wait for the AI to do it.

18:48I'm just lashing myself for no reason.

18:51I'm just being glad for punishment or something.

18:55So we call them, call Demes and tell them to hurry up and then you can have a holiday, right?

19:00It's a plug.

19:02Yeah, no, it's a, look, it's a tricky thing because I think, you know, part of our job

19:06is to make sure that we can navigate to that very, I think, largely positive place that

19:11you're describing.

19:12It is like, and how much people throw it between now and then because these things bring a

19:16lot about a change in the labor market as we've seen.

19:20Yeah.

19:21I think it's probably is generally a good thing because, you know, there are a lot of

19:23jobs that are uncomfortable or dangerous or which sort of tedious. And the computer will

19:30have no problem doing that. They're happy to do that all day long. So, you know, it's

19:34fun to cook food, but it's not that fun to wash the dishes. And like, but the computer's

19:38perfectly happy to wash the dishes. I guess there is, you know, we still have sports,

19:46like where humans compete in like the Olympics. And obviously, a machine can go faster than

19:52any human, but we still have humans race against each other.

19:57And have these sports competitions against each other,

20:02where even though the machines are better,

20:03we're still, I guess, competing to see

20:05who can be the best human at something.

20:08And people do find fulfillment in that.

20:10So I guess that's perhaps a good example

20:12of how even when machines are faster than us stronger than us.

20:14We still find a way.

20:15We still enjoy competing against other humans,

20:18so at least the human is the best human.

20:20That's a good analogy.

20:22And we've been talking a lot about managing the risks.

20:25Before we move on and finish on AI,

20:27it's just talking a little bit about the opportunities.

20:31You're engaged in lots of different companies,

20:33neuro-looking and obvious one.

20:36Which is doing some exciting stuff.

20:38You touched on the thing that I'm probably most excited

20:40about, which is an education.

20:43And I think many people will have seen

20:44Sal Khan's video from earlier this year

20:47has talked about, as you talked about,

20:49it's like a personal tutor at Edge.

20:50an amazing personal tutor.

20:52An amazing personal tutor.

20:53And we know the difference in learning,

20:55having that personal tutor is incredible

20:57compared to class from learning.

20:58So if you can have every child have a personal tutor,

21:01specifically for them,

21:02that then just evolves with them over time.

21:04That could be extraordinary.

21:05And so that, for me, I look at it, I think,

21:07gosh, that is within reach at this point.

21:10And that's one of the benefits I'm most excited about.

21:13When you look at the landscape of things

21:15that you see as possible,

21:16what is it that you are particularly excited about?

21:19I think certainly AI tutors are going to be amazing.

21:25Perhaps already are.

21:26I think there's also perhaps companionship, which may seem odd, because how can the computer

21:31really be your friend.

21:32But if you have an AI that has memory and remembers all of your interactions and has

21:38read everything, you can say like give it permission to read everything you've ever

21:42done.

21:43So it really will know you better than anyone, perhaps even yourself.

21:47where you can talk to it every day and those conversations

21:49hold upon each other, you will actually have a great friend.

21:54As long as that friend can stay, your friend

21:56did not get turned off or something.

21:58Don't turn off my friends.

22:00But I think that will actually be a real thing.

22:06And one of my sons has some learning disabilities

22:12and has trouble making friends actually.

22:14And I was like, well, you know, he,

22:16the AI friend would actually be grateful.

22:18Oh, okay.

22:19Yeah, that was a surprising answer,

22:21but that's actually worth reflecting on.

22:24So it's really interesting.

22:25I mean, we're already seeing it actually as we deliver,

22:28you know, psychotherapy anyway,

22:30now doing far more by digitally and by telephone to people.

22:34And it's making a huge difference,

22:35and you can see a world in which actually,

22:37you know, AI can provide that social benefit to people.

22:40And just a quick question on X, and then we should open it up to everybody.

22:46You made a change when you made many changes.

22:49But one of the changes-

22:50Yeah, quite a few.

22:51You love that letter.

22:52Yeah.

22:53I've got a real thing about it.

22:56You really do.

22:57You really do.

22:58One of the changes, which kind of, it goes into the space that we have to operate in,

23:03and this balance between free speech and moderation is, you know, we grapple with as politicians.

23:09you were grappling with your inversion of that.

23:11And you moved away from a manual human way of doing it,

23:17the moderation to the community notes.

23:20And I think it was an interesting change.

23:23It's not what everyone else has done.

23:25What was the reasoning behind that?

23:27Why do you think that is a better way to do that?

23:31Yeah, part of the problem is if you're in power people as sensors,

23:35then there's going to be some amount of bias.

23:39they have, and then whoever points the senses is effectively in control of information.

23:44So then the idea behind theory notes is how do we have a consensus driven, I mean, so

23:52it's not really censoring it, but consensus driven approach to truth.

23:55How do we make things the least amount untrue?

24:00You can say like, you can't perhaps get to pure truth, but you can aspire to be more

24:06truthful.

24:07So the thing about community notes is it doesn't actually

24:11delete anything, it simply adds context.

24:13Now that context could be, this thing is untrue

24:15for the following reasons.

24:16But importantly with community notes, everything is open source,

24:23actually, so you can see the software, every line of the software,

24:28you can see all of the data that went into a community note

24:31and you can independently create that community note.

24:34So if you've got, if you see manipulation of the data,

24:36You can actually highlight that and say, well, this,

24:39there appears to be some gaming of the system.

24:43And you can suggest improvements.

24:45So it's maximum transparency, which is combined with the

24:50kind of wisdom of the crowds and transparency to get to a

24:53better answer.

24:54And really, one of the key elements of community notes is

24:57that in order for a note to be shown, people who have

24:59historically disagreed must agree.

25:03And there is a bit of AI usage here.

25:05So this will populate a parameter space around each contributed

25:11to community notes.

25:12And then a parameter space.

25:15So everyone's got basically these vectors associated with them.

25:19Which is not as simple as Rijolift.

25:21It's saying it's several hundred vectors

25:25because things are more complicated than something

25:27right or left.

25:28And then we'll do sort of inverse correlation.

25:34say like, okay, these people generally disagree,

25:37but they agree about this note.

25:39And so then that gives the note credibility.

25:43Yeah, that's the core of it.

25:45And it's working quite well.

25:47I get to see a note actually be present

25:51for more than a few hours that is incorrect.

25:53So the batting average is extremely good.

25:55And when I ask people, so they're worried

25:57about community notes sort of being disinformation

26:00like send me one, and then they can't.

26:02So I think it's quite good.

26:05I mean, the general aspiration is what the X platform is to inform

26:10and entertain the public and to be as accurate as possible

26:14and as truthful as possible, even if someone doesn't like the truth.

26:18You know, people that always like the truth.

26:20No.

26:21It's not always.

26:24But that's the aspiration.

26:26And I think if we stay true to the truth, then I think we'll find

26:30that people use the system to learn what is going on and to learn. I think actually truth

26:38pays. So I think it will be, assuming you don't want to engage in self-tolution, then

26:45I think it's the smart move.

26:50Excellent. Very helpful. Right. Let's open it up to all our guests here. We've got some

26:55microphones, they'll come up, they'll come and find you. We've got yes, go for it.

27:00Thank you. Good evening, Alice Bentink from Entrepreneur First. Thank you for

27:06a fascinating conversation. I suppose a question for each of you.

27:10Prime Minister, the UK has some of the best universities in the world. We have the

27:14talent. What will it take for the UK to be a real breeding ground for unicorn

27:20companies? And Elon, being a founder in the UK is still a non-obvious career

27:26choice for the most exceptional technical talent.

27:28What are the cultural elements that we need to put into place

27:31to change this?

27:32Thank you both.

27:33Well, you want to go first?

27:34Go for it.

27:35Sure.

27:36You're right that there are cultural elements where the

27:42culture should celebrate creating new companies.

27:48And there should be a bias towards supporting small

27:53companies, because they're the ones that need nurturing the

27:55larger companies really don't need nurturing.

27:59So you can think of it sort of like a God,

28:01and if it's a little sprout that needs nurturing,

28:04if it's a mighty oak, it doesn't need quite as much.

28:07So I think that is a mindset change that is important.

28:12But I should mention that London and San Francisco

28:19or the Bay Area are really the two senses for AI.

28:22So London is actually doing very well on that front.

28:26The two leading locations on a,

28:29you know, San Francisco is probably head of London,

28:33but London's really very strong.

28:35Or London area, greater London, home counties, I guess.

28:38I'll keep going, keep going.

28:41So I'm just saying objectively this is the case.

28:48But you do need that, you need the infrastructure,

28:51you need landlords who are willing to rent to new companies,

28:55you need law firms and accountants that are willing

28:58to support new companies.

28:59And it's generally a mind, it is a mindset change.

29:03And I think some of that is happening,

29:04but I think really it's just culturally

29:06people need to decide this is a good thing.

29:09Yeah.

29:10No, actually, well, thanks for what you said about the UK.

29:12It's something that we work hard on,

29:14lots of people in the room are part of what makes this

29:17a fabulous place for any of the companies,

29:18including Alice.

29:20So, Alice White says, my job is to get all the nuts and bolts right, make sure that all

29:26of you starting companies can raise a capital that you need, everything from your seed funding

29:31with our incredible EIS tax reliefs all the way through to your late stage rounds and we

29:38need reform of our pension funds and the Chancellor's got a bunch of incredible reforms to unlock

29:43capital from all the people who have it and deploy it into growth equity, right?

29:47That is a work in progress.

29:48We're not there yet.

29:49I think we're making good progress.

29:51We need talent, we need people.

29:53So that means an education system that

29:55prioritizes the things that matter.

29:57And you've seen my reforms.

29:58I go on about more maths, more maths, more maths.

30:01But I think that is important.

30:03But also attracting the best and the brightest here.

30:05If you look at our fastest growing companies in this country,

30:08and I think it's probably the same in the US,

30:11over half of them have a non-British founder.

30:15And that tells you we've got to be a place that is open to the world's

30:18best and brightest entrepreneurial talent.

30:20So the visa regime that we've put in place, I think,

30:23does that.

30:24Makes it easy for those people to come here.

30:25And then actually, it's the thing that we spent

30:27the beginning of the session talking about, the regulation.

30:30Making sure that we've got a regulatory system that's

30:32pro-innovation, that, yeah, of course, we always need

30:35guardrails on the things that we'll worry us, but we've

30:38got to create a space for people to innovate and do

30:41different things.

30:42Those are all my jobs.

30:43The thing that is tougher is the thing that Elon talked

30:46about, which is culture.

30:47is how do you transpose that culture from places

30:50like Silicon Valley across the world

30:52where people are unafraid to give up the security

30:56of a regular paycheck to go and start something

30:59and be comfortable with failure.

31:01You talk about that a lot.

31:02I think you talk about it more in when you're playing games,

31:04right?

31:05But you've got to be comfortable failing

31:07and knowing that that's just part of the process.

31:09And that is a tricky cultural thing to do overnight,

31:12but it's an important part of, I think,

31:14creating that kind of environment.

31:16Yeah, if you don't succeed with your first startup,

31:18it shouldn't be a catastrophic career ending.

31:20Exactly.

31:21It should be, well, good.

31:23I think you're doing it.

31:25It should be like, well, you gave it a good shot.

31:27And now try again.

31:29Exactly.

31:30Yeah.

31:31So one thing I was going to mention is,

31:33obviously, creating a company is sort of a high risk, high

31:35reward situation.

31:38But I don't know quite what this works in the UK.

31:42I think it's probably better than Continental Europe.

31:45But the stock options are very difficult in most parts.

31:50You're not sure how to do it.

31:52But if somebody's basically going to risk

31:54the sort of life savings and the vast majority of startups

31:58fail.

31:59So I mean, you hear about the startups that succeed.

32:02But most companies are, most startups

32:05consist of a massive amount of work followed by failure.

32:11That's actually most companies.

32:13And so it's a high risk higher award.

32:15And so the higher award part does need to be there

32:18for it to make a sense.

32:19I think that was a very soft pitch for a tax policy.

32:23I mean, Charles, but actually I can tell you.

32:25So look, AI agree.

32:27So we have, I think, relative to certainly European countries,

32:31but certainly the US is definitely California,

32:34a much lower rate of capital gains tax.

32:36So for those people who are risking and growing something,

32:39we think the reward should be there at the end.

32:41So 20% capital gains tax rate.

32:44And on stock options, I don't know if we've got anyone

32:46from index ventures in the room.

32:49So index one of our leading VC funds here.

32:52They do a regular report looking at most countries' tax

32:57treatment of stock options.

32:59And when I was chancellor at Treasury Secretary equivalent,

33:03we were, I think, down at, we were pretty good,

33:06but we were fourth or fifth.

33:07And I said, we need to, for exactly the reason

33:09that you mentioned, I was like, this has got to be the best

33:11place for innovators.

33:12We need to move that up.

33:13And I think in the last iteration of that report,

33:15we had, because of the changes that Jeremy and I have made,

33:19we have moved up to, I think, second from memory.

33:22So I hope that actually give you and everyone else

33:24some comfort that we recognize that's important.

33:26Because when people work hard and risk things,

33:28yeah, they should be able to enjoy the rewards of that.

33:30I respect the rewards.

33:31And I think we very much have a tax system that supports that.

33:35And those are the values that I believe in,

33:37and I think most of us in this room probably do as well.

33:39Right, next question.

33:41I've got seven in front of me, and then I'll come over here.

33:43John, John, sir.

33:48Thanks very much.

33:49We've talked about some really big ideas,

33:52global changing ideas.

33:53I'm really interested, particularly in the context

33:55of creation of science and technology super hubs and so on,

33:59how does that map onto the everyday lives

34:01of people living in, say, Austin, Texas,

34:04to choose one around you more, in my case,

34:06Nottingham, East Midlands.

34:09How do you see that evolving for people every day?

34:12be sort of everyday effects of AI?

34:15Yeah.

34:18For context, Elon, so Seb runs our equivalent of CVS,

34:23right, or Walgreens, so, you know, when actually I visited,

34:26right, so he's got millions of people coming in

34:27in his shops every day and it's making sure,

34:29how do we make this relevant, I think Seb is your question,

34:32how is this relevant to that person?

34:34You know, actually, let me go first on that,

34:36because I think it's a fair point.

34:39I was just going over with the team,

34:41a couple of things that we're doing,

34:43because I was saying like, how are we doing AI right now

34:45that it's making a difference to people's lives?

34:48And we have this thing called Gov.UK,

34:50which is when it happened several years ago

34:53was a pioneering thing.

34:55All the government information brought together

34:57on one website, Gov.UK.

34:59So you need to get a driving license, passport,

35:02any interaction with government, it was centralized

35:04in a very relatively easy to use way.

35:07It's better than most, better than most.

35:10Yeah, so we are about to deploy

35:13AI across that platform. So that is something that I think several million people a day use,

35:19right? So a large chunk of the population is interacting with gov.uk every single day to

35:24do all these day-to-day tasks, right? Every one of your customers is doing all those things.

35:29And so we're about to deploy AI into that to make that whole process so much easier. Because

35:35some people will be like, well, I'm currently here and I've lost my passport and my flights

35:40in five hours, at the moment that would require how many steps to figure out what you do.

35:46Actually, when we deploy the AI, it should be that you could just literally say that

35:50and boom, boom, boom, boom, boom.

35:51This is what we're going to do, walk you through it.

35:53And that's going to benefit millions and millions of people every single day, right?

35:56Because that's a very practical way in my seat that I can start using this technology

36:01to help people in their day-to-day lives, not just healthcare discoveries and everything

36:05else that we're also doing.

36:07I thought that's quite a powerful demonstration of literally your day-to-day customer

36:11seeing actually their just day-to-day life get a little bit easier because of something

36:15that Elon Demis and others in this room have helped create.

36:18Yeah, exactly. The most immediate thing is just being able to ask, like having a very

36:23smart friend that you can ask anything, you know, ask how to make something, how to solve

36:29any problem and it'll tell you.

36:35And obviously companies are going to adopt this.

36:37So I think we'll have much better customer service, I guess,

36:40essentially.

36:41That'll probably be the first thing you notice.

36:44And then we talked about education.

36:50So having a tutor, so if you're trying to understand a

36:54subject like having a phenomenal tutor on any subject,

36:59that's really pretty much there already almost.

37:03And we need to, obviously AI needs to stop

37:05hallucinating before, you know, it can't give you,

37:08I mean, we still have a little bit of a problem

37:10where it can give you an answer that's

37:12confidently wrong with great grammar.

37:15And, you know, in a bullet points and everything in

37:18citations it was not real.

37:20So that's to be okay, we need to make sure it's,

37:24It's not giving you confidently wrong tutor answers.

37:28But that's going to happen pretty quickly,

37:30where it is actually correct.

37:34So yeah.

37:34I'm going to say for any parent who

37:36was homeschooling during COVID and realizing

37:39what their kids needed to be helped with,

37:41that will come as an enormous relief, I think.

37:43Yeah.

37:43Very, very good.

37:44Right.

37:45And we've got quite let's go questions over here.

37:47We've got, we've got any microphones or Brent, are you there?

37:50Perfect.

37:51Hi, Brent Hoebman.

37:53So you've spoken eloquently about abundance

37:56and the age of abundance.

37:57So it feels obviously with AI, it's everything everywhere,

38:00everywhere all at once.

38:02But with robots, and to get the age of abundance,

38:06we'll need a lot of robots.

38:07I know you're working on robots as well.

38:10Are there sort of constraints that we should think of

38:12and our politicians should be thinking of,

38:14that we might get, one country might get heavily behind

38:16in robots that can do all these things

38:19and enter the age of abundance,

38:19and therefore be at a strategic disadvantage?

38:24Well, really anything that can be actuated by a computer

38:29is effectively a robot.

38:31So you can think of, frankly, Tesla

38:33cause our robots on wheels.

38:37Anything that's connected to the internet

38:39is effectively an endpoint actuator

38:41for artificial intelligence.

38:44So you've got Boston Dynamics.

38:49Obviously, they've been making impressive robots for a while.

38:53I think they're at this point mostly owned by Hyundai.

38:55So I guess who is probably going to make robots

39:00that are humanoid and some rather interesting shapes

39:03that I wasn't just making the one that looks like it

39:06has wheels and looks sort of like a kangaroo on wheels.

39:08I'm not sure what that is.

39:14Looks a little demented, frankly.

39:17But there's going to be all sorts of robots.

39:20You have a company Dyson in the UK, which I think is some pretty impressive things.

39:28I think the UK will not be behind, actually, on that front.

39:32UK also has Arm, which is really the best, one of the best, perhaps the best in chip design

39:42in the world.

39:43It tells they use a lot of Arm technology, almost everyone does, actually.

39:49So I think UK is in a strong position.

39:53Germany obviously makes a lot of robots,

39:55industrial robots.

39:57I mean, I think generally countries

39:59that make robots of any kind, even if they seem somewhat

40:03conventional, will be fine.

40:08I do think there is a safety concern,

40:12especially with humanoid robots, because at least the car

40:16can't chase you into this building, not very easily.

40:19or chase you off a tree, or you can sort of run up a flight

40:23of stairs and get away from a Tesla.

40:28I think it was a Stephen King movie about that.

40:31A few targets possessed.

40:34But if you have a humanoid robot,

40:35it can basically chase you anywhere.

40:38So I think we should have some kind of hardwired local cut-off

40:45that you can't update from the internet.

40:48So anything that can be software updated from the internet,

40:50obviously, can be overridden.

40:52But if you have a local sort of off switch

40:55where you have say a keyword or something

40:57and then that puts the robot into a safe state,

41:01some kind of localized safe state ability,

41:06an off switch where you don't have to get too close

41:10to the robot.

41:11I don't know, so if you've got millions of these things

41:13going all over the place.

41:15You're not selling it.

41:16Just, you know, like so.

41:17I know. I'm saying, is this something we should be quite concerned about? Because Robert can

41:24follow you anywhere, then what if they just one day get a software update and they're

41:30not so friendly anymore? We've got a James Cameron movie on our hands.

41:37It's actually, it's funny you saying that because in our session that we had today,

41:42I would say, they made exactly the same point, right? They were talking about, they're talking

41:47talking about movies, actually, about mentioning James Cameron, they're talking about James

41:50Cameron movies.

41:51And so they're saying, if you think about it, it's not just those movies, but any of these

41:56movies trains, subways, metros, or as buses, they said all these movies with the same plot

42:03fundamentally all end with the person turning it off, right, or finding a way to shut the

42:08thing down and they were making the same point that you were about the importance of

42:12actual physical off switches.

42:14is. All the technology is great, but fundamentally this same movie has played out 50 times. We've

42:19all watched it and all fundamentally, you know, point of view, right? Or ends in pretty

42:24much the same way with someone finding a way to just do the thing. Which is kind of interesting

42:29that you've said a similar point, right? It's not the obvious place you'd go to.

42:33Maybe that could be one of the tests for the AI. We should say like, blank is your favorite

42:38of the James Cameron movie, film in the blank.

42:40Yeah, excellent, right.

42:46Yes, we got over there, yep, perfect.

42:51Hi, a question for you both.

42:53So I'm a founder of AI and ML scale up

42:56in the third centre for AI,

42:57which is Leeds in the North England, a bit biased.

43:00Since the launch of chat GPT, three months after that,

43:04we saw a real increase in phishing attacks

43:06using much more sophisticated language patterns.

43:10What do we do to protect businesses, consumers,

43:13that they trust this technology better?

43:15And how do we bring them along that journey with us?

43:20Well, I think we shouldn't trust it that much, actually.

43:25It is actually quite a significant challenge,

43:28because we're going to the point where even open source AI

43:30can pass human capture tests.

43:33So this is, are you a human?

43:35Identify all the traffic lights in this picture.

43:37like, okay, yeah, it's going to have no problem doing that. In fact, it'll do it better than

43:42the human and faster than the human. So we're like, how do you, you know, it's the point

43:46of which is better, a better human, better passing human tests than humans, then, well,

43:52what tests actually make sense? That is a real problem. I don't actually have a good solution

43:56to it. That's one of the things we're trying to figure out on the X platform is how to

44:02deal with that because it really are at the point where even with open source, you know,

44:09readily available AI, you don't need to be sort of leading the field, you can actually

44:13be better than humans at passing these tests. And that's sort of why we think, well, perhaps

44:18we should sort of charge a dollar or a pound a year. It's a very tiny amount of money, but

44:22it still makes it privately expensive to make a million bots. So, and especially if you

44:30a million payment methods, then you run out of sort of stolen credit cards pretty quickly.

44:38So that's sort of where we're thinking like we might have to sort of just charge some

44:42very tiny amount of money, 0.3 cents a day effectively, to deal with the onslaught of

44:50AI-powered bonds.

44:52And that is still a growing problem, but it will be I think perhaps an insurmountable

44:58problem next year.

44:59And then you have to worry about manipulation of information.

45:06Making something seem very popular when it's not because it's getting boosted by all these

45:11likes and repos from AI powered bots.

45:15So that's why I sort of think somewhat inevitably it leads to some small payment in order to

45:22dramatically increase the cost of a bot.

45:26So I think frankly, I think probably any social media system that doesn't do that will simply

45:31be overrun by bots.

45:34I think my general answer would be we need to show that we are on top of mitigating the

45:41risk, so people can trust the technology.

45:44That's what actually the last couple of days has been about on the safety summit is

45:48just showing we're investing in the safety institute, having the people who can do the

45:52research on these things to figure out how we mitigate against them, and we have to do

45:57it fast and we have to keep iterating it. Because all of us probably in this room believe that

46:02the technology can be incredibly powerful, but we've got to make sure we bring people along

46:05that journey with us that we're handling the risks that are there. And there's a job to

46:10do in the last couple of days. I think we make good progress on it because we want to focus

46:14on the positives and manage these things. But that requires action and that's what the last

46:19couple of days have been about. Your analogy there was part of the research that actually

46:26the team working on the task force here,

46:30published and presented yesterday,

46:32I don't know if you saw it,

46:33was which is essentially that.

46:35It was a using AI to create a ton of fake profiles

46:41on social media and then infiltrate particular groups

46:45with particular information.

46:47And at the moment, that is, as I said to your point,

46:49I know it's like cost free.

46:50It's getting to the point where it's like,

46:53really you're gonna have a hundred for a penny

46:55sort of thing, ridiculous.

46:56And if you think about some of these social networks

46:57at what a neighborhood or town level,

46:59it's not that many big profiles that you

47:01quickly create, suddenly they're everywhere,

47:04and there's some local issue that might be of importance,

47:07and the team have run versions of how that looked like,

47:10and suddenly they're interacting with everybody,

47:12and then spreading misinformation around.

47:13Yeah, that's a real challenge.

47:15We literally as part of the research

47:17that we published on misinformation yesterday,

47:19it's a real challenge.

47:21Yeah, exactly, a two point.

47:22I mean, the images, you don't even need to steal

47:25somebody's picture, because that's traceable, but you can actually just say create a new

47:30image of a person, realistic looking, it doesn't exist, and then create a biography,

47:36realistic, but doesn't exist, and do that en masse.

47:40And practically the only way a bill tells us that the grammar is too good.

47:44Take it away.

47:45So typos, come on.

47:47Now I'm getting waved at, because I think we are out of time.

47:51I don't think we take one very brief last question.

47:54And let's make a good one.

47:55Yes, sir.

47:56Go on your own front and be calm.

48:00Elon, question for you.

48:03Related to the X platform.

48:04Are there simple things we can do,

48:06especially when it comes to visual media?

48:07You alluded to the fact that it's fairly straightforward

48:10and effectively free to make people like yourselves say

48:13and do things that you never said or did.

48:16Can we do something like cryptographically signed media?

48:18I'm from Adobe.

48:18We're working on this project.

48:20Twitter was a member.

48:21Love to see X come back.

48:23digitally signed media to indicate not only what was created by AI, but what came from

48:27a camera, what was real to imbue a sense of trust in media that can go viral.

48:32That's something a good idea actually.

48:36So some way of dedicating would be good.

48:40So yeah, that sounds like a good idea, I wish we could probably do it.

48:45Yeah.

48:46There you go.

48:47Actually, on that point, I've already, so this is particularly pertinent for people

48:53in my job, right? And I've already had a situation happen to me with a doctored image

48:58that goes everywhere, negative. By the time everyone realizes, well, that's fake and we

49:03should stop sending it, the damage is done. And actually, we were, again, reflecting today.

49:09If you think next year, you've got elections in, you know, I think, you know, the U.S.,

49:13India, I think Indonesia, probably here. There you go. Massive news. And actually, you've

49:23You've got just an enormous chunk of the world's population is voting next year.

49:28You got EU elections as well.

49:30These issues are right in front of us.

49:33Next year is where big elections across the globe, probably the first set of elections

49:37where this has been a real issue.

49:40So figuring out how we manage that is, I think, kind of mission critical for people

49:45who want the integrity of our democracy.

49:47Yeah.

49:48I mean, some of it is quite interesting.

49:50Like the Pope in the Papa jacket, have you seen that one?

49:52That's amazing.

49:54But I mean, I still run into people who think that's real.

49:57I'm like, well, one of the odds he's

49:58wearing a puffer jacket in July in Rome.

50:02He'd be sweating.

50:03But it actually looked quite dashing, I think.

50:07In fact, I think AI fashion is going to be a real thing.

50:09So I've been doing it clearly.

50:11We live in the most interesting times.

50:12And I think this is 80% likely to be good.

50:17And 20% bad.

50:18I think if we're cognizant and careful about the bad part,

50:22on balance actually, it will be the future that we want.

50:25Or the future that is preferable.

50:28And it actually will be somewhat of a leveler,

50:32an equalizer in the sense that,

50:35I think everyone will have access to goods and services

50:37and education.

50:38And so, I think probably it leads to more human happiness.

50:42So I guess I'd probably leave on an optimistic note.

50:45Yeah.

50:46Yeah.

50:47Well, that is a great note to end on.

50:50I think we're all on that better future.

50:53I think it's there.

50:54The promise of it is certainly there.

50:55Lots of people in this room, including yourselves,

50:57are working hard to make it happen.

50:58Our job in government is to make sure it happens safely.

51:00But on the basis of this conversation

51:02in the last couple of days,

51:03I'm certainly leaving more confident

51:05that we can make that happen.

51:07It's been a huge privilege and a pleasure to have you here.

51:09Well, thank you very much for having me.

51:10Thank you.

51:11Thank you.

51:12Thank you.

51:13I think previously...

资源与出处