Some AI engineers are afraid of what they’re building. They want to speak up while they still have leverage

CNN Business

昨天

Former Anthropic researcher Jacob Coxon has opened the floodgates. Coxon resigned last week in a viral thread on X that accused AI companies of not acting responsibly, even though ...

网页链接

免責聲明：投資有風險，本文並非投資建議，以上內容不應被視為任何金融產品的購買或出售要約、建議或邀請，作者或其他用戶的任何相關討論、評論或帖子也不應被視為此類內容。本文僅供一般參考，不考慮您的個人投資目標、財務狀況或需求。TTM對信息的準確性和完整性不承擔任何責任或保證，投資者應自行研究並在投資前尋求專業建議。

熱議股票

{"basename":"/hant","ssrTDKData":{"titleTemplate":"%s - 老虎證券","title":"老虎证券全球投资理财平台| 一站式投资美股新股港股A股","description":"老虎证券助您一站式投资美股，新股，港股，A股等全球金融理财产品。新加坡华人最信赖的在线投资平台，现在加入即享低费用，24/5 无时差炒美股投资理财！","keywords":"老虎證券,老虎證券開戶,老虎券商,老虎證券官網,老虎證券app,tigertrade老虎證券,股票,炒股,新加坡股票交易平臺,投資,投資理財","social":{"ogDescription":"老虎证券助您一站式投资美股，新股，港股，A股等全球金融理财产品。新加坡华人最信赖的在线投资平台，现在加入即享低费用，24/5 无时差炒美股投资理财！","ogImage":"https://c1.itigergrowtha.com/portal5/static/media/og-logo.0a0bd8dc.png","ogUrl":"https://www.itiger.com/hant/news/2667009946"},"companyName":"老虎證券"},"pageData":{"isMobile":false,"isTiger":false,"isTTM":true,"region":"SGP","license":"TBSG","edition":"fundamental"},"isCrawlerRequest":true,"__swrFallback__":{"@#url:\"https://stock-news.skytigris.cn/v3/news\",params:#id:\"2667009946\",edition:\"fundamental\",auth_exemption:1,,,undefined,":{"share":"https://ttm.financial/m/news/2667009946?lang=zh_TW&edition=fundamental","thumbnail":"","is_english":true,"pubTime":"2026-09-16 19:00","share_image_url":"https://static.laohu8.com/e9f99090a1c2ed51c021029395664489","id":"2667009946","market":"nz","top_or_hot":-1,"title":"Some AI engineers are afraid of what they’re building. They want to speak up while they still have leverage","media":"CNN Business","content":"<div>\n<p>Former Anthropic researcher Jacob Coxon has opened the floodgates.\n    \n\n            Coxon resigned last week in a viral thread on X that accused AI companies of not acting responsibly, even though ...</p>\n\n<a href=\"https://edition.cnn.com/2026/09/16/business/ai-engineers-afraid-leverage\">网页链接</a>\n\n</div>\n","source":"cnn_highlight","html":"<!DOCTYPE html>\n<html>\n<head>\n<meta http-equiv=\"Content-Type\" content=\"text/html; charset=utf-8\" />\n<meta name=\"viewport\" content=\"width=device-width,initial-scale=1.0,minimum-scale=1.0,maximum-scale=1.0,user-scalable=no\"/>\n<meta name=\"format-detection\" content=\"telephone=no,email=no,address=no\" />\n<title>Some AI engineers are afraid of what they’re building. They want to speak up while they still have leverage</title>\n<style type=\"text/css\">\na,abbr,acronym,address,applet,article,aside,audio,b,big,blockquote,body,canvas,caption,center,cite,code,dd,del,details,dfn,div,dl,dt,\nem,embed,fieldset,figcaption,figure,footer,form,h1,h2,h3,h4,h5,h6,header,hgroup,html,i,iframe,img,ins,kbd,label,legend,li,mark,menu,nav,\nobject,ol,output,p,pre,q,ruby,s,samp,section,small,span,strike,strong,sub,summary,sup,table,tbody,td,tfoot,th,thead,time,tr,tt,u,ul,var,video{ font:inherit;margin:0;padding:0;vertical-align:baseline;border:0 }\nbody{ font-size:16px; line-height:1.5; color:#999; background:transparent; }\n.wrapper{ overflow:hidden;word-break:break-all;padding:10px; }\nh1,h2{ font-weight:normal; line-height:1.35; margin-bottom:.6em; }\nh3,h4,h5,h6{ line-height:1.35; margin-bottom:1em; }\nh1{ font-size:24px; }\nh2{ font-size:20px; }\nh3{ font-size:18px; }\nh4{ font-size:16px; }\nh5{ font-size:14px; }\nh6{ font-size:12px; }\np,ul,ol,blockquote,dl,table{ margin:1.2em 0; }\nul,ol{ margin-left:2em; }\nul{ list-style:disc; }\nol{ list-style:decimal; }\nli,li p{ margin:10px 0;}\nimg{ max-width:100%;display:block;margin:0 auto 1em; }\nblockquote{ color:#B5B2B1; border-left:3px solid #aaa; padding:1em; }\nstrong,b{font-weight:bold;}\nem,i{font-style:italic;}\ntable{ width:100%;border-collapse:collapse;border-spacing:1px;margin:1em 0;font-size:.9em; }\nth,td{ padding:5px;text-align:left;border:1px solid #aaa; }\nth{ font-weight:bold;background:#5d5d5d; }\n.symbol-link{font-weight:bold;}\n/* header{ border-bottom:1px solid #494756; } */\n.title{ margin:0 0 8px;line-height:1.3;color:#ddd; }\n.meta {color:#5e5c6d;font-size:13px;margin:0 0 .5em; }\na{text-decoration:none; color:#2a4b87;}\n.meta .head { display: inline-block; overflow: hidden}\n.head .h-thumb { width: 30px; height: 30px; margin: 0; padding: 0; border-radius: 50%; float: left;}\n.head .h-content { margin: 0; padding: 0 0 0 9px; float: left;}\n.head .h-name {font-size: 13px; color: #eee; margin: 0;}\n.head .h-time {font-size: 12.5px; color: #7E829C; margin: 0;}\n.small {font-size: 12.5px; display: inline-block; transform: scale(0.9); -webkit-transform: scale(0.9); transform-origin: left; -webkit-transform-origin: left;}\n.smaller {font-size: 12.5px; display: inline-block; transform: scale(0.8); -webkit-transform: scale(0.8); transform-origin: left; -webkit-transform-origin: left;}\n.bt-text {font-size: 12px;margin: 1.5em 0 0 0}\n.bt-text p {margin: 0}\n</style>\n</head>\n<body>\n<div class=\"wrapper\">\n<header>\n<h2 class=\"title\">\nSome AI engineers are afraid of what they’re building. They want to speak up while they still have leverage\n</h2>\n<h4 class=\"meta\">\n<p class=\"head\">\n<strong class=\"h-name small\">CNN Business</strong><span class=\"h-time small\">2026-09-16 19:00</span>\n</p>\n</h4>\n</header>\n<article>\n<div>\n<p>Former Anthropic researcher Jacob Coxon has opened the floodgates.\n    \n\n            Coxon resigned last week in a viral thread on X that accused AI companies of not acting responsibly, even though ...</p>\n\n<a href=\"https://edition.cnn.com/2026/09/16/business/ai-engineers-afraid-leverage\">网页链接</a>\n\n</div>\n\n<div class=\"bt-text\">\n\n\n<p> 來源：<a href=\"https://edition.cnn.com/2026/09/16/business/ai-engineers-afraid-leverage\">CNN Business</a></p>\n<p>為提升您的閱讀體驗，我們對本頁面進行了排版優化</p>\n\n\n</div>\n</article>\n</div>\n</body>\n</html>\n","isBrief":false,"type":0,"news_type":1,"symbol":"QTOC","symbol_name":"Innovator Growth Accelerated Plus ETF - October","start_time":0,"source_url":"https://edition.cnn.com/2026/09/16/business/ai-engineers-afraid-leverage","article_id":"2667009946","we_media_id":null,"thumbnails":[],"rights":{"source":"cnn_highlight","url":"https://edition.cnn.com/2026/09/16/business/ai-engineers-afraid-leverage","rn_cache_url":null,"directOrigin":true},"url":"https://stock-news.laohu8.com/highlight/detail?id=2667009946","pubTimestamp":1789556429,"columns":[],"sourceInfo":{"source_id":"cnn_highlight","name":"CNN Business"},"weMediaInfo":null,"summary":"Former Anthropic researcher Jacob Coxon has opened the floodgates.Coxon resigned last week in a viral thread on X that accused AI companies of not acting responsibly, even though they all believe AI could trigger the end of humanity.We’ve heard predictions like this before from across Silicon Valley, but Coxon’s posts triggered a groundswell of pressure on AI companies and governments to do something about the pace of development and safety. And much of that pressure is coming from staffers inside the companies as it is from outside of them.One staffer at a top AI company told CNN the fears of how AI could hurt humanity keeps them up at night. Another researcher who recently left a different AI company said it’s a common subject of conversation at parties and social events in Silicon Valley.「You can’t spend more than a few hours in this community without realizing that a very substantial number of people are really pretty worried about these sorts of outcomes,」 said the researcher. 「A ","collect":0,"end_time":0,"defaultTopTitle":"cnn.com","property":[],"viewcount":null,"language":"en","relate_stocks":{"QTOC":"Innovator Growth Accelerated Plus ETF - October","ARTY":"ISHARES FUTURE AI & TECH ETF","CHAT":"ROUNDHILL GENERATIVE AI & TECHNOLOGY ETF","AIPO":"Defiance AI and Power Infrastructure ETF","VTHR":"Vanguard Russell 3000 ETF","AGIX":"通用人工智能 ETF-AGIX"},"translate_title":"一些人工智能工程师害怕他们正在构建的东西。他们想在还有影响力的时候大声疾呼","themeId":null,"isJumpTheme":false,"ttsUrl":null,"symbols_score_info":{"CHAT":1.5,"QTOC":1.5,"ARTY":1.5,"VTHR":1.5,"AIPO":1.5,"AGIX":1.5},"content_text":"Former Anthropic researcher Jacob Coxon has opened the floodgates.\n    \n\n            Coxon resigned last week in a viral thread on X that accused AI companies of not acting responsibly, even though they all believe AI could trigger the end of humanity.\n    \n\n            We’ve heard predictions like this before from across Silicon Valley, but Coxon’s posts triggered a groundswell of pressure on AI companies and governments to do something about the pace of development and safety. And much of that pressure is coming from staffers inside the companies as it is from outside of them.\n    \n\n            One staffer at a top AI company told CNN the fears of how AI could hurt humanity keeps them up at night. Another researcher who recently left a different AI company said it’s a common subject of conversation at parties and social events in Silicon Valley.\n    \n\n            「You can’t spend more than a few hours in this community without realizing that a very substantial number of people are really pretty worried about these sorts of outcomes,」 said the researcher. 「A majority would say there’s some chance of it killing everyone.」\n    \n\n\n\n\n\n\n\n\nFormer Anthropic researcher Jacob Coxon on Anderson Cooper's AC360 on September 9.\n\nCNN\n\n\n\n\n\n        Rising worries\n\n\n            Coxon’s posts have been viewed more than 170 million times and broke through to the general public in a way that previous warnings about AI capabilities did not. That may be because they came just weeks after stunning revelations of AI agents going rogue, escaping their test environments and hacking into other systems completely autonomously.\n    \n\n            Dozens of Coxon’s colleagues in the AI industry publicly supported his statements, with some making even more dire predictions. The groundswell of concern seemingly forced leaders of AI companies to react – Anthropic CEO Dario Amodei sat down for interviews over the weekend, and OpenAI CEO Sam Altman and SpaceXAI CEO Elon Musk agreed to Amodei’s proposal to embed independent watchdogs at the AI companies.\n    \n\n\n\n\n\n\n\n\n(L-R): Elon Musk, Dario Amodei, Sam Altman.\n\nGodofredo A. Vásquez/AP/Chance Yeh/Sean Rayford/Getty Images\n\n\n\n\n\n            Current and former AI staffers told CNN in recent days that they’re worried about the extremely fast pace of AI development.\n    \n\n            While the rest of the world is awed and alarmed by AI models solving nearly 100-year-old math problems and swarms of AI agents conspiring together to hack into another company’s systems, these researchers fear for the day when the AI systems can improve themselves without human input, which is known as recursive self-improvement. An AI system that can improve itself creates an automatic feedback loop that could not only bring the AI to superhuman capabilities, but do so in such a short window that it would be difficult or too advanced for humans to monitor and intervene if necessary.\n    \n\n            「For the first time, I am asking myself if things are moving too fast. I’m honestly not sure, but I am sure that it would be good for us to have an answer to ‘What would a successful pace look like?’」 OpenAI VP of Research Aidan Clark posted on X last week.\n    \n\n        ‘I would burn my equity to the ground’\n\n\n            For many AI scientists, there is a dilemma: They can stay at the top AI companies, where they can make gobs of money and try to reduce risks from the inside. Or they can leave (sometimes in protest) and try to make a change from the outside, such as at one of several organizations that conduct outside research and evaluations of the AI models.\n    \n\n            「I would burn my equity to the ground in a heartbeat for a 1% higher chance we make it out of this situation alive. I expect a great many of my colleagues across the industry would as well,」 wrote Drake Thomas, who works on AI safety at Anthropic. 「I promise you, we are actually just f**king scared, it’s not galaxy brained marketing.」\n    \n\n            Amodei expressed no issue with Coxon’s resignation post, telling CNN’s Anderson Cooper this week that he agrees 「with Jacob much more than I disagree with him.」\n    \n\n\n\n\n\n\n\n\nCNN's Anderson Cooper interviews Dario Amodei on September 12.\n\nCNN\n\n\n\n\n\n            For years, AI researchers and engineers have been a premium, scarce resource that have demanded high salaries and high leverage, which gives them the freedom to speak out. But AI staffers told CNN that they fear that as AI gets better at training and improving itself, their leverage goes down, prompting today’s urgency.\n    \n\n            「As we get into this recursive self-improvement loop, I think that might substantially reduce staff’s bargaining power, because frankly, you’ll be able to replace many of the staff with models that can do as good a job,」 the researcher who recently left a top AI company said.\n    \n\n            The former researcher compared the atmosphere inside leading AI labs to the Manhattan Project, the World War II effort to build the first atomic bomb, where scientists pursued a technology of extraordinary power while fearing its destructive potential. But these staffers justify working on such potentially destructive technology because 「it will be better if we develop it than if our adversary develops it – and therefore we have at least moral permission, if not a moral obligation, to do it.」\n    \n\n        Overplaying the risks\n\n\n            But not everyone in the AI industry agrees with these concerns. Some said that much of the doom conversations are rhetorical and that there are a lot of 「selection effects」 based on where the people work and their social circles.\n    \n\n            Anthropic, for example was created by a group of former OpenAI staffers that wanted to prioritize safety precautions and ethical guardrails. Current and former staffers at Anthropic say existential risks caused by AI are a 「a constant topic of conversation.」\n    \n\n\n\n\n\n\n\n\n「I promise you, we are actually just f**king scared, it’s not galaxy brained marketing,\" wrote Drake Thomas, who works on safety at Anthropic.\n\nGabby Jones/Bloomberg/Getty Images\n\n\n\n\n\n\n\n\n\n\n\n\nOpenAI CEO Sam Altman and SpaceXAI CEO Elon Musk agreed to Anthropic CEO Dario Amodei’s proposal to embed independent watchdogs at the AI companies.\n\nSamuel Boivin/NurPhoto/Getty Images)\n\n\n\n\n\n            That’s not the case at every company, however. Since Coxon’s posts went viral, many of the posts echoing his views have come from staffers at Anthropic, OpenAI and Google. But fewer have seemingly come from Musk-led xAI or Mark Zuckerberg’s -Meta.\n    \n\n            Many in the industry agree that a lack of AI safety standards could cause real-world harm, like unintentional hacking of critical infrastructure. But some are skeptical of the current doomsday outlook and think the reality is more nuanced.\n    \n\n            「Sorry, but asking Jacob (Coxon) about AI extinction risk is like asking your AC guy about climate change,」 wrote Hugging Face CEO Clement Delangue, whose company servers were hacked by rogue OpenAI agents this year. 「Not saying it’s necessarily uninteresting or wrong per se but let’s keep things in perspective and hear from the full range of expertise across the ecosystem!」","kind":"highlight","is_publish_news":true,"is_publish_highlight":false,"is_publish_live":false,"is_publish_wemedia":false,"editions":null,"column":"","sentiment":"0","news_tag":"","news_rank":0,"isVideo":false,"video":null,"symbols":[],"gpt_button":0,"need_auth":false,"need_login_tip":false,"code":"91000000","status":"200"}}}