当前位置:主页 > 国内 >

比特币

OpenAI 秀肌肉,与博通共研的 Jalapeño 芯片将向英伟达 GB300 发起挑战_我的网站

千王之王

一 |      8 月 25 日消息,OpenAI 今天(25 日)晚间在 Hot Chips 大会上公布了全新推理系统 Jalapeño 的更多细节,并首次披露基准测试成绩。    New York City officials are limiting the time asylum-seekers with children can spend in the city's shelter system.Starting next week, city officials will begin notifying some families that they have 60 days to find alternative housing. Last month, NYC Mayor Eric Adams' administration announced it would be handing out 30-day notices for adult migrants without children.The move to restrict the amount of time in the shelter system comes as the city continues to grapple with a large number of asylum-seekers coming to the city since spring of last year. Over 126,000 asylum-seekers have moved through the shelter system so far since Spring 2022."For over a year, New York City has led the response to this national crisis, but significant additional resources, coordination, and support are needed from all levels of government. With over 64,100 asylum seekers still in the city's care, and thousands more migrants arriving every week, expanding this policy to all asylum-seekers in our care is the only way to help migrants take the next steps on their journeys," Mayor Adams said in a statement Monday.The mayor's office said it would pair the notices with "intensified case work" to help asylum-seekers figure out their next steps. A spokesperson for the mayor's office told ABC News that if someone fails to secure housing by the deadline, they'll need to return to the city's intake center and seek a new placement.Some advocates believe issuing the notices is a way for the Adams administration to limit its obligation's under the city's "right-to-shelter" laws which require the city to provide shelter for anyone in need. The city has asked a court to consider allowing the city to consider allowing it relinquish some of those obligations if it doesn't have "the resources and capacity to establish and maintain sufficient shelter sites, staffing, and security to provide safe and appropriate shelter," according to court filings.On Monday, the administration announced it will open a temporary shelter at Floyd Bennett Field in the coming weeks that will be serve approximately 500 families in a "semi-congregate setting" with privacy dividers and locks."It's outrageous the way the Adams administration continues to go out of its way to gut New York City's right-to-shelter protections. This policy ensures that all New Yorkers, no matter when they arrived here, can maintain a roof over their heads while they stabilize their lives and get on the road to self-sufficiency," Murad Awawdeh, the executive director of the New York Immigration Coalition, said in part in a statement.He added, "Now, Mayor Adams is putting children in danger by forcing some asylum seeking families to stay in congregate settings as well as mandating families re-apply for shelter after 60 days, a move that creates unnecessary bureaucratic hurdles for people who are already struggling."The spokesperson for the mayor's office told ABC News they hoped the city could continue housing migrants without forcing families with children on to the streets and reiterated the administration's call for more support from the state and federal governments.。在 SemiAnalysis 的 InferenceX 测试中,Jalapeño 无论是单用户 token 处理量,还是每千瓦吞吐量,都超过了目前市面上的顶尖推理处理器。OpenAI 硬件负责人理查德 · 何在媒体电话会上表示:“测试结果最重要的一点,是 Jalapeño 相比目前最先进的产品实现了非常显著的性能提升。它可以用相同的电力处理更多 AI 工作负载,同时更快给出响应。Jalapeño 既适合高效服务大量用户,也能保持很低的延迟。”Jalapeño 由 OpenAI 与博通共同开发,OpenAI 自有模型也参与了研发。OpenAI 希望把 Jalapeño 发展成一个能够延续多代的技术平台,使 AI 产品、模型、芯片和内存从一开始就协同设计。这款芯片主要负责 AI 推理,也就是让已经训练好的 AI 模型真正运行起来,完成任务或驱动 AI 智能体。OpenAI 使用 InferenceX 平台测试 Jalapeño 的推理性能,并与英伟达 GB200 和 GB300 超级芯片系统进行比较。

二 | OpenAI 称,在 GPT-OSS 120B、DeepSeek R1 和 Kimi K2.5 1T 三个模型上,Jalapeño 每瓦能够完成的 AI 工作量是对比系统的 1.5 至 1.9 倍,端到端延迟则约为对比系统的 28% 至 59%。全栈协同开发也让 OpenAI 能够直接优化推理过程中最容易拖慢速度的环节。Jalapeño 重点降低预填充和通信阶段的延迟,而这两个环节在 OpenAI 看来往往是推理性能的主要瓶颈。

三 | OpenAI 在公布测试结果的博客文章中提到,Jalapeño 从设计之初就尽量减少数据搬运和通信延迟。生成响应时使用的 KV 缓存等模型状态可以明确存放并保留在本地,系统再根据不同推理阶段,调配合适的计算、内存和网络资源。据了解,OpenAI 计划在今年年底前先“小规模”部署 Jalapeño,2027 年再逐步扩大部署量,但没有公布明年具体会投入多少芯片。

四 | 参考广告声明:文内含有的对外跳转链接(包括不限于超链接、二维码、口令等形式),用于传递更多信息,节省甄选时间,结果仅供参考,包含外链的文章均包含本声明。

Current article:http://qlfy.cengzaodengchawonin.cyou/f2w/5hyt0o4.html

Published on:00:00:00


相关新闻

最后更新

热门新闻