🤖 AI 资讯

每日 05:00 更新 · 11-03 · 主站 liuch.name ↗
全部标签 →
筛选标签:OpenAI · 返回个性化推荐 · 清空筛选
AI 资讯

MIT让GPT-6 Astra直接修改Qwen权重!数学成绩飙升

新浪科技
2026-11-03T07:18:36+08:00 · 大模型,开源,OpenAI,阿里巴巴
AI 资讯

奥特曼预告下一代GPT!1万个Agent攻下千禧难题

新浪科技
2026-11-03T07:18:09+08:00 · 大模型,AI应用,OpenAI,Agent智能体
AI 资讯

AI investment is becoming overly concentrated, Chinese official says - Reuters

2026-11-03 02:28:00 · OpenAI,Google,推理思考,端侧AI,招聘HR
AI 资讯

CSU Uses Artificial Intelligence to Improve Hail Forecasting - North Forty News

Google News AI (英文)CSU Uses Artificial Intelligence to Improve Hail Forecasting  North Forty News
2026-11-02 17:34:00 · OpenAI,Google,推理思考,招聘HR
AI 资讯

Artificial intelligence use doubles among rural Nebraskans - Nebraska Public Media

Google News AI (英文)Artificial intelligence use doubles among rural Nebraskans  Nebraska Public Media
2026-11-02 12:05:46 · 算力芯片,OpenAI,Google,推理思考,招聘HR

Benchmarking: Qwen 27B, 35B, QFN180B; Nemotron Bolt 74B, Flint40B & Clover 35B (Q4) on M5 Max 2026 on Kapitsa with KFlash [P]

Reddit r/MachineLearning
Benchmarking: Qwen 27B, 35B, QFN180B; Nemotron Bolt 74B, Flint40B & Clover 35B (Q4) on M5 Max 2026 on Kapitsa with KFlash [P]

https://preview.redd.it/260fkihtk3zh1.png?width=2400&format=png&auto=webp&s=a80b6861abdeee3c9a4e705b6ad9b337be005722

hey folks, I'm Ye, one of the contributors to Kapitsa, an open-source inference engine optimized specifically for Apple Silicon to run Qwen, Nemotron, Flint and Clover models locally. Our custom-written Metal kernels let us tune for each chip and each model. https://github.com/nace-ai/kapitsa/

The latest update, 0.2.26, is out. Since our last M5 Max numbers, Flash-Next 180B reads prompts 46% faster and the 27B writes 8% faster, and DiffuSpace's Clover 35B joins the catalog. Kapitsa also runs Qwen Flash-Next 180B with SSD offloading: on a Mac that can't hold it, the experts that don't fit in RAM stream from the SSD, so it runs on a 48 GB MacBook Pro at 61 tok/s.

Here are the end-to-end numbers on a 2026 MacBook Pro 16 with an M5 Max and 128 GB: six targets (dense, MoE, hybrid Mamba-2 MoE and a block-diffusion MoE), from 1K context up to 32K, against the next-fastest engine for each.

Try it (any Apple Silicon Mac; models in this post: 35b, 27b, flash-next, bolt, flint, clover):

brew install nace-ai/tap/kapitsa kapitsa serve --model 35b # OpenAI and Anthropic APIs on localhost kapitsa opencode --model 35b # or claude, codex, pi kapitsa bench # benchmark your own Mac 

Results

Decode is a 512-token coding answer, prefill a 4K prompt, median of 3 runs:

Model Decode, tok/s Prefill, tok/s
Qwen3.6 35B-A3B 346 6,036
Clover 35B-A3B 304 5,981
Flint 40B 265 5,770
Nemotron Bolt 74B 154 1,075
Qwen3.8 27B 143 904
Qwen Flash-Next 180B 108 1,701

https://preview.redd.it/r1t8d4jtk3zh1.png?width=2400&format=png&auto=webp&s=6f707ed68fe883ddf206de9e30e5f94cef4bd738

From 1K context all the way up to 32K. At 32K the 35B still writes 175 tok/s, and Flash-Next barely drops (90 to 78):

https://preview.redd.it/hxod2sktk3zh1.png?width=2400&format=png&auto=webp&s=9703ef7d4356cac43d685cf5e284a60a51764786

https://preview.redd.it/b2wqfimtk3zh1.png?width=2400&format=png&auto=webp&s=fd2da7b94e354af519fde41fbdaede61aa6df883

Against the other engines

Against the next-fastest engine for each model on the same Mac: 1.23x Splash on the 35B, 2.2x oMLX on Bolt, 1.18x rec on Flint and 1.12x mlx-serve on the 27B. Flash-Next is a tie with mlx-serve, Splash still reads prompts faster on the two Qwens, and nothing else runs Clover on a Mac.

https://preview.redd.it/zpjhe6otk3zh1.png?width=2400&format=png&auto=webp&s=2bf9bbc25c8231fcc1376e9f9efcf8d024914cea

Every cell with versions and flags: benchmarks. Raw runs: results.

Why it's fast: KFlash

Other engines verify the drafter's guesses as one chain and stop at the first miss. KFlash verifies a best-first tree of the drafter's candidates in the same 8-row pass and keeps the longest branch the target agrees with.

https://preview.redd.it/sle8vzptk3zh1.png?width=1200&format=png&auto=webp&s=c2e4afec6cad457c34108beab8824353c0123514

Three details make it fit Apple silicon:

  • Nearly free rows. Apple GPUs work in 8-row tiles, so on dense models an 8-row verify costs about 1.1-1.25x one decode step.
  • Sized per Mac. Each tree is sized cycle by cycle from a budget measured on that Mac: GPU time per row count, plus a per-position calibration of the drafter against its own acceptances.
  • Seed-exact. A guess is accepted only if it equals the token the target itself samples with plain decoding's random number, so a sampled reply is the one plain sampling writes with the same seed.

Write-up and measurements

Send us your benchmarks

Run the same test on your Mac and add it to the community results. It takes 3-15 minutes:

brew install nace-ai/tap/kapitsa brew install gh && gh auth login # results are sent as a GitHub pull request kapitsa bench --submit # pick a model; it asks before sending anything 

Plug in and close heavy apps while it runs. At the end it asks once: Enter sends the result as a pull request from your GitHub fork, and n keeps it on your Mac. What it sends is about 2 KB: your Mac's model, chip, RAM, macOS version and the numbers, with no serial number, user name or paths (add --dry-run to see exactly what it would send). No GitHub? Paste the numbers it prints in a comment here.

One more ask

Do you know prior work where tree-verified sampling matches plain sampling token for token under the same seed? Please point me to it so we credit it. We cite SpecInfer, Medusa, EAGLE-2 and Sequoia.

submitted by /u/DotaMate
[link] [comments]
2026-11-02 01:05:33 · 大模型,算力芯片,开源,OpenAI,Anthropic,Meta,阿里巴巴,代码生成,扩散模型,MoE架构,模型评测,提示工程,招聘HR,榜单评测,开发者生态
AI 资讯

What did Ilya Sutskever mean when he said "The models, they just want to learn"? [D]

Reddit r/MachineLearning

It was just before OpenAI started that I met Ilya, who you interviewed. One of the first things he said to me was — “Look. The models, they just want to learn. You have to understand this. The models, they just want to learn.” And it was a bit like a Zen Koan. I listened to this and I became enlightened.

And over the years, I would be the one who would formalize a lot of these things and kind of put them together, but what that told me was that the phenomenon that I'd seen wasn't just some random thing. It was broad. It was more general. The models just want to learn. You get the obstacles out of their way. You give them good data, you give them enough space to operate in, you don't do something stupid like condition them badly numerically, and they want to learn. They'll do it.

I'm actually not entirely satisfied with Dario's elaboration! If Ilya meant precisely "given sufficient resources, do your job, and the models will do theirs [during training]", I think he would have phrased his advice slightly differently. What does it mean to "want" to learn? Why personify the model in that way, and not the optimizer or gradient descent itself or something? And I don't get why the koan would necessarily imply that scaling would have worked so well.

I realize that Ilya likes to cultivate an air of prophecy about himself (and I'd be lying if I said it didn't work on me). But it's just such a strange way to communicate the message, that I can't help but think the message must have been about something broader.

Possibly much more mundane in context, this must have been 10 years ago. Idk I wonder what it must have been like to be on the frontier at that time, maybe I take such things for granted now.

submitted by /u/XTXinverseXTY
[link] [comments]
2026-11-02 14:32:14 · OpenAI,扩散模型,招聘HR
AI 资讯

ML PhDs: Would you rather have done your PhD before or after the rise of AI chatbots? [D]

Reddit r/MachineLearning

For those doing or having completed a PhD in ML, I’m curious:
If you had the choice, would you rather have done your PhD before ChatGPT and other AI chatbots became widely available, or in today’s AI era?

submitted by /u/Hope999991
[link] [comments]
2026-11-02 10:04:25 · 大模型,OpenAI,对话助手,扩散模型,招聘HR
AI 资讯

Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights [R]

Reddit r/MachineLearning

Link: https://rikiyat.github.io/blog/weight-space-programming/

Snippet: “We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights, well past what we’d expect from humans or conventional algorithms. This might be a big deal for both optimization and interpretability.
Just by looking at the raw weights, GPT-6 Astra can tell what a network was trained to do. And without any environment feedback, it has no trouble writing, from scratch, small game-playing networks that outplay networks trained with PPO for 100 million steps.”

Very surprising result, I didn’t expect frontier models to have this capability that has not been optimized for, and it’s something humans cannot do either.

submitted by /u/RobbinDeBank
[link] [comments]
2026-11-02 20:18:26 · 大模型,开源,OpenAI,扩散模型,强化学习,招聘HR

The SEC Should Block Anthropic's IPO to Protect the Public

Hacker NewsComments
2026-11-02T21:34:46.817Z · 大模型,具身智能,融资,OpenAI,Google,Anthropic,Meta,Microsoft,推理思考,扩散模型,强化学习,提示工程,招聘HR,网络安全,榜单评测,开发者生态
AI 资讯

Scaling Git at OpenAI

Hacker NewsComments
· OpenAI,招聘HR
AI 资讯

Show HN: Hacker Times, a New York Times-inspired version of Hacker News

Hacker NewsComments
· 大模型,OpenAI,Anthropic,Meta,Microsoft,阿里巴巴,扩散模型,向量数据库,招聘HR,榜单评测,开发者生态

Goldman Sachs CEO David Solomon says the best advice he ever got came from his grandmother in his 20s: ‘Don’t be in a hurry’

Fortune

David Solomon runs one of the most powerful banks on Wall Street, but the best career advice he ever received didn’t come from a mentor in a corner office. It came from his grandmother.

“Don’t be in a hurry,” the Goldman Sachs CEO told NBC News’ Christine Romans in a rapid-fire interview about his daily routine and the lessons that have shaped his career. He said she gave him that advice when he was in his twenties.

The clip came out of Romans’ wider conversation with Solomon for NBC’s Business in America series. That conversation aired Oct. 23, one day after Goldman launched its Small Business AI Institute, part of a new $500 million commitment to its 10,000 Small Businesses program, with Anthropic, Google, Meta, and OpenAI as partners. In the segment that ran on Nightly News, Solomon said he’s excited about what AI could mean for businesses and for people’s longevity.

In the lightning round, though, he talked less about markets and more about how he manages his days and his life.

Gym, coffee, and a protein shake before 7 a.m.

Asked to name three things he does before 7 a.m., Solomon kept it simple: He wakes up, goes to the gym, and generally has a cup of coffee and a protein shake.

He’s in good company. An early workout is a fixture of many executives’ routines, from the Bupa CEO who trains six days a week with his Gen Z son to the many leaders featured in Fortune’s Day in the Life of a CEO series.

The research suggests the habit matters more than the hour. A 2022 systematic review published in the Public Health Agency of Canada’s journal Health Promotion and Chronic Disease Prevention in Canada examined 35 studies. Eleven found morning activity more beneficial; 12 found afternoon or evening activity more beneficial; and 12 found no clear difference. The authors concluded there is no consistent evidence that exercising at one time of day is better for your health than another, and they rated the evidence quality as very low.

‘Stick to the schedule’

Solomon’s best trick for keeping his day on track is unglamorous: sticking to his schedule.

“The one thing that we can’t…get back is time,” he said, adding that he tries to be very purposeful with how he spends it. That means making commitments and keeping them, because, as he noted, it’s easy to drift off schedule.

The science backs him up, with a twist. A 2021 meta-analysis in PLOS One by Brad Aeon, Aïda Faber, and Alexandra Panaccio found that time management is positively linked to job performance. It was even more strongly linked to well-being, especially life satisfaction. In other words, the payoff from guarding your calendar may show up as much in how you feel as in what you get done.

Why slowing down isn’t a contradiction

At first glance, “stick to the schedule” and “don’t be in a hurry” seem to pull in opposite directions. For Solomon, they work on different timelines: Be disciplined with the hours in a day, and be patient with the arc of a career.

He repeats this message often. In August, he told Goldman’s summer interns at a town hall that taking more time can open up more opportunities, urging them to “try not to be in a hurry and enjoy the ride.” He offered small-business owners the same counsel about AI at the institute’s launch last week, telling them that “the important thing is to get it right, not to get it quicker.”

‘I don’t like to do things halfway’

Solomon’s patience has a limit, and it’s the things he cares about. Asked whether he has any obsessions, he said it depends on what has captured his interest.

“If I’m interested in something, I get very obsessive about it. I don’t like to do things halfway,” Solomon said. When something grabs him, he added, he tends to go deep.

Psychologists have found that kind of intensity cuts both ways. In a 2007 study in the Journal of Personality, Robert Vallerand and colleagues distinguished between “harmonious” passion, an activity you freely choose that fits with the rest of your life, and “obsessive” passion, which feels compulsive. Obsessive passion predicted deliberate practice and mastery-oriented goals, which supported performance. But it was also tied to fear-of-failure goals that undercut results. Harmonious passion delivered the upside with less of the downside.

The takeaway: Going deep can fuel success, as long as the obsession serves you, not the other way around.

Not every passion turns into a career, of course. Solomon also named one ambition he’s had to let go of: playing professional basketball. He conceded that one isn’t on the table.

This story was originally featured on Fortune.com

2026-10-31 10:26:00 · AI应用,OpenAI,Google,Anthropic,Meta,搜索RAG,强化学习,招聘HR,开发者生态
继续滚动加载更多…