AI Crispy Talks

AI news for 2026-10-24

next day → ← previous day
23:14
The release underscores how much engineering attention now goes to the unglamorous middle of the RAG stack — retrieval quality often matters more than the LLM sitting on top. Calibrated scores are arguably the most interesting part: if relevance outputs are truly comparable across queries, downstream systems can automate routing and filtering instead of hand-tuning thresholds. The 82.2 on BRIGHT is a solid number, though readers should note that benchmark targets reasoning-heavy retrieval, so it favors models that actually parse the query rather than match keywords. At $0.05 per 1M tokens, Cohere is clearly pricing for enterprise volume — the reranker layer is quietly turning into a real competitive front.
Cohere Releases Rerank 5 With Passage-Level Context Focus and Calibrated Scores Cohere Rerank 5 ships in Pro and Fast tiers with a 32K context window, Context Focus passage extraction and calibrated relevance scores. Pro scores 82.2 on BRIGHT and costs $0.05 per 1M tokens. The post Cohere Releases Rerank 5 With Passage-Level Context Focus and Cali…
21:34
The striking part isn't the low share of companies reporting returns — it's that most CEOs keep raising budgets anyway. That's conviction-driven spending, and history suggests it can outlast skepticism for years: enterprises sank money into cloud and ERP long before measurable payoffs appeared. Worth noting, though, that CIO surveys systematically undercount value that arrives as avoided costs or faster cycles rather than new revenue lines. The real test comes at the next budget season: if returns stay invisible, expect the corporate mood to flip from 'spend more' to 'prove it' rather abruptly. This dataset will be quoted in every AI-bubble debate for months.
Only 13 percent of companies see real returns from AI, Gartner survey finds Only 13 percent of companies are getting real business value from their AI investments, according to a Gartner survey of 2,002 CIOs. At the same time, 51 percent expect AI to actually increase their operating costs. Yet 75 percent of CEOs plan to keep raising their technol…
20:04
Grady is pointing at one of AI's most credible promises: closing the expertise gap between elite cancer centers and community oncology. On the merits, we agree — diagnostic support is where models already show measurable clinical value, not just chatbot novelty. But 'MSK-caliber' is a high bar to claim: prospective validation, regulatory clearance and clinician trust matter far more than demo-day accuracy numbers. It's also telling when a Sequoia partner flags a vertical like this — it signals where smart money sees durable moats, namely regulated, data-rich domains where generic AI tools can't simply walk in. Expect more capital chasing clinical AI through 2026.
MSK-caliber cancer diagnostics for every oncologist… very cool use of AI
18:27
The model itself is a modest entry — a 40B MoE for local coding won't trouble frontier labs — but the real claim here is the process, not the product. Automated architecture search isn't new; NAS-style methods have existed for years, so the interesting question is whether Eureka Machine finds designs humans would miss, not just faster iterations. The Decoder is right to flag the gap: one model built with AI assistance is far from demonstrated self-improvement. Still, if Recursive can show Eureka-driven designs beating human-crafted baselines at equal compute, that would be a meaningful data point for the 'AI does AI research' thesis. For now, treat it as a promising experiment wrapped in ambitious framing — benchmarks will tell.
Recursive shows first result of its AI-driven research process with Flint The AI startup Recursive is unveiling Flint, its first language model, a 40-billion-parameter MoE for local coding developed by former DeepMind researchers. It was created in four months using the company's in-house AI system, "Eureka Machine," which independently tests and …
16:47
Podcast promos are usually filler, but this guest pick is well chosen: few people have CrowdStrike's frontline visibility into how attackers actually weaponize AI, so Kurtz's read on the threat landscape carries real weight. The open-vs-closed weights debate viewed through a defender's lens is underrated — that argument usually plays out among labs, not among the teams responding to live breaches. If the episode genuinely digs into supply-chain risks around open model hubs, it could be one of the more practical AI-security conversations of the month. Worth a listen if you care about where agentic attack tooling is heading.
Today’s @NoPriorsPod guest is a cybersecurity legend. @George_Kurtz founder/ceo of @CrowdStrike. Topics: - ai for attackers - is the internet going to fall down - closed/open weight models - huggingface attack - crowdstrike’s ai training effort - near term state of security world https://t.co/XfxFR6blS9
15:25
Edwards is pushing a thesis that increasingly looks correct: AI's binding constraints have migrated from software to the physical layer — power, cooling, memory and packaging are now the real ceilings. The week he describes, from a Nadella meeting to a GTC panel slot, suggests hyperscalers and NVIDIA treat materials as strategic, not niche. There's an elegant loop here — using AI to design the very materials AI infrastructure needs — though note the messenger: a materials-AI founder naturally frames materials as the bottleneck. The hard part remains lab-to-fab: discovering a material in simulation is one thing, manufacturing it at datacenter scale is another. Still, as compute demand outruns energy supply, expect materials startups to attract serious capital.
Two years ago materials barely existed in the context of AI. This week: Met with @satyanadella in London. Spoke at @nvidia GTC in Berlin to a packed room for a AI for materials panel. AI itself, is now limited by physical things. Power, cooling, packaging, memory. All materials problems, and the ones we’re working on at @cusp_ai .
13:53
Feldman is framing Cerebras' pitch around the two metrics that actually decide the inference market: latency and cost per token. The pledge to double speed every year is bold — it implies a steeper curve than Moore's law ever delivered — and it is only plausible because the wafer-scale architecture still has headroom that conventional GPUs lack. The harder question is whether token economics can beat an incumbent that keeps moving too; speed records mean little if NVIDIA's ecosystem stays cheaper per unit of work. The data center buildout also signals a shift from chip vendor to infrastructure player, which brings capital intensity Cerebras has not fully been tested on. Worth watching whether next year's targets come with named customers and public benchmarks rather than just momentum claims.
Last week, I caught up with Cheddar TV’s Justine Miller during @TechCrunch Disrupt. We talked through what the future holds for Cerebras. This year, we doubled our speed. That’s something for the team to be proud of. Still, a few things on my mind for next year: - Building more data centers - Deploying vastly more equipment in them - Driving do…
12:26
This is not hype: autonomous offensive AI has crossed from red-team demos into live criminal infrastructure, and Symantec's report is one of the first documented cases. The nastiest part is the economics — victims effectively fund their own attacks, which removes the main cost barrier for threat actors. It also exposes an industry hygiene failure: any unauthenticated inference endpoint is now a free drone for someone else's botnet. Expect hardened defaults, spend caps, and agent sandboxing to become standard rather than optional extras. For anyone deploying models publicly, the message is simple — treat your API like an internet-facing server, because attackers already do.
An AI agent in "Skynet mode" hijacks unprotected language models to launch self-sustaining cyberattacks Security researchers at Symantec have found an offensive AI agent that hijacks unprotected language models on the web and uses them to attack servers, steal databases, and install cryptominers on its own. It runs up to 100,000 steps without huma…
10:48
The always-on agent is now officially the next front in the platform wars, and Anthropic arriving with a credible entry confirms this is no longer a niche experiment. The approval-gate design stands out to us — requiring confirmation before payments is exactly the trust architecture enterprises will demand before letting agents loose on inboxes and finances. Six thousand connectors is a serious integration play; plumbing and distribution, not raw model quality, may decide who wins this category. The open question is whether users actually want proactive agents — notification fatigue and unpredictable compute costs could sink the whole premise. It also marks Anthropic's shift from model lab to product company, a direct consumer collision with OpenAI. Reliability outside demos will be the real test.
Anthropic takes on Grok Bot, Meta's Muse, and OpenAI's Dots with its always-on agent "Claude Duet" Anthropic has launched Claude Duet, a proactive AI agent that handles tasks on its own, even when the user is offline. The app is built on Claude Opus 5.5 and connects to services like Gmail, Slack, and Stripe through more than 6,000 connectors. It a…
09:08
Max Spero drops a sweeping claim with zero receipts — no data, no survey, just a confident one-liner. Still, it gestures at a real pattern worth taking seriously: Gen Z's AI adoption is strikingly lopsided, with ChatGPT acting as a default consumer tool while most AI products struggle for daily-use loyalty. The open question is whether that attachment survives as usage shifts toward agents embedded in apps young people already live in. As a quip it lands; as analysis it's thin, and we'd want actual numbers before repeating it.
This is the only AI that Gen Z likes btw
08:52
IBM's speech team keeps quietly outperforming its own hype cycle: a 2B model landing near the top of the Open ASR Leaderboard shows that in ASR, smart architecture often beats raw scale. The Apache 2.0 license is the real strategic weapon here — enterprises can embed it in call-center and voice-agent pipelines without legal friction, which not every open model allows. That said, benchmark WER is only half the story; robustness to accents, noise and code-switching is where production systems live or die. Still, for the open speech stack this is a genuine consolidation moment, and we'd expect Granite Speech to surface in plenty of on-device and enterprise deployments soon.
IBM AI Releases Granite Speech 5.0 2B for Multilingual Transcription and Translation IBM released Granite Speech 5.0 2B, an Apache 2.0 speech recognition and translation model. It ranks #2 on the Open ASR Leaderboard with 5.68% average English WER, alongside updated Turbo CTC and 4.1 2B Plus models. The post IBM AI Releases Granite Speech 5.0 2B f…
07:19
Masley is right that epistemic humility is in short supply in AI discourse — four years is a tiny sample when the underlying systems keep shifting every quarter. In our view the complaint cuts both ways: it should temper confident doom narratives exactly as much as confident utopian ones, and it rarely does. The deeper driver is incentives — bold claims about what AI 'really is' travel far on social media, while 'we don't know yet' earns nothing. That said, refusing to hold any working model of the technology can become its own evasion; provisional answers are fine as long as nobody mistakes them for final ones.
I'm so tired of people talking as if there's a clear final answer to what AI's about when we're about 4 years into the current era with it. The answer isn't going to vibe its way into view.
05:47
The real headline here is the collapse of the teacher-student split into a single model — a step toward self-improving post-training pipelines the field has been circling for a while. Matching GRPO, now the de facto RL baseline, at 6.5x fewer processed tokens is a meaningful efficiency claim, but a single MATH result is thin proof: math is the friendliest domain for RL gains, and transfer to code, agents and instruction-following is the actual test. If it holds at scale, the strategic upside is real — RL compute is concentrated in a handful of labs, and token efficiency is precisely the lever that lets smaller players afford serious post-training. Perplexity doing core training research alongside NVIDIA also signals the search company moving up the stack. Promising, but we'd wait for independent replication and broader benchmarks before calling it a breakthrough.
Perplexity and NVIDIA Researchers Introduce JOLT: a Joint Teacher-Student Reinforcement Learning Method Perplexity and NVIDIA introduced JOLT, a post-training method that trains one model as both teacher and student. On MATH it matched GRPO’s accuracy with 6.5x fewer processed training tokens. The post Perplexity and NVIDIA Researchers Introduce J…
04:16
Sarah Guo is pointing at a real inflection: the CVE spike she cites coincides with AI-assisted code flooding production, and agents will only widen the gap between what we ship and what we can secure. Her framing — outpacing both attackers and our own agent-generated bugs — is correct, because security was always an arms race and AI just changed its tempo. What the post understates is incentives: nobody gets paid to patch decades of legacy software, so 'fixing 50 years of sloppiness' will likely require regulatory or procurement pressure, not goodwill. For founders, this doubles as a market signal — security tooling built for agent-era code review looks like one of the hottest categories ahead. Take it seriously; this isn't alarmism.
1/ pretty bad out there. We have to fix the last 50 years of software and internet sloppiness. Faster than adversaries can find the holes, and faster than we ship new ones (with agents!). CVEs went from ~4k a month to ~15k since April. That is not business as usual.
02:44
The notable part here is not the head-to-head score itself but what it signals: speech recognition is shrinking to the point where a 16.9 MB model can handle streaming ASR and even direct speech-to-tool calls on a plain CPU. That matters for voice agents on phones and embedded hardware, where latency and power budget beat raw accuracy. Still, readers should take the comparison with some caution — Whisper Base is a fairly modest baseline, and clean-benchmark WER rarely survives noisy rooms, accents, and far-field audio. In our view, the speech-to-tool-call angle is the most telling detail: skipping the text intermediate is exactly where on-device voice assistants are heading, and benchmarks like this hint that the edge-AI stack is maturing faster than most expected.
A Coding Guide to Cactus Whistle: Does a 16.9 MB Speech Model Hold Up Against Whisper Base? Word Error Rate, Speed, Streaming, Timestamps, Keywords, and Speech-to-Tool Calls on a CPU Explore a comprehensive coding guide benchmarking Cactus Compute's 16.9 MB speech model against Whisper base. Learn about word error rates, CPU speed, streaming laten…
01:21
The interesting part here is not the 40B figure but the 2.5B active parameters — sparse MoE is what makes large weights practical on a laptop, and 125 tok/s on an M4 Pro is genuinely usable speed for agentic coding loops. If the 74.2% on SWE-bench Verified survives independent replication, local coding agents stop being a demo and become a real workflow option. Apache 2.0 licensing also removes the last excuse for enterprises that want coding help without shipping proprietary code to a cloud. Caveats apply: vendor-reported benchmarks with custom scaffolding deserve skepticism, and 'for agents' tuning is only as good as the harness around it. Still, this is exactly the segment — open-weight, efficient, specialized — where smaller labs can outmaneuver the giants.
Recursive Releases Flint, an Open-Weight 40B MoE Local Coding Model for Agents with 2.5B Active Params Recursive has released Flint, an Apache 2.0 local coding model with 40B total and 2.5B active parameters. It reports 74.2% on SWE-bench Verified and 125+ tokens per second on an M4 Pro MacBook Pro. The post Recursive Releases Flint, an Open-Weigh…