← All issues

Issue #3 · Wednesday, 21 October 2026

DeepSeek open-sources the inference stack behind V4.1 Flash

DeepSeek ended up in two different stories this week, one about its engineering and one about who is allowed to use it. Meanwhile the money side of AI looked shakier, with enormous compute commitments next to a distressed debt market.

The big one

DeepSeek open-sources DeepInfer, the inference stack behind V4.1 Flash

DeepSeek released DeepInfer under Apache 2.0. It says the framework runs V4.1 Flash in production and supports NVIDIA and Huawei Ascend hardware. The published numbers: 155 trillion tokens a day from one cluster, 96% input-cache hits, 400 ms average time to first token, and $38 revenue per accelerator-hour at off-peak prices. KV-cache management and load balancing are not fully released because they are tied to internal infrastructure. vLLM, which DeepInfer was mainly built on, says it got decode throughput within 6% of DeepInfer's results on GB200 with a matched configuration. That suggests much of the edge may lie in private orchestration rather than the engine.

Sources:github.com,HN discussion,Latent Space

Money and policy

Anthropic and Nscale reportedly near a second $45B compute deal

Bloomberg reports the two companies may soon announce another $45 billion agreement, a little over a month after the first. Talks are continuing and details could change. A leaked S-1 reported by the WSJ shows an $80.7 billion net loss on $16.3 billion revenue in the first half of 2026. It also says AWS, Google and Microsoft increasingly see Anthropic as a competitor, and that Anthropic is struggling to get enough cloud capacity from them. Nscale is pursuing its own IPO but is meeting investor pushback over a proposed $30 billion valuation. Both companies are heading into closer scrutiny.

Sources:TechCrunch,reuters.com,HN discussion,TechCrunch

US orders federal civilian agencies to remove DeepSeek from their systems

A Department of Homeland Security order bars civilian agencies from buying DeepSeek products and requires removal from government IT systems, citing national security concerns tied to the company's operations in China. It also covers third-party products and services built on DeepSeek technology, though agencies can request exceptions. DHS warned that sensitive data from US government users could be accessible to Chinese authorities under Chinese law. China's Foreign Ministry said Beijing opposes politicizing technology and trade issues. A law passed in December 2025 had already limited DeepSeek in intelligence national security systems. If you build on DeepSeek models for government customers, check your exposure.

Sources:reuters.com,HN discussion,TechCrunch

CoreWeave's bonds fall into distressed territory

Investors are now demanding more than 1,000 basis points above government yields on CoreWeave's bonds, and its shares have dropped more than 20 percent in a week. The slide has spilled over to other AI companies and revived talk of an AI private credit bubble. CoreWeave is a major GPU cloud provider, so trouble in its debt is a useful signal for how easily the wider infrastructure buildout can keep raising money. It is worth reading next to the Anthropic numbers above.

Sources:The Verge

Models and research

Nvidia releases open Nemotron 3.5 Super VL and two Bolt models

Nemotron 3.5 Super VL has 120 billion parameters and is aimed at enterprise agents. Nvidia says it matches Nemotron 3 Ultra's accuracy on instruction-following and tool-use tasks with fewer parameters. It also claims that, once post-trained on tasks like document intelligence and financial accounting, it finishes work faster than Anthropic and OpenAI models. Two Bolt models, 74B-A9B and the smaller E4B, target local use on RTX Spark AI PCs and DGX Spark workstations. Super VL and Bolt 74B-A9B are available now, and Bolt E4B arrives later this month. Nvidia lists Skydance, EY, Ramp, Crowdstrike, Perplexity and Salesforce as Super VL users.

Sources:TechCrunch

Goodfire researcher argues neural networks are easier to interpret than thought

Nick Cammarata of Goodfire published a 26,000-word post arguing that LLMs may be far easier to understand, monitor and control than assumed. He says he spent about 10 hours a day, seven days a week, for most of a year examining neurons with new tools and AI agents. Revisiting Inception v1, he now thinks the car-and-cat neuron detects a shared V shape rather than mixing unrelated concepts. Some researchers on X were effusive. Stanford's Chris Potts called it little more than a hunch that makes no problems easier. It is a bet against the superposition picture that has shaped the field since 2020.

Sources:MIT Technology Review

Security

Meta pauses Muse chat sharing after 6,800 conversations turn up in DNS records

Security firm Claroc found more than 6,800 shared Muse conversations by querying public DNS records, and says a single query was enough. Share links used the domain cf.metaaiusercontent.com with the conversation title in the subdomain, which made them discoverable. Exposed content included a loan application, a marketing firm's revenue review and a full-year staff calendar. Claroc says it reported the issue through Meta's bug bounty on October 8 and got no reply. Meta has paused sharing while it reviews the report and considers changes to how links can be discovered. Muse is an agent with access to much of a user's accounts, so privacy lapses matter more here.

Sources:Ars Technica,TechCrunch,The Verge

In brief

Three times a week

The Context Briefing.

The most important AI news, analysis and ideas, briefed and sourced.

We’ll email you once to confirm. Unsubscribe anytime. Privacy