#AI chips

610 stories · 85 in 7 days · 237 in 30 days
Oct 21
IndustryUS vs ChinaMulti-sourceSelected71°16:11
Groq plans DRAM-stacked inference chip to fix SRAM capacity

The bonding method determines the outcome: 3DS adds capacity at DRAM speeds, while hybrid bonding delivers bandwidth much closer to SRAM, deciding how few chips are needed to serve large models fast. Inference infrastructure teams evaluating Groq-class LPUs versus Nvidia GPUs, and anyone tracking Cerebras, which plans DRAM stacking on its CS-6 wafer, should watch which route ships first. Capacity, not bandwidth, is emerging as the binding constraint across SRAM-first architectures.

Event
rohanpaul_ai@rohanpaul_aiSource
ProductsBuildersSelected01:26
General Compute partners with Positron to offer Atlas inference systems

The arrangement signals a shift toward inference-specialized silicon being rented through cloud intermediaries rather than purchased, lowering the entry barrier for AI companies testing alternatives to Nvidia GPUs. Teams running high-volume token generation can compare Atlas's memory-first design against GPU-only stacks via General Compute or Oracle Cloud Infrastructure. The Titan commitment also hints at a multi-generation roadmap for custom inference hardware.

TestingCatalog@testingcatalogSource
IndustryBuildersSelected01:07
General Compute pairs GPUs with Positron chips for split inference

Specialising silicon per inference phase sidesteps the compromise a single chip type must make, and avoiding HBM removes exposure to the tightest supply constraint in AI hardware. Teams running high-volume generation workloads can compare this two-chip endpoint against all-GPU serving on cost and tokens-per-second. It also signals a broader shift toward heterogeneous inference stacks that infrastructure buyers should track.

rohanpaul_ai@rohanpaul_aiSource
Oct 20
Oct 19
Oct 18
Oct 17
Oct 16
Oct 15
Oct 14
IndustrySelected16:02
Pat Gelsinger Calls HBM "Terrible Memory" for AI Workloads

The critique reframes HBM less as a solved standard than a stopgap, which matters as hyperscalers weigh custom ASICs and alternative memory architectures. Chip designers, AI infrastructure buyers and memory investors can use his shoreline-bandwidth argument to stress-test vendor roadmaps around HBM4. The thermal ceiling near 30 watts per stack gives a concrete threshold for evaluating next-gen accelerator designs.

Event
IT之家Source
Oct 13
Oct 12
ProductsUS vs ChinaMulti-sourceSelected23:56
Microsoft Maia 300 AI Chip Uses Chiplet Architecture for 7x Tokens

The 7x token gain over Maia 200 shows Microsoft is closing the efficiency gap with Nvidia GPUs on its own cloud stack, which could eventually lower inference costs for Azure-hosted models used across Southeast Asia. Developers and enterprises running long-context or reasoning workloads on Azure should watch which regions and services get Maia 300 capacity first.

Event
Blognone@mkSource