#compilers

12 stories · 2 in 7 days · 7 in 30 days
Stories, products and papers tagged "compilers", newest first.
Nov 13
PapersBuildersMulti-sourceSelected10:28
Together Compiler Hits 2.6x Speedups on Frontier Model Inference

An agent loop that continuously recompiles inference engines against live traffic could shift how serving providers keep pace with rapidly changing model architectures, replacing static hand-tuned kernels. Teams running inference infrastructure or building MoE serving stacks can study the tiered persistent engine design and context-management ablations for their own optimizer setups. The results also benchmark directly against open source engines on Chinese frontier models like DeepSeek v4.1 Flash and Kimi K3, a useful comparison point when evaluating serving providers.

Event
arXiv: DeepSeek@Reyna Abhyankar et al. (12)Source
Nov 11
ProductsBuildersOfficialSelected01:39
Meta Open-Sources TLX, a GPU Compiler Extension for Production ML

TLX shows how Meta handles the gap between Triton's abstractions and new GPU features, an approach OpenAI's Triton team and AMD's compiler efforts have not taken in the same form. Practitioners writing kernels for RecSys or LLM pretraining can adopt cluster and warp-group controls without rewriting in CUDA. Teams benchmarking Triton against vendor-specific alternatives will find the orchestration primitives directly comparable in real training and inference pipelines.

Event
Primary sourceMeta Engineering BlogSource
Nov 6
ProductsBuildersSelected00:47
Together AI Launches Together Compiler for Polymorphic Inference

Automated compilation that replaces weeks of per-chip hand tuning could lower inference costs for anyone serving open models without a dedicated kernel team. Teams running self-hosted inference should evaluate whether the overnight optimization workflow fits their stack, especially against vLLM- and SGLang-based serving setups. Pricing and regional availability were not disclosed in the announcement.

Official accountTogether AI@togethercomputeSource
Nov 3
PapersBuildersSelected22:12
Google deploys agent swarms to fix TPU compiler bugs

Silent miscompilations are a class of failure most teams only discover after a training run collapses, and this paper shows agents can be steered past flashy crash bugs toward that higher-value target. It is also an honest cost account: human review load, not agent capability, became the bottleneck. Practitioners running large-scale training on TPUs can read the bisection pipeline details on arXiv (2611.00624) and consider similar fuzzing setups for their own compilers.

elvis@omarsar0Source
Oct 21
PapersBuildersSelected03:05
PyTorch-to-Spyre compiler pipeline explained by IBM team

The piece reveals the intermediate compiler layers most accelerator benchmarks hide: KTIR and the Dataflow Scheduler sit between Inductor and the hardware, shaping how tiling and memory placement decisions actually execute. Engineers compiling PyTorch for non-GPU accelerators, or evaluating Spyre for inference stacks, get a concrete map of the software path their models take. It also shows how IBM leans on PyTorch's open source compiler stack rather than a proprietary frontend.

Official accountPyTorch@PyTorchSource
Oct 20
Oct 9
How-toBuildersMulti-sourceSelected10:11
tsc-rs Rust TypeScript Compiler

This Rust implementation offers significant performance improvements over existing TypeScript compilers while maintaining full compatibility. Developers working with TypeScript can now use tsc-rs as a drop-in replacement for faster builds and type checking. The project demonstrates the practical benefits of rewriting performance-critical tools in Rust, potentially influencing future compiler development in the TypeScript ecosystem.

Event
shao__meng@shao__mengSource
Sep 2
Aug 12
Jun 19
Jun 9