Triton is a compiler with a Python frontend. The @triton.jit decorator does not decorate a function. It parses the function’s AST, runs it through an MLIR pipeline, and emits a GPU binary. The Pyth...
When you compile a CUDA kernel, the final artifact is a cubin — a CUDA binary. It is a standard ELF64 file with NVIDIA-specific sections that encode everything the CUDA driver needs to load and lau...
A survey of code repository hosting in 2026 Most developers do not think about where their Git repository lives until something goes wrong. An account gets suspended. A DMCA notice takes down a pr...
A review and critical analysis of Niklaus Wirth’s foundational text Over the past decade, I have been thinking about how programming languages evolve and what survives the churn. Languages rise an...
A case study of the B200 pipeline model A note on methodology: Everything in this article is based on my analysis of microbenchmarks executed directly on B200 silicon. Nvidia does not publish i...
When building a dataflow analysis framework in a compiler, you quickly encounter an array of mathematical terms: semilattices, semirings, Kleene algebras, Galois connections, and Knaster-Tarski fix...
Training is gradient descent, and gradient descent needs gradients, so every ML framework has an automatic differentiation engine at its core. What is less obvious is that the representation a fram...
If you train or serve models, you depend on MLIR whether or not you have ever written a line of it. XLA lowers through it, Triton is built on it, Mojo is MLIR-native, and Torch-MLIR, IREE, and ONNX...
Python is a productive orchestration language for inference serving, but it is the wrong tool for the critical path of token generation. Large-model inference is bound by memory bandwidth and by pe...
VLIW (Very Long Instruction Word) spent most of the last two decades as a specialist’s tool. After the commercial struggles of general-purpose VLIW designs, with Intel’s Itanium being the canonical...