Henry Clarke If you have been writing GPU kernels in Triton, you already know that performance is not just about writing correct code. It is about writing code that runs fast on the actual hardware. One of the most powerful tools Triton gives you for this is its built-in autotuning system. Triton autotune lets you define multiple … Read more
If you are just getting started with GPU programming, you have probably heard the names Nsight Compute and Nsight Systems thrown around in forums, documentation, and tutorials. Both tools come from NVIDIA and both are used for profiling GPU workloads, but they serve very different purposes. Understanding the difference between Nsight Compute vs Nsight Systems … Read more
If you are running machine learning workloads on a Mac with Apple Silicon, you have probably come across two terms that sound similar but serve different purposes: MPS kernels and MPSGraph. Both are part of Apple’s Metal Performance Shaders framework, both run on the GPU, and both are deeply involved in how frameworks like PyTorch … Read more
If you own a Mac with an M-series chip and want to train or run machine learning models locally, the Apple Silicon PyTorch MPS backend is the feature you need to understand. Introduced with PyTorch 1.12, the Metal Performance Shaders (MPS) backend lets your Mac GPU accelerate deep learning workloads directly, without needing a cloud … Read more
GPU computing is no longer the exclusive territory of CUDA or OpenCL. With the arrival of wgpu, Rust developers now have a safe, cross-platform, and portable way to run massively parallel workloads on the GPU. Whether you are targeting Vulkan on Linux, Metal on macOS, DirectX 12 on Windows, or even WebAssembly in a browser, … Read more
For years, Windows users with AMD graphics cards faced a frustrating wall when trying to do serious machine learning work. NVIDIA’s CUDA ecosystem had long enjoyed native support under Windows Subsystem for Linux 2 (WSL2), while AMD’s ROCm platform remained a Linux-only affair. That gap has been closing steadily. With ROCm 6.1.3, AMD officially declared … Read more
Running deep learning workloads on AMD GPUs has become significantly more practical over the last couple of years. ROCm, which stands for Radeon Open Compute, is AMD’s open-source software platform that allows PyTorch and other frameworks to offload computation to AMD graphics hardware much like CUDA does for NVIDIA cards. Ubuntu 24.04 LTS is now … Read more
The GPU computing landscape has never been more competitive. As NVIDIA’s CUDA continues to dominate AI and HPC workloads, developers building truly cross-platform applications face an important three-way decision: SYCL, OpenCL, or Vulkan Compute. Each of these open, vendor-neutral APIs offers a distinct trade-off between abstraction, performance, portability, and ecosystem maturity. Choosing the wrong one … Read more
Modern data pipelines are under pressure. Datasets that once fit comfortably in memory now span hundreds of gigabytes, and the expectation of near-real-time analytics has never been higher. CPUs, despite decades of optimization, are reaching their practical limits for the kind of massively parallel numerical work that dominates data science today. Two technologies have emerged … Read more
Modern video games deliver stunning graphics and immersive experiences thanks to advanced GPU programming techniques. Game developers today have three major low-level graphics APIs at their disposal: Vulkan, DirectX 12, and Metal. Understanding these technologies is essential for anyone serious about game development in 2026. This comprehensive guide explores how GPU programming for video games … Read more