Interview: From CUDA to Tile-Based Programming: NVIDIAs Stephen Jones on Building the Future of AI

NVIDIA's recent software innovations, led by Distinguished Engineer Stephen Jones, focus on advancing CUDA programming through the introduction of tile-based abstraction, known as CUDA Tile. This new approach enables developers to program directly to arrays and tensors rather than managing individual threads, facilitating higher-level optimization and better alignment with evolving hardware architectures such as larger, denser Tensor Cores. By extending CUDA to support array- and tensor-oriented programming, NVIDIA aims to simplify the development process and unlock new performance efficiencies as hardware complexity continues to grow, addressing challenges posed by the slowing of Moore's Law.