This is a documentation of my notes and code for a conceptual understanding of the CUDA memory model, the CUDA threading model, GPU hardware performance features, modern computer system architecture, and the common data-parallel programming patterns needed to develop a high-performance parallel application.
- CUDA Programming Guide by David B. Kirk/NVIDIA Corporation and Wen-mei Hwu
- How to Optimize a CUDA Matmul Kernel for cuBLAS-like Performance: a Worklog article by Simon Boehm
This Work was done on NVIDIA GeForce RTX 4080, Driver Version: 555.85
CUDA --version cuda_11.8.r11.8/compiler.31833905_0