What is SGeMM
SGeMM stands for Single-Precision General Matrix Multiplication. Let's analyze matrix multiplication on a CPU and a GPU.
Tushar Gautam
Step 1: Getting Started with CUDA Programming
Parallel matrix multiplication using CUDA C++.
Step 2: GPU Global Memory Coalescing
Memory coalescing is the most crucial concept in GPU programming. With matrix multiplication, we can get upwards of 7x improvement.
Step 3: GPU Shared Memory
Tiled matrix multiplication using GPU shared memory.
Step 4: 1D Thread Coarsening using GPU Registers
Thread registers are used to increase the performance of matrix multiplication by another 4x.