Step 4: 1D Thread Coarsening using GPU Registers
Thread registers are used to increase the performance of matrix multiplication by another 4x.
GPU Accelerated Matrix Multiplication
Learn CUDA C/C++ basics by working on a single application: matrix multiplication. To make things interesting, let us try to match the performance of NVIDIA cuBLAS.
Step 5: 2D Thread Coarsening using GPU Registers
Using even more registers, I got another 2x jump in performance.
Step 6: Vectorized Memory Accesses
Using vectorization to move multiple elements in parallel using a single thread.