2 years ago

GPU maker Nvidia will soon release the next version of the https://developer.nvidia.com/cuda-zone, version 12, to accompany the release of its new GPU architecture code-named Hopper. Jones didn’t provide an exact shipment date for CUDA 12, but past release timeline points to a version 12 available for download either late this year or early next year. Nvidia typically releases a new version of CUDA with every new GPU architecture.

CUDA 12 is specifically tuned to the new GPU architecture called Hopper, which replaces the two-year-old architecture code-named Ampere, which CUDA 11 supported.

Each block runs on a GPU like it’s a separate program, and Hopper can run several thousands of blocks at once.