The list of prerequisites for running the NVIDIA device plugin is described below: The following steps need to be executed on all your GPU nodes. This README assumes that the NVIDIA drivers and nvidia-docker have been installed. Note that you need to install the nvidia-docker2 package and not the nvidia-container-toolkit.
Example: You will need to enable the nvidia runtime as your default runtime on your node.
Now we are good to go to launch pod and access gpu’s from pods.