Difference between revisions of "GPU Support"

From Open-IOV
Jump to navigation Jump to search
Line 14: Line 14:
!Architecture
!Architecture
!Model
!Model
!Support
![https://www.fsf.org/about/what-is-free-software Libre] Drivers
![https://www.fsf.org/about/what-is-free-software Libre] Drivers
!Blob Drivers
!Blob Drivers
![https://openmdev.io/index.php/Merged_Drivers 'Merged' Host+Guest Acceleration]
![https://openmdev.io/index.php/Merged_Drivers 'Merged' Host+Guest Acceleration]
!Manufacturer Support
![https://openmdev.io/index.php/Virtual_IO_Internals#Mdev_Mode Mdev Support]
![https://openmdev.io/index.php/Virtual_IO_Internals#Mdev_Mode Mdev Support]
![https://openmdev.io/index.php/Virtual_IO_Internals#SR-IOV_Mode SR-IOV Support]
![https://openmdev.io/index.php/Virtual_IO_Internals#SR-IOV_Mode SR-IOV Support]
Line 30: Line 30:
|6th Generation (Skylake)
|6th Generation (Skylake)
|*HD
|*HD
|[https://community.intel.com/t5/Graphics/Graphics-Driver-Support-Update-for-10th-Generation-and-Older/m-p/1403969/thread-id/108899 Legacy]
|i915
|i915
|
|
|Yes
|Yes
|[https://community.intel.com/t5/Graphics/Graphics-Driver-Support-Update-for-10th-Generation-and-Older/m-p/1403969/thread-id/108899 Legacy]
|Yes
|Yes
|No
|No
Line 46: Line 46:
|7th Generation (Kaby Lake)
|7th Generation (Kaby Lake)
|*HD
|*HD
|[https://community.intel.com/t5/Graphics/Graphics-Driver-Support-Update-for-10th-Generation-and-Older/m-p/1403969/thread-id/108899 Legacy]
|i915
|i915
|
|
|Yes
|Yes
|[https://community.intel.com/t5/Graphics/Graphics-Driver-Support-Update-for-10th-Generation-and-Older/m-p/1403969/thread-id/108899 Legacy]
|Yes
|Yes
|No
|No
Line 62: Line 62:
|8th Generation (Coffee Lake)
|8th Generation (Coffee Lake)
|*HD
|*HD
|[https://community.intel.com/t5/Graphics/Graphics-Driver-Support-Update-for-10th-Generation-and-Older/m-p/1403969/thread-id/108899 Legacy]
|i915
|i915
|
|
|Yes
|Yes
|[https://community.intel.com/t5/Graphics/Graphics-Driver-Support-Update-for-10th-Generation-and-Older/m-p/1403969/thread-id/108899 Legacy]
|Yes
|Yes
|No
|No
Line 78: Line 78:
|9th Generation (Cannon Lake)
|9th Generation (Cannon Lake)
|*HD
|*HD
|[https://community.intel.com/t5/Graphics/Graphics-Driver-Support-Update-for-10th-Generation-and-Older/m-p/1403969/thread-id/108899 Legacy]
|i915
|i915
|
|
|Yes
|Yes
|[https://community.intel.com/t5/Graphics/Graphics-Driver-Support-Update-for-10th-Generation-and-Older/m-p/1403969/thread-id/108899 Legacy]
|Yes
|Yes
|No
|No
Line 94: Line 94:
|10th Generation (Ice Lake)
|10th Generation (Ice Lake)
|
|
|[https://community.intel.com/t5/Graphics/Graphics-Driver-Support-Update-for-10th-Generation-and-Older/m-p/1403969/thread-id/108899 Legacy]
|i915
|i915
|
|
|No
|No
|[https://community.intel.com/t5/Graphics/Graphics-Driver-Support-Update-for-10th-Generation-and-Older/m-p/1403969/thread-id/108899 Legacy]
|No
|No
|No
|No
Line 110: Line 110:
|11th Generation (Tiger Lake)
|11th Generation (Tiger Lake)
|Xe*
|Xe*
|Yes
|i915
|i915
|
|
|Yes
|Yes
|Yes
|
|
Line 126: Line 126:
|12th Generation (Alder Lake)
|12th Generation (Alder Lake)
|Xe*
|Xe*
|Yes
|i915
|i915
|
|
|Yes
|Yes
|Yes
|
|
Line 138: Line 138:
|In Development
|In Development
|Yes
|Yes
|-
|Nvidia
|Kepler
|
|[[wikipedia:End-of-life_product|EOL]] (2021)
|[https://nouveau.freedesktop.org/ Nouveau]
|RM
|No
|Yes
|No
|No
|
|No
|No
|No
|No
|-
|-
|Nvidia
|Nvidia
|Maxell
|Maxell
|*(see exceptions below)
|*(see exceptions below)
|Yes
|[https://nouveau.freedesktop.org/ Nouveau], [https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|[https://nouveau.freedesktop.org/ Nouveau], [https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|RM
|RM
|Yes
|Yes
|Yes
|Yes
|Yes
Line 174: Line 158:
|Pascal
|Pascal
|*
|*
|Yes
|[https://nouveau.freedesktop.org/ Nouveau], [https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|[https://nouveau.freedesktop.org/ Nouveau], [https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|RM
|RM
|Yes
|Yes
|Yes
|Yes
|Yes
Line 190: Line 174:
|Turing
|Turing
|*
|*
|Yes
|[https://nouveau.freedesktop.org/ Nouveau], [https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|[https://nouveau.freedesktop.org/ Nouveau], [https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|RM
|RM
|Yes
|Yes
|Yes
|Yes
|Yes
Line 206: Line 190:
|Ampere
|Ampere
|A*
|A*
|Yes
|[https://nouveau.freedesktop.org/ Nouveau] ([https://nouveau.freedesktop.org/FeatureMatrix.html Development]), [https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|[https://nouveau.freedesktop.org/ Nouveau] ([https://nouveau.freedesktop.org/FeatureMatrix.html Development]), [https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|RM
|RM
|No: [https://developer.nvidia.com/displaymodeselector DisplayModeSelector]
|No: [https://developer.nvidia.com/displaymodeselector DisplayModeSelector]
|Yes
|Yes
|Yes
|Yes
|Yes
Line 222: Line 206:
|Ampere
|Ampere
|RTX 30**
|RTX 30**
|Yes
|[https://nouveau.freedesktop.org/ Nouveau] ([https://nouveau.freedesktop.org/FeatureMatrix.html Development]), [https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|[https://nouveau.freedesktop.org/ Nouveau] ([https://nouveau.freedesktop.org/FeatureMatrix.html Development]), [https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|RM
|RM
|In Development
|In Development
|Yes
|Yes
|Yes
|No
|No
Line 238: Line 222:
|Ada Lovelace
|Ada Lovelace
|*
|*
|Yes
|[https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|[https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|
|
|
|
|Yes
|
|
|
|
Line 254: Line 238:
|Hopper
|Hopper
|*
|*
|Yes
|[https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|[https://open-iov.org/index.php/GPU_Driver_Internals#OpenRM OpenRM]
|
|
|
|
|Yes
|
|
|
|
Line 270: Line 254:
|Tonga
|Tonga
|W7100
|W7100
|[[wikipedia:End-of-life_product|EOL]] (2017)
|AMDGPU, [https://github.com/GPUOpen-LibrariesAndSDKs/MxGPU-Virtualization GPU-IOV Module (Deprecated)]
|AMDGPU, [https://github.com/GPUOpen-LibrariesAndSDKs/MxGPU-Virtualization GPU-IOV Module (Deprecated)]
|AMDGPU-Pro
|AMDGPU-Pro
|No
|No
|[[wikipedia:End-of-life_product|EOL]] (2017)
|No
|No
|Yes
|Yes
Line 287: Line 271:
|Tonga
|Tonga
|S71**
|S71**
|[[wikipedia:End-of-life_product|EOL]] (2017)
|AMDGPU, [https://github.com/GPUOpen-LibrariesAndSDKs/MxGPU-Virtualization GPU-IOV Module (Deprecated)]
|AMDGPU, [https://github.com/GPUOpen-LibrariesAndSDKs/MxGPU-Virtualization GPU-IOV Module (Deprecated)]
|AMDGPU-Pro
|AMDGPU-Pro
|No
|No
|[[wikipedia:End-of-life_product|EOL]] (2017)
|No
|No
|Yes
|Yes
Line 303: Line 287:
|Vega
|Vega
|*
|*
|Yes
|AMDGPU
|AMDGPU
|AMDGPU-Pro
|AMDGPU-Pro
|No
|No
|Partial
|Unknown
|Unknown
|Yes
|Yes
Line 319: Line 303:
|Navi
|Navi
|*
|*
|Yes
|AMDGPU
|AMDGPU
|AMDGPU-Pro
|AMDGPU-Pro
|No
|No
|Partial
|Unknown
|Unknown
|Yes
|Yes
Line 419: Line 403:


==== Drivers ====
==== Drivers ====
The open source [https://github.com/GPUOpen-LibrariesAndSDKs/MxGPU-Virtualization GIM driver] supports AMD Tonga architecture GPUs such as the FirePro S7150/W7100. Modern kernel versions require [https://github.com/GPUOpen-LibrariesAndSDKs/MxGPU-Virtualization/pull/24 pull request 24]
The open source [https://github.com/GPUOpen-LibrariesAndSDKs/MxGPU-Virtualization GIM driver] supports AMD Tonga architecture GPUs such as the FirePro S7150/W7100. Modern kernel versions require [https://github.com/GPUOpen-LibrariesAndSDKs/MxGPU-Virtualization/pull/24 pull request 24].
 
The availability of virtualization drivers beyond AMD's Tonga architecture is unclear.

Revision as of 00:00, 6 January 2023

Abstract

The following document will detail GPU Support for SR-IOV, SIOV, and VFIO-Mdev functionality.

Overview

Feature Matrix
Hardware Drivers Virtual I/O Assistance Modes Kernel Userspace
Vendor Architecture Model Libre Drivers Blob Drivers 'Merged' Host+Guest Acceleration Manufacturer Support Mdev Support SR-IOV Support SIOV Support GVM-kernel Support GVM-cli Support GVM-mgr Support LibGVM Support LibVF.IO Support
Intel 6th Generation (Skylake) *HD i915 Yes Legacy Yes No No No No Yes
Intel 7th Generation (Kaby Lake) *HD i915 Yes Legacy Yes No No No No Yes
Intel 8th Generation (Coffee Lake) *HD i915 Yes Legacy Yes No No No No Yes
Intel 9th Generation (Cannon Lake) *HD i915 Yes Legacy Yes No No No No Yes
Intel 10th Generation (Ice Lake) i915 No Legacy No No No No No No
Intel 11th Generation (Tiger Lake) Xe* i915 Yes Yes Yes In Development In Development In Development Yes
Intel 12th Generation (Alder Lake) Xe* i915 Yes Yes Yes In Development In Development In Development In Development Yes
Nvidia Maxell *(see exceptions below) Nouveau, OpenRM RM Yes Yes Yes No No Yes In Development In Development Yes
Nvidia Pascal * Nouveau, OpenRM RM Yes Yes Yes No No Yes In Development In Development Yes
Nvidia Turing * Nouveau, OpenRM RM Yes Yes Yes No No Yes In Development In Development Yes
Nvidia Ampere A* Nouveau (Development), OpenRM RM No: DisplayModeSelector Yes Yes Yes No Yes In Development In Development Yes
Nvidia Ampere RTX 30** Nouveau (Development), OpenRM RM In Development Yes Yes No No In Development In Development In Development In Development
Nvidia Ada Lovelace * OpenRM Yes In Development In Development
Nvidia Hopper * OpenRM Yes In Development In Development
AMD Tonga W7100 AMDGPU, GPU-IOV Module (Deprecated) AMDGPU-Pro No EOL (2017) No Yes

(patched)

No No No Yes
AMD Tonga S71** AMDGPU, GPU-IOV Module (Deprecated) AMDGPU-Pro No EOL (2017) No Yes No No No Yes
AMD Vega * AMDGPU AMDGPU-Pro No Partial Unknown Yes No No No Unknown
AMD Navi * AMDGPU AMDGPU-Pro No Partial Unknown Yes No No No Unknown

Intel

This section will cover Mdev support on Intel GPUs.

Hardware

GPUs supporting GVT-g (software based mediation)[1]:

  • Intel HD Graphics 5500
  • Intel HD Graphics 6000
  • Intel HD Graphics 510
  • Intel HD Graphics 520
  • Intel HD Graphics 530
  • Intel HD Graphics 620
  • Intel HD Graphics 630
  • Intel UHD Graphics 620
  • Intel UHD Graphics 630

GPUs supporting SR-IOV (hardware based mediation):

  • Intel Iris Xe Graphics [2][3]
  • Intel Iris Xe MAX Graphics

Drivers

Drivers with GVT-g support:

Drivers with SR-IOV support:

Nvidia

This section will cover Mdev support on Nvidia GPUs.

Hardware

  • All(?) Volta based GPUs (V-series)
  • All(?) Turing based GPUs (20-series)
  • All(?) Pascal based GPUs (10-series)
  • Most Maxwell based GPUs (9-series) with the following notable exceptions:
    • GTX 970 (mixed FB regions)
    • Quadro M2000 (mixed FB regions)
    • Tesla M40 [4]
  • NVIDIA A100 HGX 80GB
  • NVIDIA A100 PCIe 80GB (SR-IOV: 20VF [5])
  • NVIDIA A100X
  • NVIDIA A100 HGX 40GB
  • NVIDIA A100 PCIe 40GB (SR-IOV: 16VF [6])
  • NVIDIA A40 (SR-IOV: 32VF [7])
  • NVIDIA A30 (SR-IOV: 8VF [8])
  • NVIDIA A30X
  • NVIDIA A16 (SR-IOV: 16VF [9])
  • NVIDIA A10 (SR-IOV: 32VF [10])
  • NVIDIA A2 (SR-IOV: 16VF [11])
  • NVIDIA RTX A6000
  • NVIDIA RTX A5000
  • Quadro RTX 8000 (SR-IOV: 24 VF [12])
  • Quadro RTX 8000 passive
  • Quadro RTX 6000 (SR-IOV: 24 VF [13])
  • Quadro RTX 6000 passive
  • Tesla V100
  • Tesla T4 (SR-IOV: 16VF [14])
  • Tesla P100
  • Tesla P40
  • Tesla P6
  • Tesla P4
  • Tesla M60
  • Tesla M10
  • Tesla M6
  • GRID K2 (Citrix XenServer and VMware ESXi only)
  • GRID K1 (Citrix XenServer and VMware ESXi only)

Drivers

The most widely used method of enabling Mdev functionality on Nvidia GPUs is via the use of Nvidia's proprietary driver package.

Nvidia's proprietary Mdev driver supports both SR-IOV as well as software based mediation. The appropriate mode is chosen between the two methods based on hardware architecture.

AMD

This section will cover Mdev support on AMD GPUs.

Hardware

Supported GPUs:

  • AMD FirePro S7150
  • AMD Radeon Pro V520 [15]
  • AMD FirePro W7100 [15]

Drivers

The open source GIM driver supports AMD Tonga architecture GPUs such as the FirePro S7150/W7100. Modern kernel versions require pull request 24.

The availability of virtualization drivers beyond AMD's Tonga architecture is unclear.