Virtual I/O Internals - Revision history

Arthur: /* References (Talks & Reading Material) */

2023-06-19T17:54:32Z

References (Talks & Reading Material)

← Older revision		Revision as of 17:54, 19 June 2023
Line 621:		Line 621:
	#[https://sdic.sjtu.edu.cn/wp-content/uploads/2019/12/Mediated-Pass-Through-MPT-NVIDIA-vGPU.pptx Dynamic Mediation for Live Migration VFIO-PCI]		#[https://sdic.sjtu.edu.cn/wp-content/uploads/2019/12/Mediated-Pass-Through-MPT-NVIDIA-vGPU.pptx Dynamic Mediation for Live Migration VFIO-PCI]
	#[https://lwn.net/Articles/746127/ DRM Management Via CGroups]		#[https://lwn.net/Articles/746127/ DRM Management Via CGroups]
			#[https://lwn.net/Articles/292583/ DRM: Add GEM ("graphics execution manager") to i915 driver.]

Arthur at 17:52, 19 June 2023

2023-06-19T17:52:39Z

← Older revision		Revision as of 17:52, 19 June 2023
Line 620:		Line 620:
	#[https://yewtu.be/watch?v=haes4_Xnc5Q <nowiki>[2020] Getting pixels on screen: introduction to Kernel Mode Setting (KMS) by Simon Ser</nowiki>] - [https://fs.emersion.fr/protected/presentations/present.html?src=kms-foss-north/index.md#1 slides]		#[https://yewtu.be/watch?v=haes4_Xnc5Q <nowiki>[2020] Getting pixels on screen: introduction to Kernel Mode Setting (KMS) by Simon Ser</nowiki>] - [https://fs.emersion.fr/protected/presentations/present.html?src=kms-foss-north/index.md#1 slides]
	#[https://sdic.sjtu.edu.cn/wp-content/uploads/2019/12/Mediated-Pass-Through-MPT-NVIDIA-vGPU.pptx Dynamic Mediation for Live Migration VFIO-PCI]		#[https://sdic.sjtu.edu.cn/wp-content/uploads/2019/12/Mediated-Pass-Through-MPT-NVIDIA-vGPU.pptx Dynamic Mediation for Live Migration VFIO-PCI]
			#[https://lwn.net/Articles/746127/ DRM Management Via CGroups]

Arthur at 17:02, 12 June 2023

2023-06-12T17:02:36Z

← Older revision		Revision as of 17:02, 12 June 2023
Line 619:		Line 619:
	#[https://openglbook.com/chapter-0-preface-what-is-opengl.html openglbook.com: What is OpenGL?]		#[https://openglbook.com/chapter-0-preface-what-is-opengl.html openglbook.com: What is OpenGL?]
	#[https://yewtu.be/watch?v=haes4_Xnc5Q <nowiki>[2020] Getting pixels on screen: introduction to Kernel Mode Setting (KMS) by Simon Ser</nowiki>] - [https://fs.emersion.fr/protected/presentations/present.html?src=kms-foss-north/index.md#1 slides]		#[https://yewtu.be/watch?v=haes4_Xnc5Q <nowiki>[2020] Getting pixels on screen: introduction to Kernel Mode Setting (KMS) by Simon Ser</nowiki>] - [https://fs.emersion.fr/protected/presentations/present.html?src=kms-foss-north/index.md#1 slides]
			#[https://sdic.sjtu.edu.cn/wp-content/uploads/2019/12/Mediated-Pass-Through-MPT-NVIDIA-vGPU.pptx Dynamic Mediation for Live Migration VFIO-PCI]

Arthur: /* References (Talks & Reading Material) */

2023-05-22T21:20:20Z

References (Talks & Reading Material)

← Older revision		Revision as of 21:20, 22 May 2023
Line 618:		Line 618:
	#[https://docs.kernel.org/PCI/index.html docs.kernel.org: PCI Bus Subsystem]		#[https://docs.kernel.org/PCI/index.html docs.kernel.org: PCI Bus Subsystem]
	#[https://openglbook.com/chapter-0-preface-what-is-opengl.html openglbook.com: What is OpenGL?]		#[https://openglbook.com/chapter-0-preface-what-is-opengl.html openglbook.com: What is OpenGL?]
	#[https://yewtu.be/watch?v=haes4_Xnc5Q <nowiki>[2020] Getting pixels on screen: introduction to Kernel Mode Setting (KMS) by Simon Ser</nowiki>]		#[https://yewtu.be/watch?v=haes4_Xnc5Q <nowiki>[2020] Getting pixels on screen: introduction to Kernel Mode Setting (KMS) by Simon Ser</nowiki>] - [https://fs.emersion.fr/protected/presentations/present.html?src=kms-foss-north/index.md#1 slides]

Arthur: /* References (Talks & Reading Material) */

2023-05-22T16:28:00Z

References (Talks & Reading Material)

← Older revision		Revision as of 16:28, 22 May 2023
Line 618:		Line 618:
	#[https://docs.kernel.org/PCI/index.html docs.kernel.org: PCI Bus Subsystem]		#[https://docs.kernel.org/PCI/index.html docs.kernel.org: PCI Bus Subsystem]
	#[https://openglbook.com/chapter-0-preface-what-is-opengl.html openglbook.com: What is OpenGL?]		#[https://openglbook.com/chapter-0-preface-what-is-opengl.html openglbook.com: What is OpenGL?]
			#[https://yewtu.be/watch?v=haes4_Xnc5Q <nowiki>[2020] Getting pixels on screen: introduction to Kernel Mode Setting (KMS) by Simon Ser</nowiki>]

Arthur: /* References (Talks & Reading Material) */

2023-05-05T20:54:27Z

References (Talks & Reading Material)

← Older revision		Revision as of 20:54, 5 May 2023
Line 617:		Line 617:
	#[https://docs.kernel.org/gpu/drm-mm.html docs.kernel.org: DRM Memory Management]		#[https://docs.kernel.org/gpu/drm-mm.html docs.kernel.org: DRM Memory Management]
	#[https://docs.kernel.org/PCI/index.html docs.kernel.org: PCI Bus Subsystem]		#[https://docs.kernel.org/PCI/index.html docs.kernel.org: PCI Bus Subsystem]
			#[https://openglbook.com/chapter-0-preface-what-is-opengl.html openglbook.com: What is OpenGL?]

Arthur: /* References (Talks & Reading Material) */

2023-04-05T23:31:35Z

References (Talks & Reading Material)

← Older revision		Revision as of 23:31, 5 April 2023
Line 615:		Line 615:
	#[https://www.usenix.org/conference/atc14/technical-sessions/presentation/tian A Full GPU Virtualization Solution with Mediated Pass-Through by Yiying Zhang, David Cowperthwaite, Kun Tian, and Yaozu Dong] - [https://www.usenix.org/system/files/conference/atc14/atc14-paper-tian.pdf <nowiki>[Paper]</nowiki>] - [https://www.youtube.com/watch?v=vvYmDQKZ6MQ <nowiki>[Video]</nowiki>] - [https://www.usenix.org/sites/default/files/conference/protected-files/atc14_slides_tian.pdf <nowiki>[Slides 1]</nowiki>] - [https://cseweb.ucsd.edu/~yiying/cse291j-winter20/reading/GPU-Virtualization.pdf <nowiki>[Slides 2]</nowiki>]		#[https://www.usenix.org/conference/atc14/technical-sessions/presentation/tian A Full GPU Virtualization Solution with Mediated Pass-Through by Yiying Zhang, David Cowperthwaite, Kun Tian, and Yaozu Dong] - [https://www.usenix.org/system/files/conference/atc14/atc14-paper-tian.pdf <nowiki>[Paper]</nowiki>] - [https://www.youtube.com/watch?v=vvYmDQKZ6MQ <nowiki>[Video]</nowiki>] - [https://www.usenix.org/sites/default/files/conference/protected-files/atc14_slides_tian.pdf <nowiki>[Slides 1]</nowiki>] - [https://cseweb.ucsd.edu/~yiying/cse291j-winter20/reading/GPU-Virtualization.pdf <nowiki>[Slides 2]</nowiki>]
	#[https://www.youtube.com/watch?v=-iuIu7_GuEo <nowiki>[2014] KvmGT: A Full GPU Virtualization Solution by Jike Song</nowiki>]		#[https://www.youtube.com/watch?v=-iuIu7_GuEo <nowiki>[2014] KvmGT: A Full GPU Virtualization Solution by Jike Song</nowiki>]
	#[https://docs.kernel.org/gpu/drm-mm.html ~~Kernel~~.org: DRM Memory Management]		#[https://docs.kernel.org/gpu/drm-mm.html docs.kernel.org: DRM Memory Management]
			#[https://docs.kernel.org/PCI/index.html docs.kernel.org: PCI Bus Subsystem]

Arthur: /* References (Talks & Reading Material) */

2023-03-28T19:50:00Z

References (Talks & Reading Material)

← Older revision		Revision as of 19:50, 28 March 2023
Line 615:		Line 615:
	#[https://www.usenix.org/conference/atc14/technical-sessions/presentation/tian A Full GPU Virtualization Solution with Mediated Pass-Through by Yiying Zhang, David Cowperthwaite, Kun Tian, and Yaozu Dong] - [https://www.usenix.org/system/files/conference/atc14/atc14-paper-tian.pdf <nowiki>[Paper]</nowiki>] - [https://www.youtube.com/watch?v=vvYmDQKZ6MQ <nowiki>[Video]</nowiki>] - [https://www.usenix.org/sites/default/files/conference/protected-files/atc14_slides_tian.pdf <nowiki>[Slides 1]</nowiki>] - [https://cseweb.ucsd.edu/~yiying/cse291j-winter20/reading/GPU-Virtualization.pdf <nowiki>[Slides 2]</nowiki>]		#[https://www.usenix.org/conference/atc14/technical-sessions/presentation/tian A Full GPU Virtualization Solution with Mediated Pass-Through by Yiying Zhang, David Cowperthwaite, Kun Tian, and Yaozu Dong] - [https://www.usenix.org/system/files/conference/atc14/atc14-paper-tian.pdf <nowiki>[Paper]</nowiki>] - [https://www.youtube.com/watch?v=vvYmDQKZ6MQ <nowiki>[Video]</nowiki>] - [https://www.usenix.org/sites/default/files/conference/protected-files/atc14_slides_tian.pdf <nowiki>[Slides 1]</nowiki>] - [https://cseweb.ucsd.edu/~yiying/cse291j-winter20/reading/GPU-Virtualization.pdf <nowiki>[Slides 2]</nowiki>]
	#[https://www.youtube.com/watch?v=-iuIu7_GuEo <nowiki>[2014] KvmGT: A Full GPU Virtualization Solution by Jike Song</nowiki>]		#[https://www.youtube.com/watch?v=-iuIu7_GuEo <nowiki>[2014] KvmGT: A Full GPU Virtualization Solution by Jike Song</nowiki>]
			#[https://docs.kernel.org/gpu/drm-mm.html Kernel.org: DRM Memory Management]

Arthur: /* Instruction Execution */

2023-03-27T19:08:34Z

Instruction Execution

← Older revision		Revision as of 19:08, 27 March 2023
Line 388:		Line 388:
	===Instruction Execution===		===Instruction Execution===
	[[File:Ioeventfd-and-irqfd.png\|thumb\| '''Figure 13:''' A simple diagram of signalling from host to guest (via irqfd) & guest to host (via ioeventfd) From [http://blog.allenx.org/2015/07/05/kvm-irqfd-and-ioeventfd blog.allenx]]]		[[File:Ioeventfd-and-irqfd.png\|thumb\| '''Figure 13:''' A simple diagram of signalling from host to guest (via irqfd) & guest to host (via ioeventfd) From [http://blog.allenx.org/2015/07/05/kvm-irqfd-and-ioeventfd blog.allenx]]]
	'''Figure 13:''' ~~RPC~~ Mode moves instruction information across a virtual function (VF) device using [https://infogalactic.com/info/Remote_procedure_call Remote Procedure Calls] generally by way of [https://infogalactic.com/info/Interrupt software interrupt] ([https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/driver-core.git/tree/Documentation/driver-api/ioctl.rst IOCTL]). Signals to and from the guest and the host GPU driver may be passed over file descriptors such as the [https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=721eecbf4fe995ca94a9edec0c9843b1cc0eaaf3 Interrupt Request File Descriptor (irqfd)] and [https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=d34e6b175e61821026893ec5298cc8e7558df43a IO Event File Descriptor (ioeventfd)].		'''Figure 13:''' Mdev Mode moves instruction information across a virtual function (VF) device using [https://infogalactic.com/info/Remote_procedure_call Remote Procedure Calls] generally by way of [https://infogalactic.com/info/Interrupt software interrupt] ([https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/driver-core.git/tree/Documentation/driver-api/ioctl.rst IOCTL]). Signals to and from the guest and the host GPU driver may be passed over file descriptors such as the [https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=721eecbf4fe995ca94a9edec0c9843b1cc0eaaf3 Interrupt Request File Descriptor (irqfd)] and [https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=d34e6b175e61821026893ec5298cc8e7558df43a IO Event File Descriptor (ioeventfd)].
	The irqfd may be used to signal from the host into the guest whereas the ioeventfd may be used to signal from the guest into the host. Guest GPU instructions which would normally serialize as pRPCs (physical Remote Procedure Calls) are instead serialized from the guest as vRPCs (virtual Remote Procedure Calls) which are executed by the host mediated driver.		The irqfd may be used to signal from the host into the guest whereas the ioeventfd may be used to signal from the guest into the host. Guest GPU instructions which would normally serialize as pRPCs (physical Remote Procedure Calls) are instead serialized from the guest as vRPCs (virtual Remote Procedure Calls) which are executed by the host mediated driver.

Arthur at 23:48, 1 March 2023

2023-03-01T23:48:36Z

← Older revision		Revision as of 23:48, 1 March 2023
Line 1:		Line 1:
	The following document details the internals of a '''VFIO (Virtual Function I/O)''' driven '''Shared''' '''I/O Device.'''		The following document details the internals of a '''VFIO (Virtual Function I/O)''' driven '''Shared''' '''I/O Device.'''<blockquote>An absence of critical technical documentation has historically slowed growth and adoption of developer ecosystems for GPU virtualization.

	~~This article places emphasis on the '''Virtual GPU (vGPU)''' use case however these concepts apply generically to virtualization of I/O devices (TPUs, NICs, storage peripherals, ect..).~~<blockquote>An absence of critical technical documentation has historically slowed growth and adoption of developer ecosystems for GPU virtualization.

	This [https://creativecommons.org/licenses/by/4.0/ CC-BY-4.0] licensed content can either be used with attribution, or used as inspiration for new documentation, created by GPU vendors for public commercial distribution as developer documentation.		This [https://creativecommons.org/licenses/by/4.0/ CC-BY-4.0] licensed content can either be used with attribution, or used as inspiration for new documentation, created by GPU vendors for public commercial distribution as developer documentation.

	Where possible, this documentation will clearly label dates and versions of observed-but-not-guaranteed behaviour vs. vendor-documented stable interfaces/behaviour with guarantees of forward or backward compatibility.</blockquote>		Where possible, this documentation will clearly label dates and versions of observed-but-not-guaranteed behaviour vs. vendor-documented stable interfaces/behaviour with guarantees of forward or backward compatibility.</blockquote>

			This article places emphasis on the '''Virtual GPU (vGPU)''' use case however these concepts apply generically to virtualization of I/O devices (TPUs, NICs, storage peripherals, ect..).
	{\| class="wikitable"		{\| class="wikitable"
	\|+Comparison of Assistance Modes		\|+Comparison of Assistance Modes