Main Page

From Open-IOV
Revision as of 21:33, 22 November 2026 by WikiBot (talk | contribs) (2026-11-22 status refresh: virtual-display route, deterministic mode parity and VBO gate green; r1783/r1784; current wall is the partial MME pack; Virtual Display page linked)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

An absence of critical technical documentation has historically slowed growth and adoption of developer ecosystems for GPU virtualization.

This CC-BY-4.0 licensed content can either be used with attribution, or used as inspiration for new documentation, created by GPU vendors for public commercial distribution as developer documentation.

Where possible, this documentation will clearly label dates and versions of observed-but-not-guaranteed behaviour vs. vendor-documented stable interfaces/behaviour with guarantees of forward or backward compatibility.


Open-IOV is an open-source virtualization layer for NVIDIA GPUs: it runs stock, unmodified NVIDIA drivers inside virtual machines — Linux and Windows — with CUDA on hardware you own, without proprietary vGPU licenses, without patching the guest driver, the host driver, the hypervisor or the firmware.

Emulate the interface. Pass through the work. Never patch anyone.

The only new component is one host kernel module (vgsp.ko), which implements the interface the guest driver expects to talk to — the GPU System Processor and its resource-manager firmware — and arranges for the guest's work to run on real GPU hardware.

About Open-IOV · Community · Documentation

Start here

Project status (2026-11-22)

Area State
Emulated vGPU device (PCI, BARs, MSI-X, VFIO mdev) Working
GSP boot emulation and GSP-RM message queues / RPC Working
Stock guest driver probe, nvidia-smi (TU104) Working
CUDA userspace init and the driver-API smoke (ALL OK, 64-byte payload round-trips) Working
Guest CUDA kernel execution on real hardware Working — vector-add, matrix-multiply and transformer kernels run green on fresh boots, and the acceptance battery gate is closed (2026-11-19): two consecutive clean-boot guest-accept --cuda runs and a green live t/03 (VADD bad=0, STATUS OK, EXPECT_CUDA_BATTERY=closed), re-proven in r63 and later rounds. The latest full acceptance run (2026-11-20 19:49Z) is red on the known UVM/GR-wait lottery (victory_mail rc=1, 205 s); the flag stays closed. The path fixed the CE/GR ring and pool pairing, the GR ctx-init semaphores, the init preamble (host-path SW methods and the SET_VALID_SPAN_OVERFLOW_AREA trio were resetting FECS), the program-page re-rooter, the pa=0 fill/relocate class and the launch lottery. The staged-transfer class and per-guest isolation remain in progress
Display and KMS (nvidia-modeset/NvKms, /dev/dri, X) Working — the emulated display engine serves the modeset push buffers and notifier completion; NvKms registers, X settles and glxinfo reports OpenGL 4.6.0 with direct rendering. The vGPU display-control lane (0xA083 head queries, 0xA080 surface set/cleanup) and a guest virtual-display program are implemented; the per-boot nvClip mode parity is deterministic under the restarted-X gate (15,458/15,458 MODE-2 samples) — see Virtual Display
3D graphics: Xorg + OpenGL, Vulkan In progress — the display/KMS and GL stacks run, X and the stock GLX path bring up on a good boot, the DDX 3D replay executes, and the GL pixel gate is closed (2026-11-18): a stock guest glReadPixels reads a non-black engine-rendered frame (GL_FRAME nonblack=291840), enforced by the live acceptance lane and re-confirmed by the r62b two-boot proof (red on the readback pin/copy race in the latest full run). The 2026-11-22 wave recorded the one-pDevice buffer/display deadlock and moved presentation to a guest virtual-display program: the deterministic mode-parity gate holds an even nvClip word, the VBO gate is green (glBufferData err=0, glMapBufferRange non-NULL), r1783's tail trim removes the emitted-window engine data faults, and r1784 removes the 4 GiB context-buffer/OOM class. The current wall is the second direct-GL window's partial MME pack (ir_words=1608/2805, esr=badf1201 pc=513), which poisons the lane before a swap, so no captured frame exists yet; X/GLX bring-up remains a lottery — see Graphics Execution, OpenGL, Vulkan, Virtual Display
Windows guests, multi-tenancy, migration, performance Not yet — multiple mediated devices (different emulated VRAM sizes) and multiple guests already coexist; per-guest execution isolation is in progress

The full story, with evidence and the current wall: Project Status and The Execution Frontier.

Graphics

  • Graphics Execution — how guest 3D work reaches the physical engines
  • OpenGL — the stock guest GL stack on the emulated vGPU
  • Vulkan — the guest Vulkan pipeline on the emulated vGPU
  • DirectX — the Windows/DirectX target
  • Virtual Display — presenting guest-rendered frames without a physical head

Deep dives

Firmware interoperability

Project and ecosystem

Community

About Open-IOV

Open-IOV runs unmodified NVIDIA driver stacks inside virtual machines with GPU compute on hardware you own — no proprietary vGPU license, and no patches to the guest driver, the host driver, the hypervisor or the firmware. The project adds one host kernel module (vgsp.ko) that implements the interface the guest driver expects to talk to — the GPU System Processor and its resource-manager firmware — and arranges for the guest's work to run on real GPU hardware.

  • Mission: make NVIDIA GPUs fully virtualizable, by anyone, for any hypervisor, without modifying NVIDIA software, firmware or hardware.
  • Principles: no patches anywhere; honest status carried with dated evidence; an independent, self-contained IP block; durability by owning the interface rather than a snapshot of it.
  • Licensing: all documentation on this site is CC-BY-4.0; the project's code is BSD-3-Clause (GPL-2.0 for the kernel modules); NVIDIA software and firmware are used unmodified and are not redistributed.

Read more about Open-IOV →

About this wiki

This wiki previously hosted documentation from the earlier project era (2021–2023). Those pages are retained for reference under History; current documentation starts at Documentation.