Proxmox Disk Passthrough Guide#

1. Discovery Commands#

Use these commands to identify physical disks on the Proxmox host.

# Install hardware lister
apt install lshw

# List disks and storage controllers
lshw -class disk -class storage

# List all Physical Disk IDs (The ID needed for passthrough)
ls -l /dev/disk/by-id/

# Advanced list: Maps Device to ID and filters out partitions/LVM
lsblk |awk 'NR==1{print $0" DEVICE-ID(S)"}NR>1{dev=$1;printf $0" ";system("find /dev/disk/by-id -lname \"*"dev"\" -printf \" %p\"");print "";}'|grep -v -E 'part|lvm'

2. Configuration Requirements#

Adding Serials (Crucial for TrueNAS/ZFS)#

In TrueNAS manually edit the VM config file to ensure disk serials persist:

Proxmox GPU Passthrough Guide (NVIDIA Tesla P4)#

1. Proxmox Host Configuration#

Pre-requisites#

• Ensure PCIe Bifurcation is set to OFF in the server BIOS.

Enable IOMMU#

1. Open the GRUB configuration:

nano /etc/default/grub

2. Modify the line GRUB_CMDLINE_LINUX_DEFAULT="quiet" to:

GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on"

3. Update GRUB:

update-grub

4. Reboot the host.

Verify IOMMU Status#

dmesg | grep -e DMAR -e IOMMU

Note: Look for the line: DMAR: IOMMU enabled.

2. VM Configuration (Ubuntu 24.04)#

VM Hardware Settings#

• Machine: q35
• BIOS: SeaBIOS
• Note: Do NOT run apt update or upgrade yet.

Add PCIe Device#

1. Shut down the VM.
2. Go to Hardware > Add > PCI Device.
3. Select Raw Device > Select your GPU.
4. Ensure All Functions and PCI-Express are checked.

3. Driver Installation in VM#

Verify Hardware Detection#

lspci -v

lspci -nnk | grep -iA2 nvidia

Prepare Build Environment#

Required for version 550+ drivers: