Works for debian 11 on proxmox 7.3 and also Truenas.

For proxmox:

The driver is already embedded. Just load apropriate modules

modprobe mlx4_ib (or mlx4_en)

modprobe ib_ipoib

then install mstflint

apt-get install mstflint

then

mstflint -d xx:yy.z q

You should see your configuration.

Then enable your link by

ip link set ibsxxxx up

Sometimes after flashing of mcx314 to mcx354 for instance you need to change guids for infiniband

mstflint -d ca:00.0 –guids 0002c9b300067400 0002c9b300067401 0002c9b300067402 0002c9b300067403 sg

then reload pci-e by

echo “1” > /sys/bus/pci/devices/0000\:xx\:yy.z/remove

echo “1” > /sys/bus/pci/rescan

you should in principle see your cards by ip a and in the network manager

Download Nvidia driver for Your card: https://www.nvidia.com/Download/index.aspx

First need to disable nouveau driver:

Create a file in terminal as root or add sudo

nano /etc/modprobe.d/blacklist-nouveau.conf

With the following contents:

blacklist nouveau
options nouveau modeset=0

Or in terminal for script:

bash -c "echo blacklist nouveau > /etc/modprobe.d/blacklist-nvidia-nouveau.conf"

bash -c "echo options nouveau modeset=0 >> /etc/modprobe.d/blacklist-nvidia-nouveau.conf"

Regenerate the kernel initramfs:

update-initramfs -u

Reboot system.

if rebooted in terminal, good. If no, then enter terminal with

ctrl+Alt+F2

Download Nvidia driver for Your card: https://www.nvidia.com/Download/index.aspx

Enter terminal

Ctrl+Alt+F2

then stop X server:

init 3

Then need to make downloaded driver.run file executable:

chmod 777 ~/NVIDIA-Linux-x86_64-470.57.02.run

Then just run ~/NVIDIA-Linux-x86_64-470.57.02.run file and follow on screen questions.

Yes to all.

If success, restart system and enjoy!

P.S. If can.t find nvidia control panel, run nvidia-settings as root in terminal.

./NVIDIA-Linux-x86-310.19.run --uninstall