Using a PCIe splitter cable, split the PCIe 4.0x16 x1 into PCIe 4.0x8 x2. And all gpu use a PCIe extension cable.

emmmm, I’m not sure, all I can do is just plug them into the motherboard.

Do you have a link to the post please? I’d like to check it out.

There are tests in the original lora paper where the boost is very small once the rank is greater than 8.

​

https://preview.redd.it/ii53qcx8031c1.png?width=1080&format=png&auto=webp&s=821bac1232255bf791120afde7d9e9f3506a89f5

You can merge lora A to the base model, and than to finetune B and C on the merged model.