Hey flamers,
I haven’t heard of anyone using the 5090 with flame? Is there anyone out there doing this in production or a home machine?
Is it worth upgrading a 5000ADA, and losing another Pcie slot? Is it stable or is it kind of like those titan cards back in the day? I’m guessing prices are going to drop even further in the next few months, so I’m investing this for my home machine.
Thanks guys.
@feganflamer - If the used card costs around $2,400, you could probably get between 5-800 hours of high powered Amazon usage on qualified hardware.
instead of spending it on AWS credits you never wanted, just roast 44,000 marshmallows. It will be much more satisfying and take less time than learning AWS infrastructure.
It it helps - today I was working in Comfy and loaded a model that was quantized with fp8 4mf3fn, which is not supported on the A5000 generation of GPUs (Cuda 36). You need a Ada generation or Blackwell card for that, or use an older quantizing version of the model.
So it may not matter much in Flame, but that is a current issue I ran into.
Blackwell architecture is a bit frustrating, in my experience, let alone getting it to play nicely with Flame.
CUDA plus Nvidia drivers is a thing.
Thanks @randy I’ve been reading your thread. Super interesting stuff. Did the new DKU help at all?
I’ve seen some deals for less than $2k.
@feganflamer - I think Blackwell Support is part of 2026.2, no?
It is, and they deprecated the P6000. GPU caching is not supported in 2026.2 and the card is EOL when 2027 is launched, presumably in April.
progress
I head this week RHEL 10.1, and RHEL 9.7 are releasing a supported Nvidia driver.
No idea. I only run supported gpus for flame. I
Have to draw the line somewhere.
Super helpful. Thanks
DKU 20.2, released with Flame Family 2026.2 Update, adds support for the NVIDIA driver required for the Blackwell GPU generation. We qualified the RTX Pro 6000 and your mileage may vary using a non qualified card.
As far as Rocky Linux, please stick with RL 9.5 for Flame Family workflows.
I’ve been using Rocky Linux and Flame with an Nvidia 5090 for about 6 months. The drivers I installed from DKU or Nvidia’s website always gave me trouble, so I switched to installing them through ELRepo. Since then, I haven’t really had any issues.
Awesome! Thank you for this. What box are you running it on?
I checked out prices for the RTX 5000ada, and they are super reasonable(refurbished). Ever the 42gb RTX 5000 Ada isn’t terrible, but the 72gb one is still around $8k.
So unless there’s an overwhelming reason to buy the blackell, I’m probably going to purchase the 5000ada.
Thanks guys.
72gb for 8k? then better get a 96gb rtx pro 6000 for same price. NVIDIA RTX PRO 6000 Blackwell 96GB GDDR7 Workstation Edition New OEM Packaging | eBay
Dang. I hadn’t seen one for that low.